[2025-10-15T17:00:02.127354] [INFO ] [MAIN ] Using last completed trading day: 2025-10-15 [2025-10-15T17:00:02.328873] [DEBUG] [R-STATUS ] Registered 'tdm' as a dependent service. [2025-10-15T17:00:02.329170] [INFO ] [STATE ] Waiting for all dependent services to be clear... [2025-10-15T17:00:02.638177] [WARN ] [tdm-status] Service 'tdm' is not running. [2025-10-15T17:00:02.638685] [WARN ] [STATE ] State set to: RUNNING [2025-10-15T17:00:02.638767] [INFO ] [MAIN ] Refreshing symbols list before update... [2025-10-15T17:00:02.638818] [INFO ] [MAIN ] Starting TDM symbol refresh process. [2025-10-15T17:00:02.638982] [INFO ] [MAIN ] Fetching latest NYSE symbols list. [2025-10-15T17:00:02.639061] [DEBUG] [SYMBOL ] Starting fetch of NYSE Symbols. [2025-10-15T17:00:04.472977] [DEBUG] [SYMBOL ] Found 2421 valid NYSE symbols. [2025-10-15T17:00:04.473188] [INFO ] [SYMBOL ] Completed fetch of NYSE Symbols. [2025-10-15T17:00:04.473413] [INFO ] [MAIN ] Filtered out 54 blacklisted symbols. [2025-10-15T17:00:04.474053] [INFO ] [LOCAL ] Symbols cache updated with 2369 symbols. [2025-10-15T17:00:04.474111] [INFO ] [MAIN ] Successfully refreshed symbols list. [2025-10-15T17:00:04.474145] [INFO ] [MAIN ] Finished TDM symbol refresh process. [2025-10-15T17:00:04.474206] [INFO ] [MAIN ] Pruning stale symbols... [2025-10-15T17:00:04.474243] [INFO ] [MAIN ] Starting TDM stale symbol pruning process. [2025-10-15T17:00:04.474274] [INFO ] [LOCAL ] Reading cached symbols list. [2025-10-15T17:00:04.474685] [DEBUG] [LOCAL ] Found 2369 symbols in cached list. [2025-10-15T17:00:04.474744] [INFO ] [LOCAL ] Completed reading cached symbols list. [2025-10-15T17:00:04.474933] [INFO ] [MAIN ] Including 54 blacklisted symbols for pruning. [2025-10-15T17:00:04.475001] [INFO ] [MAIN ] Pruning data for symbols not in current list of 2369 valid symbols. [2025-10-15T17:00:04.475043] [INFO ] [LOCAL ] Starting pruning of local symbol history data for inactive/invalid symbols. [2025-10-15T17:00:04.475083] [DEBUG] [LOCAL ] Checking directory: '/opt/tdm/output/data/primary_storage' [2025-10-15T17:00:04.482951] [DEBUG] [LOCAL ] Deleted /opt/tdm/output/data/primary_storage/ARIS.csv (symbol ARIS no longer active). [2025-10-15T17:00:04.501434] [DEBUG] [LOCAL ] Checking directory: '/opt/tdm/output/data/derivative_storage' [2025-10-15T17:00:04.507225] [DEBUG] [LOCAL ] Deleted /opt/tdm/output/data/derivative_storage/ARIS.csv (symbol ARIS no longer active). [2025-10-15T17:00:04.525623] [INFO ] [LOCAL ] Deleted 2 obsolete data files. [2025-10-15T17:00:04.525921] [INFO ] [LOCAL ] Completed pruning of unlisted local symbol history data. [2025-10-15T17:00:04.525965] [INFO ] [MAIN ] Successfully pruned stale symbol data. [2025-10-15T17:00:04.525998] [INFO ] [MAIN ] Finished TDM stale symbol pruning process. [2025-10-15T17:00:04.526062] [INFO ] [LOCAL ] Reading cached symbols list. [2025-10-15T17:00:04.526436] [DEBUG] [LOCAL ] Found 2369 symbols in cached list. [2025-10-15T17:00:04.526473] [INFO ] [LOCAL ] Completed reading cached symbols list. [2025-10-15T17:00:04.526506] [INFO ] [MAIN ] Starting incremental update for 2369 symbols. [2025-10-15T17:00:04.526536] [INFO ] [MAIN ] Running in parallel mode [2025-10-15T17:00:04.526775] [INFO ] [MAIN ] Starting parallel primary update with 4 worker threads for 2369 symbols [2025-10-15T17:00:05.387036] [INFO ] [MAIN ] A: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:00:05.382711] [INFO ] [MAIN ] AAMI: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:00:05.408766] [INFO ] [MAIN ] AAM: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:00:05.432023] [DEBUG] [LOCAL ] AAMI: No existing data file found in primary storage. [2025-10-15T17:00:05.431185] [INFO ] [MAIN ] AA: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:00:05.427046] [DEBUG] [LOCAL ] AAM: No existing data file found in primary storage. [2025-10-15T17:00:05.432461] [WARN ] [MAIN ] AAMI: No existing data found, performing full refresh instead. [2025-10-15T17:00:05.432762] [WARN ] [MAIN ] AAM: No existing data found, performing full refresh instead. [2025-10-15T17:00:05.434065] [INFO ] [MAIN ] AAM: Wiping existing primary data before full refresh. [2025-10-15T17:00:05.434207] [INFO ] [LOCAL ] AAM: Starting deletion of primary data. [2025-10-15T17:00:05.434124] [INFO ] [MAIN ] AAMI: Wiping existing primary data before full refresh. [2025-10-15T17:00:05.434349] [DEBUG] [LOCAL ] AAM: No primary data file found to delete. [2025-10-15T17:00:05.434418] [INFO ] [MAIN ] AAM: Starting full primary refresh. [2025-10-15T17:00:05.434493] [INFO ] [LOCAL ] AAMI: Starting deletion of primary data. [2025-10-15T17:00:05.458277] [DEBUG] [LOCAL ] AAMI: No primary data file found to delete. [2025-10-15T17:00:05.484241] [INFO ] [MAIN ] AAMI: Starting full primary refresh. [2025-10-15T17:00:05.926448] [DEBUG] [LOCAL ] A: Loaded 50803 existing records from primary storage. [2025-10-15T17:00:05.984238] [INFO ] [MAIN ] A: Loaded 50803 existing records. [2025-10-15T17:00:06.024700] [DEBUG] [LOCAL ] AA: Loaded 53621 existing records from primary storage. [2025-10-15T17:00:06.145123] [INFO ] [MAIN ] AA: Loaded 53621 existing records. [2025-10-15T17:00:06.483110] [INFO ] [REMOTE ] AAM: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:00:06.513866] [INFO ] [REMOTE ] AAM: Fetching primary data for 2024-12. [2025-10-15T17:00:06.671516] [INFO ] [REMOTE ] AAMI: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:00:06.665825] [WARN ] [MAIN ] A: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:00:06.677084] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2024-12. [2025-10-15T17:00:06.699426] [INFO ] [MAIN ] A: Wiping existing primary data before full refresh. [2025-10-15T17:00:06.712999] [INFO ] [LOCAL ] A: Starting deletion of primary data. [2025-10-15T17:00:06.755903] [WARN ] [MAIN ] AA: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:00:06.755993] [DEBUG] [LOCAL ] A: Deleted primary data file. [2025-10-15T17:00:06.756306] [INFO ] [MAIN ] A: Starting full primary refresh. [2025-10-15T17:00:06.756445] [INFO ] [MAIN ] AA: Wiping existing primary data before full refresh. [2025-10-15T17:00:06.779049] [INFO ] [LOCAL ] AA: Starting deletion of primary data. [2025-10-15T17:00:06.824219] [DEBUG] [LOCAL ] AA: Deleted primary data file. [2025-10-15T17:00:06.836204] [INFO ] [MAIN ] AA: Starting full primary refresh. [2025-10-15T17:00:06.940437] [DEBUG] [REMOTE ] AAMI: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-15T17:00:06.977808] [WARN ] [REMOTE ] AAMI: No data returned for month 2024-12 [2025-10-15T17:00:07.037381] [FATAL] [REMOTE ] AAMI: API call failed - aborting fetch to avoid wasting further API calls [2025-10-15T17:00:07.068889] [FATAL] [MAIN ] AAMI: Failed to fetch primary data. [2025-10-15T17:00:07.131530] [WARN ] [MAIN ] AAMI: Deleting existing primary and derivative data due to fetch failure. [2025-10-15T17:00:07.206001] [INFO ] [LOCAL ] AAMI: Starting deletion of primary data. [2025-10-15T17:00:07.279636] [DEBUG] [LOCAL ] AAMI: No primary data file found to delete. [2025-10-15T17:00:07.290279] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-10-15T17:00:07.330563] [INFO ] [LOCAL ] AAMI: Starting deletion of derivative data. [2025-10-15T17:00:07.352796] [DEBUG] [LOCAL ] AAMI: No derivative data file found to delete. [2025-10-15T17:00:07.342116] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-01. [2025-10-15T17:00:07.376812] [INFO ] [MAIN ] Update Progress: 1/2369 symbols completed. AAMI took 2.7s. Estimated remaining: 1h 52m 29s. Rate: 21.1 symbols/min [2025-10-15T17:00:07.609830] [INFO ] [REMOTE ] A: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:00:07.703796] [INFO ] [REMOTE ] A: Fetching primary data for 2024-12. [2025-10-15T17:00:07.740545] [INFO ] [REMOTE ] AA: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:00:07.742301] [INFO ] [REMOTE ] AA: Fetching primary data for 2024-12. [2025-10-15T17:00:07.824470] [INFO ] [MAIN ] AAP: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:00:07.829597] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-10-15T17:00:07.831827] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-02. [2025-10-15T17:00:07.910435] [DEBUG] [LOCAL ] AAP: Loaded 51878 existing records from primary storage. [2025-10-15T17:00:07.911246] [INFO ] [MAIN ] AAP: Loaded 51878 existing records. [2025-10-15T17:00:08.114558] [WARN ] [MAIN ] AAP: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:00:08.114886] [INFO ] [MAIN ] AAP: Wiping existing primary data before full refresh. [2025-10-15T17:00:08.114961] [INFO ] [LOCAL ] AAP: Starting deletion of primary data. [2025-10-15T17:00:08.116150] [DEBUG] [LOCAL ] AAP: Deleted primary data file. [2025-10-15T17:00:08.116210] [INFO ] [MAIN ] AAP: Starting full primary refresh. [2025-10-15T17:00:08.177467] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-10-15T17:00:08.194260] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-03. [2025-10-15T17:00:08.500554] [INFO ] [REMOTE ] AAP: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:00:08.501016] [INFO ] [REMOTE ] AAP: Fetching primary data for 2024-12. [2025-10-15T17:00:08.548178] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-03 (0.35 seconds). [2025-10-15T17:00:08.549371] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-04. [2025-10-15T17:00:08.909503] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-04 (0.36 seconds). [2025-10-15T17:00:08.911420] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-05. [2025-10-15T17:00:09.173769] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-05 (0.26 seconds). [2025-10-15T17:00:09.174862] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-06. [2025-10-15T17:00:09.395595] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-06 (0.22 seconds). [2025-10-15T17:00:09.396625] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-07. [2025-10-15T17:00:10.125748] [INFO ] [REMOTE ] A: Incremental fetch complete for 2024-12 (2.42 seconds). [2025-10-15T17:00:10.136664] [INFO ] [REMOTE ] A: Fetching primary data for 2025-01. [2025-10-15T17:00:10.705716] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2024-12 (2.20 seconds). [2025-10-15T17:00:10.717141] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-01. [2025-10-15T17:00:10.859091] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-15T17:00:10.860332] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-08. [2025-10-15T17:00:10.980943] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2024-12 (3.24 seconds). [2025-10-15T17:00:10.992701] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-01. [2025-10-15T17:00:11.136818] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-08 (0.28 seconds). [2025-10-15T17:00:11.138456] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-09. [2025-10-15T17:00:11.538218] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-09 (0.40 seconds). [2025-10-15T17:00:11.539544] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-10. [2025-10-15T17:00:11.544560] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-15T17:00:11.561526] [INFO ] [REMOTE ] A: Fetching primary data for 2025-02. [2025-10-15T17:00:11.905088] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-10 (0.37 seconds). [2025-10-15T17:00:11.906033] [INFO ] [REMOTE ] AAM: Full fetch complete (930 records). [2025-10-15T17:00:11.906149] [DEBUG] [VALIDATOR ] AAM: Validating primary data. [2025-10-15T17:00:11.906737] [FATAL] [VALIDATOR ] AAM: Data is stale - most recent date (2025-10-13) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T17:00:11.906827] [FATAL] [MAIN ] AAM: Fetched primary data is invalid. Refusing to save it. [2025-10-15T17:00:11.906873] [WARN ] [MAIN ] AAM: Deleting existing primary and derivative data due to validation failure. [2025-10-15T17:00:11.906915] [INFO ] [LOCAL ] AAM: Starting deletion of primary data. [2025-10-15T17:00:11.906979] [DEBUG] [LOCAL ] AAM: No primary data file found to delete. [2025-10-15T17:00:11.907019] [INFO ] [LOCAL ] AAM: Starting deletion of derivative data. [2025-10-15T17:00:11.907060] [DEBUG] [LOCAL ] AAM: No derivative data file found to delete. [2025-10-15T17:00:11.907155] [INFO ] [MAIN ] Update Progress: 2/2369 symbols completed. AAM took 7.3s. Estimated remaining: 2h 25m 35s. Rate: 16.3 symbols/min [2025-10-15T17:00:12.099182] [INFO ] [MAIN ] AAT: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:00:12.099484] [DEBUG] [LOCAL ] AAT: No existing data file found in primary storage. [2025-10-15T17:00:12.099562] [WARN ] [MAIN ] AAT: No existing data found, performing full refresh instead. [2025-10-15T17:00:12.099747] [INFO ] [MAIN ] AAT: Wiping existing primary data before full refresh. [2025-10-15T17:00:12.099803] [INFO ] [LOCAL ] AAT: Starting deletion of primary data. [2025-10-15T17:00:12.099847] [DEBUG] [LOCAL ] AAT: No primary data file found to delete. [2025-10-15T17:00:12.099881] [INFO ] [MAIN ] AAT: Starting full primary refresh. [2025-10-15T17:00:12.496713] [INFO ] [REMOTE ] AAT: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:00:12.527974] [INFO ] [REMOTE ] AAT: Fetching primary data for 2024-12. [2025-10-15T17:00:12.531907] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-15T17:00:12.543245] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-02. [2025-10-15T17:00:13.085134] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-15T17:00:13.095522] [INFO ] [REMOTE ] A: Fetching primary data for 2025-03. [2025-10-15T17:00:13.208542] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-01 (2.22 seconds). [2025-10-15T17:00:13.218953] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-02. [2025-10-15T17:00:13.959252] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-15T17:00:13.969904] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-03. [2025-10-15T17:00:14.041174] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-15T17:00:14.047382] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-01. [2025-10-15T17:00:14.493434] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-15T17:00:14.505622] [INFO ] [REMOTE ] A: Fetching primary data for 2025-04. [2025-10-15T17:00:14.863531] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-15T17:00:14.869628] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-02. [2025-10-15T17:00:15.068617] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-10-15T17:00:15.079843] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-03. [2025-10-15T17:00:15.423386] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-15T17:00:15.436238] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-04. [2025-10-15T17:00:16.660405] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-04 (2.15 seconds). [2025-10-15T17:00:16.671467] [INFO ] [REMOTE ] A: Fetching primary data for 2025-05. [2025-10-15T17:00:16.807419] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-15T17:00:16.818572] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-04. [2025-10-15T17:00:17.611494] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-04 (2.18 seconds). [2025-10-15T17:00:17.622511] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-05. [2025-10-15T17:00:18.421229] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-02 (3.55 seconds). [2025-10-15T17:00:18.427373] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-03. [2025-10-15T17:00:18.622544] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-15T17:00:18.635425] [INFO ] [REMOTE ] A: Fetching primary data for 2025-06. [2025-10-15T17:00:18.730505] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-15T17:00:18.742979] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-05. [2025-10-15T17:00:19.670298] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-10-15T17:00:19.682712] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-15T17:00:19.690757] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-04. [2025-10-15T17:00:19.690412] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-06. [2025-10-15T17:00:19.872166] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-15T17:00:19.883159] [INFO ] [REMOTE ] A: Fetching primary data for 2025-07. [2025-10-15T17:00:20.558217] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-15T17:00:20.570639] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-06. [2025-10-15T17:00:21.212186] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-15T17:00:21.220428] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-05. [2025-10-15T17:00:21.452088] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-15T17:00:21.462755] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-07. [2025-10-15T17:00:21.541208] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-15T17:00:21.553680] [INFO ] [REMOTE ] A: Fetching primary data for 2025-08. [2025-10-15T17:00:22.162472] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-15T17:00:22.176065] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-07. [2025-10-15T17:00:22.518120] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-15T17:00:22.525277] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-06. [2025-10-15T17:00:23.427523] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-15T17:00:23.440193] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-15T17:00:23.453120] [INFO ] [REMOTE ] A: Fetching primary data for 2025-09. [2025-10-15T17:00:23.454942] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-08. [2025-10-15T17:00:23.483831] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-15T17:00:23.490292] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-07. [2025-10-15T17:00:23.578422] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-15T17:00:23.590798] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-08. [2025-10-15T17:00:24.471157] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-15T17:00:24.478300] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-08. [2025-10-15T17:00:24.748374] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-15T17:00:24.759237] [INFO ] [REMOTE ] A: Fetching primary data for 2025-10. [2025-10-15T17:00:24.869839] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-15T17:00:24.880975] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-09. [2025-10-15T17:00:25.228891] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-15T17:00:25.241566] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-09. [2025-10-15T17:00:25.409361] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-15T17:00:25.415924] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-09. [2025-10-15T17:00:26.234829] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-15T17:00:26.241141] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-10. [2025-10-15T17:00:26.396604] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-15T17:00:26.407210] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-10. [2025-10-15T17:00:26.604386] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-10 (1.85 seconds). [2025-10-15T17:00:26.610891] [INFO ] [REMOTE ] A: Full fetch complete (73363 records). [2025-10-15T17:00:26.611022] [DEBUG] [VALIDATOR ] A: Validating primary data. [2025-10-15T17:00:26.909577] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-15T17:00:26.968943] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-10. [2025-10-15T17:00:27.077301] [DEBUG] [VALIDATOR ] A: All expected trading days are present. [2025-10-15T17:00:27.077521] [DEBUG] [VALIDATOR ] A: Primary data validation passed. [2025-10-15T17:00:27.078341] [INFO ] [MAIN ] A: Fetched primary data is valid. [2025-10-15T17:00:27.078413] [DEBUG] [LOCAL ] A: Saving primary data. [2025-10-15T17:00:27.080911] [DEBUG] [LOCAL ] A: Trimmed 73363 records to 50779 (keeping 200 days of data) [2025-10-15T17:00:27.411336] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-15T17:00:27.426235] [INFO ] [REMOTE ] AAT: Full fetch complete (42950 records). [2025-10-15T17:00:27.442325] [DEBUG] [LOCAL ] A: Primary data saved (50779 records). [2025-10-15T17:00:27.442537] [DEBUG] [VALIDATOR ] AAT: Validating primary data. [2025-10-15T17:00:27.442870] [INFO ] [MAIN ] A: Full history saved. [2025-10-15T17:00:27.443386] [INFO ] [MAIN ] Update Progress: 3/2369 symbols completed. A took 22.9s. Estimated remaining: 5h 1m 14s. Rate: 7.9 symbols/min [2025-10-15T17:00:27.929920] [INFO ] [MAIN ] AAUC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:00:27.958244] [DEBUG] [LOCAL ] AAUC: No existing data file found in primary storage. [2025-10-15T17:00:27.968928] [WARN ] [MAIN ] AAUC: No existing data found, performing full refresh instead. [2025-10-15T17:00:27.969695] [INFO ] [MAIN ] AAUC: Wiping existing primary data before full refresh. [2025-10-15T17:00:27.975195] [INFO ] [LOCAL ] AAUC: Starting deletion of primary data. [2025-10-15T17:00:27.990814] [DEBUG] [LOCAL ] AAUC: No primary data file found to delete. [2025-10-15T17:00:28.008439] [INFO ] [MAIN ] AAUC: Starting full primary refresh. [2025-10-15T17:00:28.139507] [DEBUG] [VALIDATOR ] AAT: All expected trading days are present. [2025-10-15T17:00:28.161200] [DEBUG] [VALIDATOR ] AAT: Primary data validation passed. [2025-10-15T17:00:28.165385] [INFO ] [MAIN ] AAT: Fetched primary data is valid. [2025-10-15T17:00:28.165515] [DEBUG] [LOCAL ] AAT: Saving primary data. [2025-10-15T17:00:28.246959] [DEBUG] [LOCAL ] AAT: Trimmed 42950 records to 30450 (keeping 200 days of data) [2025-10-15T17:00:28.333204] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-10 (1.93 seconds). [2025-10-15T17:00:28.430204] [INFO ] [REMOTE ] AAP: Full fetch complete (75202 records). [2025-10-15T17:00:28.431929] [DEBUG] [VALIDATOR ] AAP: Validating primary data. [2025-10-15T17:00:28.604282] [INFO ] [REMOTE ] AAUC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:00:28.617988] [INFO ] [REMOTE ] AAUC: Fetching primary data for 2024-12. [2025-10-15T17:00:28.871760] [DEBUG] [REMOTE ] AAUC: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-15T17:00:28.877093] [WARN ] [REMOTE ] AAUC: No data returned for month 2024-12 [2025-10-15T17:00:28.877924] [FATAL] [REMOTE ] AAUC: API call failed - aborting fetch to avoid wasting further API calls [2025-10-15T17:00:28.913432] [FATAL] [MAIN ] AAUC: Failed to fetch primary data. [2025-10-15T17:00:28.951047] [WARN ] [MAIN ] AAUC: Deleting existing primary and derivative data due to fetch failure. [2025-10-15T17:00:28.960925] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-10 (1.99 seconds). [2025-10-15T17:00:28.978236] [INFO ] [LOCAL ] AAUC: Starting deletion of primary data. [2025-10-15T17:00:29.011087] [DEBUG] [VALIDATOR ] AAP: All expected trading days are present. [2025-10-15T17:00:29.012126] [DEBUG] [VALIDATOR ] AAP: Primary data validation passed. [2025-10-15T17:00:29.013754] [INFO ] [MAIN ] AAP: Fetched primary data is valid. [2025-10-15T17:00:29.014686] [DEBUG] [LOCAL ] AAP: Saving primary data. [2025-10-15T17:00:29.013986] [DEBUG] [LOCAL ] AAUC: No primary data file found to delete. [2025-10-15T17:00:29.021780] [INFO ] [LOCAL ] AAUC: Starting deletion of derivative data. [2025-10-15T17:00:29.022258] [INFO ] [REMOTE ] AA: Full fetch complete (77324 records). [2025-10-15T17:00:29.053613] [DEBUG] [LOCAL ] AAUC: No derivative data file found to delete. [2025-10-15T17:00:29.053804] [DEBUG] [VALIDATOR ] AA: Validating primary data. [2025-10-15T17:00:29.072998] [INFO ] [MAIN ] Update Progress: 4/2369 symbols completed. AAUC took 1.6s. Estimated remaining: 4h 1m 53s. Rate: 9.8 symbols/min [2025-10-15T17:00:29.074970] [DEBUG] [LOCAL ] AAP: Trimmed 75202 records to 51846 (keeping 200 days of data) [2025-10-15T17:00:29.074191] [FATAL] [VALIDATOR ] AA: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T17:00:29.082215] [FATAL] [MAIN ] AA: Fetched primary data is invalid. Refusing to save it. [2025-10-15T17:00:29.199011] [WARN ] [MAIN ] AA: Deleting existing primary and derivative data due to validation failure. [2025-10-15T17:00:29.225599] [INFO ] [LOCAL ] AA: Starting deletion of primary data. [2025-10-15T17:00:29.270845] [DEBUG] [LOCAL ] AA: No primary data file found to delete. [2025-10-15T17:00:29.287011] [INFO ] [LOCAL ] AA: Starting deletion of derivative data. [2025-10-15T17:00:29.295933] [DEBUG] [LOCAL ] AA: Deleted derivative data file. [2025-10-15T17:00:29.298363] [INFO ] [MAIN ] Update Progress: 5/2369 symbols completed. AA took 24.7s. Estimated remaining: 3h 15m 12s. Rate: 12.1 symbols/min [2025-10-15T17:00:29.426250] [INFO ] [MAIN ] AB: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:00:29.500918] [DEBUG] [LOCAL ] AAT: Primary data saved (30450 records). [2025-10-15T17:00:29.501134] [INFO ] [MAIN ] AAT: Full history saved. [2025-10-15T17:00:29.505441] [INFO ] [MAIN ] Update Progress: 6/2369 symbols completed. AAT took 17.6s. Estimated remaining: 2h 43m 57s. Rate: 14.4 symbols/min [2025-10-15T17:00:29.782836] [INFO ] [MAIN ] ABBV: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:00:29.784526] [DEBUG] [LOCAL ] AB: Loaded 25669 existing records from primary storage. [2025-10-15T17:00:29.799704] [DEBUG] [LOCAL ] ABBV: No existing data file found in primary storage. [2025-10-15T17:00:29.806471] [WARN ] [MAIN ] ABBV: No existing data found, performing full refresh instead. [2025-10-15T17:00:29.805862] [INFO ] [MAIN ] AB: Loaded 25669 existing records. [2025-10-15T17:00:29.810548] [INFO ] [MAIN ] ABBV: Wiping existing primary data before full refresh. [2025-10-15T17:00:29.835431] [INFO ] [LOCAL ] ABBV: Starting deletion of primary data. [2025-10-15T17:00:29.913013] [DEBUG] [LOCAL ] ABBV: No primary data file found to delete. [2025-10-15T17:00:29.935231] [INFO ] [MAIN ] ABBV: Starting full primary refresh. [2025-10-15T17:00:29.944206] [INFO ] [MAIN ] ABCB: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:00:30.381870] [WARN ] [MAIN ] AB: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:00:30.399445] [DEBUG] [LOCAL ] ABCB: Loaded 30529 existing records from primary storage. [2025-10-15T17:00:30.395213] [INFO ] [MAIN ] AB: Wiping existing primary data before full refresh. [2025-10-15T17:00:30.438567] [INFO ] [LOCAL ] AB: Starting deletion of primary data. [2025-10-15T17:00:30.444294] [INFO ] [MAIN ] ABCB: Loaded 30529 existing records. [2025-10-15T17:00:30.450418] [DEBUG] [LOCAL ] AB: Deleted primary data file. [2025-10-15T17:00:30.461457] [INFO ] [MAIN ] AB: Starting full primary refresh. [2025-10-15T17:00:30.931712] [DEBUG] [LOCAL ] AAP: Primary data saved (51846 records). [2025-10-15T17:00:30.966963] [INFO ] [MAIN ] AAP: Full history saved. [2025-10-15T17:00:30.935886] [INFO ] [REMOTE ] ABBV: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:00:30.968710] [INFO ] [MAIN ] Update Progress: 7/2369 symbols completed. AAP took 23.6s. Estimated remaining: 2h 28m 42s. Rate: 15.9 symbols/min [2025-10-15T17:00:31.053781] [WARN ] [MAIN ] ABCB: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:00:30.990450] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2024-12. [2025-10-15T17:00:31.069470] [INFO ] [MAIN ] ABCB: Wiping existing primary data before full refresh. [2025-10-15T17:00:31.069622] [INFO ] [LOCAL ] ABCB: Starting deletion of primary data. [2025-10-15T17:00:31.212373] [DEBUG] [LOCAL ] ABCB: Deleted primary data file. [2025-10-15T17:00:31.240464] [INFO ] [MAIN ] ABCB: Starting full primary refresh. [2025-10-15T17:00:31.461192] [INFO ] [MAIN ] ABEV: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:00:31.653613] [INFO ] [REMOTE ] AB: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:00:31.683222] [INFO ] [REMOTE ] AB: Fetching primary data for 2024-12. [2025-10-15T17:00:31.911728] [INFO ] [REMOTE ] ABCB: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:00:31.912916] [DEBUG] [LOCAL ] ABEV: Loaded 53279 existing records from primary storage. [2025-10-15T17:00:31.913217] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2024-12. [2025-10-15T17:00:31.914500] [INFO ] [MAIN ] ABEV: Loaded 53279 existing records. [2025-10-15T17:00:32.094602] [WARN ] [MAIN ] ABEV: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:00:32.094894] [INFO ] [MAIN ] ABEV: Wiping existing primary data before full refresh. [2025-10-15T17:00:32.094945] [INFO ] [LOCAL ] ABEV: Starting deletion of primary data. [2025-10-15T17:00:32.095888] [DEBUG] [LOCAL ] ABEV: Deleted primary data file. [2025-10-15T17:00:32.095947] [INFO ] [MAIN ] ABEV: Starting full primary refresh. [2025-10-15T17:00:32.449312] [INFO ] [REMOTE ] ABEV: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:00:32.449742] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2024-12. [2025-10-15T17:00:33.208415] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-15T17:00:33.215938] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-01. [2025-10-15T17:00:33.373795] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2024-12 (2.38 seconds). [2025-10-15T17:00:33.374843] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-15T17:00:33.386606] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-01. [2025-10-15T17:00:33.392888] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-01. [2025-10-15T17:00:34.505025] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-15T17:00:34.513461] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-02. [2025-10-15T17:00:34.570148] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2024-12 (2.12 seconds). [2025-10-15T17:00:34.581174] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-01. [2025-10-15T17:00:34.657909] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-15T17:00:34.666336] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-02. [2025-10-15T17:00:35.390962] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-10-15T17:00:35.402186] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-02. [2025-10-15T17:00:35.812864] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-15T17:00:35.819390] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-03. [2025-10-15T17:00:36.253553] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-15T17:00:36.262902] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-03. [2025-10-15T17:00:36.414883] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-15T17:00:36.425298] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-02. [2025-10-15T17:00:37.067992] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-15T17:00:37.075634] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-04. [2025-10-15T17:00:37.518478] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-02 (2.12 seconds). [2025-10-15T17:00:37.528979] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-03. [2025-10-15T17:00:37.836239] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-15T17:00:37.845940] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-04. [2025-10-15T17:00:38.014138] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-15T17:00:38.024052] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-03. [2025-10-15T17:00:38.516712] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-15T17:00:38.525969] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-05. [2025-10-15T17:00:39.274099] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-15T17:00:39.285535] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-04. [2025-10-15T17:00:39.529771] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-15T17:00:39.538558] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-05. [2025-10-15T17:00:39.645301] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-15T17:00:39.656787] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-04. [2025-10-15T17:00:40.087538] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-15T17:00:40.093836] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-06. [2025-10-15T17:00:40.859065] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-15T17:00:40.865388] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-06. [2025-10-15T17:00:41.106090] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-15T17:00:41.111705] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-07. [2025-10-15T17:00:41.222778] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-15T17:00:41.234281] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-05. [2025-10-15T17:00:41.542585] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-15T17:00:41.553706] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-05. [2025-10-15T17:00:41.930127] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-15T17:00:41.934959] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-07. [2025-10-15T17:00:42.289310] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-15T17:00:42.296526] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-08. [2025-10-15T17:00:43.035044] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-15T17:00:43.048040] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-06. [2025-10-15T17:00:43.064384] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-15T17:00:43.070510] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-08. [2025-10-15T17:00:43.283340] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-10-15T17:00:43.295141] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-06. [2025-10-15T17:00:43.619215] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-15T17:00:43.625983] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-09. [2025-10-15T17:00:44.202371] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-15T17:00:44.207605] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-09. [2025-10-15T17:00:44.807131] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-15T17:00:44.822537] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-15T17:00:44.823540] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-10. [2025-10-15T17:00:44.839526] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-07. [2025-10-15T17:00:44.944288] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-15T17:00:44.962714] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-07. [2025-10-15T17:00:45.037840] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-15T17:00:45.047161] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-10. [2025-10-15T17:00:45.921362] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-15T17:00:45.925433] [INFO ] [REMOTE ] ABCB: Full fetch complete (44709 records). [2025-10-15T17:00:45.925548] [DEBUG] [VALIDATOR ] ABCB: Validating primary data. [2025-10-15T17:00:46.108290] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-15T17:00:46.132889] [INFO ] [REMOTE ] AB: Full fetch complete (44398 records). [2025-10-15T17:00:46.174156] [DEBUG] [VALIDATOR ] AB: Validating primary data. [2025-10-15T17:00:46.217839] [FATAL] [VALIDATOR ] AB: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T17:00:46.241141] [FATAL] [MAIN ] AB: Fetched primary data is invalid. Refusing to save it. [2025-10-15T17:00:46.245706] [WARN ] [MAIN ] AB: Deleting existing primary and derivative data due to validation failure. [2025-10-15T17:00:46.246090] [INFO ] [LOCAL ] AB: Starting deletion of primary data. [2025-10-15T17:00:46.251622] [DEBUG] [LOCAL ] AB: No primary data file found to delete. [2025-10-15T17:00:46.256894] [INFO ] [LOCAL ] AB: Starting deletion of derivative data. [2025-10-15T17:00:46.272394] [DEBUG] [LOCAL ] AB: Deleted derivative data file. [2025-10-15T17:00:46.289749] [INFO ] [MAIN ] Update Progress: 8/2369 symbols completed. AB took 17.2s. Estimated remaining: 3h 25m 25s. Rate: 11.5 symbols/min [2025-10-15T17:00:46.366873] [DEBUG] [VALIDATOR ] ABCB: All expected trading days are present. [2025-10-15T17:00:46.398162] [DEBUG] [VALIDATOR ] ABCB: Primary data validation passed. [2025-10-15T17:00:46.415524] [INFO ] [MAIN ] ABCB: Fetched primary data is valid. [2025-10-15T17:00:46.426150] [DEBUG] [LOCAL ] ABCB: Saving primary data. [2025-10-15T17:00:46.490202] [DEBUG] [LOCAL ] ABCB: Trimmed 44709 records to 30489 (keeping 200 days of data) [2025-10-15T17:00:46.508835] [INFO ] [MAIN ] ABG: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:00:46.509328] [DEBUG] [LOCAL ] ABG: No existing data file found in primary storage. [2025-10-15T17:00:46.509606] [WARN ] [MAIN ] ABG: No existing data found, performing full refresh instead. [2025-10-15T17:00:46.509749] [INFO ] [MAIN ] ABG: Wiping existing primary data before full refresh. [2025-10-15T17:00:46.509792] [INFO ] [LOCAL ] ABG: Starting deletion of primary data. [2025-10-15T17:00:46.509834] [DEBUG] [LOCAL ] ABG: No primary data file found to delete. [2025-10-15T17:00:46.509867] [INFO ] [MAIN ] ABG: Starting full primary refresh. [2025-10-15T17:00:47.076846] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-07 (2.24 seconds). [2025-10-15T17:00:47.119471] [INFO ] [REMOTE ] ABG: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:00:47.132745] [INFO ] [REMOTE ] ABG: Fetching primary data for 2024-12. [2025-10-15T17:00:47.138879] [DEBUG] [LOCAL ] ABCB: Primary data saved (30489 records). [2025-10-15T17:00:47.139231] [INFO ] [MAIN ] ABCB: Full history saved. [2025-10-15T17:00:47.140338] [INFO ] [MAIN ] Update Progress: 9/2369 symbols completed. ABCB took 17.6s. Estimated remaining: 3h 6m 14s. Rate: 12.7 symbols/min [2025-10-15T17:00:47.141753] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-08. [2025-10-15T17:00:47.327626] [INFO ] [MAIN ] ABM: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:00:47.372297] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-07 (2.41 seconds). [2025-10-15T17:00:47.384753] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-08. [2025-10-15T17:00:47.395960] [DEBUG] [LOCAL ] ABM: Loaded 32100 existing records from primary storage. [2025-10-15T17:00:47.396259] [INFO ] [MAIN ] ABM: Loaded 32100 existing records. [2025-10-15T17:00:47.595885] [WARN ] [MAIN ] ABM: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:00:47.596533] [INFO ] [MAIN ] ABM: Wiping existing primary data before full refresh. [2025-10-15T17:00:47.596624] [INFO ] [LOCAL ] ABM: Starting deletion of primary data. [2025-10-15T17:00:47.597299] [DEBUG] [LOCAL ] ABM: Deleted primary data file. [2025-10-15T17:00:47.597362] [INFO ] [MAIN ] ABM: Starting full primary refresh. [2025-10-15T17:00:47.947768] [INFO ] [REMOTE ] ABM: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:00:47.948081] [INFO ] [REMOTE ] ABM: Fetching primary data for 2024-12. [2025-10-15T17:00:48.293925] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-15T17:00:48.297556] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-01. [2025-10-15T17:00:48.727341] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-15T17:00:48.741860] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-09. [2025-10-15T17:00:49.033877] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-15T17:00:49.045715] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-09. [2025-10-15T17:00:49.159231] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-15T17:00:49.165312] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-01. [2025-10-15T17:00:49.393063] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-15T17:00:49.397870] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-02. [2025-10-15T17:00:50.038214] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-15T17:00:50.043965] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-02. [2025-10-15T17:00:50.199278] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-15T17:00:50.203216] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-03. [2025-10-15T17:00:50.311900] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-15T17:00:50.325625] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-10. [2025-10-15T17:00:50.929284] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-15T17:00:50.953338] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-10. [2025-10-15T17:00:50.954287] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-15T17:00:50.960455] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-03. [2025-10-15T17:00:51.291521] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-15T17:00:51.296443] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-04. [2025-10-15T17:00:51.637406] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-15T17:00:51.643268] [INFO ] [REMOTE ] ABBV: Full fetch complete (77454 records). [2025-10-15T17:00:51.643387] [DEBUG] [VALIDATOR ] ABBV: Validating primary data. [2025-10-15T17:00:51.644182] [FATAL] [VALIDATOR ] ABBV: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T17:00:51.644272] [FATAL] [MAIN ] ABBV: Fetched primary data is invalid. Refusing to save it. [2025-10-15T17:00:51.644315] [WARN ] [MAIN ] ABBV: Deleting existing primary and derivative data due to validation failure. [2025-10-15T17:00:51.644379] [INFO ] [LOCAL ] ABBV: Starting deletion of primary data. [2025-10-15T17:00:51.644459] [DEBUG] [LOCAL ] ABBV: No primary data file found to delete. [2025-10-15T17:00:51.644497] [INFO ] [LOCAL ] ABBV: Starting deletion of derivative data. [2025-10-15T17:00:51.644535] [DEBUG] [LOCAL ] ABBV: No derivative data file found to delete. [2025-10-15T17:00:51.644591] [INFO ] [MAIN ] Update Progress: 10/2369 symbols completed. ABBV took 22.3s. Estimated remaining: 3h 5m 15s. Rate: 12.7 symbols/min [2025-10-15T17:00:51.810661] [INFO ] [MAIN ] ABR: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:00:51.861335] [DEBUG] [LOCAL ] ABR: Loaded 51964 existing records from primary storage. [2025-10-15T17:00:51.861679] [INFO ] [MAIN ] ABR: Loaded 51964 existing records. [2025-10-15T17:00:52.040453] [WARN ] [MAIN ] ABR: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:00:52.040805] [INFO ] [MAIN ] ABR: Wiping existing primary data before full refresh. [2025-10-15T17:00:52.040861] [INFO ] [LOCAL ] ABR: Starting deletion of primary data. [2025-10-15T17:00:52.041770] [DEBUG] [LOCAL ] ABR: Deleted primary data file. [2025-10-15T17:00:52.041829] [INFO ] [MAIN ] ABR: Starting full primary refresh. [2025-10-15T17:00:52.375677] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-10 (2.05 seconds). [2025-10-15T17:00:52.424067] [INFO ] [REMOTE ] ABEV: Full fetch complete (77353 records). [2025-10-15T17:00:52.436790] [DEBUG] [VALIDATOR ] ABEV: Validating primary data. [2025-10-15T17:00:52.489882] [INFO ] [REMOTE ] ABR: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:00:52.530806] [INFO ] [REMOTE ] ABR: Fetching primary data for 2024-12. [2025-10-15T17:00:52.702008] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-15T17:00:52.820531] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-04. [2025-10-15T17:00:52.864998] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-15T17:00:52.897225] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-05. [2025-10-15T17:00:52.975988] [DEBUG] [VALIDATOR ] ABEV: All expected trading days are present. [2025-10-15T17:00:52.976154] [DEBUG] [VALIDATOR ] ABEV: Primary data validation passed. [2025-10-15T17:00:52.976955] [INFO ] [MAIN ] ABEV: Fetched primary data is valid. [2025-10-15T17:00:52.977095] [DEBUG] [LOCAL ] ABEV: Saving primary data. [2025-10-15T17:00:52.978819] [DEBUG] [LOCAL ] ABEV: Trimmed 77353 records to 53278 (keeping 200 days of data) [2025-10-15T17:00:53.283461] [DEBUG] [LOCAL ] ABEV: Primary data saved (53278 records). [2025-10-15T17:00:53.283614] [INFO ] [MAIN ] ABEV: Full history saved. [2025-10-15T17:00:53.283731] [INFO ] [MAIN ] Update Progress: 11/2369 symbols completed. ABEV took 22.3s. Estimated remaining: 2h 54m 12s. Rate: 13.5 symbols/min [2025-10-15T17:00:53.449250] [INFO ] [MAIN ] ABT: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:00:53.449417] [DEBUG] [LOCAL ] ABT: No existing data file found in primary storage. [2025-10-15T17:00:53.449454] [WARN ] [MAIN ] ABT: No existing data found, performing full refresh instead. [2025-10-15T17:00:53.449562] [INFO ] [MAIN ] ABT: Wiping existing primary data before full refresh. [2025-10-15T17:00:53.449603] [INFO ] [LOCAL ] ABT: Starting deletion of primary data. [2025-10-15T17:00:53.449669] [DEBUG] [LOCAL ] ABT: No primary data file found to delete. [2025-10-15T17:00:53.449724] [INFO ] [MAIN ] ABT: Starting full primary refresh. [2025-10-15T17:00:53.812418] [INFO ] [REMOTE ] ABT: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:00:53.812976] [INFO ] [REMOTE ] ABT: Fetching primary data for 2024-12. [2025-10-15T17:00:54.023839] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-15T17:00:54.028946] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-06. [2025-10-15T17:00:54.107912] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-15T17:00:54.119837] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-01. [2025-10-15T17:00:54.141209] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-15T17:00:54.149112] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-05. [2025-10-15T17:00:54.969821] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-15T17:00:54.973784] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-07. [2025-10-15T17:00:55.293155] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-15T17:00:55.304063] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-01. [2025-10-15T17:00:55.320682] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-15T17:00:55.326304] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-06. [2025-10-15T17:00:55.823389] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-15T17:00:55.833688] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-02. [2025-10-15T17:00:55.885569] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-15T17:00:55.890441] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-08. [2025-10-15T17:00:56.353194] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-15T17:00:56.360279] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-07. [2025-10-15T17:00:56.816797] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-15T17:00:56.822052] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-09. [2025-10-15T17:00:56.994115] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-15T17:00:57.004460] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-02. [2025-10-15T17:00:57.720215] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-10-15T17:00:57.730453] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-03. [2025-10-15T17:00:57.779817] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-15T17:00:57.783881] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-10. [2025-10-15T17:00:57.822899] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-15T17:00:57.830951] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-08. [2025-10-15T17:00:58.617684] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-15T17:00:58.620042] [INFO ] [REMOTE ] ABG: Full fetch complete (26679 records). [2025-10-15T17:00:58.620120] [DEBUG] [VALIDATOR ] ABG: Validating primary data. [2025-10-15T17:00:58.918179] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-10-15T17:00:58.956034] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-03. [2025-10-15T17:00:59.040050] [DEBUG] [VALIDATOR ] ABG: All expected trading days are present. [2025-10-15T17:00:59.040210] [DEBUG] [VALIDATOR ] ABG: Primary data validation passed. [2025-10-15T17:00:59.040607] [INFO ] [MAIN ] ABG: Fetched primary data is valid. [2025-10-15T17:00:59.040716] [DEBUG] [LOCAL ] ABG: Saving primary data. [2025-10-15T17:00:59.059311] [DEBUG] [LOCAL ] ABG: Trimmed 26679 records to 18383 (keeping 200 days of data) [2025-10-15T17:00:59.060993] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-15T17:00:59.145836] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-09. [2025-10-15T17:00:59.177677] [DEBUG] [LOCAL ] ABG: Primary data saved (18383 records). [2025-10-15T17:00:59.178464] [INFO ] [MAIN ] ABG: Full history saved. [2025-10-15T17:00:59.178604] [INFO ] [MAIN ] Update Progress: 12/2369 symbols completed. ABG took 12.9s. Estimated remaining: 2h 58m 55s. Rate: 13.2 symbols/min [2025-10-15T17:00:59.349505] [INFO ] [MAIN ] ACA: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:00:59.369994] [DEBUG] [LOCAL ] ACA: Loaded 22976 existing records from primary storage. [2025-10-15T17:00:59.370267] [INFO ] [MAIN ] ACA: Loaded 22976 existing records. [2025-10-15T17:00:59.554774] [WARN ] [MAIN ] ACA: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:00:59.555082] [INFO ] [MAIN ] ACA: Wiping existing primary data before full refresh. [2025-10-15T17:00:59.555164] [INFO ] [LOCAL ] ACA: Starting deletion of primary data. [2025-10-15T17:00:59.555799] [DEBUG] [LOCAL ] ACA: Deleted primary data file. [2025-10-15T17:00:59.555959] [INFO ] [MAIN ] ACA: Starting full primary refresh. [2025-10-15T17:00:59.777152] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-10-15T17:00:59.857891] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-04. [2025-10-15T17:00:59.976058] [INFO ] [REMOTE ] ACA: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:00:59.976363] [INFO ] [REMOTE ] ACA: Fetching primary data for 2024-12. [2025-10-15T17:01:00.849172] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-15T17:01:00.857485] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-10. [2025-10-15T17:01:00.888829] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-15T17:01:00.900000] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-04. [2025-10-15T17:01:01.246116] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-15T17:01:01.251200] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-01. [2025-10-15T17:01:02.081952] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-04 (2.22 seconds). [2025-10-15T17:01:02.101192] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-05. [2025-10-15T17:01:02.102774] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-15T17:01:02.106535] [INFO ] [REMOTE ] ABM: Full fetch complete (44672 records). [2025-10-15T17:01:02.106616] [DEBUG] [VALIDATOR ] ABM: Validating primary data. [2025-10-15T17:01:02.107167] [FATAL] [VALIDATOR ] ABM: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T17:01:02.107246] [FATAL] [MAIN ] ABM: Fetched primary data is invalid. Refusing to save it. [2025-10-15T17:01:02.107314] [WARN ] [MAIN ] ABM: Deleting existing primary and derivative data due to validation failure. [2025-10-15T17:01:02.107387] [INFO ] [LOCAL ] ABM: Starting deletion of primary data. [2025-10-15T17:01:02.107446] [DEBUG] [LOCAL ] ABM: No primary data file found to delete. [2025-10-15T17:01:02.107482] [INFO ] [LOCAL ] ABM: Starting deletion of derivative data. [2025-10-15T17:01:02.107690] [DEBUG] [LOCAL ] ABM: Deleted derivative data file. [2025-10-15T17:01:02.109205] [INFO ] [MAIN ] Update Progress: 13/2369 symbols completed. ABM took 15.0s. Estimated remaining: 2h 53m 56s. Rate: 13.5 symbols/min [2025-10-15T17:01:02.292702] [INFO ] [MAIN ] ACCO: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:01:02.292959] [DEBUG] [LOCAL ] ACCO: No existing data file found in primary storage. [2025-10-15T17:01:02.293024] [WARN ] [MAIN ] ACCO: No existing data found, performing full refresh instead. [2025-10-15T17:01:02.293210] [INFO ] [MAIN ] ACCO: Wiping existing primary data before full refresh. [2025-10-15T17:01:02.293252] [INFO ] [LOCAL ] ACCO: Starting deletion of primary data. [2025-10-15T17:01:02.293293] [DEBUG] [LOCAL ] ACCO: No primary data file found to delete. [2025-10-15T17:01:02.293325] [INFO ] [MAIN ] ACCO: Starting full primary refresh. [2025-10-15T17:01:02.588495] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-15T17:01:02.633360] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-02. [2025-10-15T17:01:02.698953] [INFO ] [REMOTE ] ACCO: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:01:02.699531] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2024-12. [2025-10-15T17:01:02.747075] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-15T17:01:02.758558] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-05. [2025-10-15T17:01:03.840069] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-15T17:01:03.845301] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-03. [2025-10-15T17:01:04.021043] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-15T17:01:04.032204] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-06. [2025-10-15T17:01:04.219926] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-15T17:01:04.227141] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-01. [2025-10-15T17:01:04.732003] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-15T17:01:04.743885] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-06. [2025-10-15T17:01:05.210352] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-15T17:01:05.217038] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-04. [2025-10-15T17:01:05.352011] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-15T17:01:05.361038] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-02. [2025-10-15T17:01:05.798962] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-15T17:01:05.809582] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-07. [2025-10-15T17:01:06.371752] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-15T17:01:06.379342] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-03. [2025-10-15T17:01:06.505268] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-15T17:01:06.511404] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-05. [2025-10-15T17:01:06.600275] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-15T17:01:06.612392] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-07. [2025-10-15T17:01:07.795517] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-15T17:01:07.805749] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-04. [2025-10-15T17:01:07.888011] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-10-15T17:01:07.899820] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-08. [2025-10-15T17:01:08.086329] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-15T17:01:08.114018] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-06. [2025-10-15T17:01:08.705357] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-10-15T17:01:08.914011] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-08. [2025-10-15T17:01:09.227719] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-15T17:01:09.305558] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-15T17:01:09.723211] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-07. [2025-10-15T17:01:09.728790] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-15T17:01:10.514028] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-09. [2025-10-15T17:01:10.970039] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-10-15T17:01:11.029473] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-15T17:01:11.314037] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-05. [2025-10-15T17:01:12.113977] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-08. [2025-10-15T17:01:12.211758] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-15T17:01:12.704016] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-15T17:01:12.914065] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-10. [2025-10-15T17:01:13.366671] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-15T17:01:13.714034] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-09. [2025-10-15T17:01:14.514036] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-09. [2025-10-15T17:01:14.535949] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-15T17:01:14.542048] [INFO ] [REMOTE ] ABR: Full fetch complete (75402 records). [2025-10-15T17:01:14.542165] [DEBUG] [VALIDATOR ] ABR: Validating primary data. [2025-10-15T17:01:14.940202] [DEBUG] [VALIDATOR ] ABR: All expected trading days are present. [2025-10-15T17:01:14.940288] [DEBUG] [VALIDATOR ] ABR: Primary data validation passed. [2025-10-15T17:01:14.941014] [INFO ] [MAIN ] ABR: Fetched primary data is valid. [2025-10-15T17:01:14.941105] [DEBUG] [LOCAL ] ABR: Saving primary data. [2025-10-15T17:01:14.942547] [DEBUG] [LOCAL ] ABR: Trimmed 75402 records to 51966 (keeping 200 days of data) [2025-10-15T17:01:15.252283] [DEBUG] [LOCAL ] ABR: Primary data saved (51966 records). [2025-10-15T17:01:15.252507] [INFO ] [MAIN ] ABR: Full history saved. [2025-10-15T17:01:15.252612] [INFO ] [MAIN ] Update Progress: 14/2369 symbols completed. ABR took 23.6s. Estimated remaining: 3h 18m 17s. Rate: 11.9 symbols/min [2025-10-15T17:01:15.317396] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-06. [2025-10-15T17:01:15.431158] [INFO ] [MAIN ] ACEL: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:01:15.431549] [DEBUG] [LOCAL ] ACEL: No existing data file found in primary storage. [2025-10-15T17:01:15.431768] [WARN ] [MAIN ] ACEL: No existing data found, performing full refresh instead. [2025-10-15T17:01:15.431881] [INFO ] [MAIN ] ACEL: Wiping existing primary data before full refresh. [2025-10-15T17:01:15.431924] [INFO ] [LOCAL ] ACEL: Starting deletion of primary data. [2025-10-15T17:01:15.431966] [DEBUG] [LOCAL ] ACEL: No primary data file found to delete. [2025-10-15T17:01:15.431998] [INFO ] [MAIN ] ACEL: Starting full primary refresh. [2025-10-15T17:01:15.721139] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-15T17:01:15.830227] [INFO ] [REMOTE ] ACEL: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:01:15.862064] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-09 (2.15 seconds). [2025-10-15T17:01:16.114017] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-10. [2025-10-15T17:01:16.895357] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-15T17:01:16.913959] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-07. [2025-10-15T17:01:17.074259] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-15T17:01:17.077227] [INFO ] [REMOTE ] ACA: Full fetch complete (34207 records). [2025-10-15T17:01:17.077311] [DEBUG] [VALIDATOR ] ACA: Validating primary data. [2025-10-15T17:01:17.447568] [DEBUG] [VALIDATOR ] ACA: All expected trading days are present. [2025-10-15T17:01:17.447690] [DEBUG] [VALIDATOR ] ACA: Primary data validation passed. [2025-10-15T17:01:17.448141] [INFO ] [MAIN ] ACA: Fetched primary data is valid. [2025-10-15T17:01:17.448186] [DEBUG] [LOCAL ] ACA: Saving primary data. [2025-10-15T17:01:17.449178] [DEBUG] [LOCAL ] ACA: Trimmed 34207 records to 22955 (keeping 200 days of data) [2025-10-15T17:01:17.583622] [DEBUG] [LOCAL ] ACA: Primary data saved (22955 records). [2025-10-15T17:01:17.583778] [INFO ] [MAIN ] ACA: Full history saved. [2025-10-15T17:01:17.583861] [INFO ] [MAIN ] Update Progress: 15/2369 symbols completed. ACA took 18.4s. Estimated remaining: 3h 11m 5s. Rate: 12.3 symbols/min [2025-10-15T17:01:17.721790] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-10. [2025-10-15T17:01:17.753296] [INFO ] [MAIN ] ACHR: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:01:17.753465] [DEBUG] [LOCAL ] ACHR: No existing data file found in primary storage. [2025-10-15T17:01:17.753510] [WARN ] [MAIN ] ACHR: No existing data found, performing full refresh instead. [2025-10-15T17:01:17.753619] [INFO ] [MAIN ] ACHR: Wiping existing primary data before full refresh. [2025-10-15T17:01:17.753698] [INFO ] [LOCAL ] ACHR: Starting deletion of primary data. [2025-10-15T17:01:17.753755] [DEBUG] [LOCAL ] ACHR: No primary data file found to delete. [2025-10-15T17:01:17.753796] [INFO ] [MAIN ] ACHR: Starting full primary refresh. [2025-10-15T17:01:18.144013] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-15T17:01:18.142620] [INFO ] [REMOTE ] ACHR: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:01:18.317633] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-15T17:01:18.324591] [INFO ] [REMOTE ] ABT: Full fetch complete (77762 records). [2025-10-15T17:01:18.324948] [DEBUG] [VALIDATOR ] ABT: Validating primary data. [2025-10-15T17:01:18.527202] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-08. [2025-10-15T17:01:18.759132] [DEBUG] [VALIDATOR ] ABT: All expected trading days are present. [2025-10-15T17:01:18.759220] [DEBUG] [VALIDATOR ] ABT: Primary data validation passed. [2025-10-15T17:01:18.759962] [INFO ] [MAIN ] ABT: Fetched primary data is valid. [2025-10-15T17:01:18.760029] [DEBUG] [LOCAL ] ABT: Saving primary data. [2025-10-15T17:01:18.761591] [DEBUG] [LOCAL ] ABT: Trimmed 77762 records to 53621 (keeping 200 days of data) [2025-10-15T17:01:19.100141] [DEBUG] [LOCAL ] ABT: Primary data saved (53621 records). [2025-10-15T17:01:19.100288] [INFO ] [MAIN ] ABT: Full history saved. [2025-10-15T17:01:19.100366] [INFO ] [MAIN ] Update Progress: 16/2369 symbols completed. ABT took 25.8s. Estimated remaining: 3h 2m 47s. Rate: 12.9 symbols/min [2025-10-15T17:01:19.278198] [INFO ] [MAIN ] ACI: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:01:19.320373] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2024-12. [2025-10-15T17:01:19.342887] [DEBUG] [LOCAL ] ACI: Loaded 53280 existing records from primary storage. [2025-10-15T17:01:19.343249] [INFO ] [MAIN ] ACI: Loaded 53280 existing records. [2025-10-15T17:01:19.532087] [WARN ] [MAIN ] ACI: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:01:19.532307] [INFO ] [MAIN ] ACI: Wiping existing primary data before full refresh. [2025-10-15T17:01:19.532354] [INFO ] [LOCAL ] ACI: Starting deletion of primary data. [2025-10-15T17:01:19.532789] [DEBUG] [LOCAL ] ACI: Deleted primary data file. [2025-10-15T17:01:19.532848] [INFO ] [MAIN ] ACI: Starting full primary refresh. [2025-10-15T17:01:19.908659] [INFO ] [REMOTE ] ACI: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:01:20.061929] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-15T17:01:20.114142] [INFO ] [REMOTE ] ACI: Fetching primary data for 2024-12. [2025-10-15T17:01:20.456135] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-15T17:01:20.914054] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2024-12. [2025-10-15T17:01:21.714039] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-01. [2025-10-15T17:01:22.022970] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-10-15T17:01:22.514036] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-01. [2025-10-15T17:01:22.927284] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-15T17:01:23.314040] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-09. [2025-10-15T17:01:23.736215] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-15T17:01:23.779555] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2024-12 (2.87 seconds). [2025-10-15T17:01:24.114087] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-02. [2025-10-15T17:01:24.656522] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-15T17:01:24.914011] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-01. [2025-10-15T17:01:25.391499] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-15T17:01:25.714048] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-03. [2025-10-15T17:01:26.514047] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-02. [2025-10-15T17:01:27.230803] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-15T17:01:27.313983] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-10. [2025-10-15T17:01:27.455399] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-01 (2.54 seconds). [2025-10-15T17:01:27.556997] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-15T17:01:28.114070] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-04. [2025-10-15T17:01:28.601232] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-15T17:01:28.605810] [INFO ] [REMOTE ] ACCO: Full fetch complete (54086 records). [2025-10-15T17:01:28.605921] [DEBUG] [VALIDATOR ] ACCO: Validating primary data. [2025-10-15T17:01:28.919093] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-02. [2025-10-15T17:01:29.005515] [DEBUG] [VALIDATOR ] ACCO: All expected trading days are present. [2025-10-15T17:01:29.005606] [DEBUG] [VALIDATOR ] ACCO: Primary data validation passed. [2025-10-15T17:01:29.006175] [INFO ] [MAIN ] ACCO: Fetched primary data is valid. [2025-10-15T17:01:29.006238] [DEBUG] [LOCAL ] ACCO: Saving primary data. [2025-10-15T17:01:29.007306] [DEBUG] [LOCAL ] ACCO: Trimmed 54086 records to 37070 (keeping 200 days of data) [2025-10-15T17:01:29.217921] [DEBUG] [LOCAL ] ACCO: Primary data saved (37070 records). [2025-10-15T17:01:29.218071] [INFO ] [MAIN ] ACCO: Full history saved. [2025-10-15T17:01:29.218150] [INFO ] [MAIN ] Update Progress: 17/2369 symbols completed. ACCO took 27.1s. Estimated remaining: 3h 15m 17s. Rate: 12.0 symbols/min [2025-10-15T17:01:29.394293] [INFO ] [MAIN ] ACM: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:01:29.439331] [DEBUG] [LOCAL ] ACM: Loaded 43037 existing records from primary storage. [2025-10-15T17:01:29.439712] [INFO ] [MAIN ] ACM: Loaded 43037 existing records. [2025-10-15T17:01:29.654685] [WARN ] [MAIN ] ACM: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:01:29.654905] [INFO ] [MAIN ] ACM: Wiping existing primary data before full refresh. [2025-10-15T17:01:29.654955] [INFO ] [LOCAL ] ACM: Starting deletion of primary data. [2025-10-15T17:01:29.655437] [DEBUG] [LOCAL ] ACM: Deleted primary data file. [2025-10-15T17:01:29.655496] [INFO ] [MAIN ] ACM: Starting full primary refresh. [2025-10-15T17:01:29.724388] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-03. [2025-10-15T17:01:30.036944] [INFO ] [REMOTE ] ACM: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:01:30.068254] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-15T17:01:30.514001] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-05. [2025-10-15T17:01:31.229738] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-15T17:01:31.313987] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-04. [2025-10-15T17:01:32.093150] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-02 (3.17 seconds). [2025-10-15T17:01:32.119080] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-03. [2025-10-15T17:01:32.146577] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-15T17:01:32.691569] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-15T17:01:32.913999] [INFO ] [REMOTE ] ACM: Fetching primary data for 2024-12. [2025-10-15T17:01:33.714042] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-05. [2025-10-15T17:01:34.337593] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-15T17:01:34.494050] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-03 (2.37 seconds). [2025-10-15T17:01:34.513983] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-04. [2025-10-15T17:01:35.163741] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-15T17:01:35.314019] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-06. [2025-10-15T17:01:36.113990] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-01. [2025-10-15T17:01:36.163736] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-15T17:01:36.830340] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-04 (2.32 seconds). [2025-10-15T17:01:36.914036] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-06. [2025-10-15T17:01:37.714139] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-05. [2025-10-15T17:01:37.793604] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-15T17:01:38.365114] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-15T17:01:38.514021] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-07. [2025-10-15T17:01:39.314026] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-07. [2025-10-15T17:01:39.651226] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-15T17:01:40.113972] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-06. [2025-10-15T17:01:40.402070] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-15T17:01:40.462226] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-15T17:01:40.914059] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-08. [2025-10-15T17:01:41.714017] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-08. [2025-10-15T17:01:42.359282] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-06 (2.25 seconds). [2025-10-15T17:01:42.463639] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-15T17:01:42.513973] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-09. [2025-10-15T17:01:42.791244] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-15T17:01:43.314015] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-07. [2025-10-15T17:01:44.114030] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-02. [2025-10-15T17:01:44.351581] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-15T17:01:44.914013] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-10. [2025-10-15T17:01:45.682940] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-15T17:01:45.713999] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-03. [2025-10-15T17:01:46.197130] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-07 (2.88 seconds). [2025-10-15T17:01:46.513978] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-09. [2025-10-15T17:01:46.790579] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-10 (1.88 seconds). [2025-10-15T17:01:46.797252] [INFO ] [REMOTE ] ACI: Full fetch complete (77221 records). [2025-10-15T17:01:46.797428] [DEBUG] [VALIDATOR ] ACI: Validating primary data. [2025-10-15T17:01:47.256063] [DEBUG] [VALIDATOR ] ACI: All expected trading days are present. [2025-10-15T17:01:47.256678] [DEBUG] [VALIDATOR ] ACI: Primary data validation passed. [2025-10-15T17:01:47.257773] [INFO ] [MAIN ] ACI: Fetched primary data is valid. [2025-10-15T17:01:47.257868] [DEBUG] [LOCAL ] ACI: Saving primary data. [2025-10-15T17:01:47.275374] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-15T17:01:47.274445] [DEBUG] [LOCAL ] ACI: Trimmed 77221 records to 53282 (keeping 200 days of data) [2025-10-15T17:01:47.343216] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-10. [2025-10-15T17:01:47.425780] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-15T17:01:47.649629] [DEBUG] [LOCAL ] ACI: Primary data saved (53282 records). [2025-10-15T17:01:47.649815] [INFO ] [MAIN ] ACI: Full history saved. [2025-10-15T17:01:47.649926] [INFO ] [MAIN ] Update Progress: 18/2369 symbols completed. ACI took 28.5s. Estimated remaining: 3h 44m 29s. Rate: 10.5 symbols/min [2025-10-15T17:01:47.825818] [INFO ] [MAIN ] ACN: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:01:47.826008] [DEBUG] [LOCAL ] ACN: No existing data file found in primary storage. [2025-10-15T17:01:47.826057] [WARN ] [MAIN ] ACN: No existing data found, performing full refresh instead. [2025-10-15T17:01:47.826182] [INFO ] [MAIN ] ACN: Wiping existing primary data before full refresh. [2025-10-15T17:01:47.826223] [INFO ] [LOCAL ] ACN: Starting deletion of primary data. [2025-10-15T17:01:47.826265] [DEBUG] [LOCAL ] ACN: No primary data file found to delete. [2025-10-15T17:01:47.826298] [INFO ] [MAIN ] ACN: Starting full primary refresh. [2025-10-15T17:01:48.119068] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-04. [2025-10-15T17:01:48.180456] [INFO ] [REMOTE ] ACN: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:01:48.246385] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-15T17:01:48.249903] [INFO ] [REMOTE ] ACEL: Full fetch complete (38849 records). [2025-10-15T17:01:48.250008] [DEBUG] [VALIDATOR ] ACEL: Validating primary data. [2025-10-15T17:01:48.631749] [DEBUG] [VALIDATOR ] ACEL: All expected trading days are present. [2025-10-15T17:01:48.631843] [DEBUG] [VALIDATOR ] ACEL: Primary data validation passed. [2025-10-15T17:01:48.632258] [INFO ] [MAIN ] ACEL: Fetched primary data is valid. [2025-10-15T17:01:48.632302] [DEBUG] [LOCAL ] ACEL: Saving primary data. [2025-10-15T17:01:48.633355] [DEBUG] [LOCAL ] ACEL: Trimmed 38849 records to 26736 (keeping 200 days of data) [2025-10-15T17:01:48.787046] [DEBUG] [LOCAL ] ACEL: Primary data saved (26736 records). [2025-10-15T17:01:48.787190] [INFO ] [MAIN ] ACEL: Full history saved. [2025-10-15T17:01:48.787264] [INFO ] [MAIN ] Update Progress: 19/2369 symbols completed. ACEL took 33.5s. Estimated remaining: 3h 34m 55s. Rate: 10.9 symbols/min [2025-10-15T17:01:48.928377] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-08. [2025-10-15T17:01:48.961797] [INFO ] [MAIN ] ACP: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:01:48.992567] [DEBUG] [LOCAL ] ACP: Loaded 30979 existing records from primary storage. [2025-10-15T17:01:48.992938] [INFO ] [MAIN ] ACP: Loaded 30979 existing records. [2025-10-15T17:01:49.178450] [WARN ] [MAIN ] ACP: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:01:49.178735] [INFO ] [MAIN ] ACP: Wiping existing primary data before full refresh. [2025-10-15T17:01:49.178794] [INFO ] [LOCAL ] ACP: Starting deletion of primary data. [2025-10-15T17:01:49.179152] [DEBUG] [LOCAL ] ACP: Deleted primary data file. [2025-10-15T17:01:49.179211] [INFO ] [MAIN ] ACP: Starting full primary refresh. [2025-10-15T17:01:49.546836] [INFO ] [REMOTE ] ACP: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:01:49.623286] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-15T17:01:49.713987] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-05. [2025-10-15T17:01:50.514030] [INFO ] [REMOTE ] ACN: Fetching primary data for 2024-12. [2025-10-15T17:01:51.135784] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-15T17:01:51.314025] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-06. [2025-10-15T17:01:51.676491] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-08 (2.75 seconds). [2025-10-15T17:01:52.114001] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-09. [2025-10-15T17:01:52.648874] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2024-12 (2.13 seconds). [2025-10-15T17:01:52.846003] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-15T17:01:52.914054] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-01. [2025-10-15T17:01:53.714016] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-07. [2025-10-15T17:01:54.513972] [INFO ] [REMOTE ] ACP: Fetching primary data for 2024-12. [2025-10-15T17:01:54.556358] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-09 (2.44 seconds). [2025-10-15T17:01:54.785679] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-15T17:01:54.964974] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-15T17:01:55.314001] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-08. [2025-10-15T17:01:55.906714] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-15T17:01:56.114020] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-10. [2025-10-15T17:01:56.629669] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-15T17:01:56.914034] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-02. [2025-10-15T17:01:57.714063] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-01. [2025-10-15T17:01:58.513985] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-09. [2025-10-15T17:01:58.620307] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-15T17:01:58.706437] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-15T17:01:58.818214] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-10 (2.70 seconds). [2025-10-15T17:01:58.824638] [INFO ] [REMOTE ] ACHR: Full fetch complete (77608 records). [2025-10-15T17:01:58.824854] [DEBUG] [VALIDATOR ] ACHR: Validating primary data. [2025-10-15T17:01:58.825717] [FATAL] [VALIDATOR ] ACHR: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T17:01:58.825821] [FATAL] [MAIN ] ACHR: Fetched primary data is invalid. Refusing to save it. [2025-10-15T17:01:58.825866] [WARN ] [MAIN ] ACHR: Deleting existing primary and derivative data due to validation failure. [2025-10-15T17:01:58.825932] [INFO ] [LOCAL ] ACHR: Starting deletion of primary data. [2025-10-15T17:01:58.825998] [DEBUG] [LOCAL ] ACHR: No primary data file found to delete. [2025-10-15T17:01:58.826035] [INFO ] [LOCAL ] ACHR: Starting deletion of derivative data. [2025-10-15T17:01:58.826076] [DEBUG] [LOCAL ] ACHR: No derivative data file found to delete. [2025-10-15T17:01:58.826157] [INFO ] [MAIN ] Update Progress: 20/2369 symbols completed. ACHR took 41.2s. Estimated remaining: 3h 43m 44s. Rate: 10.5 symbols/min [2025-10-15T17:01:59.033977] [INFO ] [MAIN ] ACR: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:01:59.041263] [DEBUG] [LOCAL ] ACR: Loaded 5471 existing records from primary storage. [2025-10-15T17:01:59.041431] [INFO ] [MAIN ] ACR: Loaded 5471 existing records. [2025-10-15T17:01:59.215482] [WARN ] [MAIN ] ACR: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:01:59.215715] [INFO ] [MAIN ] ACR: Wiping existing primary data before full refresh. [2025-10-15T17:01:59.215772] [INFO ] [LOCAL ] ACR: Starting deletion of primary data. [2025-10-15T17:01:59.215911] [DEBUG] [LOCAL ] ACR: Deleted primary data file. [2025-10-15T17:01:59.215949] [INFO ] [MAIN ] ACR: Starting full primary refresh. [2025-10-15T17:01:59.319091] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-02. [2025-10-15T17:01:59.611049] [INFO ] [REMOTE ] ACR: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:01:59.921749] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-15T17:02:00.114076] [INFO ] [REMOTE ] ACR: Fetching primary data for 2024-12. [2025-10-15T17:02:00.518307] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-15T17:02:00.914034] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-03. [2025-10-15T17:02:01.035205] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-10-15T17:02:01.714053] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-03. [2025-10-15T17:02:02.514028] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-01. [2025-10-15T17:02:02.704075] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-15T17:02:02.974697] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-10-15T17:02:03.028860] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-03 (2.11 seconds). [2025-10-15T17:02:03.314040] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-02. [2025-10-15T17:02:03.970036] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-15T17:02:04.114010] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-04. [2025-10-15T17:02:04.914146] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-10. [2025-10-15T17:02:05.230968] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-15T17:02:05.714003] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-03. [2025-10-15T17:02:06.448289] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-15T17:02:06.453526] [INFO ] [REMOTE ] ACM: Full fetch complete (63074 records). [2025-10-15T17:02:06.453634] [DEBUG] [VALIDATOR ] ACM: Validating primary data. [2025-10-15T17:02:06.518031] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-05. [2025-10-15T17:02:06.564622] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-15T17:02:06.863944] [DEBUG] [VALIDATOR ] ACM: All expected trading days are present. [2025-10-15T17:02:06.864033] [DEBUG] [VALIDATOR ] ACM: Primary data validation passed. [2025-10-15T17:02:06.864722] [INFO ] [MAIN ] ACM: Fetched primary data is valid. [2025-10-15T17:02:06.864790] [DEBUG] [LOCAL ] ACM: Saving primary data. [2025-10-15T17:02:06.866124] [DEBUG] [LOCAL ] ACM: Trimmed 63074 records to 42993 (keeping 200 days of data) [2025-10-15T17:02:07.139996] [DEBUG] [LOCAL ] ACM: Primary data saved (42993 records). [2025-10-15T17:02:07.140125] [INFO ] [MAIN ] ACM: Full history saved. [2025-10-15T17:02:07.141492] [INFO ] [MAIN ] Update Progress: 21/2369 symbols completed. ACM took 37.9s. Estimated remaining: 3h 48m 30s. Rate: 10.3 symbols/min [2025-10-15T17:02:07.318713] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-04. [2025-10-15T17:02:07.318619] [INFO ] [MAIN ] ACRE: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:02:07.318929] [DEBUG] [LOCAL ] ACRE: No existing data file found in primary storage. [2025-10-15T17:02:07.319001] [WARN ] [MAIN ] ACRE: No existing data found, performing full refresh instead. [2025-10-15T17:02:07.319132] [INFO ] [MAIN ] ACRE: Wiping existing primary data before full refresh. [2025-10-15T17:02:07.319196] [INFO ] [LOCAL ] ACRE: Starting deletion of primary data. [2025-10-15T17:02:07.319281] [DEBUG] [LOCAL ] ACRE: No primary data file found to delete. [2025-10-15T17:02:07.320135] [INFO ] [MAIN ] ACRE: Starting full primary refresh. [2025-10-15T17:02:07.675185] [INFO ] [REMOTE ] ACRE: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:02:07.750348] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-15T17:02:08.113999] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-04. [2025-10-15T17:02:08.828209] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-15T17:02:08.914040] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2024-12. [2025-10-15T17:02:09.220766] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-15T17:02:09.714093] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-05. [2025-10-15T17:02:10.445340] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-15T17:02:10.471911] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-15T17:02:10.513982] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-06. [2025-10-15T17:02:11.314046] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-06. [2025-10-15T17:02:11.683764] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-15T17:02:12.114023] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-07. [2025-10-15T17:02:12.144161] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-15T17:02:12.914021] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-07. [2025-10-15T17:02:13.295821] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-15T17:02:13.510582] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-15T17:02:13.714055] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-01. [2025-10-15T17:02:14.514028] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-08. [2025-10-15T17:02:14.911518] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-15T17:02:14.982826] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-10-15T17:02:15.314003] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-02. [2025-10-15T17:02:16.114030] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-08. [2025-10-15T17:02:16.756141] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-15T17:02:16.914014] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-03. [2025-10-15T17:02:17.006407] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-15T17:02:17.714112] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-05. [2025-10-15T17:02:18.358285] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-15T17:02:18.514122] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-09. [2025-10-15T17:02:19.314017] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-04. [2025-10-15T17:02:19.688185] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-15T17:02:19.699741] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-10-15T17:02:20.114009] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-06. [2025-10-15T17:02:20.696520] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-15T17:02:20.914031] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-10. [2025-10-15T17:02:21.631234] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-15T17:02:21.714034] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-09. [2025-10-15T17:02:21.987974] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-15T17:02:21.993351] [INFO ] [REMOTE ] ACP: Full fetch complete (46550 records). [2025-10-15T17:02:21.993526] [DEBUG] [VALIDATOR ] ACP: Validating primary data. [2025-10-15T17:02:22.325435] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-15T17:02:22.417824] [DEBUG] [VALIDATOR ] ACP: All expected trading days are present. [2025-10-15T17:02:22.417913] [DEBUG] [VALIDATOR ] ACP: Primary data validation passed. [2025-10-15T17:02:22.418382] [INFO ] [MAIN ] ACP: Fetched primary data is valid. [2025-10-15T17:02:22.418425] [DEBUG] [LOCAL ] ACP: Saving primary data. [2025-10-15T17:02:22.419863] [DEBUG] [LOCAL ] ACP: Trimmed 46550 records to 30939 (keeping 200 days of data) [2025-10-15T17:02:22.519109] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-05. [2025-10-15T17:02:22.606357] [DEBUG] [LOCAL ] ACP: Primary data saved (30939 records). [2025-10-15T17:02:22.606472] [INFO ] [MAIN ] ACP: Full history saved. [2025-10-15T17:02:22.606550] [INFO ] [MAIN ] Update Progress: 22/2369 symbols completed. ACP took 33.8s. Estimated remaining: 4h 5m 31s. Rate: 9.6 symbols/min [2025-10-15T17:02:22.771113] [INFO ] [MAIN ] ACV: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:02:22.780362] [DEBUG] [LOCAL ] ACV: Loaded 7641 existing records from primary storage. [2025-10-15T17:02:22.780561] [INFO ] [MAIN ] ACV: Loaded 7641 existing records. [2025-10-15T17:02:22.956630] [WARN ] [MAIN ] ACV: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:02:22.956902] [INFO ] [MAIN ] ACV: Wiping existing primary data before full refresh. [2025-10-15T17:02:22.956949] [INFO ] [LOCAL ] ACV: Starting deletion of primary data. [2025-10-15T17:02:22.957099] [DEBUG] [LOCAL ] ACV: Deleted primary data file. [2025-10-15T17:02:22.957137] [INFO ] [MAIN ] ACV: Starting full primary refresh. [2025-10-15T17:02:23.320700] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-10. [2025-10-15T17:02:23.320604] [INFO ] [REMOTE ] ACV: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:02:23.577199] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-15T17:02:23.833615] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-15T17:02:23.834629] [INFO ] [REMOTE ] ACR: Full fetch complete (8534 records). [2025-10-15T17:02:23.834732] [DEBUG] [VALIDATOR ] ACR: Validating primary data. [2025-10-15T17:02:24.119162] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-06. [2025-10-15T17:02:24.194722] [DEBUG] [VALIDATOR ] ACR: All expected trading days are present. [2025-10-15T17:02:24.195168] [DEBUG] [VALIDATOR ] ACR: Primary data validation passed. [2025-10-15T17:02:24.195441] [INFO ] [MAIN ] ACR: Fetched primary data is valid. [2025-10-15T17:02:24.195490] [DEBUG] [LOCAL ] ACR: Saving primary data. [2025-10-15T17:02:24.195969] [DEBUG] [LOCAL ] ACR: Trimmed 8534 records to 5445 (keeping 200 days of data) [2025-10-15T17:02:24.231570] [DEBUG] [LOCAL ] ACR: Primary data saved (5445 records). [2025-10-15T17:02:24.231746] [INFO ] [MAIN ] ACR: Full history saved. [2025-10-15T17:02:24.231856] [INFO ] [MAIN ] Update Progress: 23/2369 symbols completed. ACR took 25.4s. Estimated remaining: 3h 57m 30s. Rate: 9.9 symbols/min [2025-10-15T17:02:24.401565] [INFO ] [MAIN ] ACVA: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:02:24.452122] [DEBUG] [LOCAL ] ACVA: Loaded 49301 existing records from primary storage. [2025-10-15T17:02:24.452449] [INFO ] [MAIN ] ACVA: Loaded 49301 existing records. [2025-10-15T17:02:24.630614] [WARN ] [MAIN ] ACVA: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:02:24.630875] [INFO ] [MAIN ] ACVA: Wiping existing primary data before full refresh. [2025-10-15T17:02:24.630934] [INFO ] [LOCAL ] ACVA: Starting deletion of primary data. [2025-10-15T17:02:24.631442] [DEBUG] [LOCAL ] ACVA: Deleted primary data file. [2025-10-15T17:02:24.631484] [INFO ] [MAIN ] ACVA: Starting full primary refresh. [2025-10-15T17:02:24.919185] [INFO ] [REMOTE ] ACV: Fetching primary data for 2024-12. [2025-10-15T17:02:24.988160] [INFO ] [REMOTE ] ACVA: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:02:25.416286] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-15T17:02:25.503111] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2024-12 (0.58 seconds). [2025-10-15T17:02:25.714023] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2024-12. [2025-10-15T17:02:26.514020] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-07. [2025-10-15T17:02:27.122482] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-15T17:02:27.314013] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-07. [2025-10-15T17:02:28.114103] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-01. [2025-10-15T17:02:28.779247] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-15T17:02:28.824135] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-07 (2.31 seconds). [2025-10-15T17:02:28.914058] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-08. [2025-10-15T17:02:29.396940] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-15T17:02:29.714030] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-02. [2025-10-15T17:02:30.272217] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-15T17:02:30.514001] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-01. [2025-10-15T17:02:31.095779] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-15T17:02:31.275757] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-15T17:02:31.313963] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-02. [2025-10-15T17:02:31.915360] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-15T17:02:32.114008] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-03. [2025-10-15T17:02:32.710894] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-15T17:02:32.914043] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-08. [2025-10-15T17:02:33.714007] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-03. [2025-10-15T17:02:34.514006] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-04. [2025-10-15T17:02:35.094369] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-15T17:02:35.159597] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-08 (2.25 seconds). [2025-10-15T17:02:35.218522] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-15T17:02:35.313994] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-09. [2025-10-15T17:02:36.114062] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-05. [2025-10-15T17:02:36.913983] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-04. [2025-10-15T17:02:36.954908] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-15T17:02:37.139386] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-15T17:02:37.714011] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-10. [2025-10-15T17:02:38.426240] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-15T17:02:38.514003] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-05. [2025-10-15T17:02:39.313998] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-09. [2025-10-15T17:02:39.821145] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-15T17:02:40.042015] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-10 (2.33 seconds). [2025-10-15T17:02:40.048781] [INFO ] [REMOTE ] ACN: Full fetch complete (77352 records). [2025-10-15T17:02:40.048953] [DEBUG] [VALIDATOR ] ACN: Validating primary data. [2025-10-15T17:02:40.119179] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-06. [2025-10-15T17:02:40.452829] [DEBUG] [VALIDATOR ] ACN: All expected trading days are present. [2025-10-15T17:02:40.452991] [DEBUG] [VALIDATOR ] ACN: Primary data validation passed. [2025-10-15T17:02:40.453748] [INFO ] [MAIN ] ACN: Fetched primary data is valid. [2025-10-15T17:02:40.453833] [DEBUG] [LOCAL ] ACN: Saving primary data. [2025-10-15T17:02:40.455370] [DEBUG] [LOCAL ] ACN: Trimmed 77352 records to 53439 (keeping 200 days of data) [2025-10-15T17:02:40.772383] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-15T17:02:40.795253] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-15T17:02:40.822025] [DEBUG] [LOCAL ] ACN: Primary data saved (53439 records). [2025-10-15T17:02:40.822149] [INFO ] [MAIN ] ACN: Full history saved. [2025-10-15T17:02:40.822213] [INFO ] [MAIN ] Update Progress: 24/2369 symbols completed. ACN took 53.2s. Estimated remaining: 4h 14m 31s. Rate: 9.2 symbols/min [2025-10-15T17:02:40.920451] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-06. [2025-10-15T17:02:41.011756] [INFO ] [MAIN ] AD: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:02:41.011915] [DEBUG] [LOCAL ] AD: No existing data file found in primary storage. [2025-10-15T17:02:41.011952] [WARN ] [MAIN ] AD: No existing data found, performing full refresh instead. [2025-10-15T17:02:41.012061] [INFO ] [MAIN ] AD: Wiping existing primary data before full refresh. [2025-10-15T17:02:41.012104] [INFO ] [LOCAL ] AD: Starting deletion of primary data. [2025-10-15T17:02:41.012147] [DEBUG] [LOCAL ] AD: No primary data file found to delete. [2025-10-15T17:02:41.012180] [INFO ] [MAIN ] AD: Starting full primary refresh. [2025-10-15T17:02:41.376104] [INFO ] [REMOTE ] AD: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:02:41.713990] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-10. [2025-10-15T17:02:42.280128] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-15T17:02:42.513981] [INFO ] [REMOTE ] AD: Fetching primary data for 2024-12. [2025-10-15T17:02:42.755255] [DEBUG] [REMOTE ] AD: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-15T17:02:42.755573] [WARN ] [REMOTE ] AD: No data returned for month 2024-12 [2025-10-15T17:02:42.755691] [FATAL] [REMOTE ] AD: API call failed - aborting fetch to avoid wasting further API calls [2025-10-15T17:02:42.755766] [FATAL] [MAIN ] AD: Failed to fetch primary data. [2025-10-15T17:02:42.755837] [WARN ] [MAIN ] AD: Deleting existing primary and derivative data due to fetch failure. [2025-10-15T17:02:42.755910] [INFO ] [LOCAL ] AD: Starting deletion of primary data. [2025-10-15T17:02:42.755976] [DEBUG] [LOCAL ] AD: No primary data file found to delete. [2025-10-15T17:02:42.756015] [INFO ] [LOCAL ] AD: Starting deletion of derivative data. [2025-10-15T17:02:42.756057] [DEBUG] [LOCAL ] AD: No derivative data file found to delete. [2025-10-15T17:02:42.756108] [INFO ] [MAIN ] Update Progress: 25/2369 symbols completed. AD took 1.9s. Estimated remaining: 4h 7m 16s. Rate: 9.5 symbols/min [2025-10-15T17:02:42.948768] [INFO ] [MAIN ] ADC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:02:42.989237] [DEBUG] [LOCAL ] ADC: Loaded 46340 existing records from primary storage. [2025-10-15T17:02:42.989628] [INFO ] [MAIN ] ADC: Loaded 46340 existing records. [2025-10-15T17:02:43.122368] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-15T17:02:43.169729] [INFO ] [REMOTE ] ACRE: Full fetch complete (49965 records). [2025-10-15T17:02:43.186906] [DEBUG] [VALIDATOR ] ACRE: Validating primary data. [2025-10-15T17:02:43.199002] [WARN ] [MAIN ] ADC: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:02:43.199445] [INFO ] [MAIN ] ADC: Wiping existing primary data before full refresh. [2025-10-15T17:02:43.199557] [INFO ] [LOCAL ] ADC: Starting deletion of primary data. [2025-10-15T17:02:43.233536] [DEBUG] [LOCAL ] ADC: Deleted primary data file. [2025-10-15T17:02:43.281067] [INFO ] [MAIN ] ADC: Starting full primary refresh. [2025-10-15T17:02:43.320674] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-07. [2025-10-15T17:02:43.959026] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-10-15T17:02:43.989008] [INFO ] [REMOTE ] ADC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:02:43.989370] [DEBUG] [VALIDATOR ] ACRE: All expected trading days are present. [2025-10-15T17:02:43.991292] [DEBUG] [VALIDATOR ] ACRE: Primary data validation passed. [2025-10-15T17:02:43.992204] [INFO ] [MAIN ] ACRE: Fetched primary data is valid. [2025-10-15T17:02:43.992518] [DEBUG] [LOCAL ] ACRE: Saving primary data. [2025-10-15T17:02:43.994108] [DEBUG] [LOCAL ] ACRE: Trimmed 49965 records to 33640 (keeping 200 days of data) [2025-10-15T17:02:44.138984] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-07. [2025-10-15T17:02:44.186181] [DEBUG] [LOCAL ] ACRE: Primary data saved (33640 records). [2025-10-15T17:02:44.186334] [INFO ] [MAIN ] ACRE: Full history saved. [2025-10-15T17:02:44.186412] [INFO ] [MAIN ] Update Progress: 26/2369 symbols completed. ACRE took 37.0s. Estimated remaining: 3h 59m 48s. Rate: 9.8 symbols/min [2025-10-15T17:02:44.356788] [INFO ] [MAIN ] ADCT: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:02:44.388422] [DEBUG] [LOCAL ] ADCT: Loaded 35199 existing records from primary storage. [2025-10-15T17:02:44.388747] [INFO ] [MAIN ] ADCT: Loaded 35199 existing records. [2025-10-15T17:02:44.563095] [WARN ] [MAIN ] ADCT: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:02:44.563297] [INFO ] [MAIN ] ADCT: Wiping existing primary data before full refresh. [2025-10-15T17:02:44.563343] [INFO ] [LOCAL ] ADCT: Starting deletion of primary data. [2025-10-15T17:02:44.564344] [DEBUG] [LOCAL ] ADCT: Deleted primary data file. [2025-10-15T17:02:44.564404] [INFO ] [MAIN ] ADCT: Starting full primary refresh. [2025-10-15T17:02:44.921796] [INFO ] [REMOTE ] ADCT: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:02:44.918069] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-08. [2025-10-15T17:02:45.481386] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-15T17:02:45.541726] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-15T17:02:45.713996] [INFO ] [REMOTE ] ADC: Fetching primary data for 2024-12. [2025-10-15T17:02:46.514017] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-08. [2025-10-15T17:02:47.191275] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-15T17:02:47.314001] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-01. [2025-10-15T17:02:48.114089] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2024-12. [2025-10-15T17:02:48.114008] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-15T17:02:48.823785] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-15T17:02:48.914019] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-09. [2025-10-15T17:02:49.714010] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-09. [2025-10-15T17:02:49.964283] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-15T17:02:50.453606] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-15T17:02:50.472148] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-15T17:02:50.513958] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-10. [2025-10-15T17:02:51.314041] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-01. [2025-10-15T17:02:51.963211] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-15T17:02:51.970272] [INFO ] [REMOTE ] ACVA: Full fetch complete (70873 records). [2025-10-15T17:02:51.970409] [DEBUG] [VALIDATOR ] ACVA: Validating primary data. [2025-10-15T17:02:52.122372] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-10. [2025-10-15T17:02:52.367084] [DEBUG] [VALIDATOR ] ACVA: All expected trading days are present. [2025-10-15T17:02:52.367238] [DEBUG] [VALIDATOR ] ACVA: Primary data validation passed. [2025-10-15T17:02:52.367978] [INFO ] [MAIN ] ACVA: Fetched primary data is valid. [2025-10-15T17:02:52.368121] [DEBUG] [LOCAL ] ACVA: Saving primary data. [2025-10-15T17:02:52.369564] [DEBUG] [LOCAL ] ACVA: Trimmed 70873 records to 49299 (keeping 200 days of data) [2025-10-15T17:02:52.601920] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-15T17:02:52.695049] [DEBUG] [LOCAL ] ACVA: Primary data saved (49299 records). [2025-10-15T17:02:52.695224] [INFO ] [MAIN ] ACVA: Full history saved. [2025-10-15T17:02:52.696383] [INFO ] [MAIN ] Update Progress: 27/2369 symbols completed. ACVA took 28.5s. Estimated remaining: 4h 3m 7s. Rate: 9.6 symbols/min [2025-10-15T17:02:52.909071] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-15T17:02:52.908846] [INFO ] [MAIN ] ADM: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:02:52.911442] [INFO ] [REMOTE ] ACV: Full fetch complete (10422 records). [2025-10-15T17:02:52.911575] [DEBUG] [VALIDATOR ] ACV: Validating primary data. [2025-10-15T17:02:52.922584] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-02. [2025-10-15T17:02:53.275013] [DEBUG] [LOCAL ] ADM: Loaded 53395 existing records from primary storage. [2025-10-15T17:02:53.287979] [INFO ] [MAIN ] ADM: Loaded 53395 existing records. [2025-10-15T17:02:53.401926] [DEBUG] [VALIDATOR ] ACV: All expected trading days are present. [2025-10-15T17:02:53.409933] [DEBUG] [VALIDATOR ] ACV: Primary data validation passed. [2025-10-15T17:02:53.412325] [INFO ] [MAIN ] ACV: Fetched primary data is valid. [2025-10-15T17:02:53.412398] [DEBUG] [LOCAL ] ACV: Saving primary data. [2025-10-15T17:02:53.428721] [DEBUG] [LOCAL ] ACV: Trimmed 10422 records to 7659 (keeping 200 days of data) [2025-10-15T17:02:53.530531] [WARN ] [MAIN ] ADM: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:02:53.531745] [INFO ] [MAIN ] ADM: Wiping existing primary data before full refresh. [2025-10-15T17:02:53.532831] [INFO ] [LOCAL ] ADM: Starting deletion of primary data. [2025-10-15T17:02:53.534386] [DEBUG] [LOCAL ] ADM: Deleted primary data file. [2025-10-15T17:02:53.534692] [INFO ] [MAIN ] ADM: Starting full primary refresh. [2025-10-15T17:02:53.730781] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-02. [2025-10-15T17:02:53.767220] [DEBUG] [LOCAL ] ACV: Primary data saved (7659 records). [2025-10-15T17:02:53.800715] [INFO ] [MAIN ] ACV: Full history saved. [2025-10-15T17:02:53.800963] [INFO ] [MAIN ] Update Progress: 28/2369 symbols completed. ACV took 31.2s. Estimated remaining: 3h 55m 53s. Rate: 9.9 symbols/min [2025-10-15T17:02:54.109795] [INFO ] [MAIN ] ADNT: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:02:54.146178] [INFO ] [REMOTE ] ADM: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:02:54.181537] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-15T17:02:54.229266] [DEBUG] [LOCAL ] ADNT: Loaded 46912 existing records from primary storage. [2025-10-15T17:02:54.229607] [INFO ] [MAIN ] ADNT: Loaded 46912 existing records. [2025-10-15T17:02:54.410198] [WARN ] [MAIN ] ADNT: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:02:54.410434] [INFO ] [MAIN ] ADNT: Wiping existing primary data before full refresh. [2025-10-15T17:02:54.410483] [INFO ] [LOCAL ] ADNT: Starting deletion of primary data. [2025-10-15T17:02:54.411893] [DEBUG] [LOCAL ] ADNT: Deleted primary data file. [2025-10-15T17:02:54.411958] [INFO ] [MAIN ] ADNT: Starting full primary refresh. [2025-10-15T17:02:54.519108] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-03. [2025-10-15T17:02:54.791864] [INFO ] [REMOTE ] ADNT: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:02:55.301636] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-15T17:02:55.313942] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-03. [2025-10-15T17:02:55.845426] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-15T17:02:56.113995] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2024-12. [2025-10-15T17:02:56.914059] [INFO ] [REMOTE ] ADM: Fetching primary data for 2024-12. [2025-10-15T17:02:57.721510] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-04. [2025-10-15T17:02:57.742895] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-15T17:02:58.513997] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-01. [2025-10-15T17:02:58.760068] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-15T17:02:58.974017] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-03 (3.66 seconds). [2025-10-15T17:02:59.314041] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-04. [2025-10-15T17:02:59.545152] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-15T17:02:59.656380] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-15T17:03:00.114044] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-02. [2025-10-15T17:03:00.913985] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-05. [2025-10-15T17:03:01.714043] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-01. [2025-10-15T17:03:01.764767] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-15T17:03:02.514059] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-03. [2025-10-15T17:03:03.038132] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-04 (3.72 seconds). [2025-10-15T17:03:03.317951] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-05. [2025-10-15T17:03:03.319989] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-05 (2.41 seconds). [2025-10-15T17:03:03.957457] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-01 (2.24 seconds). [2025-10-15T17:03:04.113989] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-02. [2025-10-15T17:03:04.180890] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-15T17:03:04.683037] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-15T17:03:04.914010] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-06. [2025-10-15T17:03:05.714054] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-06. [2025-10-15T17:03:05.864569] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-15T17:03:06.369792] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-15T17:03:06.513997] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-04. [2025-10-15T17:03:07.314017] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-07. [2025-10-15T17:03:07.711393] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-10-15T17:03:08.113989] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-03. [2025-10-15T17:03:08.316009] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-15T17:03:08.577165] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-15T17:03:08.914049] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-07. [2025-10-15T17:03:09.713968] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-08. [2025-10-15T17:03:10.514050] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-05. [2025-10-15T17:03:10.573776] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-15T17:03:11.314055] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-08. [2025-10-15T17:03:11.995523] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-08 (2.28 seconds). [2025-10-15T17:03:12.114024] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-09. [2025-10-15T17:03:12.185662] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-03 (4.07 seconds). [2025-10-15T17:03:12.920510] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-04. [2025-10-15T17:03:12.934049] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-05 (2.42 seconds). [2025-10-15T17:03:13.592635] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-08 (2.28 seconds). [2025-10-15T17:03:13.713961] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-06. [2025-10-15T17:03:13.790196] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-15T17:03:14.513980] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-10. [2025-10-15T17:03:14.768702] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-15T17:03:15.314063] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-05. [2025-10-15T17:03:16.114060] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-09. [2025-10-15T17:03:17.442038] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-06 (3.73 seconds). [2025-10-15T17:03:17.452164] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-07. [2025-10-15T17:03:17.851469] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-10 (3.34 seconds). [2025-10-15T17:03:17.856616] [INFO ] [REMOTE ] ADCT: Full fetch complete (51210 records). [2025-10-15T17:03:17.856811] [DEBUG] [VALIDATOR ] ADCT: Validating primary data. [2025-10-15T17:03:17.857539] [FATAL] [VALIDATOR ] ADCT: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T17:03:17.857632] [FATAL] [MAIN ] ADCT: Fetched primary data is invalid. Refusing to save it. [2025-10-15T17:03:17.857712] [WARN ] [MAIN ] ADCT: Deleting existing primary and derivative data due to validation failure. [2025-10-15T17:03:17.857758] [INFO ] [LOCAL ] ADCT: Starting deletion of primary data. [2025-10-15T17:03:17.857833] [DEBUG] [LOCAL ] ADCT: No primary data file found to delete. [2025-10-15T17:03:17.857888] [INFO ] [LOCAL ] ADCT: Starting deletion of derivative data. [2025-10-15T17:03:17.858054] [DEBUG] [LOCAL ] ADCT: Deleted derivative data file. [2025-10-15T17:03:17.858148] [INFO ] [MAIN ] Update Progress: 29/2369 symbols completed. ADCT took 33.7s. Estimated remaining: 4h 19m 60s. Rate: 9.0 symbols/min [2025-10-15T17:03:18.052217] [INFO ] [MAIN ] ADT: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:03:18.107111] [DEBUG] [LOCAL ] ADT: Loaded 53444 existing records from primary storage. [2025-10-15T17:03:18.107458] [INFO ] [MAIN ] ADT: Loaded 53444 existing records. [2025-10-15T17:03:18.288784] [WARN ] [MAIN ] ADT: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:03:18.289364] [INFO ] [MAIN ] ADT: Wiping existing primary data before full refresh. [2025-10-15T17:03:18.289518] [INFO ] [LOCAL ] ADT: Starting deletion of primary data. [2025-10-15T17:03:18.289847] [DEBUG] [LOCAL ] ADT: Deleted primary data file. [2025-10-15T17:03:18.289903] [INFO ] [MAIN ] ADT: Starting full primary refresh. [2025-10-15T17:03:18.644225] [INFO ] [REMOTE ] ADT: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:03:18.644879] [INFO ] [REMOTE ] ADT: Fetching primary data for 2024-12. [2025-10-15T17:03:18.749001] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-05 (3.43 seconds). [2025-10-15T17:03:18.760618] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-06. [2025-10-15T17:03:18.923627] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-09 (2.81 seconds). [2025-10-15T17:03:19.222285] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-15T17:03:19.314000] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-10. [2025-10-15T17:03:20.114074] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-08. [2025-10-15T17:03:20.553429] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-10-15T17:03:20.619375] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-15T17:03:20.625923] [INFO ] [REMOTE ] ADC: Full fetch complete (66456 records). [2025-10-15T17:03:20.626070] [DEBUG] [VALIDATOR ] ADC: Validating primary data. [2025-10-15T17:03:20.921669] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-01. [2025-10-15T17:03:21.024848] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-06 (2.26 seconds). [2025-10-15T17:03:21.129548] [DEBUG] [VALIDATOR ] ADC: All expected trading days are present. [2025-10-15T17:03:21.129677] [DEBUG] [VALIDATOR ] ADC: Primary data validation passed. [2025-10-15T17:03:21.130401] [INFO ] [MAIN ] ADC: Fetched primary data is valid. [2025-10-15T17:03:21.130470] [DEBUG] [LOCAL ] ADC: Saving primary data. [2025-10-15T17:03:21.132337] [DEBUG] [LOCAL ] ADC: Trimmed 66456 records to 46389 (keeping 200 days of data) [2025-10-15T17:03:21.441982] [DEBUG] [LOCAL ] ADC: Primary data saved (46389 records). [2025-10-15T17:03:21.442108] [INFO ] [MAIN ] ADC: Full history saved. [2025-10-15T17:03:21.442187] [INFO ] [MAIN ] Update Progress: 30/2369 symbols completed. ADC took 38.7s. Estimated remaining: 4h 15m 53s. Rate: 9.1 symbols/min [2025-10-15T17:03:21.614468] [INFO ] [MAIN ] ADX: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:03:21.641994] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-15T17:03:21.673938] [DEBUG] [LOCAL ] ADX: Loaded 27690 existing records from primary storage. [2025-10-15T17:03:21.674199] [INFO ] [MAIN ] ADX: Loaded 27690 existing records. [2025-10-15T17:03:21.719087] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-07. [2025-10-15T17:03:21.851927] [WARN ] [MAIN ] ADX: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:03:21.852126] [INFO ] [MAIN ] ADX: Wiping existing primary data before full refresh. [2025-10-15T17:03:21.852173] [INFO ] [LOCAL ] ADX: Starting deletion of primary data. [2025-10-15T17:03:21.852363] [DEBUG] [LOCAL ] ADX: Deleted primary data file. [2025-10-15T17:03:21.852401] [INFO ] [MAIN ] ADX: Starting full primary refresh. [2025-10-15T17:03:22.222702] [INFO ] [REMOTE ] ADX: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:03:22.306826] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-15T17:03:22.514009] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-02. [2025-10-15T17:03:23.313994] [INFO ] [REMOTE ] ADX: Fetching primary data for 2024-12. [2025-10-15T17:03:24.119704] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-09. [2025-10-15T17:03:24.133763] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-07 (2.41 seconds). [2025-10-15T17:03:24.171113] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-15T17:03:24.476547] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-15T17:03:24.914008] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-01. [2025-10-15T17:03:25.713986] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-03. [2025-10-15T17:03:26.041627] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-15T17:03:26.264479] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-15T17:03:26.514008] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-08. [2025-10-15T17:03:27.314004] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-02. [2025-10-15T17:03:28.114048] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-10. [2025-10-15T17:03:28.254287] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-15T17:03:28.382298] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-03 (2.67 seconds). [2025-10-15T17:03:28.913986] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-09. [2025-10-15T17:03:29.099434] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-15T17:03:29.714007] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-03. [2025-10-15T17:03:30.259606] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-10 (2.15 seconds). [2025-10-15T17:03:30.264814] [INFO ] [REMOTE ] ADNT: Full fetch complete (68013 records). [2025-10-15T17:03:30.264942] [DEBUG] [VALIDATOR ] ADNT: Validating primary data. [2025-10-15T17:03:30.519259] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-04. [2025-10-15T17:03:30.694161] [DEBUG] [VALIDATOR ] ADNT: All expected trading days are present. [2025-10-15T17:03:30.694277] [DEBUG] [VALIDATOR ] ADNT: Primary data validation passed. [2025-10-15T17:03:30.695112] [INFO ] [MAIN ] ADNT: Fetched primary data is valid. [2025-10-15T17:03:30.695186] [DEBUG] [LOCAL ] ADNT: Saving primary data. [2025-10-15T17:03:30.696785] [DEBUG] [LOCAL ] ADNT: Trimmed 68013 records to 46787 (keeping 200 days of data) [2025-10-15T17:03:30.919570] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-15T17:03:31.000971] [DEBUG] [LOCAL ] ADNT: Primary data saved (46787 records). [2025-10-15T17:03:31.001125] [INFO ] [MAIN ] ADNT: Full history saved. [2025-10-15T17:03:31.001229] [INFO ] [MAIN ] Update Progress: 31/2369 symbols completed. ADNT took 37.2s. Estimated remaining: 4h 19m 32s. Rate: 9.0 symbols/min [2025-10-15T17:03:31.192856] [INFO ] [MAIN ] AEE: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:03:31.241987] [DEBUG] [LOCAL ] AEE: Loaded 50168 existing records from primary storage. [2025-10-15T17:03:31.242321] [INFO ] [MAIN ] AEE: Loaded 50168 existing records. [2025-10-15T17:03:31.318334] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-04. [2025-10-15T17:03:31.413234] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-09 (2.50 seconds). [2025-10-15T17:03:31.496823] [WARN ] [MAIN ] AEE: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:03:31.497033] [INFO ] [MAIN ] AEE: Wiping existing primary data before full refresh. [2025-10-15T17:03:31.497081] [INFO ] [LOCAL ] AEE: Starting deletion of primary data. [2025-10-15T17:03:31.497530] [DEBUG] [LOCAL ] AEE: Deleted primary data file. [2025-10-15T17:03:31.497603] [INFO ] [MAIN ] AEE: Starting full primary refresh. [2025-10-15T17:03:31.866989] [INFO ] [REMOTE ] AEE: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:03:32.113963] [INFO ] [REMOTE ] AEE: Fetching primary data for 2024-12. [2025-10-15T17:03:32.577223] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-10-15T17:03:32.913968] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-05. [2025-10-15T17:03:33.578853] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-04 (2.26 seconds). [2025-10-15T17:03:33.714022] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-10. [2025-10-15T17:03:34.345589] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2024-12 (2.23 seconds). [2025-10-15T17:03:34.513993] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-05. [2025-10-15T17:03:34.613142] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-15T17:03:34.619709] [INFO ] [REMOTE ] ADM: Full fetch complete (77436 records). [2025-10-15T17:03:34.619840] [DEBUG] [VALIDATOR ] ADM: Validating primary data. [2025-10-15T17:03:35.067087] [DEBUG] [VALIDATOR ] ADM: All expected trading days are present. [2025-10-15T17:03:35.067333] [DEBUG] [VALIDATOR ] ADM: Primary data validation passed. [2025-10-15T17:03:35.068424] [INFO ] [MAIN ] ADM: Fetched primary data is valid. [2025-10-15T17:03:35.068501] [DEBUG] [LOCAL ] ADM: Saving primary data. [2025-10-15T17:03:35.070782] [DEBUG] [LOCAL ] ADM: Trimmed 77436 records to 53398 (keeping 200 days of data) [2025-10-15T17:03:35.314796] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-01. [2025-10-15T17:03:35.432702] [DEBUG] [LOCAL ] ADM: Primary data saved (53398 records). [2025-10-15T17:03:35.432930] [INFO ] [MAIN ] ADM: Full history saved. [2025-10-15T17:03:35.434601] [INFO ] [MAIN ] Update Progress: 32/2369 symbols completed. ADM took 42.7s. Estimated remaining: 4h 16m 43s. Rate: 9.1 symbols/min [2025-10-15T17:03:35.620110] [INFO ] [MAIN ] AEFC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:03:35.634055] [DEBUG] [LOCAL ] AEFC: Loaded 8406 existing records from primary storage. [2025-10-15T17:03:35.634418] [INFO ] [MAIN ] AEFC: Loaded 8406 existing records. [2025-10-15T17:03:35.785306] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-05 (2.87 seconds). [2025-10-15T17:03:35.889026] [WARN ] [MAIN ] AEFC: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:03:35.891699] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-15T17:03:35.892280] [INFO ] [MAIN ] AEFC: Wiping existing primary data before full refresh. [2025-10-15T17:03:35.898107] [INFO ] [LOCAL ] AEFC: Starting deletion of primary data. [2025-10-15T17:03:35.899363] [DEBUG] [LOCAL ] AEFC: Deleted primary data file. [2025-10-15T17:03:35.899433] [INFO ] [MAIN ] AEFC: Starting full primary refresh. [2025-10-15T17:03:36.119248] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-06. [2025-10-15T17:03:36.286967] [INFO ] [REMOTE ] AEFC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:03:36.914031] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2024-12. [2025-10-15T17:03:37.053962] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-15T17:03:37.563796] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-15T17:03:37.714011] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-07. [2025-10-15T17:03:37.741723] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-10-15T17:03:38.514023] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-01. [2025-10-15T17:03:39.028168] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-15T17:03:39.106169] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-15T17:03:39.313994] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-02. [2025-10-15T17:03:39.834594] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-10-15T17:03:40.113988] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-02. [2025-10-15T17:03:40.914002] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-03. [2025-10-15T17:03:41.554991] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-15T17:03:41.723573] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-08. [2025-10-15T17:03:41.755927] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-15T17:03:42.514070] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-03. [2025-10-15T17:03:42.618935] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-15T17:03:43.314029] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-06. [2025-10-15T17:03:44.114049] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-09. [2025-10-15T17:03:44.286059] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-15T17:03:44.914086] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-04. [2025-10-15T17:03:45.714075] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-04. [2025-10-15T17:03:47.059713] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-09 (2.95 seconds). [2025-10-15T17:03:47.065760] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-10. [2025-10-15T17:03:47.336280] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-06 (4.02 seconds). [2025-10-15T17:03:47.347248] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-07. [2025-10-15T17:03:47.535284] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-04 (2.62 seconds). [2025-10-15T17:03:48.113970] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-05. [2025-10-15T17:03:48.449573] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-15T17:03:48.451219] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-04 (2.74 seconds). [2025-10-15T17:03:48.465029] [INFO ] [REMOTE ] ADX: Full fetch complete (41877 records). [2025-10-15T17:03:48.465485] [DEBUG] [VALIDATOR ] ADX: Validating primary data. [2025-10-15T17:03:48.840526] [DEBUG] [VALIDATOR ] ADX: All expected trading days are present. [2025-10-15T17:03:48.840628] [DEBUG] [VALIDATOR ] ADX: Primary data validation passed. [2025-10-15T17:03:48.841193] [INFO ] [MAIN ] ADX: Fetched primary data is valid. [2025-10-15T17:03:48.841250] [DEBUG] [LOCAL ] ADX: Saving primary data. [2025-10-15T17:03:48.842127] [DEBUG] [LOCAL ] ADX: Trimmed 41877 records to 27657 (keeping 200 days of data) [2025-10-15T17:03:48.928784] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-05. [2025-10-15T17:03:49.013419] [DEBUG] [LOCAL ] ADX: Primary data saved (27657 records). [2025-10-15T17:03:49.013550] [INFO ] [MAIN ] ADX: Full history saved. [2025-10-15T17:03:49.013631] [INFO ] [MAIN ] Update Progress: 33/2369 symbols completed. ADX took 27.6s. Estimated remaining: 4h 24m 51s. Rate: 8.8 symbols/min [2025-10-15T17:03:49.082034] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-15T17:03:49.207583] [INFO ] [MAIN ] AEG: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:03:49.207781] [DEBUG] [LOCAL ] AEG: No existing data file found in primary storage. [2025-10-15T17:03:49.207826] [WARN ] [MAIN ] AEG: No existing data found, performing full refresh instead. [2025-10-15T17:03:49.207935] [INFO ] [MAIN ] AEG: Wiping existing primary data before full refresh. [2025-10-15T17:03:49.207976] [INFO ] [LOCAL ] AEG: Starting deletion of primary data. [2025-10-15T17:03:49.208016] [DEBUG] [LOCAL ] AEG: No primary data file found to delete. [2025-10-15T17:03:49.208047] [INFO ] [MAIN ] AEG: Starting full primary refresh. [2025-10-15T17:03:49.577902] [INFO ] [REMOTE ] AEG: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:03:49.714019] [INFO ] [REMOTE ] AEG: Fetching primary data for 2024-12. [2025-10-15T17:03:50.514076] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-06. [2025-10-15T17:03:50.752112] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-07 (3.40 seconds). [2025-10-15T17:03:51.314089] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-08. [2025-10-15T17:03:52.764310] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-15T17:03:52.776263] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-09. [2025-10-15T17:03:54.476705] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-15T17:03:54.488585] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-10. [2025-10-15T17:03:55.912113] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-06 (5.40 seconds). [2025-10-15T17:03:55.914440] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-07. [2025-10-15T17:03:56.047062] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-15T17:03:56.053943] [INFO ] [REMOTE ] ADT: Full fetch complete (77365 records). [2025-10-15T17:03:56.054130] [DEBUG] [VALIDATOR ] ADT: Validating primary data. [2025-10-15T17:03:56.448070] [DEBUG] [VALIDATOR ] ADT: All expected trading days are present. [2025-10-15T17:03:56.448171] [DEBUG] [VALIDATOR ] ADT: Primary data validation passed. [2025-10-15T17:03:56.449037] [INFO ] [MAIN ] ADT: Fetched primary data is valid. [2025-10-15T17:03:56.449121] [DEBUG] [LOCAL ] ADT: Saving primary data. [2025-10-15T17:03:56.450803] [DEBUG] [LOCAL ] ADT: Trimmed 77365 records to 53443 (keeping 200 days of data) [2025-10-15T17:03:56.772174] [DEBUG] [LOCAL ] ADT: Primary data saved (53443 records). [2025-10-15T17:03:56.772375] [INFO ] [MAIN ] ADT: Full history saved. [2025-10-15T17:03:56.772507] [INFO ] [MAIN ] Update Progress: 34/2369 symbols completed. ADT took 38.9s. Estimated remaining: 4h 25m 50s. Rate: 8.8 symbols/min [2025-10-15T17:03:56.941115] [INFO ] [MAIN ] AEM: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:03:56.994576] [DEBUG] [LOCAL ] AEM: Loaded 53476 existing records from primary storage. [2025-10-15T17:03:56.994905] [INFO ] [MAIN ] AEM: Loaded 53476 existing records. [2025-10-15T17:03:57.166986] [WARN ] [MAIN ] AEM: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:03:57.167206] [INFO ] [MAIN ] AEM: Wiping existing primary data before full refresh. [2025-10-15T17:03:57.167252] [INFO ] [LOCAL ] AEM: Starting deletion of primary data. [2025-10-15T17:03:57.167871] [DEBUG] [LOCAL ] AEM: Deleted primary data file. [2025-10-15T17:03:57.167928] [INFO ] [MAIN ] AEM: Starting full primary refresh. [2025-10-15T17:03:57.554818] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-05 (8.63 seconds). [2025-10-15T17:03:57.559607] [INFO ] [REMOTE ] AEM: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:03:57.570632] [INFO ] [REMOTE ] AEM: Fetching primary data for 2024-12. [2025-10-15T17:03:57.571043] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-06. [2025-10-15T17:03:59.326422] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-15T17:03:59.336975] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-07. [2025-10-15T17:03:59.685880] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2024-12 (2.12 seconds). [2025-10-15T17:03:59.696585] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-01. [2025-10-15T17:04:01.281539] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-15T17:04:01.292234] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-02. [2025-10-15T17:04:03.118189] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-15T17:04:03.128823] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-03. [2025-10-15T17:04:05.845013] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-07 (9.93 seconds). [2025-10-15T17:04:05.847212] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-08. [2025-10-15T17:04:06.692160] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-15T17:04:06.694602] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-09. [2025-10-15T17:04:07.181988] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-10-15T17:04:07.184024] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-10. [2025-10-15T17:04:07.866142] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-15T17:04:07.867309] [INFO ] [REMOTE ] AEFC: Full fetch complete (11851 records). [2025-10-15T17:04:07.867377] [DEBUG] [VALIDATOR ] AEFC: Validating primary data. [2025-10-15T17:04:07.867856] [FATAL] [VALIDATOR ] AEFC: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T17:04:07.867936] [FATAL] [MAIN ] AEFC: Fetched primary data is invalid. Refusing to save it. [2025-10-15T17:04:07.867978] [WARN ] [MAIN ] AEFC: Deleting existing primary and derivative data due to validation failure. [2025-10-15T17:04:07.868039] [INFO ] [LOCAL ] AEFC: Starting deletion of primary data. [2025-10-15T17:04:07.868101] [DEBUG] [LOCAL ] AEFC: No primary data file found to delete. [2025-10-15T17:04:07.868135] [INFO ] [LOCAL ] AEFC: Starting deletion of derivative data. [2025-10-15T17:04:07.868269] [DEBUG] [LOCAL ] AEFC: Deleted derivative data file. [2025-10-15T17:04:07.868362] [INFO ] [MAIN ] Update Progress: 35/2369 symbols completed. AEFC took 32.4s. Estimated remaining: 4h 30m 27s. Rate: 8.6 symbols/min [2025-10-15T17:04:08.032431] [INFO ] [MAIN ] AEO: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:04:08.093024] [DEBUG] [LOCAL ] AEO: Loaded 53566 existing records from primary storage. [2025-10-15T17:04:08.093388] [INFO ] [MAIN ] AEO: Loaded 53566 existing records. [2025-10-15T17:04:08.273012] [WARN ] [MAIN ] AEO: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:04:08.273221] [INFO ] [MAIN ] AEO: Wiping existing primary data before full refresh. [2025-10-15T17:04:08.273270] [INFO ] [LOCAL ] AEO: Starting deletion of primary data. [2025-10-15T17:04:08.273495] [DEBUG] [LOCAL ] AEO: Deleted primary data file. [2025-10-15T17:04:08.273551] [INFO ] [MAIN ] AEO: Starting full primary refresh. [2025-10-15T17:04:08.637860] [INFO ] [REMOTE ] AEO: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:04:08.638348] [INFO ] [REMOTE ] AEO: Fetching primary data for 2024-12. [2025-10-15T17:04:10.541100] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-10-15T17:04:10.551901] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-01. [2025-10-15T17:04:11.914612] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-15T17:04:11.925511] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-02. [2025-10-15T17:04:13.762368] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-15T17:04:13.772765] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-03. [2025-10-15T17:04:18.275165] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2024-12 (28.56 seconds). [2025-10-15T17:04:18.284421] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-01. [2025-10-15T17:04:21.180065] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-01 (2.90 seconds). [2025-10-15T17:04:21.189346] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-02. [2025-10-15T17:04:22.655764] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-15T17:04:22.665341] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-03. [2025-10-15T17:04:23.681211] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-07 (24.34 seconds). [2025-10-15T17:04:23.692598] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-08. [2025-10-15T17:04:24.469268] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-03 (21.34 seconds). [2025-10-15T17:04:24.480991] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-04. [2025-10-15T17:04:25.428473] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-03 (11.66 seconds). [2025-10-15T17:04:25.439958] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-04. [2025-10-15T17:04:26.298535] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-03 (3.63 seconds). [2025-10-15T17:04:26.309054] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-04. [2025-10-15T17:04:26.581797] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-08 (2.89 seconds). [2025-10-15T17:04:26.592463] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-09. [2025-10-15T17:04:26.844844] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-04 (2.36 seconds). [2025-10-15T17:04:26.856262] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-05. [2025-10-15T17:04:27.856992] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-15T17:04:27.868909] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-10. [2025-10-15T17:04:28.125240] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-04 (2.69 seconds). [2025-10-15T17:04:28.137352] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-05. [2025-10-15T17:04:28.972980] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-05 (2.12 seconds). [2025-10-15T17:04:28.985109] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-06. [2025-10-15T17:04:30.359475] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-04 (4.05 seconds). [2025-10-15T17:04:30.371005] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-05. [2025-10-15T17:04:30.533542] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-10 (2.66 seconds). [2025-10-15T17:04:30.539969] [INFO ] [REMOTE ] AEE: Full fetch complete (72947 records). [2025-10-15T17:04:30.540096] [DEBUG] [VALIDATOR ] AEE: Validating primary data. [2025-10-15T17:04:30.959206] [DEBUG] [VALIDATOR ] AEE: All expected trading days are present. [2025-10-15T17:04:30.959323] [DEBUG] [VALIDATOR ] AEE: Primary data validation passed. [2025-10-15T17:04:30.960130] [INFO ] [MAIN ] AEE: Fetched primary data is valid. [2025-10-15T17:04:30.960290] [DEBUG] [LOCAL ] AEE: Saving primary data. [2025-10-15T17:04:30.961754] [DEBUG] [LOCAL ] AEE: Trimmed 72947 records to 50164 (keeping 200 days of data) [2025-10-15T17:04:31.081440] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-06 (2.10 seconds). [2025-10-15T17:04:31.104993] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-07. [2025-10-15T17:04:31.312427] [DEBUG] [LOCAL ] AEE: Primary data saved (50164 records). [2025-10-15T17:04:31.312568] [INFO ] [MAIN ] AEE: Full history saved. [2025-10-15T17:04:31.312671] [INFO ] [MAIN ] Update Progress: 36/2369 symbols completed. AEE took 1m 0s. Estimated remaining: 4h 48m 9s. Rate: 8.1 symbols/min [2025-10-15T17:04:31.486897] [INFO ] [MAIN ] AER: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:04:31.536043] [DEBUG] [LOCAL ] AER: Loaded 48175 existing records from primary storage. [2025-10-15T17:04:31.536331] [INFO ] [MAIN ] AER: Loaded 48175 existing records. [2025-10-15T17:04:31.728982] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-05 (3.59 seconds). [2025-10-15T17:04:31.747843] [WARN ] [MAIN ] AER: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:04:31.758185] [INFO ] [MAIN ] AER: Wiping existing primary data before full refresh. [2025-10-15T17:04:31.758554] [INFO ] [LOCAL ] AER: Starting deletion of primary data. [2025-10-15T17:04:31.758933] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-06. [2025-10-15T17:04:31.758994] [DEBUG] [LOCAL ] AER: Deleted primary data file. [2025-10-15T17:04:31.759780] [INFO ] [MAIN ] AER: Starting full primary refresh. [2025-10-15T17:04:32.131889] [INFO ] [REMOTE ] AER: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:04:32.132312] [INFO ] [REMOTE ] AER: Fetching primary data for 2024-12. [2025-10-15T17:04:33.265625] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-07 (2.16 seconds). [2025-10-15T17:04:33.277830] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-08. [2025-10-15T17:04:33.587091] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-15T17:04:33.598378] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-07. [2025-10-15T17:04:34.166388] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-05 (3.80 seconds). [2025-10-15T17:04:34.178583] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-06. [2025-10-15T17:04:35.451684] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2024-12 (3.32 seconds). [2025-10-15T17:04:35.462670] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-01. [2025-10-15T17:04:35.588241] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-15T17:04:35.599756] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-08. [2025-10-15T17:04:35.658331] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-15T17:04:35.668754] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-07. [2025-10-15T17:04:36.417532] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-08 (3.14 seconds). [2025-10-15T17:04:36.429154] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-09. [2025-10-15T17:04:37.146890] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-15T17:04:37.156522] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-02. [2025-10-15T17:04:37.433252] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-15T17:04:37.443879] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-08. [2025-10-15T17:04:38.765970] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-15T17:04:38.775537] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-03. [2025-10-15T17:04:38.845989] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-15T17:04:38.884915] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-09. [2025-10-15T17:04:38.887374] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-09 (2.46 seconds). [2025-10-15T17:04:38.899603] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-10. [2025-10-15T17:04:39.306449] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-08 (3.71 seconds). [2025-10-15T17:04:39.317869] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-09. [2025-10-15T17:04:40.264747] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-15T17:04:40.275573] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-10. [2025-10-15T17:04:40.896305] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-10-15T17:04:40.907090] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-04. [2025-10-15T17:04:41.066984] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-10 (2.17 seconds). [2025-10-15T17:04:41.074768] [INFO ] [REMOTE ] AEM: Full fetch complete (77423 records). [2025-10-15T17:04:41.074959] [DEBUG] [VALIDATOR ] AEM: Validating primary data. [2025-10-15T17:04:41.474493] [DEBUG] [VALIDATOR ] AEM: All expected trading days are present. [2025-10-15T17:04:41.474710] [DEBUG] [VALIDATOR ] AEM: Primary data validation passed. [2025-10-15T17:04:41.475511] [INFO ] [MAIN ] AEM: Fetched primary data is valid. [2025-10-15T17:04:41.491419] [DEBUG] [LOCAL ] AEM: Saving primary data. [2025-10-15T17:04:41.512710] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-09 (2.19 seconds). [2025-10-15T17:04:41.524387] [DEBUG] [LOCAL ] AEM: Trimmed 77423 records to 53478 (keeping 200 days of data) [2025-10-15T17:04:41.526240] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-10. [2025-10-15T17:04:41.891919] [DEBUG] [LOCAL ] AEM: Primary data saved (53478 records). [2025-10-15T17:04:41.892104] [INFO ] [MAIN ] AEM: Full history saved. [2025-10-15T17:04:41.892201] [INFO ] [MAIN ] Update Progress: 37/2369 symbols completed. AEM took 45.1s. Estimated remaining: 4h 51m 22s. Rate: 8.0 symbols/min [2025-10-15T17:04:42.453983] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-10 (2.18 seconds). [2025-10-15T17:04:42.459860] [INFO ] [REMOTE ] AEG: Full fetch complete (70490 records). [2025-10-15T17:04:42.460039] [DEBUG] [VALIDATOR ] AEG: Validating primary data. [2025-10-15T17:04:42.845214] [DEBUG] [VALIDATOR ] AEG: All expected trading days are present. [2025-10-15T17:04:42.845318] [DEBUG] [VALIDATOR ] AEG: Primary data validation passed. [2025-10-15T17:04:42.846033] [INFO ] [MAIN ] AEG: Fetched primary data is valid. [2025-10-15T17:04:42.846203] [DEBUG] [LOCAL ] AEG: Saving primary data. [2025-10-15T17:04:42.876961] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-15T17:04:42.877111] [DEBUG] [LOCAL ] AEG: Trimmed 70490 records to 49572 (keeping 200 days of data) [2025-10-15T17:04:42.891867] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-05. [2025-10-15T17:04:43.169555] [DEBUG] [LOCAL ] AEG: Primary data saved (49572 records). [2025-10-15T17:04:43.169715] [INFO ] [MAIN ] AEG: Full history saved. [2025-10-15T17:04:43.169796] [INFO ] [MAIN ] Update Progress: 38/2369 symbols completed. AEG took 54.2s. Estimated remaining: 4h 44m 53s. Rate: 8.2 symbols/min [2025-10-15T17:04:43.848805] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-10 (2.32 seconds). [2025-10-15T17:04:43.854684] [INFO ] [REMOTE ] AEO: Full fetch complete (77246 records). [2025-10-15T17:04:43.854794] [DEBUG] [VALIDATOR ] AEO: Validating primary data. [2025-10-15T17:04:43.855558] [FATAL] [VALIDATOR ] AEO: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T17:04:43.855664] [FATAL] [MAIN ] AEO: Fetched primary data is invalid. Refusing to save it. [2025-10-15T17:04:43.855729] [WARN ] [MAIN ] AEO: Deleting existing primary and derivative data due to validation failure. [2025-10-15T17:04:43.855782] [INFO ] [LOCAL ] AEO: Starting deletion of primary data. [2025-10-15T17:04:43.855879] [DEBUG] [LOCAL ] AEO: No primary data file found to delete. [2025-10-15T17:04:43.855968] [INFO ] [LOCAL ] AEO: Starting deletion of derivative data. [2025-10-15T17:04:43.856172] [DEBUG] [LOCAL ] AEO: Deleted derivative data file. [2025-10-15T17:04:43.857059] [INFO ] [MAIN ] Update Progress: 39/2369 symbols completed. AEO took 36.0s. Estimated remaining: 4h 38m 8s. Rate: 8.4 symbols/min [2025-10-15T17:04:45.934496] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-05 (3.04 seconds). [2025-10-15T17:04:45.945843] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-06. [2025-10-15T17:04:47.448806] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-15T17:04:47.458026] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-07. [2025-10-15T17:04:48.874365] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-15T17:04:48.884800] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-08. [2025-10-15T17:04:51.953016] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-08 (3.07 seconds). [2025-10-15T17:04:51.963682] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-09. [2025-10-15T17:04:55.457407] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-09 (3.49 seconds). [2025-10-15T17:04:55.467839] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-10. [2025-10-15T17:04:57.200487] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-15T17:04:57.206212] [INFO ] [REMOTE ] AER: Full fetch complete (69863 records). [2025-10-15T17:04:57.206380] [DEBUG] [VALIDATOR ] AER: Validating primary data. [2025-10-15T17:04:57.628934] [DEBUG] [VALIDATOR ] AER: All expected trading days are present. [2025-10-15T17:04:57.629083] [DEBUG] [VALIDATOR ] AER: Primary data validation passed. [2025-10-15T17:04:57.630015] [INFO ] [MAIN ] AER: Fetched primary data is valid. [2025-10-15T17:04:57.630087] [DEBUG] [LOCAL ] AER: Saving primary data. [2025-10-15T17:04:57.632059] [DEBUG] [LOCAL ] AER: Trimmed 69863 records to 48137 (keeping 200 days of data) [2025-10-15T17:04:57.947160] [DEBUG] [LOCAL ] AER: Primary data saved (48137 records). [2025-10-15T17:04:57.947369] [INFO ] [MAIN ] AER: Full history saved. [2025-10-15T17:04:57.947985] [INFO ] [MAIN ] Update Progress: 40/2369 symbols completed. AER took 26.6s. Estimated remaining: 4h 44m 44s. Rate: 8.2 symbols/min [2025-10-15T17:04:58.674819] [INFO ] [MAIN ] AES: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:04:58.670462] [INFO ] [MAIN ] AEXA: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:04:58.726264] [DEBUG] [LOCAL ] AEXA: No existing data file found in primary storage. [2025-10-15T17:04:58.726050] [INFO ] [MAIN ] AFB: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:04:58.734345] [WARN ] [MAIN ] AEXA: No existing data found, performing full refresh instead. [2025-10-15T17:04:58.755243] [INFO ] [MAIN ] AESI: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:04:58.755718] [INFO ] [MAIN ] AEXA: Wiping existing primary data before full refresh. [2025-10-15T17:04:58.756183] [INFO ] [LOCAL ] AEXA: Starting deletion of primary data. [2025-10-15T17:04:58.756266] [DEBUG] [LOCAL ] AEXA: No primary data file found to delete. [2025-10-15T17:04:58.756310] [INFO ] [MAIN ] AEXA: Starting full primary refresh. [2025-10-15T17:04:58.885465] [DEBUG] [LOCAL ] AFB: Loaded 11214 existing records from primary storage. [2025-10-15T17:04:58.896388] [INFO ] [MAIN ] AFB: Loaded 11214 existing records. [2025-10-15T17:04:59.231511] [DEBUG] [LOCAL ] AES: Loaded 53669 existing records from primary storage. [2025-10-15T17:04:59.312902] [INFO ] [MAIN ] AES: Loaded 53669 existing records. [2025-10-15T17:04:59.296270] [DEBUG] [LOCAL ] AESI: Loaded 49736 existing records from primary storage. [2025-10-15T17:04:59.366144] [INFO ] [MAIN ] AESI: Loaded 49736 existing records. [2025-10-15T17:04:59.382511] [WARN ] [MAIN ] AFB: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:04:59.450473] [INFO ] [MAIN ] AFB: Wiping existing primary data before full refresh. [2025-10-15T17:04:59.512318] [INFO ] [LOCAL ] AFB: Starting deletion of primary data. [2025-10-15T17:04:59.586335] [DEBUG] [LOCAL ] AFB: Deleted primary data file. [2025-10-15T17:04:59.615241] [INFO ] [MAIN ] AFB: Starting full primary refresh. [2025-10-15T17:04:59.693067] [INFO ] [REMOTE ] AEXA: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:04:59.717370] [INFO ] [REMOTE ] AEXA: Fetching primary data for 2024-12. [2025-10-15T17:04:59.922368] [WARN ] [MAIN ] AES: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:04:59.977941] [WARN ] [MAIN ] AESI: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:04:59.999999] [INFO ] [MAIN ] AES: Wiping existing primary data before full refresh. [2025-10-15T17:05:00.006027] [INFO ] [LOCAL ] AES: Starting deletion of primary data. [2025-10-15T17:05:00.000261] [INFO ] [MAIN ] AESI: Wiping existing primary data before full refresh. [2025-10-15T17:05:00.011387] [INFO ] [LOCAL ] AESI: Starting deletion of primary data. [2025-10-15T17:05:00.027200] [DEBUG] [LOCAL ] AESI: Deleted primary data file. [2025-10-15T17:05:00.027418] [INFO ] [MAIN ] AESI: Starting full primary refresh. [2025-10-15T17:05:00.021879] [DEBUG] [LOCAL ] AES: Deleted primary data file. [2025-10-15T17:05:00.065311] [INFO ] [MAIN ] AES: Starting full primary refresh. [2025-10-15T17:05:00.185226] [DEBUG] [REMOTE ] AEXA: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-15T17:05:00.287760] [WARN ] [REMOTE ] AEXA: No data returned for month 2024-12 [2025-10-15T17:05:00.379709] [FATAL] [REMOTE ] AEXA: API call failed - aborting fetch to avoid wasting further API calls [2025-10-15T17:05:00.401571] [FATAL] [MAIN ] AEXA: Failed to fetch primary data. [2025-10-15T17:05:00.490380] [WARN ] [MAIN ] AEXA: Deleting existing primary and derivative data due to fetch failure. [2025-10-15T17:05:00.500913] [INFO ] [LOCAL ] AEXA: Starting deletion of primary data. [2025-10-15T17:05:00.501070] [DEBUG] [LOCAL ] AEXA: No primary data file found to delete. [2025-10-15T17:05:00.528679] [INFO ] [LOCAL ] AEXA: Starting deletion of derivative data. [2025-10-15T17:05:00.561771] [INFO ] [REMOTE ] AFB: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:05:00.614439] [DEBUG] [LOCAL ] AEXA: No derivative data file found to delete. [2025-10-15T17:05:00.636449] [INFO ] [MAIN ] Update Progress: 41/2369 symbols completed. AEXA took 2.7s. Estimated remaining: 4h 40m 13s. Rate: 8.3 symbols/min [2025-10-15T17:05:00.634041] [INFO ] [REMOTE ] AFB: Fetching primary data for 2024-12. [2025-10-15T17:05:01.159114] [INFO ] [REMOTE ] AESI: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:05:01.170141] [INFO ] [REMOTE ] AESI: Fetching primary data for 2024-12. [2025-10-15T17:05:01.284293] [INFO ] [REMOTE ] AES: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:05:01.287159] [INFO ] [MAIN ] AFG: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:05:01.287848] [INFO ] [REMOTE ] AES: Fetching primary data for 2024-12. [2025-10-15T17:05:01.368741] [DEBUG] [LOCAL ] AFG: Loaded 32274 existing records from primary storage. [2025-10-15T17:05:01.369073] [INFO ] [MAIN ] AFG: Loaded 32274 existing records. [2025-10-15T17:05:01.580410] [WARN ] [MAIN ] AFG: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:05:01.580697] [INFO ] [MAIN ] AFG: Wiping existing primary data before full refresh. [2025-10-15T17:05:01.580757] [INFO ] [LOCAL ] AFG: Starting deletion of primary data. [2025-10-15T17:05:01.581082] [DEBUG] [LOCAL ] AFG: Deleted primary data file. [2025-10-15T17:05:01.581140] [INFO ] [MAIN ] AFG: Starting full primary refresh. [2025-10-15T17:05:01.956890] [INFO ] [REMOTE ] AFG: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:05:01.957320] [INFO ] [REMOTE ] AFG: Fetching primary data for 2024-12. [2025-10-15T17:05:02.112475] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-15T17:05:02.115452] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-01. [2025-10-15T17:05:03.332032] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-10-15T17:05:03.343442] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-01. [2025-10-15T17:05:03.381340] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-15T17:05:03.386898] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-01. [2025-10-15T17:05:04.533831] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-15T17:05:04.539227] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-02. [2025-10-15T17:05:04.876516] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2024-12 (3.71 seconds). [2025-10-15T17:05:04.885575] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-01. [2025-10-15T17:05:05.139775] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-01 (3.02 seconds). [2025-10-15T17:05:05.143036] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-02. [2025-10-15T17:05:06.009947] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-15T17:05:06.017864] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-03. [2025-10-15T17:05:06.110016] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-15T17:05:06.119232] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-02. [2025-10-15T17:05:06.160211] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-01 (2.82 seconds). [2025-10-15T17:05:06.171488] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-02. [2025-10-15T17:05:06.296870] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-15T17:05:06.299693] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-03. [2025-10-15T17:05:07.618674] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-15T17:05:07.626824] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-04. [2025-10-15T17:05:07.653910] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-15T17:05:07.663837] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-03. [2025-10-15T17:05:07.941753] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-15T17:05:07.953379] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-03. [2025-10-15T17:05:08.070792] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-15T17:05:08.074098] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-04. [2025-10-15T17:05:08.695412] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-15T17:05:08.702400] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-05. [2025-10-15T17:05:09.012257] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-15T17:05:09.015894] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-05. [2025-10-15T17:05:09.272116] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-15T17:05:09.286051] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-04. [2025-10-15T17:05:09.622225] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-15T17:05:09.625329] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-06. [2025-10-15T17:05:10.173370] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-15T17:05:10.183427] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-06. [2025-10-15T17:05:10.321799] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-15T17:05:10.325975] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-07. [2025-10-15T17:05:10.730398] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-15T17:05:10.746173] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-03 (2.79 seconds). [2025-10-15T17:05:10.757604] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-05. [2025-10-15T17:05:10.759311] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-04. [2025-10-15T17:05:11.090622] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-15T17:05:11.094071] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-08. [2025-10-15T17:05:11.817400] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-15T17:05:11.820170] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-09. [2025-10-15T17:05:12.811310] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-06 (2.63 seconds). [2025-10-15T17:05:12.819057] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-07. [2025-10-15T17:05:14.181248] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-05 (3.42 seconds). [2025-10-15T17:05:14.191976] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-06. [2025-10-15T17:05:14.364078] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-15T17:05:14.371834] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-08. [2025-10-15T17:05:15.060748] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-04 (4.30 seconds). [2025-10-15T17:05:15.072176] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-05. [2025-10-15T17:05:15.202924] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-09 (3.38 seconds). [2025-10-15T17:05:15.206057] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-10. [2025-10-15T17:05:15.688138] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-15T17:05:15.695171] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-09. [2025-10-15T17:05:16.883785] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-15T17:05:16.885473] [INFO ] [REMOTE ] AFB: Full fetch complete (16479 records). [2025-10-15T17:05:16.885542] [DEBUG] [VALIDATOR ] AFB: Validating primary data. [2025-10-15T17:05:16.885961] [FATAL] [VALIDATOR ] AFB: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T17:05:16.886441] [FATAL] [MAIN ] AFB: Fetched primary data is invalid. Refusing to save it. [2025-10-15T17:05:16.886484] [WARN ] [MAIN ] AFB: Deleting existing primary and derivative data due to validation failure. [2025-10-15T17:05:16.886523] [INFO ] [LOCAL ] AFB: Starting deletion of primary data. [2025-10-15T17:05:16.886576] [DEBUG] [LOCAL ] AFB: No primary data file found to delete. [2025-10-15T17:05:16.886611] [INFO ] [LOCAL ] AFB: Starting deletion of derivative data. [2025-10-15T17:05:16.886814] [DEBUG] [LOCAL ] AFB: Deleted derivative data file. [2025-10-15T17:05:16.886902] [INFO ] [MAIN ] Update Progress: 42/2369 symbols completed. AFB took 18.9s. Estimated remaining: 4h 48m 26s. Rate: 8.1 symbols/min [2025-10-15T17:05:17.084257] [INFO ] [MAIN ] AFGB: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:05:17.086667] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-15T17:05:17.095872] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-10. [2025-10-15T17:05:17.098944] [DEBUG] [LOCAL ] AFGB: Loaded 2269 existing records from primary storage. [2025-10-15T17:05:17.099195] [INFO ] [MAIN ] AFGB: Loaded 2269 existing records. [2025-10-15T17:05:17.261201] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-06 (3.07 seconds). [2025-10-15T17:05:17.332792] [WARN ] [MAIN ] AFGB: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:05:17.333167] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-07. [2025-10-15T17:05:17.333369] [INFO ] [MAIN ] AFGB: Wiping existing primary data before full refresh. [2025-10-15T17:05:17.334337] [INFO ] [LOCAL ] AFGB: Starting deletion of primary data. [2025-10-15T17:05:17.335003] [DEBUG] [LOCAL ] AFGB: Deleted primary data file. [2025-10-15T17:05:17.335094] [INFO ] [MAIN ] AFGB: Starting full primary refresh. [2025-10-15T17:05:17.476494] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-05 (2.40 seconds). [2025-10-15T17:05:17.537457] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-06. [2025-10-15T17:05:17.737055] [INFO ] [REMOTE ] AFGB: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:05:17.737363] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2024-12. [2025-10-15T17:05:18.215150] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2024-12 (0.48 seconds). [2025-10-15T17:05:18.216391] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-01. [2025-10-15T17:05:18.613721] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-01 (0.40 seconds). [2025-10-15T17:05:18.615041] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-02. [2025-10-15T17:05:18.628752] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-15T17:05:18.633193] [INFO ] [REMOTE ] AFG: Full fetch complete (46618 records). [2025-10-15T17:05:18.633305] [DEBUG] [VALIDATOR ] AFG: Validating primary data. [2025-10-15T17:05:19.051729] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-15T17:05:19.063547] [DEBUG] [VALIDATOR ] AFG: All expected trading days are present. [2025-10-15T17:05:19.063788] [DEBUG] [VALIDATOR ] AFG: Primary data validation passed. [2025-10-15T17:05:19.064380] [INFO ] [MAIN ] AFG: Fetched primary data is valid. [2025-10-15T17:05:19.066031] [DEBUG] [LOCAL ] AFG: Saving primary data. [2025-10-15T17:05:19.065967] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-03. [2025-10-15T17:05:19.068064] [DEBUG] [LOCAL ] AFG: Trimmed 46618 records to 32218 (keeping 200 days of data) [2025-10-15T17:05:19.268349] [DEBUG] [LOCAL ] AFG: Primary data saved (32218 records). [2025-10-15T17:05:19.268544] [INFO ] [MAIN ] AFG: Full history saved. [2025-10-15T17:05:19.268637] [INFO ] [MAIN ] Update Progress: 43/2369 symbols completed. AFG took 18.6s. Estimated remaining: 4h 43m 45s. Rate: 8.2 symbols/min [2025-10-15T17:05:19.409967] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-10-15T17:05:19.493881] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-08. [2025-10-15T17:05:19.493515] [INFO ] [MAIN ] AFGC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:05:19.526329] [DEBUG] [LOCAL ] AFGC: Loaded 2554 existing records from primary storage. [2025-10-15T17:05:19.527605] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-10-15T17:05:19.537825] [INFO ] [MAIN ] AFGC: Loaded 2554 existing records. [2025-10-15T17:05:19.583530] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-07. [2025-10-15T17:05:19.724170] [WARN ] [MAIN ] AFGC: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:05:19.724404] [INFO ] [MAIN ] AFGC: Wiping existing primary data before full refresh. [2025-10-15T17:05:19.724453] [INFO ] [LOCAL ] AFGC: Starting deletion of primary data. [2025-10-15T17:05:19.724606] [DEBUG] [LOCAL ] AFGC: Deleted primary data file. [2025-10-15T17:05:19.724696] [INFO ] [MAIN ] AFGC: Starting full primary refresh. [2025-10-15T17:05:19.820460] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-15T17:05:19.836526] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-04. [2025-10-15T17:05:20.136198] [INFO ] [REMOTE ] AFGC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:05:20.136598] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2024-12. [2025-10-15T17:05:20.347844] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-10-15T17:05:20.349201] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-05. [2025-10-15T17:05:20.677324] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2024-12 (0.54 seconds). [2025-10-15T17:05:20.678595] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-01. [2025-10-15T17:05:20.774829] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-10-15T17:05:20.776064] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-06. [2025-10-15T17:05:21.038330] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-15T17:05:21.049139] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-09. [2025-10-15T17:05:21.067192] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-01 (0.39 seconds). [2025-10-15T17:05:21.068525] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-02. [2025-10-15T17:05:22.637399] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-07 (3.05 seconds). [2025-10-15T17:05:22.650166] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-08. [2025-10-15T17:05:22.656151] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-15T17:05:22.657763] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-07. [2025-10-15T17:05:22.706253] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-15T17:05:22.709337] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-15T17:05:22.708081] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-03. [2025-10-15T17:05:22.722403] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-10. [2025-10-15T17:05:23.081011] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-10-15T17:05:23.082177] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-04. [2025-10-15T17:05:23.121520] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-10-15T17:05:23.122791] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-08. [2025-10-15T17:05:23.547189] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-10-15T17:05:23.548820] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-05. [2025-10-15T17:05:23.631402] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-10-15T17:05:23.632976] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-09. [2025-10-15T17:05:24.072339] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-10-15T17:05:24.074044] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-10. [2025-10-15T17:05:24.113747] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-15T17:05:24.114963] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-06. [2025-10-15T17:05:24.295416] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-15T17:05:24.302479] [INFO ] [REMOTE ] AESI: Full fetch complete (71165 records). [2025-10-15T17:05:24.302882] [DEBUG] [VALIDATOR ] AESI: Validating primary data. [2025-10-15T17:05:24.498865] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-10-15T17:05:24.506267] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-10 (0.43 seconds). [2025-10-15T17:05:24.507968] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-07. [2025-10-15T17:05:24.556019] [INFO ] [REMOTE ] AFGB: Full fetch complete (3556 records). [2025-10-15T17:05:24.583198] [DEBUG] [VALIDATOR ] AFGB: Validating primary data. [2025-10-15T17:05:24.598341] [FATAL] [VALIDATOR ] AFGB: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T17:05:24.633372] [FATAL] [MAIN ] AFGB: Fetched primary data is invalid. Refusing to save it. [2025-10-15T17:05:24.644292] [WARN ] [MAIN ] AFGB: Deleting existing primary and derivative data due to validation failure. [2025-10-15T17:05:24.665374] [INFO ] [LOCAL ] AFGB: Starting deletion of primary data. [2025-10-15T17:05:24.758878] [DEBUG] [LOCAL ] AFGB: No primary data file found to delete. [2025-10-15T17:05:24.780791] [DEBUG] [VALIDATOR ] AESI: All expected trading days are present. [2025-10-15T17:05:24.780598] [INFO ] [LOCAL ] AFGB: Starting deletion of derivative data. [2025-10-15T17:05:24.780986] [DEBUG] [VALIDATOR ] AESI: Primary data validation passed. [2025-10-15T17:05:24.783065] [DEBUG] [LOCAL ] AFGB: Deleted derivative data file. [2025-10-15T17:05:24.782592] [INFO ] [MAIN ] AESI: Fetched primary data is valid. [2025-10-15T17:05:24.785676] [DEBUG] [LOCAL ] AESI: Saving primary data. [2025-10-15T17:05:24.785827] [INFO ] [MAIN ] Update Progress: 44/2369 symbols completed. AFGB took 7.9s. Estimated remaining: 4h 42m 3s. Rate: 8.2 symbols/min [2025-10-15T17:05:24.785450] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-08 (2.14 seconds). [2025-10-15T17:05:24.885307] [DEBUG] [LOCAL ] AESI: Trimmed 71165 records to 49739 (keeping 200 days of data) [2025-10-15T17:05:24.919119] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-09. [2025-10-15T17:05:25.080348] [INFO ] [MAIN ] AFGD: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:05:25.095510] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-10-15T17:05:25.102719] [DEBUG] [LOCAL ] AFGD: Loaded 1770 existing records from primary storage. [2025-10-15T17:05:25.104045] [INFO ] [MAIN ] AFGD: Loaded 1770 existing records. [2025-10-15T17:05:25.313670] [WARN ] [MAIN ] AFGD: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:05:25.315538] [INFO ] [MAIN ] AFGD: Wiping existing primary data before full refresh. [2025-10-15T17:05:25.315610] [INFO ] [LOCAL ] AFGD: Starting deletion of primary data. [2025-10-15T17:05:25.316038] [DEBUG] [LOCAL ] AFGD: Deleted primary data file. [2025-10-15T17:05:25.316117] [INFO ] [MAIN ] AFGD: Starting full primary refresh. [2025-10-15T17:05:25.720703] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-08. [2025-10-15T17:05:25.818003] [INFO ] [REMOTE ] AFGD: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:05:25.890852] [DEBUG] [LOCAL ] AESI: Primary data saved (49739 records). [2025-10-15T17:05:25.891004] [INFO ] [MAIN ] AESI: Full history saved. [2025-10-15T17:05:25.891087] [INFO ] [MAIN ] Update Progress: 45/2369 symbols completed. AESI took 27.9s. Estimated remaining: 4h 36m 37s. Rate: 8.4 symbols/min [2025-10-15T17:05:26.058479] [INFO ] [MAIN ] AFGE: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:05:26.063437] [DEBUG] [LOCAL ] AFGE: Loaded 2396 existing records from primary storage. [2025-10-15T17:05:26.063614] [INFO ] [MAIN ] AFGE: Loaded 2396 existing records. [2025-10-15T17:05:26.236990] [WARN ] [MAIN ] AFGE: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:05:26.237202] [INFO ] [MAIN ] AFGE: Wiping existing primary data before full refresh. [2025-10-15T17:05:26.237251] [INFO ] [LOCAL ] AFGE: Starting deletion of primary data. [2025-10-15T17:05:26.238231] [DEBUG] [LOCAL ] AFGE: Deleted primary data file. [2025-10-15T17:05:26.238292] [INFO ] [MAIN ] AFGE: Starting full primary refresh. [2025-10-15T17:05:26.355026] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-15T17:05:26.520202] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2024-12. [2025-10-15T17:05:26.613604] [INFO ] [REMOTE ] AFGE: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:05:27.187318] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-10-15T17:05:27.314097] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2024-12. [2025-10-15T17:05:27.788178] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2024-12 (0.47 seconds). [2025-10-15T17:05:28.114030] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-01. [2025-10-15T17:05:28.584947] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-10-15T17:05:28.914067] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-01. [2025-10-15T17:05:29.166526] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-09 (4.25 seconds). [2025-10-15T17:05:29.342708] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-10-15T17:05:29.714018] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-02. [2025-10-15T17:05:30.040428] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-10-15T17:05:30.514003] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-09. [2025-10-15T17:05:31.131299] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-15T17:05:31.314053] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-02. [2025-10-15T17:05:31.666540] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-10-15T17:05:32.113997] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-03. [2025-10-15T17:05:32.474890] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-10-15T17:05:32.914003] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-03. [2025-10-15T17:05:33.336504] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-10-15T17:05:33.714004] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-04. [2025-10-15T17:05:34.168864] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-10-15T17:05:34.514006] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-10. [2025-10-15T17:05:35.116694] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-15T17:05:35.117554] [INFO ] [REMOTE ] AFGC: Full fetch complete (3682 records). [2025-10-15T17:05:35.117624] [DEBUG] [VALIDATOR ] AFGC: Validating primary data. [2025-10-15T17:05:35.323437] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-05. [2025-10-15T17:05:35.475519] [DEBUG] [VALIDATOR ] AFGC: All expected trading days are present. [2025-10-15T17:05:35.475594] [DEBUG] [VALIDATOR ] AFGC: Primary data validation passed. [2025-10-15T17:05:35.475736] [INFO ] [MAIN ] AFGC: Fetched primary data is valid. [2025-10-15T17:05:35.475798] [DEBUG] [LOCAL ] AFGC: Saving primary data. [2025-10-15T17:05:35.476140] [DEBUG] [LOCAL ] AFGC: Trimmed 3682 records to 2561 (keeping 200 days of data) [2025-10-15T17:05:35.491773] [DEBUG] [LOCAL ] AFGC: Primary data saved (2561 records). [2025-10-15T17:05:35.491850] [INFO ] [MAIN ] AFGC: Full history saved. [2025-10-15T17:05:35.491932] [INFO ] [MAIN ] Update Progress: 46/2369 symbols completed. AFGC took 16.2s. Estimated remaining: 4h 38m 34s. Rate: 8.3 symbols/min [2025-10-15T17:05:35.664315] [INFO ] [MAIN ] AFL: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:05:35.717404] [DEBUG] [LOCAL ] AFL: Loaded 53189 existing records from primary storage. [2025-10-15T17:05:35.717899] [INFO ] [MAIN ] AFL: Loaded 53189 existing records. [2025-10-15T17:05:35.909211] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-15T17:05:35.915330] [WARN ] [MAIN ] AFL: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:05:35.917687] [INFO ] [MAIN ] AFL: Wiping existing primary data before full refresh. [2025-10-15T17:05:35.917794] [INFO ] [LOCAL ] AFL: Starting deletion of primary data. [2025-10-15T17:05:35.918828] [DEBUG] [LOCAL ] AFL: Deleted primary data file. [2025-10-15T17:05:35.918886] [INFO ] [MAIN ] AFL: Starting full primary refresh. [2025-10-15T17:05:36.123029] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-04. [2025-10-15T17:05:36.271564] [INFO ] [REMOTE ] AFL: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:05:36.573102] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-10-15T17:05:36.913997] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-06. [2025-10-15T17:05:37.354601] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-10-15T17:05:37.713991] [INFO ] [REMOTE ] AFL: Fetching primary data for 2024-12. [2025-10-15T17:05:38.514019] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-05. [2025-10-15T17:05:39.053427] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-10-15T17:05:39.314017] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-06. [2025-10-15T17:05:39.584969] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-10-15T17:05:39.766710] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-15T17:05:40.114079] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-07. [2025-10-15T17:05:40.673379] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-15T17:05:40.914070] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-08. [2025-10-15T17:05:41.338950] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-10-15T17:05:41.714007] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-01. [2025-10-15T17:05:42.514033] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-07. [2025-10-15T17:05:42.948101] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-10-15T17:05:43.136798] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-15T17:05:43.313987] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-02. [2025-10-15T17:05:44.113990] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-09. [2025-10-15T17:05:44.601761] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-10-15T17:05:44.922915] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-10. [2025-10-15T17:05:44.942533] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-15T17:05:45.301491] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-10 (0.38 seconds). [2025-10-15T17:05:45.302375] [INFO ] [REMOTE ] AFGE: Full fetch complete (3442 records). [2025-10-15T17:05:45.302477] [DEBUG] [VALIDATOR ] AFGE: Validating primary data. [2025-10-15T17:05:45.663478] [DEBUG] [VALIDATOR ] AFGE: All expected trading days are present. [2025-10-15T17:05:45.663561] [DEBUG] [VALIDATOR ] AFGE: Primary data validation passed. [2025-10-15T17:05:45.663754] [INFO ] [MAIN ] AFGE: Fetched primary data is valid. [2025-10-15T17:05:45.663817] [DEBUG] [LOCAL ] AFGE: Saving primary data. [2025-10-15T17:05:45.664198] [DEBUG] [LOCAL ] AFGE: Trimmed 3442 records to 2374 (keeping 200 days of data) [2025-10-15T17:05:45.679721] [DEBUG] [LOCAL ] AFGE: Primary data saved (2374 records). [2025-10-15T17:05:45.679873] [INFO ] [MAIN ] AFGE: Full history saved. [2025-10-15T17:05:45.679987] [INFO ] [MAIN ] Update Progress: 47/2369 symbols completed. AFGE took 19.8s. Estimated remaining: 4h 40m 54s. Rate: 8.3 symbols/min [2025-10-15T17:05:45.719112] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-03. [2025-10-15T17:05:45.876093] [INFO ] [MAIN ] AG: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:05:45.933131] [DEBUG] [LOCAL ] AG: Loaded 53643 existing records from primary storage. [2025-10-15T17:05:45.933616] [INFO ] [MAIN ] AG: Loaded 53643 existing records. [2025-10-15T17:05:46.109113] [WARN ] [MAIN ] AG: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:05:46.109387] [INFO ] [MAIN ] AG: Wiping existing primary data before full refresh. [2025-10-15T17:05:46.109453] [INFO ] [LOCAL ] AG: Starting deletion of primary data. [2025-10-15T17:05:46.110350] [DEBUG] [LOCAL ] AG: Deleted primary data file. [2025-10-15T17:05:46.110416] [INFO ] [MAIN ] AG: Starting full primary refresh. [2025-10-15T17:05:46.458767] [INFO ] [REMOTE ] AG: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:05:46.514018] [INFO ] [REMOTE ] AG: Fetching primary data for 2024-12. [2025-10-15T17:05:47.313977] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-08. [2025-10-15T17:05:47.563892] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-15T17:05:47.722762] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-08 (0.41 seconds). [2025-10-15T17:05:48.114009] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-09. [2025-10-15T17:05:48.570000] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-10-15T17:05:48.913981] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-10. [2025-10-15T17:05:49.447163] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-15T17:05:49.447979] [INFO ] [REMOTE ] AFGD: Full fetch complete (3030 records). [2025-10-15T17:05:49.448047] [DEBUG] [VALIDATOR ] AFGD: Validating primary data. [2025-10-15T17:05:49.722511] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-04. [2025-10-15T17:05:49.804497] [DEBUG] [VALIDATOR ] AFGD: All expected trading days are present. [2025-10-15T17:05:49.804569] [DEBUG] [VALIDATOR ] AFGD: Primary data validation passed. [2025-10-15T17:05:49.804699] [INFO ] [MAIN ] AFGD: Fetched primary data is valid. [2025-10-15T17:05:49.804759] [DEBUG] [LOCAL ] AFGD: Saving primary data. [2025-10-15T17:05:49.805087] [DEBUG] [LOCAL ] AFGD: Trimmed 3030 records to 1772 (keeping 200 days of data) [2025-10-15T17:05:49.815914] [DEBUG] [LOCAL ] AFGD: Primary data saved (1772 records). [2025-10-15T17:05:49.815975] [INFO ] [MAIN ] AFGD: Full history saved. [2025-10-15T17:05:49.816040] [INFO ] [MAIN ] Update Progress: 48/2369 symbols completed. AFGD took 25.0s. Estimated remaining: 4h 38m 16s. Rate: 8.3 symbols/min [2025-10-15T17:05:49.981486] [INFO ] [MAIN ] AGCO: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:05:50.028873] [DEBUG] [LOCAL ] AGCO: Loaded 42456 existing records from primary storage. [2025-10-15T17:05:50.029151] [INFO ] [MAIN ] AGCO: Loaded 42456 existing records. [2025-10-15T17:05:50.202732] [WARN ] [MAIN ] AGCO: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:05:50.202979] [INFO ] [MAIN ] AGCO: Wiping existing primary data before full refresh. [2025-10-15T17:05:50.203101] [INFO ] [LOCAL ] AGCO: Starting deletion of primary data. [2025-10-15T17:05:50.203941] [DEBUG] [LOCAL ] AGCO: Deleted primary data file. [2025-10-15T17:05:50.203998] [INFO ] [MAIN ] AGCO: Starting full primary refresh. [2025-10-15T17:05:50.514546] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-10. [2025-10-15T17:05:50.556843] [INFO ] [REMOTE ] AGCO: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:05:50.588161] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2024-12 (4.07 seconds). [2025-10-15T17:05:51.313984] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-01. [2025-10-15T17:05:51.651176] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-15T17:05:52.114004] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2024-12. [2025-10-15T17:05:52.886521] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-15T17:05:52.913947] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-02. [2025-10-15T17:05:53.404807] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-15T17:05:53.714025] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-05. [2025-10-15T17:05:54.026140] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-10 (3.51 seconds). [2025-10-15T17:05:54.032688] [INFO ] [REMOTE ] AES: Full fetch complete (77847 records). [2025-10-15T17:05:54.032866] [DEBUG] [VALIDATOR ] AES: Validating primary data. [2025-10-15T17:05:54.425711] [DEBUG] [VALIDATOR ] AES: All expected trading days are present. [2025-10-15T17:05:54.426035] [DEBUG] [VALIDATOR ] AES: Primary data validation passed. [2025-10-15T17:05:54.426850] [INFO ] [MAIN ] AES: Fetched primary data is valid. [2025-10-15T17:05:54.426915] [DEBUG] [LOCAL ] AES: Saving primary data. [2025-10-15T17:05:54.428476] [DEBUG] [LOCAL ] AES: Trimmed 77847 records to 53669 (keeping 200 days of data) [2025-10-15T17:05:54.515981] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-01. [2025-10-15T17:05:54.745734] [DEBUG] [LOCAL ] AES: Primary data saved (53669 records). [2025-10-15T17:05:54.745862] [INFO ] [MAIN ] AES: Full history saved. [2025-10-15T17:05:54.745940] [INFO ] [MAIN ] Update Progress: 49/2369 symbols completed. AES took 56.8s. Estimated remaining: 4h 36m 22s. Rate: 8.4 symbols/min [2025-10-15T17:05:54.915614] [INFO ] [MAIN ] AGD: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:05:54.935999] [DEBUG] [LOCAL ] AGD: Loaded 19218 existing records from primary storage. [2025-10-15T17:05:54.946436] [INFO ] [MAIN ] AGD: Loaded 19218 existing records. [2025-10-15T17:05:55.059085] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-02 (2.15 seconds). [2025-10-15T17:05:55.169061] [WARN ] [MAIN ] AGD: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:05:55.169316] [INFO ] [MAIN ] AGD: Wiping existing primary data before full refresh. [2025-10-15T17:05:55.169363] [INFO ] [LOCAL ] AGD: Starting deletion of primary data. [2025-10-15T17:05:55.169856] [DEBUG] [LOCAL ] AGD: Deleted primary data file. [2025-10-15T17:05:55.169917] [INFO ] [MAIN ] AGD: Starting full primary refresh. [2025-10-15T17:05:55.372126] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-03. [2025-10-15T17:05:55.533822] [INFO ] [REMOTE ] AGD: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:05:55.573620] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-15T17:05:56.028913] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-15T17:05:56.114064] [INFO ] [REMOTE ] AGD: Fetching primary data for 2024-12. [2025-10-15T17:05:56.914027] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-06. [2025-10-15T17:05:57.101951] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-10-15T17:05:57.714000] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-01. [2025-10-15T17:05:58.514033] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-02. [2025-10-15T17:05:58.578305] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-15T17:05:58.748166] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-15T17:05:59.314038] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-07. [2025-10-15T17:06:00.034016] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-15T17:06:00.114052] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-02. [2025-10-15T17:06:00.913990] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-03. [2025-10-15T17:06:01.007379] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-15T17:06:01.713993] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-03. [2025-10-15T17:06:02.551637] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-15T17:06:02.555401] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-04. [2025-10-15T17:06:39.502330] [DEBUG] [REMOTE ] AG: Error fetching primary data for 2025-03: ("Connection broken: InvalidChunkLength(got length b'', 0 bytes read)", InvalidChunkLength(got length b'', 0 bytes read)) [2025-10-15T17:06:39.502515] [WARN ] [REMOTE ] AG: No data returned for month 2025-03 [2025-10-15T17:06:39.502593] [FATAL] [REMOTE ] AG: API call failed - aborting fetch to avoid wasting further API calls [2025-10-15T17:06:39.502674] [FATAL] [MAIN ] AG: Failed to fetch primary data. [2025-10-15T17:06:39.502744] [WARN ] [MAIN ] AG: Deleting existing primary and derivative data due to fetch failure. [2025-10-15T17:06:39.502828] [INFO ] [LOCAL ] AG: Starting deletion of primary data. [2025-10-15T17:06:39.502925] [DEBUG] [LOCAL ] AG: No primary data file found to delete. [2025-10-15T17:06:39.502981] [INFO ] [LOCAL ] AG: Starting deletion of derivative data. [2025-10-15T17:06:39.503099] [DEBUG] [LOCAL ] AG: Deleted derivative data file. [2025-10-15T17:06:39.503198] [INFO ] [MAIN ] Update Progress: 50/2369 symbols completed. AG took 53.8s. Estimated remaining: 5h 5m 19s. Rate: 7.6 symbols/min [2025-10-15T17:06:39.672853] [INFO ] [MAIN ] AGI: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:06:39.723152] [DEBUG] [LOCAL ] AGI: Loaded 53424 existing records from primary storage. [2025-10-15T17:06:39.723519] [INFO ] [MAIN ] AGI: Loaded 53424 existing records. [2025-10-15T17:06:39.902269] [WARN ] [MAIN ] AGI: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:06:39.902496] [INFO ] [MAIN ] AGI: Wiping existing primary data before full refresh. [2025-10-15T17:06:39.902545] [INFO ] [LOCAL ] AGI: Starting deletion of primary data. [2025-10-15T17:06:39.903566] [DEBUG] [LOCAL ] AGI: Deleted primary data file. [2025-10-15T17:06:39.903626] [INFO ] [MAIN ] AGI: Starting full primary refresh. [2025-10-15T17:06:40.255921] [INFO ] [REMOTE ] AGI: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:06:40.256259] [INFO ] [REMOTE ] AGI: Fetching primary data for 2024-12. [2025-10-15T17:06:41.020732] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-04 (38.47 seconds). [2025-10-15T17:06:41.024618] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-05. [2025-10-15T17:06:41.973378] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-15T17:06:41.978194] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-06. [2025-10-15T17:06:42.049015] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-15T17:06:42.059955] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-01. [2025-10-15T17:06:42.252928] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-03 (41.34 seconds). [2025-10-15T17:06:42.262364] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-04. [2025-10-15T17:06:43.072830] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-15T17:06:43.077445] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-07. [2025-10-15T17:06:44.483423] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-07 (45.17 seconds). [2025-10-15T17:06:44.495982] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-08. [2025-10-15T17:06:45.494968] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-01 (3.44 seconds). [2025-10-15T17:06:45.505433] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-02. [2025-10-15T17:06:46.129740] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-04 (3.87 seconds). [2025-10-15T17:06:46.140237] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-05. [2025-10-15T17:06:46.777597] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-07 (3.70 seconds). [2025-10-15T17:06:46.782708] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-08. [2025-10-15T17:06:47.711551] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-15T17:06:47.716048] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-09. [2025-10-15T17:06:47.761062] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-02 (2.26 seconds). [2025-10-15T17:06:47.772447] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-03. [2025-10-15T17:06:48.376939] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-05 (2.24 seconds). [2025-10-15T17:06:48.386792] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-06. [2025-10-15T17:06:48.735524] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-08 (4.24 seconds). [2025-10-15T17:06:48.747478] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-09. [2025-10-15T17:06:48.824114] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-15T17:06:48.831387] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-10. [2025-10-15T17:06:49.676703] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-15T17:06:49.688013] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-04. [2025-10-15T17:06:49.817602] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-15T17:06:49.829357] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-07. [2025-10-15T17:06:50.311323] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-15T17:06:50.314860] [INFO ] [REMOTE ] AGD: Full fetch complete (26591 records). [2025-10-15T17:06:50.314930] [DEBUG] [VALIDATOR ] AGD: Validating primary data. [2025-10-15T17:06:50.660147] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-15T17:06:50.756385] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-10. [2025-10-15T17:06:50.768483] [DEBUG] [VALIDATOR ] AGD: All expected trading days are present. [2025-10-15T17:06:50.768574] [DEBUG] [VALIDATOR ] AGD: Primary data validation passed. [2025-10-15T17:06:50.769035] [INFO ] [MAIN ] AGD: Fetched primary data is valid. [2025-10-15T17:06:50.769099] [DEBUG] [LOCAL ] AGD: Saving primary data. [2025-10-15T17:06:50.769969] [DEBUG] [LOCAL ] AGD: Trimmed 26591 records to 19317 (keeping 200 days of data) [2025-10-15T17:06:50.887301] [DEBUG] [LOCAL ] AGD: Primary data saved (19317 records). [2025-10-15T17:06:50.887456] [INFO ] [MAIN ] AGD: Full history saved. [2025-10-15T17:06:50.887573] [INFO ] [MAIN ] Update Progress: 51/2369 symbols completed. AGD took 56.1s. Estimated remaining: 5h 7m 50s. Rate: 7.5 symbols/min [2025-10-15T17:06:51.053686] [INFO ] [MAIN ] AGL: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:06:51.102620] [DEBUG] [LOCAL ] AGL: Loaded 52562 existing records from primary storage. [2025-10-15T17:06:51.102961] [INFO ] [MAIN ] AGL: Loaded 52562 existing records. [2025-10-15T17:06:51.280030] [WARN ] [MAIN ] AGL: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:06:51.280237] [INFO ] [MAIN ] AGL: Wiping existing primary data before full refresh. [2025-10-15T17:06:51.280284] [INFO ] [LOCAL ] AGL: Starting deletion of primary data. [2025-10-15T17:06:51.280606] [DEBUG] [LOCAL ] AGL: Deleted primary data file. [2025-10-15T17:06:51.280683] [INFO ] [MAIN ] AGL: Starting full primary refresh. [2025-10-15T17:06:51.634712] [INFO ] [REMOTE ] AGL: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:06:51.635034] [INFO ] [REMOTE ] AGL: Fetching primary data for 2024-12. [2025-10-15T17:06:51.897672] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-10-15T17:06:51.907251] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-08. [2025-10-15T17:06:52.701624] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-04 (3.01 seconds). [2025-10-15T17:06:52.717518] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-05. [2025-10-15T17:06:52.739535] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-10 (1.98 seconds). [2025-10-15T17:06:52.749585] [INFO ] [REMOTE ] AFL: Full fetch complete (77070 records). [2025-10-15T17:06:52.749849] [DEBUG] [VALIDATOR ] AFL: Validating primary data. [2025-10-15T17:06:53.187059] [DEBUG] [VALIDATOR ] AFL: All expected trading days are present. [2025-10-15T17:06:53.196777] [DEBUG] [VALIDATOR ] AFL: Primary data validation passed. [2025-10-15T17:06:53.198161] [INFO ] [MAIN ] AFL: Fetched primary data is valid. [2025-10-15T17:06:53.212378] [DEBUG] [LOCAL ] AFL: Saving primary data. [2025-10-15T17:06:53.217457] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-15T17:06:53.228949] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-01. [2025-10-15T17:06:53.230953] [DEBUG] [LOCAL ] AFL: Trimmed 77070 records to 53190 (keeping 200 days of data) [2025-10-15T17:06:53.603856] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-15T17:06:53.607295] [DEBUG] [LOCAL ] AFL: Primary data saved (53190 records). [2025-10-15T17:06:53.616153] [INFO ] [MAIN ] AFL: Full history saved. [2025-10-15T17:06:53.617605] [INFO ] [MAIN ] Update Progress: 52/2369 symbols completed. AFL took 1m 18s. Estimated remaining: 5h 3m 48s. Rate: 7.6 symbols/min [2025-10-15T17:06:53.651776] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-09. [2025-10-15T17:06:53.803769] [INFO ] [MAIN ] AGM: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:06:53.818298] [DEBUG] [LOCAL ] AGM: Loaded 10669 existing records from primary storage. [2025-10-15T17:06:53.818548] [INFO ] [MAIN ] AGM: Loaded 10669 existing records. [2025-10-15T17:06:54.005632] [WARN ] [MAIN ] AGM: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:06:54.005879] [INFO ] [MAIN ] AGM: Wiping existing primary data before full refresh. [2025-10-15T17:06:54.005929] [INFO ] [LOCAL ] AGM: Starting deletion of primary data. [2025-10-15T17:06:54.006099] [DEBUG] [LOCAL ] AGM: Deleted primary data file. [2025-10-15T17:06:54.006139] [INFO ] [MAIN ] AGM: Starting full primary refresh. [2025-10-15T17:06:54.381368] [INFO ] [REMOTE ] AGM: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:06:54.382030] [INFO ] [REMOTE ] AGM: Fetching primary data for 2024-12. [2025-10-15T17:06:54.859865] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-15T17:06:54.870040] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-02. [2025-10-15T17:06:55.115265] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-15T17:06:55.126180] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-10. [2025-10-15T17:06:55.161856] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-10-15T17:06:55.163887] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-01. [2025-10-15T17:06:55.560781] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-01 (0.40 seconds). [2025-10-15T17:06:55.562607] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-02. [2025-10-15T17:06:56.088457] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-05 (3.37 seconds). [2025-10-15T17:06:56.092943] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-15T17:06:56.101187] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-03. [2025-10-15T17:06:56.103399] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-06. [2025-10-15T17:06:56.394366] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-15T17:06:56.400320] [INFO ] [REMOTE ] AGCO: Full fetch complete (61714 records). [2025-10-15T17:06:56.400500] [DEBUG] [VALIDATOR ] AGCO: Validating primary data. [2025-10-15T17:06:56.757841] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-10-15T17:06:56.795063] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-04. [2025-10-15T17:06:56.870830] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-10-15T17:06:56.880401] [DEBUG] [VALIDATOR ] AGCO: All expected trading days are present. [2025-10-15T17:06:56.881509] [DEBUG] [VALIDATOR ] AGCO: Primary data validation passed. [2025-10-15T17:06:56.881886] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-03. [2025-10-15T17:06:56.883083] [INFO ] [MAIN ] AGCO: Fetched primary data is valid. [2025-10-15T17:06:56.883816] [DEBUG] [LOCAL ] AGCO: Saving primary data. [2025-10-15T17:06:56.885483] [DEBUG] [LOCAL ] AGCO: Trimmed 61714 records to 42395 (keeping 200 days of data) [2025-10-15T17:06:57.153225] [DEBUG] [LOCAL ] AGCO: Primary data saved (42395 records). [2025-10-15T17:06:57.153347] [INFO ] [MAIN ] AGCO: Full history saved. [2025-10-15T17:06:57.154066] [INFO ] [MAIN ] Update Progress: 53/2369 symbols completed. AGCO took 1m 7s. Estimated remaining: 5h 0m 31s. Rate: 7.7 symbols/min [2025-10-15T17:06:57.323892] [INFO ] [MAIN ] AGO: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:06:57.352548] [DEBUG] [LOCAL ] AGO: Loaded 27878 existing records from primary storage. [2025-10-15T17:06:57.352968] [INFO ] [MAIN ] AGO: Loaded 27878 existing records. [2025-10-15T17:06:57.476486] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-10-15T17:06:57.490041] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-05. [2025-10-15T17:06:57.561835] [WARN ] [MAIN ] AGO: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:06:57.562265] [INFO ] [MAIN ] AGO: Wiping existing primary data before full refresh. [2025-10-15T17:06:57.562337] [INFO ] [LOCAL ] AGO: Starting deletion of primary data. [2025-10-15T17:06:57.563108] [DEBUG] [LOCAL ] AGO: Deleted primary data file. [2025-10-15T17:06:57.563169] [INFO ] [MAIN ] AGO: Starting full primary refresh. [2025-10-15T17:06:57.974276] [INFO ] [REMOTE ] AGO: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:06:57.974941] [INFO ] [REMOTE ] AGO: Fetching primary data for 2024-12. [2025-10-15T17:06:58.121681] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-15T17:06:58.123688] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-06. [2025-10-15T17:06:58.186986] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-06 (2.08 seconds). [2025-10-15T17:06:58.197844] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-07. [2025-10-15T17:06:58.526098] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-15T17:06:58.537261] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-04. [2025-10-15T17:06:59.032926] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-10-15T17:06:59.038417] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-01. [2025-10-15T17:06:59.731752] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-15T17:06:59.736430] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-07. [2025-10-15T17:07:00.260076] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-15T17:07:00.293938] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-10-15T17:07:00.292790] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-05. [2025-10-15T17:07:00.307335] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-08. [2025-10-15T17:07:00.516600] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-15T17:07:00.523054] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-02. [2025-10-15T17:07:00.614372] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-15T17:07:00.617591] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-08. [2025-10-15T17:07:01.235087] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-15T17:07:01.237625] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-09. [2025-10-15T17:07:01.667669] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-15T17:07:01.673876] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-03. [2025-10-15T17:07:01.927490] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-10-15T17:07:01.930347] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-10. [2025-10-15T17:07:02.230690] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-15T17:07:02.242833] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-09. [2025-10-15T17:07:03.617147] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-15T17:07:03.625839] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-04. [2025-10-15T17:07:03.660119] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-05 (3.37 seconds). [2025-10-15T17:07:03.671255] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-06. [2025-10-15T17:07:03.793145] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-10 (1.86 seconds). [2025-10-15T17:07:03.797037] [INFO ] [REMOTE ] AGM: Full fetch complete (13242 records). [2025-10-15T17:07:03.797146] [DEBUG] [VALIDATOR ] AGM: Validating primary data. [2025-10-15T17:07:04.242829] [DEBUG] [VALIDATOR ] AGM: All expected trading days are present. [2025-10-15T17:07:04.243057] [DEBUG] [VALIDATOR ] AGM: Primary data validation passed. [2025-10-15T17:07:04.243482] [INFO ] [MAIN ] AGM: Fetched primary data is valid. [2025-10-15T17:07:04.243538] [DEBUG] [LOCAL ] AGM: Saving primary data. [2025-10-15T17:07:04.244811] [DEBUG] [LOCAL ] AGM: Trimmed 13242 records to 10719 (keeping 200 days of data) [2025-10-15T17:07:04.324133] [DEBUG] [LOCAL ] AGM: Primary data saved (10719 records). [2025-10-15T17:07:04.324350] [INFO ] [MAIN ] AGM: Full history saved. [2025-10-15T17:07:04.324455] [INFO ] [MAIN ] Update Progress: 54/2369 symbols completed. AGM took 10.7s. Estimated remaining: 4h 59m 57s. Rate: 7.7 symbols/min [2025-10-15T17:07:04.533858] [INFO ] [MAIN ] AGRO: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:07:04.570737] [DEBUG] [LOCAL ] AGRO: Loaded 33181 existing records from primary storage. [2025-10-15T17:07:04.571208] [INFO ] [MAIN ] AGRO: Loaded 33181 existing records. [2025-10-15T17:07:04.773843] [WARN ] [MAIN ] AGRO: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:07:04.774181] [INFO ] [MAIN ] AGRO: Wiping existing primary data before full refresh. [2025-10-15T17:07:04.774244] [INFO ] [LOCAL ] AGRO: Starting deletion of primary data. [2025-10-15T17:07:04.775005] [DEBUG] [LOCAL ] AGRO: Deleted primary data file. [2025-10-15T17:07:04.775067] [INFO ] [MAIN ] AGRO: Starting full primary refresh. [2025-10-15T17:07:05.084157] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-09 (2.84 seconds). [2025-10-15T17:07:05.128029] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-10. [2025-10-15T17:07:05.187182] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-15T17:07:05.236969] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-05. [2025-10-15T17:07:05.281787] [INFO ] [REMOTE ] AGRO: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:07:05.282420] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2024-12. [2025-10-15T17:07:05.680585] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-10-15T17:07:05.691071] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-07. [2025-10-15T17:07:06.578355] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-15T17:07:06.587562] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-01. [2025-10-15T17:07:07.047004] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-10 (1.92 seconds). [2025-10-15T17:07:07.056047] [INFO ] [REMOTE ] AGI: Full fetch complete (77212 records). [2025-10-15T17:07:07.056333] [DEBUG] [VALIDATOR ] AGI: Validating primary data. [2025-10-15T17:07:07.467043] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-05 (2.23 seconds). [2025-10-15T17:07:07.518283] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-06. [2025-10-15T17:07:07.542904] [DEBUG] [VALIDATOR ] AGI: All expected trading days are present. [2025-10-15T17:07:07.543055] [DEBUG] [VALIDATOR ] AGI: Primary data validation passed. [2025-10-15T17:07:07.544273] [INFO ] [MAIN ] AGI: Fetched primary data is valid. [2025-10-15T17:07:07.544627] [DEBUG] [LOCAL ] AGI: Saving primary data. [2025-10-15T17:07:07.547025] [DEBUG] [LOCAL ] AGI: Trimmed 77212 records to 53424 (keeping 200 days of data) [2025-10-15T17:07:07.801170] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-10-15T17:07:07.802628] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-15T17:07:07.850774] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-08. [2025-10-15T17:07:07.854784] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-02. [2025-10-15T17:07:07.973923] [DEBUG] [LOCAL ] AGI: Primary data saved (53424 records). [2025-10-15T17:07:07.974152] [INFO ] [MAIN ] AGI: Full history saved. [2025-10-15T17:07:07.974266] [INFO ] [MAIN ] Update Progress: 55/2369 symbols completed. AGI took 28.5s. Estimated remaining: 4h 56m 56s. Rate: 7.8 symbols/min [2025-10-15T17:07:08.154571] [INFO ] [MAIN ] AGX: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:07:08.192044] [DEBUG] [LOCAL ] AGX: Loaded 33019 existing records from primary storage. [2025-10-15T17:07:08.192404] [INFO ] [MAIN ] AGX: Loaded 33019 existing records. [2025-10-15T17:07:08.386782] [WARN ] [MAIN ] AGX: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:07:08.387086] [INFO ] [MAIN ] AGX: Wiping existing primary data before full refresh. [2025-10-15T17:07:08.387139] [INFO ] [LOCAL ] AGX: Starting deletion of primary data. [2025-10-15T17:07:08.387710] [DEBUG] [LOCAL ] AGX: Deleted primary data file. [2025-10-15T17:07:08.387773] [INFO ] [MAIN ] AGX: Starting full primary refresh. [2025-10-15T17:07:08.781786] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-15T17:07:08.806107] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-07. [2025-10-15T17:07:08.823127] [INFO ] [REMOTE ] AGX: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:07:08.823670] [INFO ] [REMOTE ] AGX: Fetching primary data for 2024-12. [2025-10-15T17:07:09.327214] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-15T17:07:09.334522] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-03. [2025-10-15T17:07:09.815419] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-10-15T17:07:09.829113] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-09. [2025-10-15T17:07:10.259226] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-15T17:07:10.266115] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-08. [2025-10-15T17:07:10.304609] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-15T17:07:10.310787] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-01. [2025-10-15T17:07:10.488270] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-15T17:07:10.496185] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-04. [2025-10-15T17:07:11.662884] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-15T17:07:11.672249] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-15T17:07:11.688254] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-09. [2025-10-15T17:07:11.691581] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-10. [2025-10-15T17:07:11.733453] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-15T17:07:11.743243] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-05. [2025-10-15T17:07:12.018520] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-15T17:07:12.027251] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-02. [2025-10-15T17:07:12.740405] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-15T17:07:12.746981] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-10. [2025-10-15T17:07:13.058252] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-15T17:07:13.067092] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-06. [2025-10-15T17:07:13.424858] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-15T17:07:13.432733] [INFO ] [REMOTE ] AGL: Full fetch complete (75876 records). [2025-10-15T17:07:13.446083] [DEBUG] [VALIDATOR ] AGL: Validating primary data. [2025-10-15T17:07:13.515227] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-15T17:07:13.574624] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-03. [2025-10-15T17:07:13.705871] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-15T17:07:13.774573] [INFO ] [REMOTE ] AGO: Full fetch complete (39637 records). [2025-10-15T17:07:13.809706] [DEBUG] [VALIDATOR ] AGO: Validating primary data. [2025-10-15T17:07:14.050950] [DEBUG] [VALIDATOR ] AGL: All expected trading days are present. [2025-10-15T17:07:14.054403] [DEBUG] [VALIDATOR ] AGL: Primary data validation passed. [2025-10-15T17:07:14.056108] [INFO ] [MAIN ] AGL: Fetched primary data is valid. [2025-10-15T17:07:14.066755] [DEBUG] [LOCAL ] AGL: Saving primary data. [2025-10-15T17:07:14.196066] [DEBUG] [LOCAL ] AGL: Trimmed 75876 records to 52580 (keeping 200 days of data) [2025-10-15T17:07:14.331893] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-15T17:07:14.435947] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-07. [2025-10-15T17:07:14.487726] [DEBUG] [VALIDATOR ] AGO: All expected trading days are present. [2025-10-15T17:07:14.491682] [DEBUG] [VALIDATOR ] AGO: Primary data validation passed. [2025-10-15T17:07:14.502221] [INFO ] [MAIN ] AGO: Fetched primary data is valid. [2025-10-15T17:07:14.504137] [DEBUG] [LOCAL ] AGO: Saving primary data. [2025-10-15T17:07:14.511085] [DEBUG] [LOCAL ] AGO: Trimmed 39637 records to 27929 (keeping 200 days of data) [2025-10-15T17:07:14.885244] [DEBUG] [LOCAL ] AGL: Primary data saved (52580 records). [2025-10-15T17:07:14.898185] [INFO ] [MAIN ] AGL: Full history saved. [2025-10-15T17:07:14.898085] [DEBUG] [LOCAL ] AGO: Primary data saved (27929 records). [2025-10-15T17:07:14.898385] [INFO ] [MAIN ] Update Progress: 56/2369 symbols completed. AGL took 24.0s. Estimated remaining: 4h 56m 16s. Rate: 7.8 symbols/min [2025-10-15T17:07:14.898481] [INFO ] [MAIN ] AGO: Full history saved. [2025-10-15T17:07:14.898783] [INFO ] [MAIN ] Update Progress: 57/2369 symbols completed. AGO took 17.7s. Estimated remaining: 4h 50m 56s. Rate: 7.9 symbols/min [2025-10-15T17:07:15.244337] [INFO ] [MAIN ] AHH: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:07:15.296849] [INFO ] [MAIN ] AHL: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:07:15.297245] [DEBUG] [LOCAL ] AHL: No existing data file found in primary storage. [2025-10-15T17:07:15.297292] [WARN ] [MAIN ] AHL: No existing data found, performing full refresh instead. [2025-10-15T17:07:15.297418] [INFO ] [MAIN ] AHL: Wiping existing primary data before full refresh. [2025-10-15T17:07:15.297460] [INFO ] [LOCAL ] AHL: Starting deletion of primary data. [2025-10-15T17:07:15.297532] [DEBUG] [LOCAL ] AHL: No primary data file found to delete. [2025-10-15T17:07:15.297589] [INFO ] [MAIN ] AHL: Starting full primary refresh. [2025-10-15T17:07:15.617697] [DEBUG] [LOCAL ] AHH: Loaded 40550 existing records from primary storage. [2025-10-15T17:07:15.645229] [INFO ] [MAIN ] AHH: Loaded 40550 existing records. [2025-10-15T17:07:15.915214] [INFO ] [REMOTE ] AHL: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:07:15.944520] [INFO ] [REMOTE ] AHL: Fetching primary data for 2024-12. [2025-10-15T17:07:15.992676] [WARN ] [MAIN ] AHH: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:07:15.993333] [INFO ] [MAIN ] AHH: Wiping existing primary data before full refresh. [2025-10-15T17:07:15.993390] [INFO ] [LOCAL ] AHH: Starting deletion of primary data. [2025-10-15T17:07:15.994181] [DEBUG] [LOCAL ] AHH: Deleted primary data file. [2025-10-15T17:07:15.994245] [INFO ] [MAIN ] AHH: Starting full primary refresh. [2025-10-15T17:07:16.233262] [DEBUG] [REMOTE ] AHL: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-15T17:07:16.282416] [WARN ] [REMOTE ] AHL: No data returned for month 2024-12 [2025-10-15T17:07:16.319551] [FATAL] [REMOTE ] AHL: API call failed - aborting fetch to avoid wasting further API calls [2025-10-15T17:07:16.327850] [FATAL] [MAIN ] AHL: Failed to fetch primary data. [2025-10-15T17:07:16.351854] [WARN ] [MAIN ] AHL: Deleting existing primary and derivative data due to fetch failure. [2025-10-15T17:07:16.415367] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-03 (2.84 seconds). [2025-10-15T17:07:16.413428] [INFO ] [REMOTE ] AHH: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:07:16.409260] [INFO ] [LOCAL ] AHL: Starting deletion of primary data. [2025-10-15T17:07:16.422797] [INFO ] [REMOTE ] AHH: Fetching primary data for 2024-12. [2025-10-15T17:07:16.423181] [DEBUG] [LOCAL ] AHL: No primary data file found to delete. [2025-10-15T17:07:16.424827] [INFO ] [LOCAL ] AHL: Starting deletion of derivative data. [2025-10-15T17:07:16.425135] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-04. [2025-10-15T17:07:16.425879] [DEBUG] [LOCAL ] AHL: No derivative data file found to delete. [2025-10-15T17:07:16.426134] [INFO ] [MAIN ] Update Progress: 58/2369 symbols completed. AHL took 1.5s. Estimated remaining: 4h 46m 49s. Rate: 8.1 symbols/min [2025-10-15T17:07:16.595371] [INFO ] [MAIN ] AHR: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:07:16.638154] [DEBUG] [LOCAL ] AHR: Loaded 49074 existing records from primary storage. [2025-10-15T17:07:16.638527] [INFO ] [MAIN ] AHR: Loaded 49074 existing records. [2025-10-15T17:07:16.816011] [WARN ] [MAIN ] AHR: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:07:16.816337] [INFO ] [MAIN ] AHR: Wiping existing primary data before full refresh. [2025-10-15T17:07:16.816387] [INFO ] [LOCAL ] AHR: Starting deletion of primary data. [2025-10-15T17:07:16.816752] [DEBUG] [LOCAL ] AHR: Deleted primary data file. [2025-10-15T17:07:16.816809] [INFO ] [MAIN ] AHR: Starting full primary refresh. [2025-10-15T17:07:17.010857] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-07 (2.57 seconds). [2025-10-15T17:07:17.099986] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-08. [2025-10-15T17:07:17.205958] [INFO ] [REMOTE ] AHR: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:07:17.206284] [INFO ] [REMOTE ] AHR: Fetching primary data for 2024-12. [2025-10-15T17:07:17.951798] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-15T17:07:17.959309] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-05. [2025-10-15T17:07:18.283161] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-10-15T17:07:18.292549] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-01. [2025-10-15T17:07:18.462483] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-15T17:07:18.472618] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-01. [2025-10-15T17:07:18.743926] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-15T17:07:18.751237] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-09. [2025-10-15T17:07:19.020139] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-15T17:07:19.027376] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-06. [2025-10-15T17:07:19.817629] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-15T17:07:19.826301] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-02. [2025-10-15T17:07:20.519743] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-01 (2.05 seconds). [2025-10-15T17:07:20.529168] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-02. [2025-10-15T17:07:20.640495] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-15T17:07:20.648498] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-07. [2025-10-15T17:07:21.032366] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-09 (2.28 seconds). [2025-10-15T17:07:21.039468] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-10. [2025-10-15T17:07:21.245131] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-15T17:07:21.252999] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-03. [2025-10-15T17:07:21.794574] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-15T17:07:21.803579] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-08. [2025-10-15T17:07:21.904208] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-15T17:07:21.908133] [INFO ] [REMOTE ] AGRO: Full fetch complete (49105 records). [2025-10-15T17:07:21.908237] [DEBUG] [VALIDATOR ] AGRO: Validating primary data. [2025-10-15T17:07:22.308881] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-15T17:07:22.353064] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-03. [2025-10-15T17:07:22.366706] [DEBUG] [VALIDATOR ] AGRO: All expected trading days are present. [2025-10-15T17:07:22.366839] [DEBUG] [VALIDATOR ] AGRO: Primary data validation passed. [2025-10-15T17:07:22.367578] [INFO ] [MAIN ] AGRO: Fetched primary data is valid. [2025-10-15T17:07:22.367822] [DEBUG] [LOCAL ] AGRO: Saving primary data. [2025-10-15T17:07:22.369570] [DEBUG] [LOCAL ] AGRO: Trimmed 49105 records to 33087 (keeping 200 days of data) [2025-10-15T17:07:22.583102] [DEBUG] [LOCAL ] AGRO: Primary data saved (33087 records). [2025-10-15T17:07:22.583318] [INFO ] [MAIN ] AGRO: Full history saved. [2025-10-15T17:07:22.584347] [INFO ] [MAIN ] Update Progress: 59/2369 symbols completed. AGRO took 18.3s. Estimated remaining: 4h 45m 51s. Rate: 8.1 symbols/min [2025-10-15T17:07:22.783472] [INFO ] [MAIN ] AHT: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:07:22.818236] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-15T17:07:22.832620] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-04. [2025-10-15T17:07:22.847047] [DEBUG] [LOCAL ] AHT: Loaded 6353 existing records from primary storage. [2025-10-15T17:07:22.849816] [INFO ] [MAIN ] AHT: Loaded 6353 existing records. [2025-10-15T17:07:22.885985] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-15T17:07:22.953621] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-09. [2025-10-15T17:07:23.044503] [WARN ] [MAIN ] AHT: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:07:23.044750] [INFO ] [MAIN ] AHT: Wiping existing primary data before full refresh. [2025-10-15T17:07:23.044806] [INFO ] [LOCAL ] AHT: Starting deletion of primary data. [2025-10-15T17:07:23.045013] [DEBUG] [LOCAL ] AHT: Deleted primary data file. [2025-10-15T17:07:23.045070] [INFO ] [MAIN ] AHT: Starting full primary refresh. [2025-10-15T17:07:23.392174] [INFO ] [REMOTE ] AHT: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:07:23.392489] [INFO ] [REMOTE ] AHT: Fetching primary data for 2024-12. [2025-10-15T17:07:23.720597] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-15T17:07:23.731242] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-04. [2025-10-15T17:07:24.054429] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-10-15T17:07:24.057170] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-01. [2025-10-15T17:07:24.463750] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-15T17:07:24.470981] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-10. [2025-10-15T17:07:24.639964] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-15T17:07:24.641994] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-02. [2025-10-15T17:07:24.979914] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-15T17:07:24.990310] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-05. [2025-10-15T17:07:25.117810] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-04 (2.29 seconds). [2025-10-15T17:07:25.128049] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-05. [2025-10-15T17:07:25.378153] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-15T17:07:25.380238] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-03. [2025-10-15T17:07:25.820734] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-15T17:07:25.824356] [INFO ] [REMOTE ] AGX: Full fetch complete (48911 records). [2025-10-15T17:07:25.824456] [DEBUG] [VALIDATOR ] AGX: Validating primary data. [2025-10-15T17:07:25.945575] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-15T17:07:25.982322] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-04. [2025-10-15T17:07:26.229106] [DEBUG] [VALIDATOR ] AGX: All expected trading days are present. [2025-10-15T17:07:26.229212] [DEBUG] [VALIDATOR ] AGX: Primary data validation passed. [2025-10-15T17:07:26.229797] [INFO ] [MAIN ] AGX: Fetched primary data is valid. [2025-10-15T17:07:26.229860] [DEBUG] [LOCAL ] AGX: Saving primary data. [2025-10-15T17:07:26.231750] [DEBUG] [LOCAL ] AGX: Trimmed 48911 records to 32884 (keeping 200 days of data) [2025-10-15T17:07:26.452090] [DEBUG] [LOCAL ] AGX: Primary data saved (32884 records). [2025-10-15T17:07:26.452272] [INFO ] [MAIN ] AGX: Full history saved. [2025-10-15T17:07:26.452375] [INFO ] [MAIN ] Update Progress: 60/2369 symbols completed. AGX took 18.5s. Estimated remaining: 4h 43m 27s. Rate: 8.1 symbols/min [2025-10-15T17:07:26.632739] [INFO ] [MAIN ] AI: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:07:26.668410] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-15T17:07:26.669393] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-15T17:07:26.682283] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-05. [2025-10-15T17:07:26.683939] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-06. [2025-10-15T17:07:26.712551] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-15T17:07:26.722812] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-06. [2025-10-15T17:07:26.768842] [DEBUG] [LOCAL ] AI: Loaded 53764 existing records from primary storage. [2025-10-15T17:07:26.769165] [INFO ] [MAIN ] AI: Loaded 53764 existing records. [2025-10-15T17:07:26.941840] [WARN ] [MAIN ] AI: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:07:26.942079] [INFO ] [MAIN ] AI: Wiping existing primary data before full refresh. [2025-10-15T17:07:26.942128] [INFO ] [LOCAL ] AI: Starting deletion of primary data. [2025-10-15T17:07:26.942524] [DEBUG] [LOCAL ] AI: Deleted primary data file. [2025-10-15T17:07:26.942581] [INFO ] [MAIN ] AI: Starting full primary refresh. [2025-10-15T17:07:27.300466] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-15T17:07:27.306257] [INFO ] [REMOTE ] AI: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:07:27.308572] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-06. [2025-10-15T17:07:27.309731] [INFO ] [REMOTE ] AI: Fetching primary data for 2024-12. [2025-10-15T17:07:27.782302] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-10-15T17:07:27.784442] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-07. [2025-10-15T17:07:28.284606] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-15T17:07:28.294840] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-07. [2025-10-15T17:07:28.525570] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-15T17:07:28.914013] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-08. [2025-10-15T17:07:29.384748] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-06 (2.70 seconds). [2025-10-15T17:07:29.555552] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-15T17:07:29.713974] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-09. [2025-10-15T17:07:29.922178] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-15T17:07:30.145947] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-10-15T17:07:30.514058] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-08. [2025-10-15T17:07:30.843338] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2024-12 (3.53 seconds). [2025-10-15T17:07:31.314020] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-01. [2025-10-15T17:07:32.113974] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-07. [2025-10-15T17:07:32.913958] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-10. [2025-10-15T17:07:33.224794] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-08 (2.71 seconds). [2025-10-15T17:07:33.568103] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-15T17:07:33.569702] [INFO ] [REMOTE ] AHT: Full fetch complete (9163 records). [2025-10-15T17:07:33.569776] [DEBUG] [VALIDATOR ] AHT: Validating primary data. [2025-10-15T17:07:33.718310] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-09. [2025-10-15T17:07:33.943542] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-15T17:07:34.002380] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-01 (2.69 seconds). [2025-10-15T17:07:34.017125] [DEBUG] [VALIDATOR ] AHT: All expected trading days are present. [2025-10-15T17:07:34.017405] [DEBUG] [VALIDATOR ] AHT: Primary data validation passed. [2025-10-15T17:07:34.028674] [INFO ] [MAIN ] AHT: Fetched primary data is valid. [2025-10-15T17:07:34.029951] [DEBUG] [LOCAL ] AHT: Saving primary data. [2025-10-15T17:07:34.031514] [DEBUG] [LOCAL ] AHT: Trimmed 9163 records to 6362 (keeping 200 days of data) [2025-10-15T17:07:34.065757] [DEBUG] [LOCAL ] AHT: Primary data saved (6362 records). [2025-10-15T17:07:34.065843] [INFO ] [MAIN ] AHT: Full history saved. [2025-10-15T17:07:34.065924] [INFO ] [MAIN ] Update Progress: 61/2369 symbols completed. AHT took 11.5s. Estimated remaining: 4h 43m 29s. Rate: 8.1 symbols/min [2025-10-15T17:07:34.232265] [INFO ] [MAIN ] AIG: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:07:34.282694] [DEBUG] [LOCAL ] AIG: Loaded 53470 existing records from primary storage. [2025-10-15T17:07:34.283005] [INFO ] [MAIN ] AIG: Loaded 53470 existing records. [2025-10-15T17:07:34.462806] [WARN ] [MAIN ] AIG: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:07:34.463101] [INFO ] [MAIN ] AIG: Wiping existing primary data before full refresh. [2025-10-15T17:07:34.463154] [INFO ] [LOCAL ] AIG: Starting deletion of primary data. [2025-10-15T17:07:34.464021] [DEBUG] [LOCAL ] AIG: Deleted primary data file. [2025-10-15T17:07:34.464249] [INFO ] [MAIN ] AIG: Starting full primary refresh. [2025-10-15T17:07:34.526391] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-02. [2025-10-15T17:07:34.836995] [INFO ] [REMOTE ] AIG: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:07:35.112123] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-15T17:07:35.314056] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-10. [2025-10-15T17:07:36.114033] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-08. [2025-10-15T17:07:36.766786] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-15T17:07:36.771605] [INFO ] [REMOTE ] AHH: Full fetch complete (59748 records). [2025-10-15T17:07:36.771744] [DEBUG] [VALIDATOR ] AHH: Validating primary data. [2025-10-15T17:07:36.921956] [INFO ] [REMOTE ] AIG: Fetching primary data for 2024-12. [2025-10-15T17:07:37.171767] [DEBUG] [VALIDATOR ] AHH: All expected trading days are present. [2025-10-15T17:07:37.171848] [DEBUG] [VALIDATOR ] AHH: Primary data validation passed. [2025-10-15T17:07:37.172440] [INFO ] [MAIN ] AHH: Fetched primary data is valid. [2025-10-15T17:07:37.172481] [DEBUG] [LOCAL ] AHH: Saving primary data. [2025-10-15T17:07:37.173725] [DEBUG] [LOCAL ] AHH: Trimmed 59748 records to 40527 (keeping 200 days of data) [2025-10-15T17:07:37.404894] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-02 (2.88 seconds). [2025-10-15T17:07:37.441333] [DEBUG] [LOCAL ] AHH: Primary data saved (40527 records). [2025-10-15T17:07:37.441446] [INFO ] [MAIN ] AHH: Full history saved. [2025-10-15T17:07:37.441516] [INFO ] [MAIN ] Update Progress: 62/2369 symbols completed. AHH took 22.5s. Estimated remaining: 4h 40m 53s. Rate: 8.2 symbols/min [2025-10-15T17:07:37.615194] [INFO ] [MAIN ] AII: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:07:37.615472] [DEBUG] [LOCAL ] AII: No existing data file found in primary storage. [2025-10-15T17:07:37.615544] [WARN ] [MAIN ] AII: No existing data found, performing full refresh instead. [2025-10-15T17:07:37.615687] [INFO ] [MAIN ] AII: Wiping existing primary data before full refresh. [2025-10-15T17:07:37.615754] [INFO ] [LOCAL ] AII: Starting deletion of primary data. [2025-10-15T17:07:37.615807] [DEBUG] [LOCAL ] AII: No primary data file found to delete. [2025-10-15T17:07:37.615841] [INFO ] [MAIN ] AII: Starting full primary refresh. [2025-10-15T17:07:37.717175] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-03. [2025-10-15T17:07:38.014900] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-15T17:07:38.018551] [INFO ] [REMOTE ] AII: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:07:38.513965] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-09. [2025-10-15T17:07:38.955174] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2024-12 (2.03 seconds). [2025-10-15T17:07:39.314043] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-01. [2025-10-15T17:07:40.114011] [INFO ] [REMOTE ] AII: Fetching primary data for 2024-12. [2025-10-15T17:07:40.175316] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-15T17:07:40.180212] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-03 (2.46 seconds). [2025-10-15T17:07:40.358439] [DEBUG] [REMOTE ] AII: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-15T17:07:40.358788] [WARN ] [REMOTE ] AII: No data returned for month 2024-12 [2025-10-15T17:07:40.358874] [FATAL] [REMOTE ] AII: API call failed - aborting fetch to avoid wasting further API calls [2025-10-15T17:07:40.358920] [FATAL] [MAIN ] AII: Failed to fetch primary data. [2025-10-15T17:07:40.358979] [WARN ] [MAIN ] AII: Deleting existing primary and derivative data due to fetch failure. [2025-10-15T17:07:40.359049] [INFO ] [LOCAL ] AII: Starting deletion of primary data. [2025-10-15T17:07:40.359110] [DEBUG] [LOCAL ] AII: No primary data file found to delete. [2025-10-15T17:07:40.359146] [INFO ] [LOCAL ] AII: Starting deletion of derivative data. [2025-10-15T17:07:40.359184] [DEBUG] [LOCAL ] AII: No derivative data file found to delete. [2025-10-15T17:07:40.359228] [INFO ] [MAIN ] Update Progress: 63/2369 symbols completed. AII took 2.9s. Estimated remaining: 4h 38m 5s. Rate: 8.3 symbols/min [2025-10-15T17:07:40.522148] [INFO ] [MAIN ] AIN: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:07:40.545716] [DEBUG] [LOCAL ] AIN: Loaded 24467 existing records from primary storage. [2025-10-15T17:07:40.546023] [INFO ] [MAIN ] AIN: Loaded 24467 existing records. [2025-10-15T17:07:40.721014] [WARN ] [MAIN ] AIN: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:07:40.721201] [INFO ] [MAIN ] AIN: Wiping existing primary data before full refresh. [2025-10-15T17:07:40.721270] [INFO ] [LOCAL ] AIN: Starting deletion of primary data. [2025-10-15T17:07:40.721553] [DEBUG] [LOCAL ] AIN: Deleted primary data file. [2025-10-15T17:07:40.721611] [INFO ] [MAIN ] AIN: Starting full primary refresh. [2025-10-15T17:07:40.919116] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-04. [2025-10-15T17:07:41.083898] [INFO ] [REMOTE ] AIN: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:07:41.113170] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-15T17:07:41.714029] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-02. [2025-10-15T17:07:42.514001] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-10. [2025-10-15T17:07:43.316880] [INFO ] [REMOTE ] AIN: Fetching primary data for 2024-12. [2025-10-15T17:07:43.322340] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-15T17:07:44.084463] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-04 (3.17 seconds). [2025-10-15T17:07:44.113962] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-05. [2025-10-15T17:07:44.222047] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-15T17:07:44.227823] [INFO ] [REMOTE ] AHR: Full fetch complete (70822 records). [2025-10-15T17:07:44.227936] [DEBUG] [VALIDATOR ] AHR: Validating primary data. [2025-10-15T17:07:44.607701] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-15T17:07:44.634242] [DEBUG] [VALIDATOR ] AHR: All expected trading days are present. [2025-10-15T17:07:44.634297] [DEBUG] [VALIDATOR ] AHR: Primary data validation passed. [2025-10-15T17:07:44.634977] [INFO ] [MAIN ] AHR: Fetched primary data is valid. [2025-10-15T17:07:44.635038] [DEBUG] [LOCAL ] AHR: Saving primary data. [2025-10-15T17:07:44.636250] [DEBUG] [LOCAL ] AHR: Trimmed 70822 records to 49077 (keeping 200 days of data) [2025-10-15T17:07:44.918595] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-03. [2025-10-15T17:07:44.936556] [DEBUG] [LOCAL ] AHR: Primary data saved (49077 records). [2025-10-15T17:07:44.936733] [INFO ] [MAIN ] AHR: Full history saved. [2025-10-15T17:07:44.936847] [INFO ] [MAIN ] Update Progress: 64/2369 symbols completed. AHR took 28.5s. Estimated remaining: 4h 36m 22s. Rate: 8.3 symbols/min [2025-10-15T17:07:45.108187] [INFO ] [MAIN ] AIO: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:07:45.122813] [DEBUG] [LOCAL ] AIO: Loaded 13374 existing records from primary storage. [2025-10-15T17:07:45.123029] [INFO ] [MAIN ] AIO: Loaded 13374 existing records. [2025-10-15T17:07:45.306025] [WARN ] [MAIN ] AIO: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:07:45.306304] [INFO ] [MAIN ] AIO: Wiping existing primary data before full refresh. [2025-10-15T17:07:45.306369] [INFO ] [LOCAL ] AIO: Starting deletion of primary data. [2025-10-15T17:07:45.306737] [DEBUG] [LOCAL ] AIO: Deleted primary data file. [2025-10-15T17:07:45.306804] [INFO ] [MAIN ] AIO: Starting full primary refresh. [2025-10-15T17:07:45.657352] [INFO ] [REMOTE ] AIO: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:07:45.713959] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-01. [2025-10-15T17:07:46.514022] [INFO ] [REMOTE ] AIO: Fetching primary data for 2024-12. [2025-10-15T17:07:46.646211] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-15T17:07:47.313985] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-04. [2025-10-15T17:07:47.514381] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-10-15T17:07:48.114009] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-01. [2025-10-15T17:07:48.472908] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-05 (4.36 seconds). [2025-10-15T17:07:48.913976] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-06. [2025-10-15T17:07:48.969958] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-01 (3.26 seconds). [2025-10-15T17:07:48.985629] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-15T17:07:49.713997] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-02. [2025-10-15T17:07:49.860290] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-04 (2.55 seconds). [2025-10-15T17:07:50.513983] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-02. [2025-10-15T17:07:50.551065] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-15T17:07:51.313984] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-05. [2025-10-15T17:07:51.477454] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-15T17:07:52.114045] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-03. [2025-10-15T17:07:52.476512] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-06 (3.56 seconds). [2025-10-15T17:07:52.845195] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-15T17:07:52.914014] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-07. [2025-10-15T17:07:53.353553] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-15T17:07:53.714064] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-03. [2025-10-15T17:07:54.514004] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-06. [2025-10-15T17:07:54.700896] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-15T17:07:55.313989] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-04. [2025-10-15T17:07:55.462957] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-07 (2.55 seconds). [2025-10-15T17:07:56.113997] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-08. [2025-10-15T17:07:56.914000] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-04. [2025-10-15T17:07:57.650902] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-06 (3.14 seconds). [2025-10-15T17:07:57.713960] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-07. [2025-10-15T17:07:58.015476] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-04 (2.70 seconds). [2025-10-15T17:07:58.124234] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-15T17:07:58.474828] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-08 (2.36 seconds). [2025-10-15T17:07:58.513966] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-05. [2025-10-15T17:07:59.313985] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-09. [2025-10-15T17:07:59.374963] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-15T17:08:00.114067] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-06. [2025-10-15T17:08:00.262389] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-07 (2.55 seconds). [2025-10-15T17:08:00.914086] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-05. [2025-10-15T17:08:01.309712] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-15T17:08:01.714023] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-07. [2025-10-15T17:08:02.245984] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-09 (2.93 seconds). [2025-10-15T17:08:02.502247] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-15T17:08:02.513945] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-06. [2025-10-15T17:08:02.629445] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-15T17:08:03.314568] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-15T17:08:03.314024] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-10. [2025-10-15T17:08:04.113993] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-08. [2025-10-15T17:08:04.914022] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-07. [2025-10-15T17:08:05.671511] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-10 (2.36 seconds). [2025-10-15T17:08:05.678062] [INFO ] [REMOTE ] AI: Full fetch complete (77915 records). [2025-10-15T17:08:05.678215] [DEBUG] [VALIDATOR ] AI: Validating primary data. [2025-10-15T17:08:05.721561] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-08. [2025-10-15T17:08:06.090394] [DEBUG] [VALIDATOR ] AI: All expected trading days are present. [2025-10-15T17:08:06.090590] [DEBUG] [VALIDATOR ] AI: Primary data validation passed. [2025-10-15T17:08:06.091410] [INFO ] [MAIN ] AI: Fetched primary data is valid. [2025-10-15T17:08:06.091565] [DEBUG] [LOCAL ] AI: Saving primary data. [2025-10-15T17:08:06.093261] [DEBUG] [LOCAL ] AI: Trimmed 77915 records to 53765 (keeping 200 days of data) [2025-10-15T17:08:06.238795] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-08 (2.12 seconds). [2025-10-15T17:08:06.451907] [DEBUG] [LOCAL ] AI: Primary data saved (53765 records). [2025-10-15T17:08:06.452051] [INFO ] [MAIN ] AI: Full history saved. [2025-10-15T17:08:06.452143] [INFO ] [MAIN ] Update Progress: 65/2369 symbols completed. AI took 40.0s. Estimated remaining: 4h 44m 42s. Rate: 8.1 symbols/min [2025-10-15T17:08:06.516982] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-09. [2025-10-15T17:08:06.618849] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-15T17:08:06.649614] [INFO ] [MAIN ] AIR: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:08:06.673920] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-15T17:08:06.706092] [DEBUG] [LOCAL ] AIR: Loaded 29018 existing records from primary storage. [2025-10-15T17:08:06.706379] [INFO ] [MAIN ] AIR: Loaded 29018 existing records. [2025-10-15T17:08:06.902174] [WARN ] [MAIN ] AIR: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:08:06.902407] [INFO ] [MAIN ] AIR: Wiping existing primary data before full refresh. [2025-10-15T17:08:06.902453] [INFO ] [LOCAL ] AIR: Starting deletion of primary data. [2025-10-15T17:08:06.902842] [DEBUG] [LOCAL ] AIR: Deleted primary data file. [2025-10-15T17:08:06.902901] [INFO ] [MAIN ] AIR: Starting full primary refresh. [2025-10-15T17:08:07.264144] [INFO ] [REMOTE ] AIR: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:08:07.313983] [INFO ] [REMOTE ] AIR: Fetching primary data for 2024-12. [2025-10-15T17:08:08.123890] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-10-15T17:08:08.114263] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-08. [2025-10-15T17:08:08.805849] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-09 (2.29 seconds). [2025-10-15T17:08:08.913996] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-10. [2025-10-15T17:08:09.400618] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-15T17:08:09.714071] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-01. [2025-10-15T17:08:09.774588] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-15T17:08:09.786449] [INFO ] [REMOTE ] AIG: Full fetch complete (77559 records). [2025-10-15T17:08:09.786589] [DEBUG] [VALIDATOR ] AIG: Validating primary data. [2025-10-15T17:08:10.179236] [DEBUG] [VALIDATOR ] AIG: All expected trading days are present. [2025-10-15T17:08:10.179315] [DEBUG] [VALIDATOR ] AIG: Primary data validation passed. [2025-10-15T17:08:10.180057] [INFO ] [MAIN ] AIG: Fetched primary data is valid. [2025-10-15T17:08:10.180119] [DEBUG] [LOCAL ] AIG: Saving primary data. [2025-10-15T17:08:10.181504] [DEBUG] [LOCAL ] AIG: Trimmed 77559 records to 53470 (keeping 200 days of data) [2025-10-15T17:08:10.510994] [DEBUG] [LOCAL ] AIG: Primary data saved (53470 records). [2025-10-15T17:08:10.511141] [INFO ] [MAIN ] AIG: Full history saved. [2025-10-15T17:08:10.511898] [INFO ] [MAIN ] Update Progress: 66/2369 symbols completed. AIG took 36.4s. Estimated remaining: 4h 42m 38s. Rate: 8.1 symbols/min [2025-10-15T17:08:10.523104] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-09. [2025-10-15T17:08:10.683230] [INFO ] [MAIN ] AIT: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:08:10.711246] [DEBUG] [LOCAL ] AIT: Loaded 26970 existing records from primary storage. [2025-10-15T17:08:10.711508] [INFO ] [MAIN ] AIT: Loaded 26970 existing records. [2025-10-15T17:08:10.890888] [WARN ] [MAIN ] AIT: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:08:10.891115] [INFO ] [MAIN ] AIT: Wiping existing primary data before full refresh. [2025-10-15T17:08:10.891300] [INFO ] [LOCAL ] AIT: Starting deletion of primary data. [2025-10-15T17:08:10.891717] [DEBUG] [LOCAL ] AIT: Deleted primary data file. [2025-10-15T17:08:10.891818] [INFO ] [MAIN ] AIT: Starting full primary refresh. [2025-10-15T17:08:11.217033] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-15T17:08:11.284823] [INFO ] [REMOTE ] AIT: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:08:11.313959] [INFO ] [REMOTE ] AIT: Fetching primary data for 2024-12. [2025-10-15T17:08:11.565461] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-15T17:08:12.114076] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-09. [2025-10-15T17:08:12.610840] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-15T17:08:12.913968] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-01. [2025-10-15T17:08:13.155541] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-15T17:08:13.713995] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-02. [2025-10-15T17:08:14.257548] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-15T17:08:14.451578] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-15T17:08:14.514019] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-03. [2025-10-15T17:08:15.313999] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-10. [2025-10-15T17:08:15.772167] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-15T17:08:16.053575] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-15T17:08:16.055811] [INFO ] [REMOTE ] AIO: Full fetch complete (20163 records). [2025-10-15T17:08:16.055909] [DEBUG] [VALIDATOR ] AIO: Validating primary data. [2025-10-15T17:08:16.119128] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-02. [2025-10-15T17:08:16.424192] [DEBUG] [VALIDATOR ] AIO: All expected trading days are present. [2025-10-15T17:08:16.424274] [DEBUG] [VALIDATOR ] AIO: Primary data validation passed. [2025-10-15T17:08:16.424575] [INFO ] [MAIN ] AIO: Fetched primary data is valid. [2025-10-15T17:08:16.424616] [DEBUG] [LOCAL ] AIO: Saving primary data. [2025-10-15T17:08:16.425242] [DEBUG] [LOCAL ] AIO: Trimmed 20163 records to 13371 (keeping 200 days of data) [2025-10-15T17:08:16.504866] [DEBUG] [LOCAL ] AIO: Primary data saved (13371 records). [2025-10-15T17:08:16.505016] [INFO ] [MAIN ] AIO: Full history saved. [2025-10-15T17:08:16.505134] [INFO ] [MAIN ] Update Progress: 67/2369 symbols completed. AIO took 31.6s. Estimated remaining: 4h 41m 44s. Rate: 8.2 symbols/min [2025-10-15T17:08:16.672746] [INFO ] [MAIN ] AIV: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:08:16.707337] [DEBUG] [LOCAL ] AIV: Loaded 41269 existing records from primary storage. [2025-10-15T17:08:16.707700] [INFO ] [MAIN ] AIV: Loaded 41269 existing records. [2025-10-15T17:08:16.881786] [WARN ] [MAIN ] AIV: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:08:16.882016] [INFO ] [MAIN ] AIV: Wiping existing primary data before full refresh. [2025-10-15T17:08:16.882063] [INFO ] [LOCAL ] AIV: Starting deletion of primary data. [2025-10-15T17:08:16.882748] [DEBUG] [LOCAL ] AIV: Deleted primary data file. [2025-10-15T17:08:16.882806] [INFO ] [MAIN ] AIV: Starting full primary refresh. [2025-10-15T17:08:16.919166] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-04. [2025-10-15T17:08:17.260495] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-15T17:08:17.290071] [INFO ] [REMOTE ] AIV: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:08:17.713997] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-03. [2025-10-15T17:08:18.219534] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-15T17:08:18.514036] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-05. [2025-10-15T17:08:18.929946] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-15T17:08:19.314030] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-10. [2025-10-15T17:08:19.603111] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-15T17:08:20.113999] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-06. [2025-10-15T17:08:20.262331] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-15T17:08:20.266316] [INFO ] [REMOTE ] AIN: Full fetch complete (33546 records). [2025-10-15T17:08:20.266425] [DEBUG] [VALIDATOR ] AIN: Validating primary data. [2025-10-15T17:08:20.631897] [DEBUG] [VALIDATOR ] AIN: All expected trading days are present. [2025-10-15T17:08:20.631974] [DEBUG] [VALIDATOR ] AIN: Primary data validation passed. [2025-10-15T17:08:20.632366] [INFO ] [MAIN ] AIN: Fetched primary data is valid. [2025-10-15T17:08:20.632407] [DEBUG] [LOCAL ] AIN: Saving primary data. [2025-10-15T17:08:20.633196] [DEBUG] [LOCAL ] AIN: Trimmed 33546 records to 24434 (keeping 200 days of data) [2025-10-15T17:08:20.781254] [DEBUG] [LOCAL ] AIN: Primary data saved (24434 records). [2025-10-15T17:08:20.781397] [INFO ] [MAIN ] AIN: Full history saved. [2025-10-15T17:08:20.781484] [INFO ] [MAIN ] Update Progress: 68/2369 symbols completed. AIN took 40.4s. Estimated remaining: 4h 39m 52s. Rate: 8.2 symbols/min [2025-10-15T17:08:20.926234] [INFO ] [REMOTE ] AIV: Fetching primary data for 2024-12. [2025-10-15T17:08:20.960383] [INFO ] [MAIN ] AIZ: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:08:20.992422] [DEBUG] [LOCAL ] AIZ: Loaded 29563 existing records from primary storage. [2025-10-15T17:08:20.992800] [INFO ] [MAIN ] AIZ: Loaded 29563 existing records. [2025-10-15T17:08:21.111582] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-15T17:08:21.199548] [WARN ] [MAIN ] AIZ: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:08:21.199840] [INFO ] [MAIN ] AIZ: Wiping existing primary data before full refresh. [2025-10-15T17:08:21.199895] [INFO ] [LOCAL ] AIZ: Starting deletion of primary data. [2025-10-15T17:08:21.200271] [DEBUG] [LOCAL ] AIZ: Deleted primary data file. [2025-10-15T17:08:21.200329] [INFO ] [MAIN ] AIZ: Starting full primary refresh. [2025-10-15T17:08:21.552235] [INFO ] [REMOTE ] AIZ: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:08:21.714000] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-04. [2025-10-15T17:08:22.083802] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-15T17:08:22.514005] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-07. [2025-10-15T17:08:23.290279] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-15T17:08:23.314038] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2024-12. [2025-10-15T17:08:23.817242] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-15T17:08:24.114078] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-01. [2025-10-15T17:08:24.475023] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-15T17:08:24.913970] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-08. [2025-10-15T17:08:25.634398] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-15T17:08:25.714003] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-02. [2025-10-15T17:08:26.153313] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-15T17:08:26.514000] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-09. [2025-10-15T17:08:26.991397] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-15T17:08:27.314004] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-05. [2025-10-15T17:08:27.936002] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-15T17:08:28.114036] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-01. [2025-10-15T17:08:28.630008] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-15T17:08:28.913965] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-10. [2025-10-15T17:08:29.461437] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-15T17:08:29.713987] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-02. [2025-10-15T17:08:30.370802] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-15T17:08:30.375631] [INFO ] [REMOTE ] AIR: Full fetch complete (40163 records). [2025-10-15T17:08:30.375794] [DEBUG] [VALIDATOR ] AIR: Validating primary data. [2025-10-15T17:08:30.523191] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-06. [2025-10-15T17:08:30.745550] [DEBUG] [VALIDATOR ] AIR: All expected trading days are present. [2025-10-15T17:08:30.745624] [DEBUG] [VALIDATOR ] AIR: Primary data validation passed. [2025-10-15T17:08:30.746102] [INFO ] [MAIN ] AIR: Fetched primary data is valid. [2025-10-15T17:08:30.746154] [DEBUG] [LOCAL ] AIR: Saving primary data. [2025-10-15T17:08:30.747036] [DEBUG] [LOCAL ] AIR: Trimmed 40163 records to 28874 (keeping 200 days of data) [2025-10-15T17:08:30.922392] [DEBUG] [LOCAL ] AIR: Primary data saved (28874 records). [2025-10-15T17:08:30.922638] [INFO ] [MAIN ] AIR: Full history saved. [2025-10-15T17:08:30.922794] [INFO ] [MAIN ] Update Progress: 69/2369 symbols completed. AIR took 24.5s. Estimated remaining: 4h 41m 20s. Rate: 8.2 symbols/min [2025-10-15T17:08:31.102056] [INFO ] [MAIN ] AIZN: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:08:31.120761] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-15T17:08:31.131840] [DEBUG] [LOCAL ] AIZN: Loaded 4043 existing records from primary storage. [2025-10-15T17:08:31.132051] [INFO ] [MAIN ] AIZN: Loaded 4043 existing records. [2025-10-15T17:08:31.325482] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-03. [2025-10-15T17:08:31.331559] [WARN ] [MAIN ] AIZN: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:08:31.333249] [INFO ] [MAIN ] AIZN: Wiping existing primary data before full refresh. [2025-10-15T17:08:31.333324] [INFO ] [LOCAL ] AIZN: Starting deletion of primary data. [2025-10-15T17:08:31.333499] [DEBUG] [LOCAL ] AIZN: Deleted primary data file. [2025-10-15T17:08:31.333559] [INFO ] [MAIN ] AIZN: Starting full primary refresh. [2025-10-15T17:08:31.735261] [INFO ] [REMOTE ] AIZN: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:08:31.737543] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-15T17:08:32.114038] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-03. [2025-10-15T17:08:32.859980] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-15T17:08:32.913993] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-04. [2025-10-15T17:08:33.678388] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-15T17:08:33.713964] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-04. [2025-10-15T17:08:34.261970] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-15T17:08:34.514058] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-07. [2025-10-15T17:08:35.201542] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-15T17:08:35.313959] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-05. [2025-10-15T17:08:35.825457] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-15T17:08:36.114034] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2024-12. [2025-10-15T17:08:36.288871] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-15T17:08:36.745415] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-10-15T17:08:36.914034] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-01. [2025-10-15T17:08:37.587966] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-15T17:08:37.713982] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-06. [2025-10-15T17:08:38.514011] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-05. [2025-10-15T17:08:39.129703] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-15T17:08:39.313998] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-08. [2025-10-15T17:08:40.052260] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-15T17:08:40.113965] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-06. [2025-10-15T17:08:40.395242] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-15T17:08:40.914010] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-02. [2025-10-15T17:08:41.292861] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-15T17:08:41.388709] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-15T17:08:41.714016] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-07. [2025-10-15T17:08:42.514008] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-09. [2025-10-15T17:08:43.023059] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-15T17:08:43.186531] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-15T17:08:43.313972] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-10. [2025-10-15T17:08:44.113971] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-03. [2025-10-15T17:08:44.195597] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-15T17:08:44.199678] [INFO ] [REMOTE ] AIT: Full fetch complete (39187 records). [2025-10-15T17:08:44.199788] [DEBUG] [VALIDATOR ] AIT: Validating primary data. [2025-10-15T17:08:44.587760] [DEBUG] [VALIDATOR ] AIT: All expected trading days are present. [2025-10-15T17:08:44.587873] [DEBUG] [VALIDATOR ] AIT: Primary data validation passed. [2025-10-15T17:08:44.588388] [INFO ] [MAIN ] AIT: Fetched primary data is valid. [2025-10-15T17:08:44.588434] [DEBUG] [LOCAL ] AIT: Saving primary data. [2025-10-15T17:08:44.589507] [DEBUG] [LOCAL ] AIT: Trimmed 39187 records to 26971 (keeping 200 days of data) [2025-10-15T17:08:44.684627] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-15T17:08:44.763806] [DEBUG] [LOCAL ] AIT: Primary data saved (26971 records). [2025-10-15T17:08:44.763956] [INFO ] [MAIN ] AIT: Full history saved. [2025-10-15T17:08:44.764037] [INFO ] [MAIN ] Update Progress: 70/2369 symbols completed. AIT took 34.3s. Estimated remaining: 4h 44m 46s. Rate: 8.1 symbols/min [2025-10-15T17:08:44.927539] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-08. [2025-10-15T17:08:44.931087] [INFO ] [MAIN ] AJG: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:08:44.977558] [DEBUG] [LOCAL ] AJG: Loaded 46548 existing records from primary storage. [2025-10-15T17:08:44.977928] [INFO ] [MAIN ] AJG: Loaded 46548 existing records. [2025-10-15T17:08:45.150036] [WARN ] [MAIN ] AJG: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:08:45.150279] [INFO ] [MAIN ] AJG: Wiping existing primary data before full refresh. [2025-10-15T17:08:45.150345] [INFO ] [LOCAL ] AJG: Starting deletion of primary data. [2025-10-15T17:08:45.150745] [DEBUG] [LOCAL ] AJG: Deleted primary data file. [2025-10-15T17:08:45.150830] [INFO ] [MAIN ] AJG: Starting full primary refresh. [2025-10-15T17:08:45.503463] [INFO ] [REMOTE ] AJG: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:08:45.714004] [INFO ] [REMOTE ] AJG: Fetching primary data for 2024-12. [2025-10-15T17:08:46.224844] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-15T17:08:46.513988] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-04. [2025-10-15T17:08:47.068792] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-10-15T17:08:47.314016] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-05. [2025-10-15T17:08:47.742075] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-10-15T17:08:47.879490] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2024-12 (2.17 seconds). [2025-10-15T17:08:48.114014] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-06. [2025-10-15T17:08:48.684798] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-15T17:08:48.914068] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-07. [2025-10-15T17:08:49.714013] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-01. [2025-10-15T17:08:50.445323] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-15T17:08:50.513982] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-08. [2025-10-15T17:08:51.314064] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-07. [2025-10-15T17:08:51.550544] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-15T17:08:51.806714] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-10-15T17:08:52.022967] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-15T17:08:52.113970] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-02. [2025-10-15T17:08:52.914003] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-09. [2025-10-15T17:08:53.713967] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-09. [2025-10-15T17:08:53.793742] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-15T17:08:54.160360] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-15T17:08:54.513998] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-10. [2025-10-15T17:08:55.314043] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-03. [2025-10-15T17:08:55.355441] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-15T17:08:55.594934] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-15T17:08:55.598160] [INFO ] [REMOTE ] AIZ: Full fetch complete (42813 records). [2025-10-15T17:08:55.598253] [DEBUG] [VALIDATOR ] AIZ: Validating primary data. [2025-10-15T17:08:55.970825] [DEBUG] [VALIDATOR ] AIZ: All expected trading days are present. [2025-10-15T17:08:55.970925] [DEBUG] [VALIDATOR ] AIZ: Primary data validation passed. [2025-10-15T17:08:55.971427] [INFO ] [MAIN ] AIZ: Fetched primary data is valid. [2025-10-15T17:08:55.971511] [DEBUG] [LOCAL ] AIZ: Saving primary data. [2025-10-15T17:08:55.972414] [DEBUG] [LOCAL ] AIZ: Trimmed 42813 records to 29532 (keeping 200 days of data) [2025-10-15T17:08:56.118072] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-08. [2025-10-15T17:08:56.152481] [DEBUG] [LOCAL ] AIZ: Primary data saved (29532 records). [2025-10-15T17:08:56.152578] [INFO ] [MAIN ] AIZ: Full history saved. [2025-10-15T17:08:56.152679] [INFO ] [MAIN ] Update Progress: 71/2369 symbols completed. AIZ took 35.4s. Estimated remaining: 4h 46m 47s. Rate: 8.0 symbols/min [2025-10-15T17:08:56.317467] [INFO ] [MAIN ] AKA: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:08:56.317669] [DEBUG] [LOCAL ] AKA: No existing data file found in primary storage. [2025-10-15T17:08:56.317725] [WARN ] [MAIN ] AKA: No existing data found, performing full refresh instead. [2025-10-15T17:08:56.317832] [INFO ] [MAIN ] AKA: Wiping existing primary data before full refresh. [2025-10-15T17:08:56.317884] [INFO ] [LOCAL ] AKA: Starting deletion of primary data. [2025-10-15T17:08:56.317950] [DEBUG] [LOCAL ] AKA: No primary data file found to delete. [2025-10-15T17:08:56.317984] [INFO ] [MAIN ] AKA: Starting full primary refresh. [2025-10-15T17:08:56.662264] [INFO ] [REMOTE ] AKA: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:08:56.756569] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-15T17:08:56.913968] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-10. [2025-10-15T17:08:57.180064] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-15T17:08:57.714001] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-04. [2025-10-15T17:08:58.347536] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-15T17:08:58.353149] [INFO ] [REMOTE ] AIV: Full fetch complete (60270 records). [2025-10-15T17:08:58.353268] [DEBUG] [VALIDATOR ] AIV: Validating primary data. [2025-10-15T17:08:58.524844] [INFO ] [REMOTE ] AKA: Fetching primary data for 2024-12. [2025-10-15T17:08:58.740071] [DEBUG] [VALIDATOR ] AIV: All expected trading days are present. [2025-10-15T17:08:58.740177] [DEBUG] [VALIDATOR ] AIV: Primary data validation passed. [2025-10-15T17:08:58.740831] [INFO ] [MAIN ] AIV: Fetched primary data is valid. [2025-10-15T17:08:58.740893] [DEBUG] [LOCAL ] AIV: Saving primary data. [2025-10-15T17:08:58.742256] [DEBUG] [LOCAL ] AIV: Trimmed 60270 records to 41436 (keeping 200 days of data) [2025-10-15T17:08:58.970238] [DEBUG] [LOCAL ] AIV: Primary data saved (41436 records). [2025-10-15T17:08:58.970355] [INFO ] [MAIN ] AIV: Full history saved. [2025-10-15T17:08:58.970433] [INFO ] [MAIN ] Update Progress: 72/2369 symbols completed. AIV took 42.5s. Estimated remaining: 4h 44m 10s. Rate: 8.1 symbols/min [2025-10-15T17:08:59.146538] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-10-15T17:08:59.176013] [INFO ] [MAIN ] AKR: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:08:59.227252] [DEBUG] [LOCAL ] AKR: Loaded 46079 existing records from primary storage. [2025-10-15T17:08:59.227788] [INFO ] [MAIN ] AKR: Loaded 46079 existing records. [2025-10-15T17:08:59.321361] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-09. [2025-10-15T17:08:59.418265] [WARN ] [MAIN ] AKR: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:08:59.418562] [INFO ] [MAIN ] AKR: Wiping existing primary data before full refresh. [2025-10-15T17:08:59.418615] [INFO ] [LOCAL ] AKR: Starting deletion of primary data. [2025-10-15T17:08:59.419029] [DEBUG] [LOCAL ] AKR: Deleted primary data file. [2025-10-15T17:08:59.419083] [INFO ] [MAIN ] AKR: Starting full primary refresh. [2025-10-15T17:08:59.806456] [INFO ] [REMOTE ] AKR: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:08:59.838497] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-10-15T17:08:59.994972] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-15T17:09:00.114058] [INFO ] [REMOTE ] AKR: Fetching primary data for 2024-12. [2025-10-15T17:09:00.914005] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-01. [2025-10-15T17:09:01.307274] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-01 (0.39 seconds). [2025-10-15T17:09:01.714141] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-10. [2025-10-15T17:09:01.956149] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-15T17:09:02.316424] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-15T17:09:02.317860] [INFO ] [REMOTE ] AIZN: Full fetch complete (5903 records). [2025-10-15T17:09:02.317933] [DEBUG] [VALIDATOR ] AIZN: Validating primary data. [2025-10-15T17:09:02.523954] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-02. [2025-10-15T17:09:02.713200] [DEBUG] [VALIDATOR ] AIZN: All expected trading days are present. [2025-10-15T17:09:02.713303] [DEBUG] [VALIDATOR ] AIZN: Primary data validation passed. [2025-10-15T17:09:02.713575] [INFO ] [MAIN ] AIZN: Fetched primary data is valid. [2025-10-15T17:09:02.713719] [DEBUG] [LOCAL ] AIZN: Saving primary data. [2025-10-15T17:09:02.714329] [DEBUG] [LOCAL ] AIZN: Trimmed 5903 records to 3961 (keeping 200 days of data) [2025-10-15T17:09:02.741677] [DEBUG] [LOCAL ] AIZN: Primary data saved (3961 records). [2025-10-15T17:09:02.741875] [INFO ] [MAIN ] AIZN: Full history saved. [2025-10-15T17:09:02.741985] [INFO ] [MAIN ] Update Progress: 73/2369 symbols completed. AIZN took 31.8s. Estimated remaining: 4h 42m 8s. Rate: 8.1 symbols/min [2025-10-15T17:09:02.926603] [INFO ] [MAIN ] AL: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:09:02.979998] [DEBUG] [LOCAL ] AL: Loaded 44659 existing records from primary storage. [2025-10-15T17:09:02.980438] [INFO ] [MAIN ] AL: Loaded 44659 existing records. [2025-10-15T17:09:03.095627] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-15T17:09:03.178751] [WARN ] [MAIN ] AL: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:09:03.179024] [INFO ] [MAIN ] AL: Wiping existing primary data before full refresh. [2025-10-15T17:09:03.179076] [INFO ] [LOCAL ] AL: Starting deletion of primary data. [2025-10-15T17:09:03.179430] [DEBUG] [LOCAL ] AL: Deleted primary data file. [2025-10-15T17:09:03.179472] [INFO ] [MAIN ] AL: Starting full primary refresh. [2025-10-15T17:09:03.319170] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-03. [2025-10-15T17:09:03.563034] [INFO ] [REMOTE ] AL: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:09:03.788730] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-10-15T17:09:04.114021] [INFO ] [REMOTE ] AL: Fetching primary data for 2024-12. [2025-10-15T17:09:04.914014] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-01. [2025-10-15T17:09:05.585436] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-15T17:09:05.714023] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-01. [2025-10-15T17:09:06.379270] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-15T17:09:06.514010] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-02. [2025-10-15T17:09:06.822035] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-15T17:09:07.314003] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-02. [2025-10-15T17:09:07.979742] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-15T17:09:08.114064] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-03. [2025-10-15T17:09:08.752555] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-15T17:09:08.914004] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-04. [2025-10-15T17:09:09.445130] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-10-15T17:09:09.719109] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-03. [2025-10-15T17:09:09.733803] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-15T17:09:10.514007] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-05. [2025-10-15T17:09:11.313970] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-04. [2025-10-15T17:09:11.352270] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-15T17:09:12.113992] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-05. [2025-10-15T17:09:12.330755] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-15T17:09:12.659372] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-10-15T17:09:12.913981] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-06. [2025-10-15T17:09:13.126457] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-15T17:09:13.329065] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-10-15T17:09:13.714013] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-04. [2025-10-15T17:09:14.514001] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-05. [2025-10-15T17:09:15.314000] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-06. [2025-10-15T17:09:15.353179] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-15T17:09:15.952334] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-15T17:09:16.114053] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-05. [2025-10-15T17:09:16.922414] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-07. [2025-10-15T17:09:16.931040] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-15T17:09:17.197451] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-07 (0.28 seconds). [2025-10-15T17:09:17.713987] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-08. [2025-10-15T17:09:17.832400] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-15T17:09:17.964042] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-08 (0.25 seconds). [2025-10-15T17:09:18.514014] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-06. [2025-10-15T17:09:19.313989] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-06. [2025-10-15T17:09:19.829812] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-15T17:09:20.113999] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-07. [2025-10-15T17:09:20.672216] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-15T17:09:20.913996] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-09. [2025-10-15T17:09:21.459494] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-15T17:09:21.473566] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-10-15T17:09:21.714029] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-07. [2025-10-15T17:09:22.514008] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-08. [2025-10-15T17:09:23.313978] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-07. [2025-10-15T17:09:23.466008] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-15T17:09:23.856739] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-15T17:09:24.114021] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-08. [2025-10-15T17:09:24.913980] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-09. [2025-10-15T17:09:25.016380] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-15T17:09:25.712092] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-15T17:09:25.721019] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-08. [2025-10-15T17:09:26.504849] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-15T17:09:26.519017] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-09. [2025-10-15T17:09:27.293561] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-15T17:09:27.313959] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-09. [2025-10-15T17:09:28.114010] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-10. [2025-10-15T17:09:28.181606] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-15T17:09:28.657697] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-15T17:09:28.658726] [INFO ] [REMOTE ] AKA: Full fetch complete (2606 records). [2025-10-15T17:09:28.658798] [DEBUG] [VALIDATOR ] AKA: Validating primary data. [2025-10-15T17:09:28.841023] [WARN ] [VALIDATOR ] AKA: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-15T17:09:28.841250] [FATAL] [MAIN ] AKA: Fetched primary data is invalid. Refusing to save it. [2025-10-15T17:09:28.841365] [WARN ] [MAIN ] AKA: Deleting existing primary and derivative data due to validation failure. [2025-10-15T17:09:28.841583] [INFO ] [LOCAL ] AKA: Starting deletion of primary data. [2025-10-15T17:09:28.841755] [DEBUG] [LOCAL ] AKA: No primary data file found to delete. [2025-10-15T17:09:28.841886] [INFO ] [LOCAL ] AKA: Starting deletion of derivative data. [2025-10-15T17:09:28.841953] [DEBUG] [LOCAL ] AKA: No derivative data file found to delete. [2025-10-15T17:09:28.842020] [INFO ] [MAIN ] Update Progress: 74/2369 symbols completed. AKA took 32.7s. Estimated remaining: 4h 51m 41s. Rate: 7.9 symbols/min [2025-10-15T17:09:28.918432] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-10. [2025-10-15T17:09:29.018700] [INFO ] [MAIN ] ALB: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:09:29.046366] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-15T17:09:29.103010] [DEBUG] [LOCAL ] ALB: Loaded 53335 existing records from primary storage. [2025-10-15T17:09:29.103312] [INFO ] [MAIN ] ALB: Loaded 53335 existing records. [2025-10-15T17:09:29.276432] [WARN ] [MAIN ] ALB: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:09:29.276692] [INFO ] [MAIN ] ALB: Wiping existing primary data before full refresh. [2025-10-15T17:09:29.276751] [INFO ] [LOCAL ] ALB: Starting deletion of primary data. [2025-10-15T17:09:29.277208] [DEBUG] [LOCAL ] ALB: Deleted primary data file. [2025-10-15T17:09:29.277265] [INFO ] [MAIN ] ALB: Starting full primary refresh. [2025-10-15T17:09:29.626407] [INFO ] [REMOTE ] ALB: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:09:29.713978] [INFO ] [REMOTE ] ALB: Fetching primary data for 2024-12. [2025-10-15T17:09:30.509328] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-15T17:09:30.513970] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-10. [2025-10-15T17:09:30.515427] [INFO ] [REMOTE ] AJG: Full fetch complete (69053 records). [2025-10-15T17:09:30.515520] [DEBUG] [VALIDATOR ] AJG: Validating primary data. [2025-10-15T17:09:30.901164] [DEBUG] [VALIDATOR ] AJG: All expected trading days are present. [2025-10-15T17:09:30.901248] [DEBUG] [VALIDATOR ] AJG: Primary data validation passed. [2025-10-15T17:09:30.901972] [INFO ] [MAIN ] AJG: Fetched primary data is valid. [2025-10-15T17:09:30.902035] [DEBUG] [LOCAL ] AJG: Saving primary data. [2025-10-15T17:09:30.903404] [DEBUG] [LOCAL ] AJG: Trimmed 69053 records to 46536 (keeping 200 days of data) [2025-10-15T17:09:31.193698] [DEBUG] [LOCAL ] AJG: Primary data saved (46536 records). [2025-10-15T17:09:31.193824] [INFO ] [MAIN ] AJG: Full history saved. [2025-10-15T17:09:31.194553] [INFO ] [MAIN ] Update Progress: 75/2369 symbols completed. AJG took 46.4s. Estimated remaining: 4h 48m 52s. Rate: 7.9 symbols/min [2025-10-15T17:09:31.319078] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-10. [2025-10-15T17:09:31.369442] [INFO ] [MAIN ] ALC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:09:31.419087] [DEBUG] [LOCAL ] ALC: Loaded 51170 existing records from primary storage. [2025-10-15T17:09:31.419439] [INFO ] [MAIN ] ALC: Loaded 51170 existing records. [2025-10-15T17:09:31.623585] [WARN ] [MAIN ] ALC: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:09:31.623891] [INFO ] [MAIN ] ALC: Wiping existing primary data before full refresh. [2025-10-15T17:09:31.623998] [INFO ] [LOCAL ] ALC: Starting deletion of primary data. [2025-10-15T17:09:31.624274] [DEBUG] [LOCAL ] ALC: Deleted primary data file. [2025-10-15T17:09:31.624332] [INFO ] [MAIN ] ALC: Starting full primary refresh. [2025-10-15T17:09:32.003837] [INFO ] [REMOTE ] ALC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:09:32.034627] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2024-12 (2.32 seconds). [2025-10-15T17:09:32.121331] [INFO ] [REMOTE ] ALC: Fetching primary data for 2024-12. [2025-10-15T17:09:32.126421] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-15T17:09:32.133218] [INFO ] [REMOTE ] AKR: Full fetch complete (65429 records). [2025-10-15T17:09:32.133440] [DEBUG] [VALIDATOR ] AKR: Validating primary data. [2025-10-15T17:09:32.567770] [DEBUG] [VALIDATOR ] AKR: All expected trading days are present. [2025-10-15T17:09:32.567927] [DEBUG] [VALIDATOR ] AKR: Primary data validation passed. [2025-10-15T17:09:32.568795] [INFO ] [MAIN ] AKR: Fetched primary data is valid. [2025-10-15T17:09:32.568863] [DEBUG] [LOCAL ] AKR: Saving primary data. [2025-10-15T17:09:32.570689] [DEBUG] [LOCAL ] AKR: Trimmed 65429 records to 46096 (keeping 200 days of data) [2025-10-15T17:09:32.874433] [DEBUG] [LOCAL ] AKR: Primary data saved (46096 records). [2025-10-15T17:09:32.874769] [INFO ] [MAIN ] AKR: Full history saved. [2025-10-15T17:09:32.874884] [INFO ] [MAIN ] Update Progress: 76/2369 symbols completed. AKR took 33.9s. Estimated remaining: 4h 45m 48s. Rate: 8.0 symbols/min [2025-10-15T17:09:32.921198] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-01. [2025-10-15T17:09:33.059451] [INFO ] [MAIN ] ALE: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:09:33.076939] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-15T17:09:33.083354] [INFO ] [REMOTE ] AL: Full fetch complete (63313 records). [2025-10-15T17:09:33.083551] [DEBUG] [VALIDATOR ] AL: Validating primary data. [2025-10-15T17:09:33.333674] [DEBUG] [LOCAL ] ALE: Loaded 31799 existing records from primary storage. [2025-10-15T17:09:33.367462] [INFO ] [MAIN ] ALE: Loaded 31799 existing records. [2025-10-15T17:09:33.636760] [DEBUG] [VALIDATOR ] AL: All expected trading days are present. [2025-10-15T17:09:33.656433] [DEBUG] [VALIDATOR ] AL: Primary data validation passed. [2025-10-15T17:09:33.676087] [INFO ] [MAIN ] AL: Fetched primary data is valid. [2025-10-15T17:09:33.678954] [DEBUG] [LOCAL ] AL: Saving primary data. [2025-10-15T17:09:33.702332] [WARN ] [MAIN ] ALE: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:09:33.702991] [INFO ] [MAIN ] ALE: Wiping existing primary data before full refresh. [2025-10-15T17:09:33.703208] [INFO ] [LOCAL ] ALE: Starting deletion of primary data. [2025-10-15T17:09:33.703885] [DEBUG] [LOCAL ] ALE: Deleted primary data file. [2025-10-15T17:09:33.704152] [DEBUG] [LOCAL ] AL: Trimmed 63313 records to 44699 (keeping 200 days of data) [2025-10-15T17:09:33.703997] [INFO ] [MAIN ] ALE: Starting full primary refresh. [2025-10-15T17:09:33.995075] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-10-15T17:09:34.019576] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-01. [2025-10-15T17:09:34.264355] [INFO ] [REMOTE ] ALE: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:09:34.430901] [DEBUG] [LOCAL ] AL: Primary data saved (44699 records). [2025-10-15T17:09:34.431187] [INFO ] [MAIN ] AL: Full history saved. [2025-10-15T17:09:34.431404] [INFO ] [MAIN ] Update Progress: 77/2369 symbols completed. AL took 31.7s. Estimated remaining: 4h 42m 44s. Rate: 8.1 symbols/min [2025-10-15T17:09:34.513983] [INFO ] [REMOTE ] ALE: Fetching primary data for 2024-12. [2025-10-15T17:09:34.730223] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-15T17:09:35.314032] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-02. [2025-10-15T17:09:35.535281] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-15T17:09:35.697103] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-15T17:09:36.113986] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-02. [2025-10-15T17:09:36.913994] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-01. [2025-10-15T17:09:37.224414] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-10-15T17:09:37.581836] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-15T17:09:37.714010] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-03. [2025-10-15T17:09:37.931508] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-15T17:09:38.514042] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-02. [2025-10-15T17:09:39.313998] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-03. [2025-10-15T17:09:39.412881] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-15T17:09:39.489887] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-15T17:09:40.114037] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-04. [2025-10-15T17:09:40.914041] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-03. [2025-10-15T17:09:41.202292] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-15T17:09:41.713997] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-04. [2025-10-15T17:09:41.848075] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-15T17:09:41.871106] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-15T17:09:42.514080] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-04. [2025-10-15T17:09:43.314032] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-05. [2025-10-15T17:09:43.630944] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-15T17:09:43.896927] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-04 (2.18 seconds). [2025-10-15T17:09:44.114053] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-05. [2025-10-15T17:09:44.913972] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-05. [2025-10-15T17:09:45.111360] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-15T17:09:45.155860] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-15T17:09:45.713999] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-06. [2025-10-15T17:09:46.513981] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-06. [2025-10-15T17:09:46.897485] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-10-15T17:09:47.194282] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-15T17:09:47.313958] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-07. [2025-10-15T17:09:47.650394] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-15T17:09:48.114007] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-07. [2025-10-15T17:09:48.914012] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-06. [2025-10-15T17:09:49.103629] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-15T17:09:49.384845] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-15T17:09:49.714010] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-08. [2025-10-15T17:09:50.513997] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-08. [2025-10-15T17:09:50.801915] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-15T17:09:50.896343] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-15T17:09:51.314006] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-09. [2025-10-15T17:09:52.113998] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-07. [2025-10-15T17:09:52.352430] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-15T17:09:52.537588] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-15T17:09:52.914006] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-09. [2025-10-15T17:09:53.714016] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-10. [2025-10-15T17:09:54.255353] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-07 (2.14 seconds). [2025-10-15T17:09:54.513970] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-08. [2025-10-15T17:09:54.722853] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-15T17:09:54.967695] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-15T17:09:54.972350] [INFO ] [REMOTE ] ALE: Full fetch complete (43808 records). [2025-10-15T17:09:54.972429] [DEBUG] [VALIDATOR ] ALE: Validating primary data. [2025-10-15T17:09:55.325737] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-10. [2025-10-15T17:09:55.379755] [DEBUG] [VALIDATOR ] ALE: All expected trading days are present. [2025-10-15T17:09:55.379871] [DEBUG] [VALIDATOR ] ALE: Primary data validation passed. [2025-10-15T17:09:55.380440] [INFO ] [MAIN ] ALE: Fetched primary data is valid. [2025-10-15T17:09:55.380488] [DEBUG] [LOCAL ] ALE: Saving primary data. [2025-10-15T17:09:55.381956] [DEBUG] [LOCAL ] ALE: Trimmed 43808 records to 31952 (keeping 200 days of data) [2025-10-15T17:09:55.587744] [DEBUG] [LOCAL ] ALE: Primary data saved (31952 records). [2025-10-15T17:09:55.587952] [INFO ] [MAIN ] ALE: Full history saved. [2025-10-15T17:09:55.588057] [INFO ] [MAIN ] Update Progress: 78/2369 symbols completed. ALE took 22.7s. Estimated remaining: 4h 49m 21s. Rate: 7.9 symbols/min [2025-10-15T17:09:56.741748] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-08 (2.23 seconds). [2025-10-15T17:09:56.753542] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-09. [2025-10-15T17:09:57.017210] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-15T17:09:57.024039] [INFO ] [REMOTE ] ALC: Full fetch complete (73570 records). [2025-10-15T17:09:57.024242] [DEBUG] [VALIDATOR ] ALC: Validating primary data. [2025-10-15T17:09:57.409984] [DEBUG] [VALIDATOR ] ALC: All expected trading days are present. [2025-10-15T17:09:57.410078] [DEBUG] [VALIDATOR ] ALC: Primary data validation passed. [2025-10-15T17:09:57.410810] [INFO ] [MAIN ] ALC: Fetched primary data is valid. [2025-10-15T17:09:57.410872] [DEBUG] [LOCAL ] ALC: Saving primary data. [2025-10-15T17:09:57.412221] [DEBUG] [LOCAL ] ALC: Trimmed 73570 records to 51181 (keeping 200 days of data) [2025-10-15T17:09:57.706404] [DEBUG] [LOCAL ] ALC: Primary data saved (51181 records). [2025-10-15T17:09:57.706534] [INFO ] [MAIN ] ALC: Full history saved. [2025-10-15T17:09:57.707153] [INFO ] [MAIN ] Update Progress: 79/2369 symbols completed. ALC took 26.5s. Estimated remaining: 4h 46m 35s. Rate: 8.0 symbols/min [2025-10-15T17:09:58.933220] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-09 (2.18 seconds). [2025-10-15T17:09:58.945331] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-10. [2025-10-15T17:10:01.333183] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-10 (2.39 seconds). [2025-10-15T17:10:01.339899] [INFO ] [REMOTE ] ALB: Full fetch complete (77045 records). [2025-10-15T17:10:01.340082] [DEBUG] [VALIDATOR ] ALB: Validating primary data. [2025-10-15T17:10:01.753906] [DEBUG] [VALIDATOR ] ALB: All expected trading days are present. [2025-10-15T17:10:01.754006] [DEBUG] [VALIDATOR ] ALB: Primary data validation passed. [2025-10-15T17:10:01.754797] [INFO ] [MAIN ] ALB: Fetched primary data is valid. [2025-10-15T17:10:01.754868] [DEBUG] [LOCAL ] ALB: Saving primary data. [2025-10-15T17:10:01.756564] [DEBUG] [LOCAL ] ALB: Trimmed 77045 records to 53343 (keeping 200 days of data) [2025-10-15T17:10:02.104307] [DEBUG] [LOCAL ] ALB: Primary data saved (53343 records). [2025-10-15T17:10:02.104514] [INFO ] [MAIN ] ALB: Full history saved. [2025-10-15T17:10:02.104618] [INFO ] [MAIN ] Update Progress: 80/2369 symbols completed. ALB took 33.3s. Estimated remaining: 4h 44m 58s. Rate: 8.0 symbols/min [2025-10-15T17:10:02.756010] [INFO ] [MAIN ] ALG: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:10:02.828740] [INFO ] [MAIN ] ALEX: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:10:02.827766] [INFO ] [MAIN ] ALIT: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:10:02.829723] [INFO ] [MAIN ] ALH: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:10:02.830599] [DEBUG] [LOCAL ] ALH: No existing data file found in primary storage. [2025-10-15T17:10:02.830846] [WARN ] [MAIN ] ALH: No existing data found, performing full refresh instead. [2025-10-15T17:10:02.831072] [INFO ] [MAIN ] ALH: Wiping existing primary data before full refresh. [2025-10-15T17:10:02.831119] [INFO ] [LOCAL ] ALH: Starting deletion of primary data. [2025-10-15T17:10:02.831162] [DEBUG] [LOCAL ] ALH: No primary data file found to delete. [2025-10-15T17:10:02.831193] [INFO ] [MAIN ] ALH: Starting full primary refresh. [2025-10-15T17:10:02.970012] [DEBUG] [LOCAL ] ALG: Loaded 9741 existing records from primary storage. [2025-10-15T17:10:02.970264] [INFO ] [MAIN ] ALG: Loaded 9741 existing records. [2025-10-15T17:10:03.230148] [DEBUG] [LOCAL ] ALEX: Loaded 31123 existing records from primary storage. [2025-10-15T17:10:03.364607] [INFO ] [MAIN ] ALEX: Loaded 31123 existing records. [2025-10-15T17:10:03.415294] [WARN ] [MAIN ] ALG: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:10:03.421847] [DEBUG] [LOCAL ] ALIT: Loaded 52792 existing records from primary storage. [2025-10-15T17:10:03.432951] [INFO ] [MAIN ] ALG: Wiping existing primary data before full refresh. [2025-10-15T17:10:03.456864] [INFO ] [MAIN ] ALIT: Loaded 52792 existing records. [2025-10-15T17:10:03.456937] [INFO ] [LOCAL ] ALG: Starting deletion of primary data. [2025-10-15T17:10:03.488363] [DEBUG] [LOCAL ] ALG: Deleted primary data file. [2025-10-15T17:10:03.512471] [INFO ] [MAIN ] ALG: Starting full primary refresh. [2025-10-15T17:10:03.787148] [INFO ] [REMOTE ] ALH: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:10:03.845330] [INFO ] [REMOTE ] ALH: Fetching primary data for 2024-12. [2025-10-15T17:10:04.007066] [WARN ] [MAIN ] ALIT: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:10:04.040295] [WARN ] [MAIN ] ALEX: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:10:04.065688] [INFO ] [MAIN ] ALEX: Wiping existing primary data before full refresh. [2025-10-15T17:10:04.067173] [INFO ] [LOCAL ] ALEX: Starting deletion of primary data. [2025-10-15T17:10:04.074191] [INFO ] [MAIN ] ALIT: Wiping existing primary data before full refresh. [2025-10-15T17:10:04.081143] [INFO ] [LOCAL ] ALIT: Starting deletion of primary data. [2025-10-15T17:10:04.100309] [DEBUG] [LOCAL ] ALEX: Deleted primary data file. [2025-10-15T17:10:04.112227] [DEBUG] [LOCAL ] ALIT: Deleted primary data file. [2025-10-15T17:10:04.112160] [INFO ] [MAIN ] ALEX: Starting full primary refresh. [2025-10-15T17:10:04.123118] [INFO ] [MAIN ] ALIT: Starting full primary refresh. [2025-10-15T17:10:04.249937] [DEBUG] [REMOTE ] ALH: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-15T17:10:04.316470] [WARN ] [REMOTE ] ALH: No data returned for month 2024-12 [2025-10-15T17:10:04.364535] [FATAL] [REMOTE ] ALH: API call failed - aborting fetch to avoid wasting further API calls [2025-10-15T17:10:04.532221] [FATAL] [MAIN ] ALH: Failed to fetch primary data. [2025-10-15T17:10:04.594040] [WARN ] [MAIN ] ALH: Deleting existing primary and derivative data due to fetch failure. [2025-10-15T17:10:04.593981] [INFO ] [REMOTE ] ALG: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:10:04.604404] [INFO ] [LOCAL ] ALH: Starting deletion of primary data. [2025-10-15T17:10:04.615283] [INFO ] [REMOTE ] ALG: Fetching primary data for 2024-12. [2025-10-15T17:10:04.640672] [DEBUG] [LOCAL ] ALH: No primary data file found to delete. [2025-10-15T17:10:04.674864] [INFO ] [LOCAL ] ALH: Starting deletion of derivative data. [2025-10-15T17:10:04.751343] [DEBUG] [LOCAL ] ALH: No derivative data file found to delete. [2025-10-15T17:10:04.813178] [INFO ] [MAIN ] Update Progress: 81/2369 symbols completed. ALH took 2.7s. Estimated remaining: 4h 42m 36s. Rate: 8.1 symbols/min [2025-10-15T17:10:05.090419] [INFO ] [REMOTE ] ALIT: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:10:05.126347] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2024-12. [2025-10-15T17:10:05.131144] [INFO ] [REMOTE ] ALEX: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:10:05.136189] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2024-12. [2025-10-15T17:10:05.210232] [INFO ] [MAIN ] ALK: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:10:05.263001] [DEBUG] [LOCAL ] ALK: Loaded 53079 existing records from primary storage. [2025-10-15T17:10:05.263324] [INFO ] [MAIN ] ALK: Loaded 53079 existing records. [2025-10-15T17:10:05.436179] [WARN ] [MAIN ] ALK: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:10:05.436461] [INFO ] [MAIN ] ALK: Wiping existing primary data before full refresh. [2025-10-15T17:10:05.436516] [INFO ] [LOCAL ] ALK: Starting deletion of primary data. [2025-10-15T17:10:05.437052] [DEBUG] [LOCAL ] ALK: Deleted primary data file. [2025-10-15T17:10:05.437108] [INFO ] [MAIN ] ALK: Starting full primary refresh. [2025-10-15T17:10:05.786429] [INFO ] [REMOTE ] ALK: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:10:05.786836] [INFO ] [REMOTE ] ALK: Fetching primary data for 2024-12. [2025-10-15T17:10:05.806318] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-15T17:10:05.809265] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-01. [2025-10-15T17:10:06.693832] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-15T17:10:06.697585] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-02. [2025-10-15T17:10:06.766565] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-15T17:10:06.773412] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-01. [2025-10-15T17:10:07.120227] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-10-15T17:10:07.131003] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-01. [2025-10-15T17:10:07.621549] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-15T17:10:07.632414] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-01. [2025-10-15T17:10:07.722903] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-15T17:10:07.725741] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-03. [2025-10-15T17:10:08.007022] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-15T17:10:08.013377] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-02. [2025-10-15T17:10:08.701027] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-15T17:10:08.705120] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-04. [2025-10-15T17:10:08.799469] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-15T17:10:08.823862] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-02. [2025-10-15T17:10:08.825939] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-15T17:10:08.913999] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-03. [2025-10-15T17:10:09.299015] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-15T17:10:09.369830] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-15T17:10:09.713977] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-02. [2025-10-15T17:10:09.954725] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-15T17:10:10.415025] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-15T17:10:10.513976] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-04. [2025-10-15T17:10:11.314013] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-05. [2025-10-15T17:10:11.449268] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-15T17:10:11.852106] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-15T17:10:11.869572] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-15T17:10:12.114018] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-03. [2025-10-15T17:10:12.913993] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-06. [2025-10-15T17:10:13.606086] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-15T17:10:13.713964] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-07. [2025-10-15T17:10:13.768126] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-15T17:10:14.496056] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-15T17:10:14.513952] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-08. [2025-10-15T17:10:15.198948] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-15T17:10:15.314013] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-03. [2025-10-15T17:10:16.114025] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-05. [2025-10-15T17:10:16.913998] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-04. [2025-10-15T17:10:17.311002] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-15T17:10:17.714003] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-06. [2025-10-15T17:10:17.955342] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-03 (2.64 seconds). [2025-10-15T17:10:18.513968] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-09. [2025-10-15T17:10:18.769468] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-15T17:10:18.818146] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-15T17:10:19.036402] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-10-15T17:10:19.314001] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-05. [2025-10-15T17:10:20.114011] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-04. [2025-10-15T17:10:20.914064] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-07. [2025-10-15T17:10:20.981085] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-15T17:10:21.686389] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-15T17:10:21.713959] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-10. [2025-10-15T17:10:22.310372] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-15T17:10:22.495592] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-15T17:10:22.496997] [INFO ] [REMOTE ] ALG: Full fetch complete (15345 records). [2025-10-15T17:10:22.497068] [DEBUG] [VALIDATOR ] ALG: Validating primary data. [2025-10-15T17:10:22.519196] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-08. [2025-10-15T17:10:22.867137] [DEBUG] [VALIDATOR ] ALG: All expected trading days are present. [2025-10-15T17:10:22.867289] [DEBUG] [VALIDATOR ] ALG: Primary data validation passed. [2025-10-15T17:10:22.867863] [INFO ] [MAIN ] ALG: Fetched primary data is valid. [2025-10-15T17:10:22.867935] [DEBUG] [LOCAL ] ALG: Saving primary data. [2025-10-15T17:10:22.869045] [DEBUG] [LOCAL ] ALG: Trimmed 15345 records to 9756 (keeping 200 days of data) [2025-10-15T17:10:22.939859] [DEBUG] [LOCAL ] ALG: Primary data saved (9756 records). [2025-10-15T17:10:22.940103] [INFO ] [MAIN ] ALG: Full history saved. [2025-10-15T17:10:22.940216] [INFO ] [MAIN ] Update Progress: 82/2369 symbols completed. ALG took 20.8s. Estimated remaining: 4h 47m 28s. Rate: 8.0 symbols/min [2025-10-15T17:10:23.127107] [INFO ] [MAIN ] ALL: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:10:23.182193] [DEBUG] [LOCAL ] ALL: Loaded 49767 existing records from primary storage. [2025-10-15T17:10:23.182707] [INFO ] [MAIN ] ALL: Loaded 49767 existing records. [2025-10-15T17:10:23.328631] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-06. [2025-10-15T17:10:23.437385] [WARN ] [MAIN ] ALL: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:10:23.438002] [INFO ] [MAIN ] ALL: Wiping existing primary data before full refresh. [2025-10-15T17:10:23.438054] [INFO ] [LOCAL ] ALL: Starting deletion of primary data. [2025-10-15T17:10:23.438615] [DEBUG] [LOCAL ] ALL: Deleted primary data file. [2025-10-15T17:10:23.438754] [INFO ] [MAIN ] ALL: Starting full primary refresh. [2025-10-15T17:10:23.805974] [INFO ] [REMOTE ] ALL: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:10:23.823098] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-15T17:10:24.113993] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-09. [2025-10-15T17:10:24.914007] [INFO ] [REMOTE ] ALL: Fetching primary data for 2024-12. [2025-10-15T17:10:24.952425] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-15T17:10:25.161206] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-15T17:10:25.714012] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-10. [2025-10-15T17:10:26.514103] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-07. [2025-10-15T17:10:26.722969] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-15T17:10:27.161386] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-15T17:10:27.165613] [INFO ] [REMOTE ] ALEX: Full fetch complete (44637 records). [2025-10-15T17:10:27.165754] [DEBUG] [VALIDATOR ] ALEX: Validating primary data. [2025-10-15T17:10:27.319295] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-01. [2025-10-15T17:10:27.542071] [DEBUG] [VALIDATOR ] ALEX: All expected trading days are present. [2025-10-15T17:10:27.542155] [DEBUG] [VALIDATOR ] ALEX: Primary data validation passed. [2025-10-15T17:10:27.542672] [INFO ] [MAIN ] ALEX: Fetched primary data is valid. [2025-10-15T17:10:27.542735] [DEBUG] [LOCAL ] ALEX: Saving primary data. [2025-10-15T17:10:27.543780] [DEBUG] [LOCAL ] ALEX: Trimmed 44637 records to 31156 (keeping 200 days of data) [2025-10-15T17:10:27.728083] [DEBUG] [LOCAL ] ALEX: Primary data saved (31156 records). [2025-10-15T17:10:27.728226] [INFO ] [MAIN ] ALEX: Full history saved. [2025-10-15T17:10:27.728311] [INFO ] [MAIN ] Update Progress: 83/2369 symbols completed. ALEX took 25.6s. Estimated remaining: 4h 46m 4s. Rate: 8.0 symbols/min [2025-10-15T17:10:27.902360] [INFO ] [MAIN ] ALLE: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:10:27.947621] [DEBUG] [LOCAL ] ALLE: Loaded 44314 existing records from primary storage. [2025-10-15T17:10:27.948059] [INFO ] [MAIN ] ALLE: Loaded 44314 existing records. [2025-10-15T17:10:28.115518] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-05. [2025-10-15T17:10:28.156376] [WARN ] [MAIN ] ALLE: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:10:28.174165] [INFO ] [MAIN ] ALLE: Wiping existing primary data before full refresh. [2025-10-15T17:10:28.174322] [INFO ] [LOCAL ] ALLE: Starting deletion of primary data. [2025-10-15T17:10:28.176421] [DEBUG] [LOCAL ] ALLE: Deleted primary data file. [2025-10-15T17:10:28.177678] [INFO ] [MAIN ] ALLE: Starting full primary refresh. [2025-10-15T17:10:28.177569] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-15T17:10:28.548952] [INFO ] [REMOTE ] ALLE: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:10:28.870949] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-15T17:10:28.913959] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-02. [2025-10-15T17:10:29.713978] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-08. [2025-10-15T17:10:30.025697] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-15T17:10:30.521118] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-06. [2025-10-15T17:10:30.525877] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-15T17:10:31.314020] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-03. [2025-10-15T17:10:31.656738] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-15T17:10:32.104546] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-15T17:10:32.114566] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-09. [2025-10-15T17:10:32.914021] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-07. [2025-10-15T17:10:33.148466] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-15T17:10:33.669871] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-15T17:10:33.713961] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-10. [2025-10-15T17:10:34.513972] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-04. [2025-10-15T17:10:34.700368] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-15T17:10:35.096729] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-15T17:10:35.103171] [INFO ] [REMOTE ] ALIT: Full fetch complete (76611 records). [2025-10-15T17:10:35.103286] [DEBUG] [VALIDATOR ] ALIT: Validating primary data. [2025-10-15T17:10:35.319160] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-08. [2025-10-15T17:10:35.491153] [DEBUG] [VALIDATOR ] ALIT: All expected trading days are present. [2025-10-15T17:10:35.491239] [DEBUG] [VALIDATOR ] ALIT: Primary data validation passed. [2025-10-15T17:10:35.491992] [INFO ] [MAIN ] ALIT: Fetched primary data is valid. [2025-10-15T17:10:35.492055] [DEBUG] [LOCAL ] ALIT: Saving primary data. [2025-10-15T17:10:35.493544] [DEBUG] [LOCAL ] ALIT: Trimmed 76611 records to 52788 (keeping 200 days of data) [2025-10-15T17:10:35.813029] [DEBUG] [LOCAL ] ALIT: Primary data saved (52788 records). [2025-10-15T17:10:35.813197] [INFO ] [MAIN ] ALIT: Full history saved. [2025-10-15T17:10:35.813330] [INFO ] [MAIN ] Update Progress: 84/2369 symbols completed. ALIT took 33.7s. Estimated remaining: 4h 46m 13s. Rate: 8.0 symbols/min [2025-10-15T17:10:36.009908] [INFO ] [MAIN ] ALLY: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:10:36.062563] [DEBUG] [LOCAL ] ALLY: Loaded 53223 existing records from primary storage. [2025-10-15T17:10:36.062964] [INFO ] [MAIN ] ALLY: Loaded 53223 existing records. [2025-10-15T17:10:36.135279] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2024-12. [2025-10-15T17:10:36.257388] [WARN ] [MAIN ] ALLY: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:10:36.257833] [INFO ] [MAIN ] ALLY: Wiping existing primary data before full refresh. [2025-10-15T17:10:36.257903] [INFO ] [LOCAL ] ALLY: Starting deletion of primary data. [2025-10-15T17:10:36.258409] [DEBUG] [LOCAL ] ALLY: Deleted primary data file. [2025-10-15T17:10:36.258459] [INFO ] [MAIN ] ALLY: Starting full primary refresh. [2025-10-15T17:10:36.637926] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-10-15T17:10:36.720775] [INFO ] [REMOTE ] ALLY: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:10:36.913999] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-05. [2025-10-15T17:10:37.242925] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-15T17:10:37.590453] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-15T17:10:37.713964] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-01. [2025-10-15T17:10:38.412882] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-15T17:10:38.513994] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-06. [2025-10-15T17:10:39.081367] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-15T17:10:39.314066] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2024-12. [2025-10-15T17:10:40.122556] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-09. [2025-10-15T17:10:40.125049] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-15T17:10:40.913967] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-07. [2025-10-15T17:10:41.029742] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-15T17:10:41.714004] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-02. [2025-10-15T17:10:42.176708] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-10-15T17:10:42.437142] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-15T17:10:42.514041] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-10. [2025-10-15T17:10:43.051854] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-15T17:10:43.314071] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-08. [2025-10-15T17:10:44.113993] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-03. [2025-10-15T17:10:44.395811] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-10 (1.88 seconds). [2025-10-15T17:10:44.402096] [INFO ] [REMOTE ] ALK: Full fetch complete (76998 records). [2025-10-15T17:10:44.402404] [DEBUG] [VALIDATOR ] ALK: Validating primary data. [2025-10-15T17:10:44.797416] [DEBUG] [VALIDATOR ] ALK: All expected trading days are present. [2025-10-15T17:10:44.797609] [DEBUG] [VALIDATOR ] ALK: Primary data validation passed. [2025-10-15T17:10:44.798491] [INFO ] [MAIN ] ALK: Fetched primary data is valid. [2025-10-15T17:10:44.798570] [DEBUG] [LOCAL ] ALK: Saving primary data. [2025-10-15T17:10:44.800150] [DEBUG] [LOCAL ] ALK: Trimmed 76998 records to 53081 (keeping 200 days of data) [2025-10-15T17:10:44.914713] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-01. [2025-10-15T17:10:44.917535] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-15T17:10:45.147310] [DEBUG] [LOCAL ] ALK: Primary data saved (53081 records). [2025-10-15T17:10:45.147455] [INFO ] [MAIN ] ALK: Full history saved. [2025-10-15T17:10:45.148049] [INFO ] [MAIN ] Update Progress: 85/2369 symbols completed. ALK took 40.3s. Estimated remaining: 4h 46m 54s. Rate: 8.0 symbols/min [2025-10-15T17:10:45.323361] [INFO ] [MAIN ] ALSN: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:10:45.374180] [DEBUG] [LOCAL ] ALSN: Loaded 43460 existing records from primary storage. [2025-10-15T17:10:45.375064] [INFO ] [MAIN ] ALSN: Loaded 43460 existing records. [2025-10-15T17:10:45.574758] [WARN ] [MAIN ] ALSN: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:10:45.595784] [INFO ] [MAIN ] ALSN: Wiping existing primary data before full refresh. [2025-10-15T17:10:45.595870] [INFO ] [LOCAL ] ALSN: Starting deletion of primary data. [2025-10-15T17:10:45.610870] [DEBUG] [LOCAL ] ALSN: Deleted primary data file. [2025-10-15T17:10:45.610972] [INFO ] [MAIN ] ALSN: Starting full primary refresh. [2025-10-15T17:10:45.714940] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-09. [2025-10-15T17:10:45.717951] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-15T17:10:45.997920] [INFO ] [REMOTE ] ALSN: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:10:46.311158] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-15T17:10:46.514028] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2024-12. [2025-10-15T17:10:47.323886] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-04. [2025-10-15T17:10:47.330549] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-15T17:10:48.019937] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-15T17:10:48.114073] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-01. [2025-10-15T17:10:48.913976] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-10. [2025-10-15T17:10:49.212199] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-15T17:10:49.306876] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-15T17:10:49.714062] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-05. [2025-10-15T17:10:50.448676] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-15T17:10:50.454771] [INFO ] [REMOTE ] ALL: Full fetch complete (72504 records). [2025-10-15T17:10:50.454919] [DEBUG] [VALIDATOR ] ALL: Validating primary data. [2025-10-15T17:10:50.528067] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-02. [2025-10-15T17:10:50.905306] [DEBUG] [VALIDATOR ] ALL: All expected trading days are present. [2025-10-15T17:10:50.905561] [DEBUG] [VALIDATOR ] ALL: Primary data validation passed. [2025-10-15T17:10:50.906432] [INFO ] [MAIN ] ALL: Fetched primary data is valid. [2025-10-15T17:10:50.906599] [DEBUG] [LOCAL ] ALL: Saving primary data. [2025-10-15T17:10:50.908243] [DEBUG] [LOCAL ] ALL: Trimmed 72504 records to 49786 (keeping 200 days of data) [2025-10-15T17:10:51.179755] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-15T17:10:51.278708] [DEBUG] [LOCAL ] ALL: Primary data saved (49786 records). [2025-10-15T17:10:51.278855] [INFO ] [MAIN ] ALL: Full history saved. [2025-10-15T17:10:51.279457] [INFO ] [MAIN ] Update Progress: 86/2369 symbols completed. ALL took 28.3s. Estimated remaining: 4h 46m 9s. Rate: 8.0 symbols/min [2025-10-15T17:10:51.319172] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-06. [2025-10-15T17:10:51.476016] [INFO ] [MAIN ] ALTG: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:10:51.507670] [DEBUG] [LOCAL ] ALTG: Loaded 23430 existing records from primary storage. [2025-10-15T17:10:51.507963] [INFO ] [MAIN ] ALTG: Loaded 23430 existing records. [2025-10-15T17:10:51.717804] [WARN ] [MAIN ] ALTG: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:10:51.718171] [INFO ] [MAIN ] ALTG: Wiping existing primary data before full refresh. [2025-10-15T17:10:51.718229] [INFO ] [LOCAL ] ALTG: Starting deletion of primary data. [2025-10-15T17:10:51.718460] [DEBUG] [LOCAL ] ALTG: Deleted primary data file. [2025-10-15T17:10:51.718517] [INFO ] [MAIN ] ALTG: Starting full primary refresh. [2025-10-15T17:10:52.085717] [INFO ] [REMOTE ] ALTG: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:10:52.119069] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-02. [2025-10-15T17:10:52.132037] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-15T17:10:52.914029] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2024-12. [2025-10-15T17:10:53.028884] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-15T17:10:53.713975] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-07. [2025-10-15T17:10:53.767055] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-15T17:10:53.872707] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-10-15T17:10:54.513996] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-03. [2025-10-15T17:10:55.314006] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-03. [2025-10-15T17:10:55.418637] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-15T17:10:56.114047] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-01. [2025-10-15T17:10:56.237689] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-15T17:10:56.578639] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-15T17:10:56.914000] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-04. [2025-10-15T17:10:57.122973] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-15T17:10:57.714006] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-08. [2025-10-15T17:10:58.513981] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-02. [2025-10-15T17:10:58.544146] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-15T17:10:59.268440] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-15T17:10:59.313957] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-09. [2025-10-15T17:10:59.443991] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-15T17:11:00.113982] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-05. [2025-10-15T17:11:00.604037] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-15T17:11:00.914024] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-04. [2025-10-15T17:11:01.419081] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-15T17:11:01.714026] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-03. [2025-10-15T17:11:02.429910] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-15T17:11:02.513997] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-10. [2025-10-15T17:11:02.592569] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-15T17:11:03.314051] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-05. [2025-10-15T17:11:03.952576] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-15T17:11:03.957601] [INFO ] [REMOTE ] ALLE: Full fetch complete (64755 records). [2025-10-15T17:11:03.957776] [DEBUG] [VALIDATOR ] ALLE: Validating primary data. [2025-10-15T17:11:04.119350] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-06. [2025-10-15T17:11:04.368932] [DEBUG] [VALIDATOR ] ALLE: All expected trading days are present. [2025-10-15T17:11:04.369025] [DEBUG] [VALIDATOR ] ALLE: Primary data validation passed. [2025-10-15T17:11:04.369714] [INFO ] [MAIN ] ALLE: Fetched primary data is valid. [2025-10-15T17:11:04.369778] [DEBUG] [LOCAL ] ALLE: Saving primary data. [2025-10-15T17:11:04.371335] [DEBUG] [LOCAL ] ALLE: Trimmed 64755 records to 44203 (keeping 200 days of data) [2025-10-15T17:11:04.641818] [DEBUG] [LOCAL ] ALLE: Primary data saved (44203 records). [2025-10-15T17:11:04.641944] [INFO ] [MAIN ] ALLE: Full history saved. [2025-10-15T17:11:04.642021] [INFO ] [MAIN ] Update Progress: 87/2369 symbols completed. ALLE took 36.9s. Estimated remaining: 4h 48m 35s. Rate: 7.9 symbols/min [2025-10-15T17:11:04.814809] [INFO ] [MAIN ] ALUR: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:11:04.847536] [DEBUG] [LOCAL ] ALUR: Loaded 9637 existing records from primary storage. [2025-10-15T17:11:04.847822] [INFO ] [MAIN ] ALUR: Loaded 9637 existing records. [2025-10-15T17:11:04.913969] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-04. [2025-10-15T17:11:05.043623] [WARN ] [MAIN ] ALUR: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:11:05.061020] [INFO ] [MAIN ] ALUR: Wiping existing primary data before full refresh. [2025-10-15T17:11:05.065025] [INFO ] [LOCAL ] ALUR: Starting deletion of primary data. [2025-10-15T17:11:05.065781] [DEBUG] [LOCAL ] ALUR: Deleted primary data file. [2025-10-15T17:11:05.068503] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-15T17:11:05.068764] [INFO ] [MAIN ] ALUR: Starting full primary refresh. [2025-10-15T17:11:05.430934] [INFO ] [REMOTE ] ALUR: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:11:05.689151] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-15T17:11:05.713953] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-07. [2025-10-15T17:11:05.923283] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-15T17:11:06.513988] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-06. [2025-10-15T17:11:06.910898] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-15T17:11:07.314028] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-08. [2025-10-15T17:11:07.963986] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-15T17:11:08.113976] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-07. [2025-10-15T17:11:08.798128] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-15T17:11:08.913990] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-09. [2025-10-15T17:11:09.713986] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-05. [2025-10-15T17:11:09.885006] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-15T17:11:10.436257] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-15T17:11:10.513963] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-08. [2025-10-15T17:11:10.565532] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-15T17:11:11.314013] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-10. [2025-10-15T17:11:12.114013] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-06. [2025-10-15T17:11:12.401508] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-15T17:11:12.801044] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-15T17:11:12.806606] [INFO ] [REMOTE ] ALSN: Full fetch complete (62474 records). [2025-10-15T17:11:12.806753] [DEBUG] [VALIDATOR ] ALSN: Validating primary data. [2025-10-15T17:11:12.919145] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-09. [2025-10-15T17:11:13.230863] [DEBUG] [VALIDATOR ] ALSN: All expected trading days are present. [2025-10-15T17:11:13.231102] [DEBUG] [VALIDATOR ] ALSN: Primary data validation passed. [2025-10-15T17:11:13.232089] [INFO ] [MAIN ] ALSN: Fetched primary data is valid. [2025-10-15T17:11:13.232208] [DEBUG] [LOCAL ] ALSN: Saving primary data. [2025-10-15T17:11:13.251007] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-15T17:11:13.257106] [DEBUG] [LOCAL ] ALSN: Trimmed 62474 records to 43474 (keeping 200 days of data) [2025-10-15T17:11:13.519511] [DEBUG] [LOCAL ] ALSN: Primary data saved (43474 records). [2025-10-15T17:11:13.519668] [INFO ] [MAIN ] ALSN: Full history saved. [2025-10-15T17:11:13.520422] [INFO ] [MAIN ] Update Progress: 88/2369 symbols completed. ALSN took 28.4s. Estimated remaining: 4h 49m 1s. Rate: 7.9 symbols/min [2025-10-15T17:11:13.684424] [INFO ] [MAIN ] ALV: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:11:13.713995] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2024-12. [2025-10-15T17:11:13.727946] [DEBUG] [LOCAL ] ALV: Loaded 42132 existing records from primary storage. [2025-10-15T17:11:13.728307] [INFO ] [MAIN ] ALV: Loaded 42132 existing records. [2025-10-15T17:11:13.946243] [WARN ] [MAIN ] ALV: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:11:13.946490] [INFO ] [MAIN ] ALV: Wiping existing primary data before full refresh. [2025-10-15T17:11:13.946553] [INFO ] [LOCAL ] ALV: Starting deletion of primary data. [2025-10-15T17:11:13.946905] [DEBUG] [LOCAL ] ALV: Deleted primary data file. [2025-10-15T17:11:13.946962] [INFO ] [MAIN ] ALV: Starting full primary refresh. [2025-10-15T17:11:14.340399] [INFO ] [REMOTE ] ALV: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:11:14.514072] [INFO ] [REMOTE ] ALV: Fetching primary data for 2024-12. [2025-10-15T17:11:14.565622] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-15T17:11:15.093680] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-15T17:11:15.314083] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-07. [2025-10-15T17:11:16.113981] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-10. [2025-10-15T17:11:16.246254] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-15T17:11:16.271366] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-15T17:11:16.914021] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-08. [2025-10-15T17:11:17.714004] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-01. [2025-10-15T17:11:17.820006] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-15T17:11:17.951190] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-15T17:11:17.958268] [INFO ] [REMOTE ] ALLY: Full fetch complete (77179 records). [2025-10-15T17:11:17.958404] [DEBUG] [VALIDATOR ] ALLY: Validating primary data. [2025-10-15T17:11:18.349692] [DEBUG] [VALIDATOR ] ALLY: All expected trading days are present. [2025-10-15T17:11:18.349781] [DEBUG] [VALIDATOR ] ALLY: Primary data validation passed. [2025-10-15T17:11:18.350578] [INFO ] [MAIN ] ALLY: Fetched primary data is valid. [2025-10-15T17:11:18.350618] [DEBUG] [LOCAL ] ALLY: Saving primary data. [2025-10-15T17:11:18.352057] [DEBUG] [LOCAL ] ALLY: Trimmed 77179 records to 53221 (keeping 200 days of data) [2025-10-15T17:11:18.526113] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-09. [2025-10-15T17:11:18.673988] [DEBUG] [LOCAL ] ALLY: Primary data saved (53221 records). [2025-10-15T17:11:18.674105] [INFO ] [MAIN ] ALLY: Full history saved. [2025-10-15T17:11:18.674184] [INFO ] [MAIN ] Update Progress: 89/2369 symbols completed. ALLY took 42.9s. Estimated remaining: 4h 47m 50s. Rate: 7.9 symbols/min [2025-10-15T17:11:18.878066] [INFO ] [MAIN ] ALX: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:11:18.907963] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-15T17:11:18.920385] [DEBUG] [LOCAL ] ALX: Loaded 6886 existing records from primary storage. [2025-10-15T17:11:18.920701] [INFO ] [MAIN ] ALX: Loaded 6886 existing records. [2025-10-15T17:11:19.133728] [WARN ] [MAIN ] ALX: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:11:19.134073] [INFO ] [MAIN ] ALX: Wiping existing primary data before full refresh. [2025-10-15T17:11:19.134144] [INFO ] [LOCAL ] ALX: Starting deletion of primary data. [2025-10-15T17:11:19.134375] [DEBUG] [LOCAL ] ALX: Deleted primary data file. [2025-10-15T17:11:19.134443] [INFO ] [MAIN ] ALX: Starting full primary refresh. [2025-10-15T17:11:19.316012] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-02. [2025-10-15T17:11:19.660757] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-15T17:11:19.688910] [INFO ] [REMOTE ] ALX: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:11:20.114011] [INFO ] [REMOTE ] ALX: Fetching primary data for 2024-12. [2025-10-15T17:11:20.545581] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-15T17:11:20.785277] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-10-15T17:11:20.914063] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-01. [2025-10-15T17:11:21.714053] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-10. [2025-10-15T17:11:22.394894] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-15T17:11:22.513985] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-02. [2025-10-15T17:11:22.845709] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-15T17:11:22.848808] [INFO ] [REMOTE ] ALTG: Full fetch complete (33489 records). [2025-10-15T17:11:22.848887] [DEBUG] [VALIDATOR ] ALTG: Validating primary data. [2025-10-15T17:11:23.237081] [DEBUG] [VALIDATOR ] ALTG: All expected trading days are present. [2025-10-15T17:11:23.237182] [DEBUG] [VALIDATOR ] ALTG: Primary data validation passed. [2025-10-15T17:11:23.237777] [INFO ] [MAIN ] ALTG: Fetched primary data is valid. [2025-10-15T17:11:23.237844] [DEBUG] [LOCAL ] ALTG: Saving primary data. [2025-10-15T17:11:23.238819] [DEBUG] [LOCAL ] ALTG: Trimmed 33489 records to 23330 (keeping 200 days of data) [2025-10-15T17:11:23.331459] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-01. [2025-10-15T17:11:23.390964] [DEBUG] [LOCAL ] ALTG: Primary data saved (23330 records). [2025-10-15T17:11:23.391129] [INFO ] [MAIN ] ALTG: Full history saved. [2025-10-15T17:11:23.391258] [INFO ] [MAIN ] Update Progress: 90/2369 symbols completed. ALTG took 32.1s. Estimated remaining: 4h 46m 30s. Rate: 8.0 symbols/min [2025-10-15T17:11:23.618598] [INFO ] [MAIN ] AM: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:11:23.680614] [DEBUG] [LOCAL ] AM: Loaded 51955 existing records from primary storage. [2025-10-15T17:11:23.681172] [INFO ] [MAIN ] AM: Loaded 51955 existing records. [2025-10-15T17:11:23.852815] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-10-15T17:11:23.871598] [WARN ] [MAIN ] AM: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:11:23.873058] [INFO ] [MAIN ] AM: Wiping existing primary data before full refresh. [2025-10-15T17:11:23.873217] [INFO ] [LOCAL ] AM: Starting deletion of primary data. [2025-10-15T17:11:23.873744] [DEBUG] [LOCAL ] AM: Deleted primary data file. [2025-10-15T17:11:23.873803] [INFO ] [MAIN ] AM: Starting full primary refresh. [2025-10-15T17:11:24.076305] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-15T17:11:24.127336] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-03. [2025-10-15T17:11:24.330871] [INFO ] [REMOTE ] AM: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:11:24.914016] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-03. [2025-10-15T17:11:25.275839] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-15T17:11:25.713997] [INFO ] [REMOTE ] AM: Fetching primary data for 2024-12. [2025-10-15T17:11:26.513967] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-02. [2025-10-15T17:11:26.614582] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-15T17:11:27.010455] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-10-15T17:11:27.314039] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-04. [2025-10-15T17:11:27.557996] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-15T17:11:28.114046] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-01. [2025-10-15T17:11:28.842422] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-15T17:11:28.913991] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-05. [2025-10-15T17:11:29.573226] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-15T17:11:29.713986] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-02. [2025-10-15T17:11:30.270570] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-15T17:11:30.513988] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-03. [2025-10-15T17:11:31.104633] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-15T17:11:31.255916] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-15T17:11:31.314035] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-03. [2025-10-15T17:11:32.113994] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-04. [2025-10-15T17:11:32.913983] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-06. [2025-10-15T17:11:32.923559] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-15T17:11:33.158417] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-15T17:11:33.714020] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-05. [2025-10-15T17:11:34.280630] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-15T17:11:34.514036] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-04. [2025-10-15T17:11:34.674214] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-15T17:11:35.313989] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-06. [2025-10-15T17:11:36.032704] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-15T17:11:36.113983] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-04. [2025-10-15T17:11:36.256778] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-15T17:11:36.593506] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-10-15T17:11:36.914025] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-07. [2025-10-15T17:11:37.644413] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-15T17:11:37.713963] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-08. [2025-10-15T17:11:38.407605] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-15T17:11:38.514002] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-09. [2025-10-15T17:11:39.141471] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-15T17:11:39.314019] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-05. [2025-10-15T17:11:39.829797] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-10-15T17:11:40.114054] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-05. [2025-10-15T17:11:40.914000] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-06. [2025-10-15T17:11:41.713980] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-10. [2025-10-15T17:11:41.805388] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-15T17:11:41.855342] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-15T17:11:42.514066] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-07. [2025-10-15T17:11:42.601868] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-15T17:11:42.603583] [INFO ] [REMOTE ] ALUR: Full fetch complete (19260 records). [2025-10-15T17:11:42.603693] [DEBUG] [VALIDATOR ] ALUR: Validating primary data. [2025-10-15T17:11:42.990306] [DEBUG] [VALIDATOR ] ALUR: All expected trading days are present. [2025-10-15T17:11:42.990384] [DEBUG] [VALIDATOR ] ALUR: Primary data validation passed. [2025-10-15T17:11:42.990703] [INFO ] [MAIN ] ALUR: Fetched primary data is valid. [2025-10-15T17:11:42.990764] [DEBUG] [LOCAL ] ALUR: Saving primary data. [2025-10-15T17:11:42.991258] [DEBUG] [LOCAL ] ALUR: Trimmed 19260 records to 9544 (keeping 200 days of data) [2025-10-15T17:11:43.044175] [DEBUG] [LOCAL ] ALUR: Primary data saved (9544 records). [2025-10-15T17:11:43.044298] [INFO ] [MAIN ] ALUR: Full history saved. [2025-10-15T17:11:43.044375] [INFO ] [MAIN ] Update Progress: 91/2369 symbols completed. ALUR took 38.4s. Estimated remaining: 4h 51m 26s. Rate: 7.8 symbols/min [2025-10-15T17:11:43.209359] [INFO ] [MAIN ] AMBC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:11:43.245279] [DEBUG] [LOCAL ] AMBC: Loaded 36259 existing records from primary storage. [2025-10-15T17:11:43.245543] [INFO ] [MAIN ] AMBC: Loaded 36259 existing records. [2025-10-15T17:11:43.318562] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-07. [2025-10-15T17:11:43.359882] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-15T17:11:43.435597] [WARN ] [MAIN ] AMBC: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:11:43.435827] [INFO ] [MAIN ] AMBC: Wiping existing primary data before full refresh. [2025-10-15T17:11:43.435889] [INFO ] [LOCAL ] AMBC: Starting deletion of primary data. [2025-10-15T17:11:43.436235] [DEBUG] [LOCAL ] AMBC: Deleted primary data file. [2025-10-15T17:11:43.436295] [INFO ] [MAIN ] AMBC: Starting full primary refresh. [2025-10-15T17:11:43.775968] [INFO ] [REMOTE ] AMBC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:11:44.114002] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2024-12. [2025-10-15T17:11:44.914040] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-08. [2025-10-15T17:11:45.117677] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-15T17:11:45.402415] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-10-15T17:11:45.536600] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-15T17:11:45.714001] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-09. [2025-10-15T17:11:46.513988] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-01. [2025-10-15T17:11:46.564901] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-15T17:11:47.314014] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-08. [2025-10-15T17:11:47.725525] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-15T17:11:48.114024] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-06. [2025-10-15T17:11:48.816428] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-15T17:11:48.914001] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-09. [2025-10-15T17:11:49.634401] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-15T17:11:49.714020] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-07. [2025-10-15T17:11:50.149338] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-15T17:11:50.514035] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-10. [2025-10-15T17:11:51.314016] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-10. [2025-10-15T17:11:51.565973] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-15T17:11:51.978979] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-15T17:11:51.984804] [INFO ] [REMOTE ] ALV: Full fetch complete (62012 records). [2025-10-15T17:11:51.985082] [DEBUG] [VALIDATOR ] ALV: Validating primary data. [2025-10-15T17:11:52.119245] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-02. [2025-10-15T17:11:52.326254] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-15T17:11:52.339809] [INFO ] [REMOTE ] ALX: Full fetch complete (7781 records). [2025-10-15T17:11:52.345098] [DEBUG] [VALIDATOR ] ALX: Validating primary data. [2025-10-15T17:11:52.580435] [DEBUG] [VALIDATOR ] ALV: All expected trading days are present. [2025-10-15T17:11:52.598402] [DEBUG] [VALIDATOR ] ALV: Primary data validation passed. [2025-10-15T17:11:52.604416] [INFO ] [MAIN ] ALV: Fetched primary data is valid. [2025-10-15T17:11:52.609842] [DEBUG] [LOCAL ] ALV: Saving primary data. [2025-10-15T17:11:52.716386] [DEBUG] [LOCAL ] ALV: Trimmed 62012 records to 42121 (keeping 200 days of data) [2025-10-15T17:11:52.919922] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-08. [2025-10-15T17:11:52.930013] [DEBUG] [VALIDATOR ] ALX: All expected trading days are present. [2025-10-15T17:11:52.931766] [DEBUG] [VALIDATOR ] ALX: Primary data validation passed. [2025-10-15T17:11:52.932124] [INFO ] [MAIN ] ALX: Fetched primary data is valid. [2025-10-15T17:11:52.932204] [DEBUG] [LOCAL ] ALX: Saving primary data. [2025-10-15T17:11:52.939738] [DEBUG] [LOCAL ] ALX: Trimmed 7781 records to 6965 (keeping 200 days of data) [2025-10-15T17:11:53.136789] [DEBUG] [LOCAL ] ALX: Primary data saved (6965 records). [2025-10-15T17:11:53.140841] [INFO ] [MAIN ] ALX: Full history saved. [2025-10-15T17:11:53.151811] [INFO ] [MAIN ] Update Progress: 92/2369 symbols completed. ALX took 34.5s. Estimated remaining: 4h 52m 18s. Rate: 7.8 symbols/min [2025-10-15T17:11:53.205414] [DEBUG] [LOCAL ] ALV: Primary data saved (42121 records). [2025-10-15T17:11:53.263826] [INFO ] [MAIN ] ALV: Full history saved. [2025-10-15T17:11:53.296273] [INFO ] [MAIN ] Update Progress: 93/2369 symbols completed. ALV took 39.8s. Estimated remaining: 4h 49m 6s. Rate: 7.9 symbols/min [2025-10-15T17:11:53.297751] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-15T17:11:53.522545] [INFO ] [MAIN ] AMBP: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:11:53.619521] [INFO ] [MAIN ] AMBQ: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:11:53.619758] [DEBUG] [LOCAL ] AMBQ: No existing data file found in primary storage. [2025-10-15T17:11:53.619846] [WARN ] [MAIN ] AMBQ: No existing data found, performing full refresh instead. [2025-10-15T17:11:53.620053] [INFO ] [MAIN ] AMBQ: Wiping existing primary data before full refresh. [2025-10-15T17:11:53.620098] [INFO ] [LOCAL ] AMBQ: Starting deletion of primary data. [2025-10-15T17:11:53.620140] [DEBUG] [LOCAL ] AMBQ: No primary data file found to delete. [2025-10-15T17:11:53.620171] [INFO ] [MAIN ] AMBQ: Starting full primary refresh. [2025-10-15T17:11:53.724059] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-03. [2025-10-15T17:11:53.915140] [DEBUG] [LOCAL ] AMBP: Loaded 44612 existing records from primary storage. [2025-10-15T17:11:53.941151] [INFO ] [MAIN ] AMBP: Loaded 44612 existing records. [2025-10-15T17:11:54.153179] [INFO ] [REMOTE ] AMBQ: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:11:54.231760] [WARN ] [MAIN ] AMBP: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:11:54.231960] [INFO ] [MAIN ] AMBP: Wiping existing primary data before full refresh. [2025-10-15T17:11:54.232008] [INFO ] [LOCAL ] AMBP: Starting deletion of primary data. [2025-10-15T17:11:54.232372] [DEBUG] [LOCAL ] AMBP: Deleted primary data file. [2025-10-15T17:11:54.232411] [INFO ] [MAIN ] AMBP: Starting full primary refresh. [2025-10-15T17:11:54.521217] [INFO ] [REMOTE ] AMBQ: Fetching primary data for 2024-12. [2025-10-15T17:11:54.609885] [INFO ] [REMOTE ] AMBP: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:11:54.641458] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-15T17:11:54.749387] [DEBUG] [REMOTE ] AMBQ: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-15T17:11:54.749752] [WARN ] [REMOTE ] AMBQ: No data returned for month 2024-12 [2025-10-15T17:11:54.749834] [FATAL] [REMOTE ] AMBQ: API call failed - aborting fetch to avoid wasting further API calls [2025-10-15T17:11:54.749880] [FATAL] [MAIN ] AMBQ: Failed to fetch primary data. [2025-10-15T17:11:54.749914] [WARN ] [MAIN ] AMBQ: Deleting existing primary and derivative data due to fetch failure. [2025-10-15T17:11:54.749951] [INFO ] [LOCAL ] AMBQ: Starting deletion of primary data. [2025-10-15T17:11:54.750008] [DEBUG] [LOCAL ] AMBQ: No primary data file found to delete. [2025-10-15T17:11:54.750042] [INFO ] [LOCAL ] AMBQ: Starting deletion of derivative data. [2025-10-15T17:11:54.750081] [DEBUG] [LOCAL ] AMBQ: No derivative data file found to delete. [2025-10-15T17:11:54.750128] [INFO ] [MAIN ] Update Progress: 94/2369 symbols completed. AMBQ took 1.4s. Estimated remaining: 4h 46m 29s. Rate: 7.9 symbols/min [2025-10-15T17:11:54.926553] [INFO ] [MAIN ] AMC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:11:54.979209] [DEBUG] [LOCAL ] AMC: Loaded 53762 existing records from primary storage. [2025-10-15T17:11:54.979551] [INFO ] [MAIN ] AMC: Loaded 53762 existing records. [2025-10-15T17:11:55.173617] [WARN ] [MAIN ] AMC: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:11:55.174079] [INFO ] [MAIN ] AMC: Wiping existing primary data before full refresh. [2025-10-15T17:11:55.174223] [INFO ] [LOCAL ] AMC: Starting deletion of primary data. [2025-10-15T17:11:55.174907] [DEBUG] [LOCAL ] AMC: Deleted primary data file. [2025-10-15T17:11:55.174969] [INFO ] [MAIN ] AMC: Starting full primary refresh. [2025-10-15T17:11:55.316905] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2024-12. [2025-10-15T17:11:55.609811] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-15T17:11:55.616357] [INFO ] [REMOTE ] AMC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:11:56.114024] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-09. [2025-10-15T17:11:56.817352] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-15T17:11:56.914052] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-01. [2025-10-15T17:11:57.714022] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-04. [2025-10-15T17:11:57.876551] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-15T17:11:58.006132] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-15T17:11:58.514046] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-10. [2025-10-15T17:11:59.226167] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-15T17:11:59.314019] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-05. [2025-10-15T17:12:00.119751] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-02. [2025-10-15T17:12:00.136964] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-15T17:12:00.147143] [INFO ] [REMOTE ] AM: Full fetch complete (75712 records). [2025-10-15T17:12:00.147331] [DEBUG] [VALIDATOR ] AM: Validating primary data. [2025-10-15T17:12:00.596754] [DEBUG] [VALIDATOR ] AM: All expected trading days are present. [2025-10-15T17:12:00.597127] [DEBUG] [VALIDATOR ] AM: Primary data validation passed. [2025-10-15T17:12:00.598143] [INFO ] [MAIN ] AM: Fetched primary data is valid. [2025-10-15T17:12:00.598237] [DEBUG] [LOCAL ] AM: Saving primary data. [2025-10-15T17:12:00.627289] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-15T17:12:00.627494] [DEBUG] [LOCAL ] AM: Trimmed 75712 records to 51939 (keeping 200 days of data) [2025-10-15T17:12:00.928405] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-06. [2025-10-15T17:12:00.973279] [DEBUG] [LOCAL ] AM: Primary data saved (51939 records). [2025-10-15T17:12:00.973479] [INFO ] [MAIN ] AM: Full history saved. [2025-10-15T17:12:00.973576] [INFO ] [MAIN ] Update Progress: 95/2369 symbols completed. AM took 37.6s. Estimated remaining: 4h 45m 49s. Rate: 8.0 symbols/min [2025-10-15T17:12:01.155354] [INFO ] [MAIN ] AMCR: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:12:01.213431] [DEBUG] [LOCAL ] AMCR: Loaded 53669 existing records from primary storage. [2025-10-15T17:12:01.213957] [INFO ] [MAIN ] AMCR: Loaded 53669 existing records. [2025-10-15T17:12:01.418556] [WARN ] [MAIN ] AMCR: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:12:01.419197] [INFO ] [MAIN ] AMCR: Wiping existing primary data before full refresh. [2025-10-15T17:12:01.419282] [INFO ] [LOCAL ] AMCR: Starting deletion of primary data. [2025-10-15T17:12:01.419860] [DEBUG] [LOCAL ] AMCR: Deleted primary data file. [2025-10-15T17:12:01.419951] [INFO ] [MAIN ] AMCR: Starting full primary refresh. [2025-10-15T17:12:01.642364] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-15T17:12:01.714260] [INFO ] [REMOTE ] AMC: Fetching primary data for 2024-12. [2025-10-15T17:12:01.885878] [INFO ] [REMOTE ] AMCR: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:12:02.084260] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-15T17:12:02.513979] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2024-12. [2025-10-15T17:12:03.314047] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-03. [2025-10-15T17:12:04.114059] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-07. [2025-10-15T17:12:04.454023] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-10-15T17:12:04.526208] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2024-12 (2.81 seconds). [2025-10-15T17:12:04.900576] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-15T17:12:04.913961] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-04. [2025-10-15T17:12:05.377243] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-15T17:12:05.714043] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-01. [2025-10-15T17:12:06.259197] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-15T17:12:06.514092] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-08. [2025-10-15T17:12:07.314038] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-01. [2025-10-15T17:12:07.662812] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-10-15T17:12:07.916240] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-15T17:12:08.114023] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-02. [2025-10-15T17:12:08.914073] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-05. [2025-10-15T17:12:09.142672] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-15T17:12:09.714045] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-09. [2025-10-15T17:12:10.156857] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-02 (2.04 seconds). [2025-10-15T17:12:10.513990] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-03. [2025-10-15T17:12:10.758568] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-15T17:12:10.825975] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-15T17:12:11.314063] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-06. [2025-10-15T17:12:12.114018] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-02. [2025-10-15T17:12:12.575540] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-15T17:12:12.899215] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-03 (2.39 seconds). [2025-10-15T17:12:12.913965] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-04. [2025-10-15T17:12:13.669131] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-15T17:12:13.714121] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-10. [2025-10-15T17:12:14.514090] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-03. [2025-10-15T17:12:15.241995] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-15T17:12:15.247840] [INFO ] [REMOTE ] AMBC: Full fetch complete (51759 records). [2025-10-15T17:12:15.247984] [DEBUG] [VALIDATOR ] AMBC: Validating primary data. [2025-10-15T17:12:15.314083] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-07. [2025-10-15T17:12:15.725369] [DEBUG] [VALIDATOR ] AMBC: All expected trading days are present. [2025-10-15T17:12:15.725190] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-04 (2.81 seconds). [2025-10-15T17:12:15.725544] [DEBUG] [VALIDATOR ] AMBC: Primary data validation passed. [2025-10-15T17:12:15.726457] [INFO ] [MAIN ] AMBC: Fetched primary data is valid. [2025-10-15T17:12:15.737305] [DEBUG] [LOCAL ] AMBC: Saving primary data. [2025-10-15T17:12:15.740054] [DEBUG] [LOCAL ] AMBC: Trimmed 51759 records to 36270 (keeping 200 days of data) [2025-10-15T17:12:15.955754] [DEBUG] [LOCAL ] AMBC: Primary data saved (36270 records). [2025-10-15T17:12:15.955967] [INFO ] [MAIN ] AMBC: Full history saved. [2025-10-15T17:12:15.956072] [INFO ] [MAIN ] Update Progress: 96/2369 symbols completed. AMBC took 32.9s. Estimated remaining: 4h 48m 38s. Rate: 7.9 symbols/min [2025-10-15T17:12:16.119282] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-05. [2025-10-15T17:12:16.147370] [INFO ] [MAIN ] AME: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:12:16.210489] [DEBUG] [LOCAL ] AME: Loaded 48682 existing records from primary storage. [2025-10-15T17:12:16.210981] [INFO ] [MAIN ] AME: Loaded 48682 existing records. [2025-10-15T17:12:16.413359] [WARN ] [MAIN ] AME: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:12:16.413847] [INFO ] [MAIN ] AME: Wiping existing primary data before full refresh. [2025-10-15T17:12:16.413922] [INFO ] [LOCAL ] AME: Starting deletion of primary data. [2025-10-15T17:12:16.414882] [DEBUG] [LOCAL ] AME: Deleted primary data file. [2025-10-15T17:12:16.414974] [INFO ] [MAIN ] AME: Starting full primary refresh. [2025-10-15T17:12:16.566541] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-10-15T17:12:16.875607] [INFO ] [REMOTE ] AME: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:12:16.915707] [INFO ] [REMOTE ] AME: Fetching primary data for 2024-12. [2025-10-15T17:12:16.923335] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-15T17:12:17.714021] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-08. [2025-10-15T17:12:18.297579] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-15T17:12:18.512764] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-05 (2.39 seconds). [2025-10-15T17:12:18.523540] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-04. [2025-10-15T17:12:19.056055] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-15T17:12:19.314033] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-06. [2025-10-15T17:12:20.113995] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-09. [2025-10-15T17:12:20.438105] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-15T17:12:20.914028] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-05. [2025-10-15T17:12:21.339487] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-10-15T17:12:21.530718] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-15T17:12:21.714018] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-10. [2025-10-15T17:12:22.428191] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-15T17:12:22.514002] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-06. [2025-10-15T17:12:23.180568] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-15T17:12:23.186308] [INFO ] [REMOTE ] AMBP: Full fetch complete (65369 records). [2025-10-15T17:12:23.186518] [DEBUG] [VALIDATOR ] AMBP: Validating primary data. [2025-10-15T17:12:23.319168] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-01. [2025-10-15T17:12:23.613470] [DEBUG] [VALIDATOR ] AMBP: All expected trading days are present. [2025-10-15T17:12:23.613600] [DEBUG] [VALIDATOR ] AMBP: Primary data validation passed. [2025-10-15T17:12:23.614529] [INFO ] [MAIN ] AMBP: Fetched primary data is valid. [2025-10-15T17:12:23.614604] [DEBUG] [LOCAL ] AMBP: Saving primary data. [2025-10-15T17:12:23.616916] [DEBUG] [LOCAL ] AMBP: Trimmed 65369 records to 44639 (keeping 200 days of data) [2025-10-15T17:12:23.908718] [DEBUG] [LOCAL ] AMBP: Primary data saved (44639 records). [2025-10-15T17:12:23.908908] [INFO ] [MAIN ] AMBP: Full history saved. [2025-10-15T17:12:23.909050] [INFO ] [MAIN ] Update Progress: 97/2369 symbols completed. AMBP took 30.7s. Estimated remaining: 4h 48m 38s. Rate: 7.9 symbols/min [2025-10-15T17:12:24.095156] [INFO ] [MAIN ] AMG: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:12:24.095571] [DEBUG] [LOCAL ] AMG: No existing data file found in primary storage. [2025-10-15T17:12:24.095702] [WARN ] [MAIN ] AMG: No existing data found, performing full refresh instead. [2025-10-15T17:12:24.095830] [INFO ] [MAIN ] AMG: Wiping existing primary data before full refresh. [2025-10-15T17:12:24.095873] [INFO ] [LOCAL ] AMG: Starting deletion of primary data. [2025-10-15T17:12:24.095915] [DEBUG] [LOCAL ] AMG: No primary data file found to delete. [2025-10-15T17:12:24.095950] [INFO ] [MAIN ] AMG: Starting full primary refresh. [2025-10-15T17:12:24.129388] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-07. [2025-10-15T17:12:24.526510] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-10-15T17:12:24.533814] [INFO ] [REMOTE ] AMG: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:12:24.914016] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-07. [2025-10-15T17:12:25.179049] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-15T17:12:25.714017] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-02. [2025-10-15T17:12:26.418775] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-07 (2.29 seconds). [2025-10-15T17:12:26.487383] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-15T17:12:26.513951] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-08. [2025-10-15T17:12:27.267324] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-15T17:12:27.313978] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-03. [2025-10-15T17:12:28.114020] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-08. [2025-10-15T17:12:28.249158] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-15T17:12:28.836198] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-15T17:12:28.914108] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-09. [2025-10-15T17:12:29.714043] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-04. [2025-10-15T17:12:30.486053] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-08 (2.37 seconds). [2025-10-15T17:12:30.513994] [INFO ] [REMOTE ] AMG: Fetching primary data for 2024-12. [2025-10-15T17:12:30.665707] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-15T17:12:31.145634] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-15T17:12:31.314069] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-05. [2025-10-15T17:12:31.663791] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-15T17:12:32.114013] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-01. [2025-10-15T17:12:32.904267] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-15T17:12:32.914876] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-10. [2025-10-15T17:12:33.099928] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-15T17:12:33.714032] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-09. [2025-10-15T17:12:34.514050] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-06. [2025-10-15T17:12:34.746888] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-15T17:12:34.753721] [INFO ] [REMOTE ] AMCR: Full fetch complete (77840 records). [2025-10-15T17:12:34.753874] [DEBUG] [VALIDATOR ] AMCR: Validating primary data. [2025-10-15T17:12:35.174825] [DEBUG] [VALIDATOR ] AMCR: All expected trading days are present. [2025-10-15T17:12:35.174934] [DEBUG] [VALIDATOR ] AMCR: Primary data validation passed. [2025-10-15T17:12:35.175788] [INFO ] [MAIN ] AMCR: Fetched primary data is valid. [2025-10-15T17:12:35.175856] [DEBUG] [LOCAL ] AMCR: Saving primary data. [2025-10-15T17:12:35.177878] [DEBUG] [LOCAL ] AMCR: Trimmed 77840 records to 53669 (keeping 200 days of data) [2025-10-15T17:12:35.354208] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-02. [2025-10-15T17:12:35.516807] [DEBUG] [LOCAL ] AMCR: Primary data saved (53669 records). [2025-10-15T17:12:35.517036] [INFO ] [MAIN ] AMCR: Full history saved. [2025-10-15T17:12:35.517637] [INFO ] [MAIN ] Update Progress: 98/2369 symbols completed. AMCR took 34.5s. Estimated remaining: 4h 50m 3s. Rate: 7.8 symbols/min [2025-10-15T17:12:35.695412] [INFO ] [MAIN ] AMH: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:12:35.761161] [DEBUG] [LOCAL ] AMH: Loaded 51797 existing records from primary storage. [2025-10-15T17:12:35.761572] [INFO ] [MAIN ] AMH: Loaded 51797 existing records. [2025-10-15T17:12:35.955726] [WARN ] [MAIN ] AMH: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:12:35.956484] [INFO ] [MAIN ] AMH: Wiping existing primary data before full refresh. [2025-10-15T17:12:35.957196] [INFO ] [LOCAL ] AMH: Starting deletion of primary data. [2025-10-15T17:12:35.957964] [DEBUG] [LOCAL ] AMH: Deleted primary data file. [2025-10-15T17:12:35.958033] [INFO ] [MAIN ] AMH: Starting full primary refresh. [2025-10-15T17:12:36.261333] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-15T17:12:36.312706] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-09 (2.60 seconds). [2025-10-15T17:12:36.367772] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-07. [2025-10-15T17:12:36.398978] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-15T17:12:36.484274] [INFO ] [REMOTE ] AMH: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:12:36.914053] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-10. [2025-10-15T17:12:37.713970] [INFO ] [REMOTE ] AMH: Fetching primary data for 2024-12. [2025-10-15T17:12:37.953938] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-15T17:12:38.514063] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-08. [2025-10-15T17:12:39.071263] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-10 (2.16 seconds). [2025-10-15T17:12:39.078233] [INFO ] [REMOTE ] AMC: Full fetch complete (77930 records). [2025-10-15T17:12:39.078420] [DEBUG] [VALIDATOR ] AMC: Validating primary data. [2025-10-15T17:12:39.325517] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-03. [2025-10-15T17:12:39.526383] [DEBUG] [VALIDATOR ] AMC: All expected trading days are present. [2025-10-15T17:12:39.526580] [DEBUG] [VALIDATOR ] AMC: Primary data validation passed. [2025-10-15T17:12:39.527634] [INFO ] [MAIN ] AMC: Fetched primary data is valid. [2025-10-15T17:12:39.527754] [DEBUG] [LOCAL ] AMC: Saving primary data. [2025-10-15T17:12:39.561881] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-15T17:12:39.559626] [DEBUG] [LOCAL ] AMC: Trimmed 77930 records to 53762 (keeping 200 days of data) [2025-10-15T17:12:39.901689] [DEBUG] [LOCAL ] AMC: Primary data saved (53762 records). [2025-10-15T17:12:39.901895] [INFO ] [MAIN ] AMC: Full history saved. [2025-10-15T17:12:39.901995] [INFO ] [MAIN ] Update Progress: 99/2369 symbols completed. AMC took 45.2s. Estimated remaining: 4h 48m 40s. Rate: 7.9 symbols/min [2025-10-15T17:12:40.079994] [INFO ] [MAIN ] AMN: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:12:40.123005] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-01. [2025-10-15T17:12:40.127301] [DEBUG] [LOCAL ] AMN: Loaded 41804 existing records from primary storage. [2025-10-15T17:12:40.127950] [INFO ] [MAIN ] AMN: Loaded 41804 existing records. [2025-10-15T17:12:40.324299] [WARN ] [MAIN ] AMN: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:12:40.325184] [INFO ] [MAIN ] AMN: Wiping existing primary data before full refresh. [2025-10-15T17:12:40.352690] [INFO ] [LOCAL ] AMN: Starting deletion of primary data. [2025-10-15T17:12:40.357708] [DEBUG] [LOCAL ] AMN: Deleted primary data file. [2025-10-15T17:12:40.359324] [INFO ] [MAIN ] AMN: Starting full primary refresh. [2025-10-15T17:12:40.359079] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-15T17:12:40.684149] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-15T17:12:40.796151] [INFO ] [REMOTE ] AMN: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:12:40.914038] [INFO ] [REMOTE ] AMN: Fetching primary data for 2024-12. [2025-10-15T17:12:41.572279] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-15T17:12:41.714049] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-02. [2025-10-15T17:12:42.514108] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-15T17:12:42.514184] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-09. [2025-10-15T17:12:43.224555] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-15T17:12:43.314032] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-01. [2025-10-15T17:12:44.114011] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-03. [2025-10-15T17:12:44.276536] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-15T17:12:44.483860] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-15T17:12:44.913996] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-04. [2025-10-15T17:12:45.714054] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-10. [2025-10-15T17:12:45.781784] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-15T17:12:45.877845] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-15T17:12:46.514085] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-02. [2025-10-15T17:12:47.314009] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-04. [2025-10-15T17:12:47.382580] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-15T17:12:47.389477] [INFO ] [REMOTE ] AME: Full fetch complete (70065 records). [2025-10-15T17:12:47.389719] [DEBUG] [VALIDATOR ] AME: Validating primary data. [2025-10-15T17:12:47.850977] [DEBUG] [VALIDATOR ] AME: All expected trading days are present. [2025-10-15T17:12:47.851181] [DEBUG] [VALIDATOR ] AME: Primary data validation passed. [2025-10-15T17:12:47.852079] [INFO ] [MAIN ] AME: Fetched primary data is valid. [2025-10-15T17:12:47.852162] [DEBUG] [LOCAL ] AME: Saving primary data. [2025-10-15T17:12:47.879382] [DEBUG] [LOCAL ] AME: Trimmed 70065 records to 48691 (keeping 200 days of data) [2025-10-15T17:12:47.879223] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-15T17:12:48.123163] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-03. [2025-10-15T17:12:48.226758] [DEBUG] [LOCAL ] AME: Primary data saved (48691 records). [2025-10-15T17:12:48.226965] [INFO ] [MAIN ] AME: Full history saved. [2025-10-15T17:12:48.229058] [INFO ] [MAIN ] Update Progress: 100/2369 symbols completed. AME took 32.3s. Estimated remaining: 4h 48m 48s. Rate: 7.9 symbols/min [2025-10-15T17:12:48.419737] [INFO ] [MAIN ] AMP: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:12:48.459906] [DEBUG] [LOCAL ] AMP: Loaded 32028 existing records from primary storage. [2025-10-15T17:12:48.460252] [INFO ] [MAIN ] AMP: Loaded 32028 existing records. [2025-10-15T17:12:48.648717] [WARN ] [MAIN ] AMP: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:12:48.648974] [INFO ] [MAIN ] AMP: Wiping existing primary data before full refresh. [2025-10-15T17:12:48.649042] [INFO ] [LOCAL ] AMP: Starting deletion of primary data. [2025-10-15T17:12:48.649926] [DEBUG] [LOCAL ] AMP: Deleted primary data file. [2025-10-15T17:12:48.649988] [INFO ] [MAIN ] AMP: Starting full primary refresh. [2025-10-15T17:12:48.918603] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-05. [2025-10-15T17:12:49.026439] [INFO ] [REMOTE ] AMP: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:12:49.064938] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-15T17:12:49.702373] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-15T17:12:49.714005] [INFO ] [REMOTE ] AMP: Fetching primary data for 2024-12. [2025-10-15T17:12:49.776759] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-15T17:12:50.514042] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-04. [2025-10-15T17:12:51.105543] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-15T17:12:51.314003] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-05. [2025-10-15T17:12:51.877046] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-15T17:12:52.114044] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-06. [2025-10-15T17:12:52.898601] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-15T17:12:52.913961] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-07. [2025-10-15T17:12:53.107060] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-15T17:12:53.714045] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-05. [2025-10-15T17:12:53.980666] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-15T17:12:54.514106] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-01. [2025-10-15T17:12:55.134461] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-15T17:12:55.314080] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-08. [2025-10-15T17:12:55.950160] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-15T17:12:56.114044] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-02. [2025-10-15T17:12:56.175225] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-15T17:12:56.914040] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-09. [2025-10-15T17:12:57.384352] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-15T17:12:57.634427] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-15T17:12:57.714053] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-06. [2025-10-15T17:12:58.514047] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-03. [2025-10-15T17:12:58.899785] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-15T17:12:59.314017] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-10. [2025-10-15T17:13:00.044564] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-15T17:13:00.113996] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-06. [2025-10-15T17:13:00.388128] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-15T17:13:00.390819] [INFO ] [REMOTE ] AMG: Full fetch complete (29577 records). [2025-10-15T17:13:00.390903] [DEBUG] [VALIDATOR ] AMG: Validating primary data. [2025-10-15T17:13:00.766275] [DEBUG] [VALIDATOR ] AMG: All expected trading days are present. [2025-10-15T17:13:00.766381] [DEBUG] [VALIDATOR ] AMG: Primary data validation passed. [2025-10-15T17:13:00.766867] [INFO ] [MAIN ] AMG: Fetched primary data is valid. [2025-10-15T17:13:00.766933] [DEBUG] [LOCAL ] AMG: Saving primary data. [2025-10-15T17:13:00.767979] [DEBUG] [LOCAL ] AMG: Trimmed 29577 records to 20143 (keeping 200 days of data) [2025-10-15T17:13:00.900480] [DEBUG] [LOCAL ] AMG: Primary data saved (20143 records). [2025-10-15T17:13:00.900639] [INFO ] [MAIN ] AMG: Full history saved. [2025-10-15T17:13:00.900759] [INFO ] [MAIN ] Update Progress: 101/2369 symbols completed. AMG took 37.0s. Estimated remaining: 4h 50m 34s. Rate: 7.8 symbols/min [2025-10-15T17:13:00.921611] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-04. [2025-10-15T17:13:01.093504] [INFO ] [MAIN ] AMPX: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:13:01.156148] [DEBUG] [LOCAL ] AMPX: Loaded 52326 existing records from primary storage. [2025-10-15T17:13:01.156609] [INFO ] [MAIN ] AMPX: Loaded 52326 existing records. [2025-10-15T17:13:01.351201] [WARN ] [MAIN ] AMPX: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:13:01.351471] [INFO ] [MAIN ] AMPX: Wiping existing primary data before full refresh. [2025-10-15T17:13:01.351616] [INFO ] [LOCAL ] AMPX: Starting deletion of primary data. [2025-10-15T17:13:01.352152] [DEBUG] [LOCAL ] AMPX: Deleted primary data file. [2025-10-15T17:13:01.352214] [INFO ] [MAIN ] AMPX: Starting full primary refresh. [2025-10-15T17:13:01.748843] [INFO ] [REMOTE ] AMPX: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:13:01.744811] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-07. [2025-10-15T17:13:01.785314] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-15T17:13:02.514103] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2024-12. [2025-10-15T17:13:02.628115] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-15T17:13:03.293108] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-15T17:13:03.314021] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-05. [2025-10-15T17:13:04.114002] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-08. [2025-10-15T17:13:04.323339] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-15T17:13:04.771310] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-15T17:13:04.914012] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-01. [2025-10-15T17:13:05.557808] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-15T17:13:05.714076] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-06. [2025-10-15T17:13:06.519206] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-07. [2025-10-15T17:13:06.540961] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-15T17:13:07.108757] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-15T17:13:07.314081] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-09. [2025-10-15T17:13:08.113978] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-07. [2025-10-15T17:13:08.466491] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-15T17:13:08.649147] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-15T17:13:08.914031] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-10. [2025-10-15T17:13:09.138319] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-15T17:13:09.714086] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-08. [2025-10-15T17:13:10.492012] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-15T17:13:10.497802] [INFO ] [REMOTE ] AMN: Full fetch complete (60390 records). [2025-10-15T17:13:10.498032] [DEBUG] [VALIDATOR ] AMN: Validating primary data. [2025-10-15T17:13:10.520467] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-02. [2025-10-15T17:13:10.922740] [DEBUG] [VALIDATOR ] AMN: All expected trading days are present. [2025-10-15T17:13:10.922856] [DEBUG] [VALIDATOR ] AMN: Primary data validation passed. [2025-10-15T17:13:10.923704] [INFO ] [MAIN ] AMN: Fetched primary data is valid. [2025-10-15T17:13:10.923820] [DEBUG] [LOCAL ] AMN: Saving primary data. [2025-10-15T17:13:10.925848] [DEBUG] [LOCAL ] AMN: Trimmed 60390 records to 41839 (keeping 200 days of data) [2025-10-15T17:13:11.183765] [DEBUG] [LOCAL ] AMN: Primary data saved (41839 records). [2025-10-15T17:13:11.184000] [INFO ] [MAIN ] AMN: Full history saved. [2025-10-15T17:13:11.184220] [INFO ] [MAIN ] Update Progress: 102/2369 symbols completed. AMN took 31.3s. Estimated remaining: 4h 51m 24s. Rate: 7.8 symbols/min [2025-10-15T17:13:11.315985] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-08. [2025-10-15T17:13:11.372783] [INFO ] [MAIN ] AMPY: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:13:11.373291] [DEBUG] [LOCAL ] AMPY: No existing data file found in primary storage. [2025-10-15T17:13:11.373370] [WARN ] [MAIN ] AMPY: No existing data found, performing full refresh instead. [2025-10-15T17:13:11.373708] [INFO ] [MAIN ] AMPY: Wiping existing primary data before full refresh. [2025-10-15T17:13:11.373791] [INFO ] [LOCAL ] AMPY: Starting deletion of primary data. [2025-10-15T17:13:11.373985] [DEBUG] [LOCAL ] AMPY: No primary data file found to delete. [2025-10-15T17:13:11.374059] [INFO ] [MAIN ] AMPY: Starting full primary refresh. [2025-10-15T17:13:11.573755] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-15T17:13:11.815376] [INFO ] [REMOTE ] AMPY: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:13:12.114008] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2024-12. [2025-10-15T17:13:12.171299] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-15T17:13:12.766975] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-15T17:13:12.914029] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-09. [2025-10-15T17:13:12.983059] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-10-15T17:13:13.714085] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-03. [2025-10-15T17:13:14.255284] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-15T17:13:14.514044] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-10. [2025-10-15T17:13:15.314016] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-09. [2025-10-15T17:13:15.802993] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-10-15T17:13:16.057398] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-15T17:13:16.061556] [INFO ] [REMOTE ] AMP: Full fetch complete (47451 records). [2025-10-15T17:13:16.061708] [DEBUG] [VALIDATOR ] AMP: Validating primary data. [2025-10-15T17:13:16.124076] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-01. [2025-10-15T17:13:16.439082] [DEBUG] [VALIDATOR ] AMP: All expected trading days are present. [2025-10-15T17:13:16.439163] [DEBUG] [VALIDATOR ] AMP: Primary data validation passed. [2025-10-15T17:13:16.439742] [INFO ] [MAIN ] AMP: Fetched primary data is valid. [2025-10-15T17:13:16.439804] [DEBUG] [LOCAL ] AMP: Saving primary data. [2025-10-15T17:13:16.440795] [DEBUG] [LOCAL ] AMP: Trimmed 47451 records to 32020 (keeping 200 days of data) [2025-10-15T17:13:16.644186] [DEBUG] [LOCAL ] AMP: Primary data saved (32020 records). [2025-10-15T17:13:16.644384] [INFO ] [MAIN ] AMP: Full history saved. [2025-10-15T17:13:16.644503] [INFO ] [MAIN ] Update Progress: 103/2369 symbols completed. AMP took 28.4s. Estimated remaining: 4h 50m 27s. Rate: 7.8 symbols/min [2025-10-15T17:13:16.815673] [INFO ] [MAIN ] AMR: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:13:16.850553] [DEBUG] [LOCAL ] AMR: Loaded 28850 existing records from primary storage. [2025-10-15T17:13:16.850880] [INFO ] [MAIN ] AMR: Loaded 28850 existing records. [2025-10-15T17:13:16.919832] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-04. [2025-10-15T17:13:17.039428] [WARN ] [MAIN ] AMR: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:13:17.040389] [INFO ] [MAIN ] AMR: Wiping existing primary data before full refresh. [2025-10-15T17:13:17.040770] [INFO ] [LOCAL ] AMR: Starting deletion of primary data. [2025-10-15T17:13:17.042020] [DEBUG] [LOCAL ] AMR: Deleted primary data file. [2025-10-15T17:13:17.073473] [INFO ] [MAIN ] AMR: Starting full primary refresh. [2025-10-15T17:13:17.125400] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-15T17:13:17.167978] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-15T17:13:17.517420] [INFO ] [REMOTE ] AMR: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:13:17.714003] [INFO ] [REMOTE ] AMR: Fetching primary data for 2024-12. [2025-10-15T17:13:18.514003] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-10. [2025-10-15T17:13:18.552799] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-15T17:13:18.657276] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-10-15T17:13:19.314049] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-05. [2025-10-15T17:13:20.114015] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-01. [2025-10-15T17:13:20.913986] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-02. [2025-10-15T17:13:21.102457] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-15T17:13:21.714013] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-02. [2025-10-15T17:13:21.789337] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-10 (3.28 seconds). [2025-10-15T17:13:21.798372] [INFO ] [REMOTE ] AMH: Full fetch complete (75052 records). [2025-10-15T17:13:21.798709] [DEBUG] [VALIDATOR ] AMH: Validating primary data. [2025-10-15T17:13:22.256208] [DEBUG] [VALIDATOR ] AMH: All expected trading days are present. [2025-10-15T17:13:22.256355] [DEBUG] [VALIDATOR ] AMH: Primary data validation passed. [2025-10-15T17:13:22.257332] [INFO ] [MAIN ] AMH: Fetched primary data is valid. [2025-10-15T17:13:22.257406] [DEBUG] [LOCAL ] AMH: Saving primary data. [2025-10-15T17:13:22.259416] [DEBUG] [LOCAL ] AMH: Trimmed 75052 records to 51831 (keeping 200 days of data) [2025-10-15T17:13:22.599542] [DEBUG] [LOCAL ] AMH: Primary data saved (51831 records). [2025-10-15T17:13:22.599742] [INFO ] [MAIN ] AMH: Full history saved. [2025-10-15T17:13:22.599854] [INFO ] [MAIN ] Update Progress: 104/2369 symbols completed. AMH took 47.1s. Estimated remaining: 4h 49m 41s. Rate: 7.8 symbols/min [2025-10-15T17:13:22.768212] [INFO ] [MAIN ] AMRC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:13:22.803479] [DEBUG] [LOCAL ] AMRC: Loaded 38369 existing records from primary storage. [2025-10-15T17:13:22.803790] [INFO ] [MAIN ] AMRC: Loaded 38369 existing records. [2025-10-15T17:13:23.024496] [WARN ] [MAIN ] AMRC: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:13:23.025914] [INFO ] [MAIN ] AMRC: Wiping existing primary data before full refresh. [2025-10-15T17:13:23.028173] [INFO ] [LOCAL ] AMRC: Starting deletion of primary data. [2025-10-15T17:13:23.028060] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-05 (3.71 seconds). [2025-10-15T17:13:23.038934] [DEBUG] [LOCAL ] AMRC: Deleted primary data file. [2025-10-15T17:13:23.039597] [INFO ] [MAIN ] AMRC: Starting full primary refresh. [2025-10-15T17:13:23.054379] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-06. [2025-10-15T17:13:23.076188] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-15T17:13:23.328785] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-03. [2025-10-15T17:13:23.379425] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-02 (2.47 seconds). [2025-10-15T17:13:23.443979] [INFO ] [REMOTE ] AMRC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:13:24.114020] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-03. [2025-10-15T17:13:24.648981] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-15T17:13:24.922246] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-04. [2025-10-15T17:13:24.941791] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-15T17:13:25.089513] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-15T17:13:25.714082] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2024-12. [2025-10-15T17:13:26.339208] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-15T17:13:26.514006] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-07. [2025-10-15T17:13:26.915175] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-15T17:13:27.314007] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-05. [2025-10-15T17:13:28.114011] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-04. [2025-10-15T17:13:28.439516] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-15T17:13:28.913988] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-01. [2025-10-15T17:13:28.948247] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-07 (2.43 seconds). [2025-10-15T17:13:29.620455] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-15T17:13:29.714045] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-08. [2025-10-15T17:13:30.201706] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-15T17:13:30.514083] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-05. [2025-10-15T17:13:31.314050] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-06. [2025-10-15T17:13:31.996662] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-08 (2.28 seconds). [2025-10-15T17:13:32.113994] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-02. [2025-10-15T17:13:32.363090] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-15T17:13:32.689504] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-15T17:13:32.914011] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-06. [2025-10-15T17:13:33.349512] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-15T17:13:33.714009] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-03. [2025-10-15T17:13:34.515208] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-07. [2025-10-15T17:13:34.516992] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-15T17:13:35.299440] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-15T17:13:35.313953] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-04. [2025-10-15T17:13:35.632472] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-15T17:13:36.114076] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-09. [2025-10-15T17:13:36.914042] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-08. [2025-10-15T17:13:37.604221] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-04 (2.29 seconds). [2025-10-15T17:13:37.714035] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-07. [2025-10-15T17:13:38.200465] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-09 (2.09 seconds). [2025-10-15T17:13:38.479025] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-15T17:13:38.514026] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-09. [2025-10-15T17:13:39.194460] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-15T17:13:39.313967] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-10. [2025-10-15T17:13:39.434216] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-15T17:13:40.114008] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-10. [2025-10-15T17:13:40.914022] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-08. [2025-10-15T17:13:41.431887] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-15T17:13:41.435701] [INFO ] [REMOTE ] AMR: Full fetch complete (40534 records). [2025-10-15T17:13:41.435807] [DEBUG] [VALIDATOR ] AMR: Validating primary data. [2025-10-15T17:13:41.718309] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-05. [2025-10-15T17:13:41.830007] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-10 (2.52 seconds). [2025-10-15T17:13:41.870795] [DEBUG] [VALIDATOR ] AMR: All expected trading days are present. [2025-10-15T17:13:41.871544] [DEBUG] [VALIDATOR ] AMR: Primary data validation passed. [2025-10-15T17:13:41.872170] [INFO ] [MAIN ] AMR: Fetched primary data is valid. [2025-10-15T17:13:41.872357] [DEBUG] [LOCAL ] AMR: Saving primary data. [2025-10-15T17:13:41.872757] [INFO ] [REMOTE ] AMPX: Full fetch complete (75205 records). [2025-10-15T17:13:41.873122] [DEBUG] [VALIDATOR ] AMPX: Validating primary data. [2025-10-15T17:13:41.873791] [DEBUG] [LOCAL ] AMR: Trimmed 40534 records to 28956 (keeping 200 days of data) [2025-10-15T17:13:42.307639] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-15T17:13:42.514114] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-09. [2025-10-15T17:13:42.516785] [DEBUG] [VALIDATOR ] AMPX: All expected trading days are present. [2025-10-15T17:13:42.516574] [DEBUG] [LOCAL ] AMR: Primary data saved (28956 records). [2025-10-15T17:13:42.517321] [INFO ] [MAIN ] AMR: Full history saved. [2025-10-15T17:13:42.518737] [DEBUG] [VALIDATOR ] AMPX: Primary data validation passed. [2025-10-15T17:13:42.518680] [INFO ] [MAIN ] Update Progress: 105/2369 symbols completed. AMR took 25.9s. Estimated remaining: 4h 53m 57s. Rate: 7.7 symbols/min [2025-10-15T17:13:42.525943] [INFO ] [MAIN ] AMPX: Fetched primary data is valid. [2025-10-15T17:13:42.537461] [DEBUG] [LOCAL ] AMPX: Saving primary data. [2025-10-15T17:13:42.638632] [DEBUG] [LOCAL ] AMPX: Trimmed 75205 records to 52338 (keeping 200 days of data) [2025-10-15T17:13:42.795009] [INFO ] [MAIN ] AMRZ: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:13:42.796785] [DEBUG] [LOCAL ] AMRZ: No existing data file found in primary storage. [2025-10-15T17:13:42.797765] [WARN ] [MAIN ] AMRZ: No existing data found, performing full refresh instead. [2025-10-15T17:13:42.798262] [INFO ] [MAIN ] AMRZ: Wiping existing primary data before full refresh. [2025-10-15T17:13:42.798696] [INFO ] [LOCAL ] AMRZ: Starting deletion of primary data. [2025-10-15T17:13:42.799042] [DEBUG] [LOCAL ] AMRZ: No primary data file found to delete. [2025-10-15T17:13:42.800894] [INFO ] [MAIN ] AMRZ: Starting full primary refresh. [2025-10-15T17:13:43.249009] [INFO ] [REMOTE ] AMRZ: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:13:43.314043] [INFO ] [REMOTE ] AMRZ: Fetching primary data for 2024-12. [2025-10-15T17:13:43.396267] [DEBUG] [LOCAL ] AMPX: Primary data saved (52338 records). [2025-10-15T17:13:43.396412] [INFO ] [MAIN ] AMPX: Full history saved. [2025-10-15T17:13:43.396497] [INFO ] [MAIN ] Update Progress: 106/2369 symbols completed. AMPX took 42.5s. Estimated remaining: 4h 51m 22s. Rate: 7.8 symbols/min [2025-10-15T17:13:43.575371] [INFO ] [MAIN ] AMT: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:13:43.627308] [DEBUG] [LOCAL ] AMT: Loaded 52466 existing records from primary storage. [2025-10-15T17:13:43.627737] [INFO ] [MAIN ] AMT: Loaded 52466 existing records. [2025-10-15T17:13:43.807254] [WARN ] [MAIN ] AMT: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:13:43.807479] [INFO ] [MAIN ] AMT: Wiping existing primary data before full refresh. [2025-10-15T17:13:43.807723] [INFO ] [LOCAL ] AMT: Starting deletion of primary data. [2025-10-15T17:13:43.808292] [DEBUG] [LOCAL ] AMT: Deleted primary data file. [2025-10-15T17:13:43.808332] [INFO ] [MAIN ] AMT: Starting full primary refresh. [2025-10-15T17:13:44.118731] [DEBUG] [REMOTE ] AMRZ: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-15T17:13:44.130074] [WARN ] [REMOTE ] AMRZ: No data returned for month 2024-12 [2025-10-15T17:13:44.140983] [FATAL] [REMOTE ] AMRZ: API call failed - aborting fetch to avoid wasting further API calls [2025-10-15T17:13:44.151444] [FATAL] [MAIN ] AMRZ: Failed to fetch primary data. [2025-10-15T17:13:44.172555] [WARN ] [MAIN ] AMRZ: Deleting existing primary and derivative data due to fetch failure. [2025-10-15T17:13:44.177957] [INFO ] [LOCAL ] AMRZ: Starting deletion of primary data. [2025-10-15T17:13:44.183988] [DEBUG] [LOCAL ] AMRZ: No primary data file found to delete. [2025-10-15T17:13:44.193958] [INFO ] [LOCAL ] AMRZ: Starting deletion of derivative data. [2025-10-15T17:13:44.212506] [DEBUG] [LOCAL ] AMRZ: No derivative data file found to delete. [2025-10-15T17:13:44.215697] [INFO ] [MAIN ] Update Progress: 107/2369 symbols completed. AMRZ took 1.7s. Estimated remaining: 4h 48m 48s. Rate: 7.8 symbols/min [2025-10-15T17:13:44.215619] [INFO ] [REMOTE ] AMT: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:13:44.274423] [INFO ] [REMOTE ] AMT: Fetching primary data for 2024-12. [2025-10-15T17:13:44.409367] [INFO ] [MAIN ] AMTB: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:13:44.431105] [DEBUG] [LOCAL ] AMTB: Loaded 20513 existing records from primary storage. [2025-10-15T17:13:44.431379] [INFO ] [MAIN ] AMTB: Loaded 20513 existing records. [2025-10-15T17:13:44.606694] [WARN ] [MAIN ] AMTB: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:13:44.606889] [INFO ] [MAIN ] AMTB: Wiping existing primary data before full refresh. [2025-10-15T17:13:44.606936] [INFO ] [LOCAL ] AMTB: Starting deletion of primary data. [2025-10-15T17:13:44.607247] [DEBUG] [LOCAL ] AMTB: Deleted primary data file. [2025-10-15T17:13:44.607309] [INFO ] [MAIN ] AMTB: Starting full primary refresh. [2025-10-15T17:13:44.942739] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-05 (3.22 seconds). [2025-10-15T17:13:44.986261] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-06. [2025-10-15T17:13:44.992339] [INFO ] [REMOTE ] AMTB: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:13:45.623230] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-09 (3.11 seconds). [2025-10-15T17:13:45.714071] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2024-12. [2025-10-15T17:13:46.412814] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-15T17:13:46.514034] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-07. [2025-10-15T17:13:46.935232] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-15T17:13:47.314028] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-10. [2025-10-15T17:13:47.637683] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-15T17:13:47.815819] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2024-12 (3.54 seconds). [2025-10-15T17:13:48.114058] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-01. [2025-10-15T17:13:48.641706] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-15T17:13:48.647431] [INFO ] [REMOTE ] AMPY: Full fetch complete (52861 records). [2025-10-15T17:13:48.647554] [DEBUG] [VALIDATOR ] AMPY: Validating primary data. [2025-10-15T17:13:48.927248] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-08. [2025-10-15T17:13:48.958845] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-15T17:13:49.054386] [DEBUG] [VALIDATOR ] AMPY: All expected trading days are present. [2025-10-15T17:13:49.054465] [DEBUG] [VALIDATOR ] AMPY: Primary data validation passed. [2025-10-15T17:13:49.055048] [INFO ] [MAIN ] AMPY: Fetched primary data is valid. [2025-10-15T17:13:49.055110] [DEBUG] [LOCAL ] AMPY: Saving primary data. [2025-10-15T17:13:49.056268] [DEBUG] [LOCAL ] AMPY: Trimmed 52861 records to 39159 (keeping 200 days of data) [2025-10-15T17:13:49.270671] [DEBUG] [LOCAL ] AMPY: Primary data saved (39159 records). [2025-10-15T17:13:49.270824] [INFO ] [MAIN ] AMPY: Full history saved. [2025-10-15T17:13:49.270906] [INFO ] [MAIN ] Update Progress: 108/2369 symbols completed. AMPY took 38.1s. Estimated remaining: 4h 47m 46s. Rate: 7.9 symbols/min [2025-10-15T17:13:49.441801] [INFO ] [MAIN ] AMTD: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:13:49.447356] [DEBUG] [LOCAL ] AMTD: Loaded 3790 existing records from primary storage. [2025-10-15T17:13:49.447497] [INFO ] [MAIN ] AMTD: Loaded 3790 existing records. [2025-10-15T17:13:49.624593] [WARN ] [MAIN ] AMTD: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:13:49.624817] [INFO ] [MAIN ] AMTD: Wiping existing primary data before full refresh. [2025-10-15T17:13:49.624867] [INFO ] [LOCAL ] AMTD: Starting deletion of primary data. [2025-10-15T17:13:49.625011] [DEBUG] [LOCAL ] AMTD: Deleted primary data file. [2025-10-15T17:13:49.625051] [INFO ] [MAIN ] AMTD: Starting full primary refresh. [2025-10-15T17:13:49.722795] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-01. [2025-10-15T17:13:49.983863] [INFO ] [REMOTE ] AMTD: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:13:50.513994] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-02. [2025-10-15T17:13:50.769205] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-15T17:13:51.313978] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2024-12. [2025-10-15T17:13:51.446836] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-15T17:13:51.511086] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-15T17:13:51.833894] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2024-12 (0.52 seconds). [2025-10-15T17:13:52.114062] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-02. [2025-10-15T17:13:52.914044] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-09. [2025-10-15T17:13:53.714007] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-01. [2025-10-15T17:13:54.089702] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-10-15T17:13:54.410965] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-15T17:13:54.438532] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-15T17:13:54.513957] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-10. [2025-10-15T17:13:55.314058] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-02. [2025-10-15T17:13:55.907059] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-15T17:13:56.003354] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-15T17:13:56.008758] [INFO ] [REMOTE ] AMRC: Full fetch complete (54124 records). [2025-10-15T17:13:56.008864] [DEBUG] [VALIDATOR ] AMRC: Validating primary data. [2025-10-15T17:13:56.119130] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-03. [2025-10-15T17:13:56.396329] [DEBUG] [VALIDATOR ] AMRC: All expected trading days are present. [2025-10-15T17:13:56.396408] [DEBUG] [VALIDATOR ] AMRC: Primary data validation passed. [2025-10-15T17:13:56.397023] [INFO ] [MAIN ] AMRC: Fetched primary data is valid. [2025-10-15T17:13:56.397085] [DEBUG] [LOCAL ] AMRC: Saving primary data. [2025-10-15T17:13:56.398266] [DEBUG] [LOCAL ] AMRC: Trimmed 54124 records to 38459 (keeping 200 days of data) [2025-10-15T17:13:56.625924] [DEBUG] [LOCAL ] AMRC: Primary data saved (38459 records). [2025-10-15T17:13:56.626091] [INFO ] [MAIN ] AMRC: Full history saved. [2025-10-15T17:13:56.626182] [INFO ] [MAIN ] Update Progress: 109/2369 symbols completed. AMRC took 34.0s. Estimated remaining: 4h 47m 33s. Rate: 7.9 symbols/min [2025-10-15T17:13:56.707018] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-15T17:13:56.802225] [INFO ] [MAIN ] AMTM: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:13:56.802402] [DEBUG] [LOCAL ] AMTM: No existing data file found in primary storage. [2025-10-15T17:13:56.802440] [WARN ] [MAIN ] AMTM: No existing data found, performing full refresh instead. [2025-10-15T17:13:56.802558] [INFO ] [MAIN ] AMTM: Wiping existing primary data before full refresh. [2025-10-15T17:13:56.802598] [INFO ] [LOCAL ] AMTM: Starting deletion of primary data. [2025-10-15T17:13:56.802639] [DEBUG] [LOCAL ] AMTM: No primary data file found to delete. [2025-10-15T17:13:56.802718] [INFO ] [MAIN ] AMTM: Starting full primary refresh. [2025-10-15T17:13:56.919121] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-03. [2025-10-15T17:13:57.175518] [INFO ] [REMOTE ] AMTM: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:13:57.714060] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2024-12. [2025-10-15T17:13:58.514019] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-03. [2025-10-15T17:13:59.313979] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-04. [2025-10-15T17:13:59.381332] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-03 (2.46 seconds). [2025-10-15T17:13:59.620594] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-10-15T17:13:59.655535] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-04 (0.34 seconds). [2025-10-15T17:13:59.818038] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-15T17:14:00.114007] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-04. [2025-10-15T17:14:00.914003] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-04. [2025-10-15T17:14:01.714103] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-05. [2025-10-15T17:14:02.206473] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-15T17:14:02.385345] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-04 (2.27 seconds). [2025-10-15T17:14:02.514054] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-05. [2025-10-15T17:14:03.089221] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-04 (2.18 seconds). [2025-10-15T17:14:03.314003] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-05. [2025-10-15T17:14:04.113974] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-01. [2025-10-15T17:14:04.214046] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-15T17:14:04.429848] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-15T17:14:04.914005] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-06. [2025-10-15T17:14:05.714099] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-06. [2025-10-15T17:14:05.769345] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-15T17:14:06.480605] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-15T17:14:06.513960] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-07. [2025-10-15T17:14:06.738985] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-15T17:14:07.314026] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-06. [2025-10-15T17:14:07.966848] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-15T17:14:08.113977] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-07. [2025-10-15T17:14:08.360238] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-15T17:14:08.913974] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-08. [2025-10-15T17:14:09.714022] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-07. [2025-10-15T17:14:09.828171] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-15T17:14:10.314740] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-15T17:14:10.514006] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-08. [2025-10-15T17:14:11.187270] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-10-15T17:14:11.190228] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-08 (2.28 seconds). [2025-10-15T17:14:11.314003] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-08. [2025-10-15T17:14:12.114023] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-09. [2025-10-15T17:14:12.417887] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-15T17:14:12.914000] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-02. [2025-10-15T17:14:13.713984] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-09. [2025-10-15T17:14:13.771914] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-15T17:14:14.513971] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-09. [2025-10-15T17:14:14.632608] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-15T17:14:15.189975] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-02 (2.28 seconds). [2025-10-15T17:14:15.313974] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-10. [2025-10-15T17:14:15.474714] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-15T17:14:15.958048] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-15T17:14:15.959637] [INFO ] [REMOTE ] AMTD: Full fetch complete (5588 records). [2025-10-15T17:14:15.959741] [DEBUG] [VALIDATOR ] AMTD: Validating primary data. [2025-10-15T17:14:16.119115] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-10. [2025-10-15T17:14:16.463432] [DEBUG] [VALIDATOR ] AMTD: All expected trading days are present. [2025-10-15T17:14:16.463529] [DEBUG] [VALIDATOR ] AMTD: Primary data validation passed. [2025-10-15T17:14:16.463740] [INFO ] [MAIN ] AMTD: Fetched primary data is valid. [2025-10-15T17:14:16.463803] [DEBUG] [LOCAL ] AMTD: Saving primary data. [2025-10-15T17:14:16.464459] [DEBUG] [LOCAL ] AMTD: Trimmed 5588 records to 3789 (keeping 200 days of data) [2025-10-15T17:14:16.489203] [DEBUG] [LOCAL ] AMTD: Primary data saved (3789 records). [2025-10-15T17:14:16.489361] [INFO ] [MAIN ] AMTD: Full history saved. [2025-10-15T17:14:16.489452] [INFO ] [MAIN ] Update Progress: 110/2369 symbols completed. AMTD took 27.2s. Estimated remaining: 4h 51m 36s. Rate: 7.7 symbols/min [2025-10-15T17:14:16.726789] [INFO ] [MAIN ] AMWL: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:14:16.740917] [DEBUG] [LOCAL ] AMWL: Loaded 9471 existing records from primary storage. [2025-10-15T17:14:16.741199] [INFO ] [MAIN ] AMWL: Loaded 9471 existing records. [2025-10-15T17:14:16.919154] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-10. [2025-10-15T17:14:17.010214] [WARN ] [MAIN ] AMWL: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:14:17.010954] [INFO ] [MAIN ] AMWL: Wiping existing primary data before full refresh. [2025-10-15T17:14:17.011006] [INFO ] [LOCAL ] AMWL: Starting deletion of primary data. [2025-10-15T17:14:17.011269] [DEBUG] [LOCAL ] AMWL: Deleted primary data file. [2025-10-15T17:14:17.011345] [INFO ] [MAIN ] AMWL: Starting full primary refresh. [2025-10-15T17:14:17.418764] [INFO ] [REMOTE ] AMWL: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:14:17.713963] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2024-12. [2025-10-15T17:14:17.982199] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-15T17:14:17.985416] [INFO ] [REMOTE ] AMTB: Full fetch complete (29594 records). [2025-10-15T17:14:17.985579] [DEBUG] [VALIDATOR ] AMTB: Validating primary data. [2025-10-15T17:14:18.144669] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-10 (2.03 seconds). [2025-10-15T17:14:18.201851] [INFO ] [REMOTE ] AMT: Full fetch complete (76190 records). [2025-10-15T17:14:18.203830] [DEBUG] [VALIDATOR ] AMT: Validating primary data. [2025-10-15T17:14:18.520224] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-03. [2025-10-15T17:14:18.703142] [DEBUG] [VALIDATOR ] AMTB: All expected trading days are present. [2025-10-15T17:14:18.733114] [DEBUG] [VALIDATOR ] AMTB: Primary data validation passed. [2025-10-15T17:14:18.741473] [INFO ] [MAIN ] AMTB: Fetched primary data is valid. [2025-10-15T17:14:18.751755] [DEBUG] [LOCAL ] AMTB: Saving primary data. [2025-10-15T17:14:18.752567] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-10-15T17:14:18.813002] [DEBUG] [LOCAL ] AMTB: Trimmed 29594 records to 20526 (keeping 200 days of data) [2025-10-15T17:14:18.910390] [DEBUG] [VALIDATOR ] AMT: All expected trading days are present. [2025-10-15T17:14:18.910832] [DEBUG] [VALIDATOR ] AMT: Primary data validation passed. [2025-10-15T17:14:18.936590] [INFO ] [MAIN ] AMT: Fetched primary data is valid. [2025-10-15T17:14:18.937248] [DEBUG] [LOCAL ] AMT: Saving primary data. [2025-10-15T17:14:18.941837] [DEBUG] [LOCAL ] AMT: Trimmed 76190 records to 52475 (keeping 200 days of data) [2025-10-15T17:14:19.082339] [DEBUG] [LOCAL ] AMTB: Primary data saved (20526 records). [2025-10-15T17:14:19.082947] [INFO ] [MAIN ] AMTB: Full history saved. [2025-10-15T17:14:19.083289] [INFO ] [MAIN ] Update Progress: 111/2369 symbols completed. AMTB took 34.9s. Estimated remaining: 4h 49m 44s. Rate: 7.8 symbols/min [2025-10-15T17:14:19.265391] [INFO ] [MAIN ] AMX: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:14:19.323228] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-01. [2025-10-15T17:14:19.484938] [DEBUG] [LOCAL ] AMX: Loaded 49095 existing records from primary storage. [2025-10-15T17:14:19.486766] [INFO ] [MAIN ] AMX: Loaded 49095 existing records. [2025-10-15T17:14:19.685375] [DEBUG] [LOCAL ] AMT: Primary data saved (52475 records). [2025-10-15T17:14:19.685496] [INFO ] [MAIN ] AMT: Full history saved. [2025-10-15T17:14:19.680187] [WARN ] [MAIN ] AMX: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:14:19.685632] [INFO ] [MAIN ] Update Progress: 112/2369 symbols completed. AMT took 36.3s. Estimated remaining: 4h 47m 13s. Rate: 7.9 symbols/min [2025-10-15T17:14:19.754767] [INFO ] [MAIN ] AMX: Wiping existing primary data before full refresh. [2025-10-15T17:14:19.784609] [INFO ] [LOCAL ] AMX: Starting deletion of primary data. [2025-10-15T17:14:19.792707] [DEBUG] [LOCAL ] AMX: Deleted primary data file. [2025-10-15T17:14:19.808160] [INFO ] [MAIN ] AMX: Starting full primary refresh. [2025-10-15T17:14:19.924592] [INFO ] [MAIN ] AN: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:14:20.263442] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-15T17:14:20.270242] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-02. [2025-10-15T17:14:20.262205] [DEBUG] [LOCAL ] AN: Loaded 31479 existing records from primary storage. [2025-10-15T17:14:20.267216] [INFO ] [REMOTE ] AMX: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:14:20.271308] [INFO ] [MAIN ] AN: Loaded 31479 existing records. [2025-10-15T17:14:20.461639] [WARN ] [MAIN ] AN: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:14:20.461858] [INFO ] [MAIN ] AN: Wiping existing primary data before full refresh. [2025-10-15T17:14:20.461920] [INFO ] [LOCAL ] AN: Starting deletion of primary data. [2025-10-15T17:14:20.462274] [DEBUG] [LOCAL ] AN: Deleted primary data file. [2025-10-15T17:14:20.462328] [INFO ] [MAIN ] AN: Starting full primary refresh. [2025-10-15T17:14:20.808785] [INFO ] [REMOTE ] AN: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:14:20.913966] [INFO ] [REMOTE ] AN: Fetching primary data for 2024-12. [2025-10-15T17:14:21.714020] [INFO ] [REMOTE ] AMX: Fetching primary data for 2024-12. [2025-10-15T17:14:22.153910] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-03 (3.63 seconds). [2025-10-15T17:14:22.251548] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-15T17:14:22.372241] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-02 (2.10 seconds). [2025-10-15T17:14:22.514060] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-04. [2025-10-15T17:14:23.313982] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-03. [2025-10-15T17:14:23.928728] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2024-12 (2.21 seconds). [2025-10-15T17:14:24.113986] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-01. [2025-10-15T17:14:24.324127] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-15T17:14:24.512411] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-15T17:14:24.914000] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-04. [2025-10-15T17:14:25.462742] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-15T17:14:25.672083] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-15T17:14:25.713974] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-05. [2025-10-15T17:14:26.309791] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-15T17:14:26.513982] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-06. [2025-10-15T17:14:27.137731] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-15T17:14:27.313986] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-07. [2025-10-15T17:14:28.069469] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-15T17:14:28.113948] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-08. [2025-10-15T17:14:28.913977] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-02. [2025-10-15T17:14:28.933846] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-15T17:14:29.714017] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-09. [2025-10-15T17:14:30.184907] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-15T17:14:30.496801] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-15T17:14:30.513962] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-10. [2025-10-15T17:14:31.313983] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-01. [2025-10-15T17:14:31.368271] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-15T17:14:31.370722] [INFO ] [REMOTE ] AMWL: Full fetch complete (14490 records). [2025-10-15T17:14:31.370799] [DEBUG] [VALIDATOR ] AMWL: Validating primary data. [2025-10-15T17:14:31.732350] [DEBUG] [VALIDATOR ] AMWL: All expected trading days are present. [2025-10-15T17:14:31.732450] [DEBUG] [VALIDATOR ] AMWL: Primary data validation passed. [2025-10-15T17:14:31.732795] [INFO ] [MAIN ] AMWL: Fetched primary data is valid. [2025-10-15T17:14:31.732856] [DEBUG] [LOCAL ] AMWL: Saving primary data. [2025-10-15T17:14:31.733552] [DEBUG] [LOCAL ] AMWL: Trimmed 14490 records to 9542 (keeping 200 days of data) [2025-10-15T17:14:31.788438] [DEBUG] [LOCAL ] AMWL: Primary data saved (9542 records). [2025-10-15T17:14:31.788584] [INFO ] [MAIN ] AMWL: Full history saved. [2025-10-15T17:14:31.788705] [INFO ] [MAIN ] Update Progress: 113/2369 symbols completed. AMWL took 15.3s. Estimated remaining: 4h 48m 35s. Rate: 7.8 symbols/min [2025-10-15T17:14:31.960920] [INFO ] [MAIN ] ANET: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:14:32.016336] [DEBUG] [LOCAL ] ANET: Loaded 53766 existing records from primary storage. [2025-10-15T17:14:32.016719] [INFO ] [MAIN ] ANET: Loaded 53766 existing records. [2025-10-15T17:14:32.117488] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-03. [2025-10-15T17:14:32.197133] [WARN ] [MAIN ] ANET: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:14:32.197395] [INFO ] [MAIN ] ANET: Wiping existing primary data before full refresh. [2025-10-15T17:14:32.197444] [INFO ] [LOCAL ] ANET: Starting deletion of primary data. [2025-10-15T17:14:32.197983] [DEBUG] [LOCAL ] ANET: Deleted primary data file. [2025-10-15T17:14:32.198040] [INFO ] [MAIN ] ANET: Starting full primary refresh. [2025-10-15T17:14:32.562901] [INFO ] [REMOTE ] ANET: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:14:32.916046] [INFO ] [REMOTE ] ANET: Fetching primary data for 2024-12. [2025-10-15T17:14:32.915872] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-15T17:14:33.708768] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-15T17:14:33.716224] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-05. [2025-10-15T17:14:34.514046] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-04. [2025-10-15T17:14:35.205364] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2024-12 (2.29 seconds). [2025-10-15T17:14:35.313998] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-01. [2025-10-15T17:14:36.078808] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-15T17:14:36.113996] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-05. [2025-10-15T17:14:36.211516] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-05 (2.50 seconds). [2025-10-15T17:14:36.914026] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-06. [2025-10-15T17:14:37.296764] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-10-15T17:14:37.507874] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-15T17:14:37.714000] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-06. [2025-10-15T17:14:38.513970] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-02. [2025-10-15T17:14:38.587174] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-15T17:14:39.177105] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-15T17:14:39.314013] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-07. [2025-10-15T17:14:40.114046] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-07. [2025-10-15T17:14:40.735602] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-15T17:14:40.882475] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-02 (2.37 seconds). [2025-10-15T17:14:40.913950] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-03. [2025-10-15T17:14:41.713970] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-08. [2025-10-15T17:14:42.021930] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-15T17:14:42.514000] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-08. [2025-10-15T17:14:42.854117] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-15T17:14:43.313974] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-02. [2025-10-15T17:14:43.411605] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-03 (2.50 seconds). [2025-10-15T17:14:44.114037] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-04. [2025-10-15T17:14:44.231473] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-15T17:14:44.709027] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-15T17:14:44.914049] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-09. [2025-10-15T17:14:45.714008] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-09. [2025-10-15T17:14:46.514023] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-03. [2025-10-15T17:14:46.900473] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-04 (2.79 seconds). [2025-10-15T17:14:46.915196] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-10-15T17:14:47.245330] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-15T17:14:47.313956] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-10. [2025-10-15T17:14:48.114095] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-10. [2025-10-15T17:14:48.143607] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-15T17:14:48.913974] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-05. [2025-10-15T17:14:49.145766] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-15T17:14:49.149633] [INFO ] [REMOTE ] AN: Full fetch complete (47159 records). [2025-10-15T17:14:49.149843] [DEBUG] [VALIDATOR ] AN: Validating primary data. [2025-10-15T17:14:49.530807] [DEBUG] [VALIDATOR ] AN: All expected trading days are present. [2025-10-15T17:14:49.530893] [DEBUG] [VALIDATOR ] AN: Primary data validation passed. [2025-10-15T17:14:49.531461] [INFO ] [MAIN ] AN: Fetched primary data is valid. [2025-10-15T17:14:49.531503] [DEBUG] [LOCAL ] AN: Saving primary data. [2025-10-15T17:14:49.532528] [DEBUG] [LOCAL ] AN: Trimmed 47159 records to 31439 (keeping 200 days of data) [2025-10-15T17:14:49.716842] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-04. [2025-10-15T17:14:49.725630] [DEBUG] [LOCAL ] AN: Primary data saved (31439 records). [2025-10-15T17:14:49.725747] [INFO ] [MAIN ] AN: Full history saved. [2025-10-15T17:14:49.725829] [INFO ] [MAIN ] Update Progress: 114/2369 symbols completed. AN took 30.0s. Estimated remaining: 4h 51m 50s. Rate: 7.7 symbols/min [2025-10-15T17:14:49.902417] [INFO ] [MAIN ] ANF: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:14:49.954614] [DEBUG] [LOCAL ] ANF: Loaded 52075 existing records from primary storage. [2025-10-15T17:14:49.954968] [INFO ] [MAIN ] ANF: Loaded 52075 existing records. [2025-10-15T17:14:50.155722] [WARN ] [MAIN ] ANF: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:14:50.156004] [INFO ] [MAIN ] ANF: Wiping existing primary data before full refresh. [2025-10-15T17:14:50.156065] [INFO ] [LOCAL ] ANF: Starting deletion of primary data. [2025-10-15T17:14:50.156626] [DEBUG] [LOCAL ] ANF: Deleted primary data file. [2025-10-15T17:14:50.156741] [INFO ] [MAIN ] ANF: Starting full primary refresh. [2025-10-15T17:14:50.447257] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-10 (2.33 seconds). [2025-10-15T17:14:50.487673] [INFO ] [REMOTE ] AMTM: Full fetch complete (73927 records). [2025-10-15T17:14:50.493615] [DEBUG] [VALIDATOR ] AMTM: Validating primary data. [2025-10-15T17:14:50.648241] [INFO ] [REMOTE ] ANF: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:14:50.683747] [INFO ] [REMOTE ] ANF: Fetching primary data for 2024-12. [2025-10-15T17:14:51.010119] [DEBUG] [VALIDATOR ] AMTM: All expected trading days are present. [2025-10-15T17:14:51.010290] [DEBUG] [VALIDATOR ] AMTM: Primary data validation passed. [2025-10-15T17:14:51.011163] [INFO ] [MAIN ] AMTM: Fetched primary data is valid. [2025-10-15T17:14:51.011276] [DEBUG] [LOCAL ] AMTM: Saving primary data. [2025-10-15T17:14:51.013075] [DEBUG] [LOCAL ] AMTM: Trimmed 73927 records to 50564 (keeping 200 days of data) [2025-10-15T17:14:51.334942] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-15T17:14:51.349972] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-05. [2025-10-15T17:14:51.355397] [DEBUG] [LOCAL ] AMTM: Primary data saved (50564 records). [2025-10-15T17:14:51.355705] [INFO ] [MAIN ] AMTM: Full history saved. [2025-10-15T17:14:51.355814] [INFO ] [MAIN ] Update Progress: 115/2369 symbols completed. AMTM took 54.7s. Estimated remaining: 4h 49m 42s. Rate: 7.8 symbols/min [2025-10-15T17:14:51.497239] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-05 (2.58 seconds). [2025-10-15T17:14:51.571845] [INFO ] [MAIN ] ANGX: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:14:51.572039] [DEBUG] [LOCAL ] ANGX: No existing data file found in primary storage. [2025-10-15T17:14:51.572095] [WARN ] [MAIN ] ANGX: No existing data found, performing full refresh instead. [2025-10-15T17:14:51.572205] [INFO ] [MAIN ] ANGX: Wiping existing primary data before full refresh. [2025-10-15T17:14:51.572259] [INFO ] [LOCAL ] ANGX: Starting deletion of primary data. [2025-10-15T17:14:51.572325] [DEBUG] [LOCAL ] ANGX: No primary data file found to delete. [2025-10-15T17:14:51.572359] [INFO ] [MAIN ] ANGX: Starting full primary refresh. [2025-10-15T17:14:51.940562] [INFO ] [REMOTE ] ANGX: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:14:52.114023] [INFO ] [REMOTE ] ANGX: Fetching primary data for 2024-12. [2025-10-15T17:14:52.306463] [DEBUG] [REMOTE ] ANGX: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-15T17:14:52.306895] [WARN ] [REMOTE ] ANGX: No data returned for month 2024-12 [2025-10-15T17:14:52.306984] [FATAL] [REMOTE ] ANGX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-15T17:14:52.307031] [FATAL] [MAIN ] ANGX: Failed to fetch primary data. [2025-10-15T17:14:52.307066] [WARN ] [MAIN ] ANGX: Deleting existing primary and derivative data due to fetch failure. [2025-10-15T17:14:52.307130] [INFO ] [LOCAL ] ANGX: Starting deletion of primary data. [2025-10-15T17:14:52.307197] [DEBUG] [LOCAL ] ANGX: No primary data file found to delete. [2025-10-15T17:14:52.307232] [INFO ] [LOCAL ] ANGX: Starting deletion of derivative data. [2025-10-15T17:14:52.307270] [DEBUG] [LOCAL ] ANGX: No derivative data file found to delete. [2025-10-15T17:14:52.307317] [INFO ] [MAIN ] Update Progress: 116/2369 symbols completed. ANGX took 1.0s. Estimated remaining: 4h 47m 23s. Rate: 7.8 symbols/min [2025-10-15T17:14:52.477742] [INFO ] [MAIN ] ANRO: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:14:52.498719] [DEBUG] [LOCAL ] ANRO: Loaded 19308 existing records from primary storage. [2025-10-15T17:14:52.498939] [INFO ] [MAIN ] ANRO: Loaded 19308 existing records. [2025-10-15T17:14:52.686855] [WARN ] [MAIN ] ANRO: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:14:52.687130] [INFO ] [MAIN ] ANRO: Wiping existing primary data before full refresh. [2025-10-15T17:14:52.687184] [INFO ] [LOCAL ] ANRO: Starting deletion of primary data. [2025-10-15T17:14:52.687414] [DEBUG] [LOCAL ] ANRO: Deleted primary data file. [2025-10-15T17:14:52.687453] [INFO ] [MAIN ] ANRO: Starting full primary refresh. [2025-10-15T17:14:52.918775] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-06. [2025-10-15T17:14:53.074553] [INFO ] [REMOTE ] ANRO: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:14:53.106190] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-15T17:14:53.714158] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-06. [2025-10-15T17:14:54.164683] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2024-12 (3.48 seconds). [2025-10-15T17:14:54.513999] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2024-12. [2025-10-15T17:14:55.007792] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-15T17:14:55.313970] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-01. [2025-10-15T17:14:55.428788] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-06 (2.51 seconds). [2025-10-15T17:14:56.048495] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-15T17:14:56.113987] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-07. [2025-10-15T17:14:56.913974] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-07. [2025-10-15T17:14:57.016870] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-15T17:14:57.714011] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-01. [2025-10-15T17:14:58.466455] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-15T17:14:58.513958] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-08. [2025-10-15T17:14:58.677932] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-15T17:14:59.313981] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-02. [2025-10-15T17:14:59.428752] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-07 (3.31 seconds). [2025-10-15T17:15:00.120793] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-02. [2025-10-15T17:15:00.126908] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-15T17:15:00.810388] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-15T17:15:00.913957] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-03. [2025-10-15T17:15:01.714019] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-08. [2025-10-15T17:15:01.811318] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-15T17:15:02.453234] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-15T17:15:02.514018] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-04. [2025-10-15T17:15:03.314023] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-09. [2025-10-15T17:15:03.594302] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-15T17:15:04.114010] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-03. [2025-10-15T17:15:04.586301] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-08 (2.87 seconds). [2025-10-15T17:15:04.913994] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-09. [2025-10-15T17:15:04.970611] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-15T17:15:05.714016] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-05. [2025-10-15T17:15:06.234167] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-10-15T17:15:06.513992] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-10. [2025-10-15T17:15:06.937790] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-15T17:15:07.313986] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-04. [2025-10-15T17:15:07.425786] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-09 (2.51 seconds). [2025-10-15T17:15:08.114031] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-10. [2025-10-15T17:15:08.549746] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-10 (2.04 seconds). [2025-10-15T17:15:08.556566] [INFO ] [REMOTE ] AMX: Full fetch complete (70935 records). [2025-10-15T17:15:08.556850] [DEBUG] [VALIDATOR ] AMX: Validating primary data. [2025-10-15T17:15:08.915988] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-06. [2025-10-15T17:15:08.929500] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-15T17:15:09.040486] [DEBUG] [VALIDATOR ] AMX: All expected trading days are present. [2025-10-15T17:15:09.036122] [INFO ] [REMOTE ] ANET: Full fetch complete (77945 records). [2025-10-15T17:15:09.040980] [DEBUG] [VALIDATOR ] AMX: Primary data validation passed. [2025-10-15T17:15:09.042028] [INFO ] [MAIN ] AMX: Fetched primary data is valid. [2025-10-15T17:15:09.041103] [DEBUG] [VALIDATOR ] ANET: Validating primary data. [2025-10-15T17:15:09.042440] [DEBUG] [LOCAL ] AMX: Saving primary data. [2025-10-15T17:15:09.118029] [DEBUG] [LOCAL ] AMX: Trimmed 70935 records to 49144 (keeping 200 days of data) [2025-10-15T17:15:09.702805] [DEBUG] [VALIDATOR ] ANET: All expected trading days are present. [2025-10-15T17:15:09.708228] [DEBUG] [VALIDATOR ] ANET: Primary data validation passed. [2025-10-15T17:15:09.733537] [INFO ] [MAIN ] ANET: Fetched primary data is valid. [2025-10-15T17:15:09.734298] [DEBUG] [LOCAL ] ANET: Saving primary data. [2025-10-15T17:15:09.742506] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-04 (2.43 seconds). [2025-10-15T17:15:09.750154] [DEBUG] [LOCAL ] ANET: Trimmed 77945 records to 53766 (keeping 200 days of data) [2025-10-15T17:15:09.766690] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-05. [2025-10-15T17:15:10.170427] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-15T17:15:10.307761] [DEBUG] [LOCAL ] AMX: Primary data saved (49144 records). [2025-10-15T17:15:10.313393] [INFO ] [MAIN ] AMX: Full history saved. [2025-10-15T17:15:10.314822] [INFO ] [MAIN ] Update Progress: 117/2369 symbols completed. AMX took 51.2s. Estimated remaining: 4h 50m 34s. Rate: 7.8 symbols/min [2025-10-15T17:15:10.435833] [DEBUG] [LOCAL ] ANET: Primary data saved (53766 records). [2025-10-15T17:15:10.436023] [INFO ] [MAIN ] ANET: Full history saved. [2025-10-15T17:15:10.436138] [INFO ] [MAIN ] Update Progress: 118/2369 symbols completed. ANET took 38.6s. Estimated remaining: 4h 48m 1s. Rate: 7.8 symbols/min [2025-10-15T17:15:10.514003] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-07. [2025-10-15T17:15:11.409733] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-15T17:15:11.413922] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-08. [2025-10-15T17:15:11.753826] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-10-15T17:15:11.923847] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-10-15T17:15:12.114075] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-06. [2025-10-15T17:15:12.914001] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-09. [2025-10-15T17:15:13.923627] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-15T17:15:13.934530] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-07. [2025-10-15T17:15:13.951561] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-15T17:15:14.514011] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-10. [2025-10-15T17:15:15.721967] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-15T17:15:15.725456] [INFO ] [REMOTE ] ANRO: Full fetch complete (29598 records). [2025-10-15T17:15:15.725560] [DEBUG] [VALIDATOR ] ANRO: Validating primary data. [2025-10-15T17:15:15.726135] [FATAL] [VALIDATOR ] ANRO: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T17:15:15.726230] [FATAL] [MAIN ] ANRO: Fetched primary data is invalid. Refusing to save it. [2025-10-15T17:15:15.726273] [WARN ] [MAIN ] ANRO: Deleting existing primary and derivative data due to validation failure. [2025-10-15T17:15:15.726368] [INFO ] [LOCAL ] ANRO: Starting deletion of primary data. [2025-10-15T17:15:15.726433] [DEBUG] [LOCAL ] ANRO: No primary data file found to delete. [2025-10-15T17:15:15.726468] [INFO ] [LOCAL ] ANRO: Starting deletion of derivative data. [2025-10-15T17:15:15.726683] [DEBUG] [LOCAL ] ANRO: Deleted derivative data file. [2025-10-15T17:15:15.726782] [INFO ] [MAIN ] Update Progress: 119/2369 symbols completed. ANRO took 23.4s. Estimated remaining: 4h 47m 9s. Rate: 7.8 symbols/min [2025-10-15T17:15:16.452373] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-07 (2.52 seconds). [2025-10-15T17:15:16.463565] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-08. [2025-10-15T17:15:18.383569] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-15T17:15:18.394663] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-09. [2025-10-15T17:15:20.638747] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-09 (2.24 seconds). [2025-10-15T17:15:20.649941] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-10. [2025-10-15T17:15:22.647101] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-10 (2.00 seconds). [2025-10-15T17:15:22.653502] [INFO ] [REMOTE ] ANF: Full fetch complete (75754 records). [2025-10-15T17:15:22.653617] [DEBUG] [VALIDATOR ] ANF: Validating primary data. [2025-10-15T17:15:23.061841] [DEBUG] [VALIDATOR ] ANF: All expected trading days are present. [2025-10-15T17:15:23.061937] [DEBUG] [VALIDATOR ] ANF: Primary data validation passed. [2025-10-15T17:15:23.062737] [INFO ] [MAIN ] ANF: Fetched primary data is valid. [2025-10-15T17:15:23.062803] [DEBUG] [LOCAL ] ANF: Saving primary data. [2025-10-15T17:15:23.064371] [DEBUG] [LOCAL ] ANF: Trimmed 75754 records to 52079 (keeping 200 days of data) [2025-10-15T17:15:23.367935] [DEBUG] [LOCAL ] ANF: Primary data saved (52079 records). [2025-10-15T17:15:23.368076] [INFO ] [MAIN ] ANF: Full history saved. [2025-10-15T17:15:23.368159] [INFO ] [MAIN ] Update Progress: 120/2369 symbols completed. ANF took 33.6s. Estimated remaining: 4h 47m 1s. Rate: 7.8 symbols/min [2025-10-15T17:15:23.934396] [INFO ] [MAIN ] ANVS: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:15:24.105252] [INFO ] [MAIN ] AOMR: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:15:24.117190] [INFO ] [MAIN ] AOD: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:15:24.145888] [INFO ] [MAIN ] AOMD: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:15:24.146606] [DEBUG] [LOCAL ] AOMD: No existing data file found in primary storage. [2025-10-15T17:15:24.146690] [WARN ] [MAIN ] AOMD: No existing data found, performing full refresh instead. [2025-10-15T17:15:24.146794] [INFO ] [MAIN ] AOMD: Wiping existing primary data before full refresh. [2025-10-15T17:15:24.146834] [INFO ] [LOCAL ] AOMD: Starting deletion of primary data. [2025-10-15T17:15:24.146976] [DEBUG] [LOCAL ] AOMD: No primary data file found to delete. [2025-10-15T17:15:24.147020] [INFO ] [MAIN ] AOMD: Starting full primary refresh. [2025-10-15T17:15:24.264798] [DEBUG] [LOCAL ] ANVS: Loaded 23680 existing records from primary storage. [2025-10-15T17:15:24.311114] [DEBUG] [LOCAL ] AOMR: Loaded 16470 existing records from primary storage. [2025-10-15T17:15:24.311494] [INFO ] [MAIN ] ANVS: Loaded 23680 existing records. [2025-10-15T17:15:24.317194] [INFO ] [MAIN ] AOMR: Loaded 16470 existing records. [2025-10-15T17:15:24.438282] [DEBUG] [LOCAL ] AOD: Loaded 30776 existing records from primary storage. [2025-10-15T17:15:24.535549] [INFO ] [MAIN ] AOD: Loaded 30776 existing records. [2025-10-15T17:15:24.995816] [WARN ] [MAIN ] ANVS: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:15:25.066674] [WARN ] [MAIN ] AOMR: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:15:25.103415] [INFO ] [MAIN ] ANVS: Wiping existing primary data before full refresh. [2025-10-15T17:15:25.111877] [WARN ] [MAIN ] AOD: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:15:25.127810] [INFO ] [LOCAL ] ANVS: Starting deletion of primary data. [2025-10-15T17:15:25.149817] [INFO ] [REMOTE ] AOMD: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:15:25.150418] [INFO ] [MAIN ] AOD: Wiping existing primary data before full refresh. [2025-10-15T17:15:25.127765] [INFO ] [MAIN ] AOMR: Wiping existing primary data before full refresh. [2025-10-15T17:15:25.150710] [INFO ] [LOCAL ] AOMR: Starting deletion of primary data. [2025-10-15T17:15:25.150777] [INFO ] [LOCAL ] AOD: Starting deletion of primary data. [2025-10-15T17:15:25.151212] [INFO ] [REMOTE ] AOMD: Fetching primary data for 2024-12. [2025-10-15T17:15:25.151321] [DEBUG] [LOCAL ] ANVS: Deleted primary data file. [2025-10-15T17:15:25.152374] [INFO ] [MAIN ] ANVS: Starting full primary refresh. [2025-10-15T17:15:25.163119] [DEBUG] [LOCAL ] AOMR: Deleted primary data file. [2025-10-15T17:15:25.172510] [INFO ] [MAIN ] AOMR: Starting full primary refresh. [2025-10-15T17:15:25.181679] [DEBUG] [LOCAL ] AOD: Deleted primary data file. [2025-10-15T17:15:25.228589] [INFO ] [MAIN ] AOD: Starting full primary refresh. [2025-10-15T17:15:25.467379] [DEBUG] [REMOTE ] AOMD: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-15T17:15:25.670231] [WARN ] [REMOTE ] AOMD: No data returned for month 2024-12 [2025-10-15T17:15:25.779386] [FATAL] [REMOTE ] AOMD: API call failed - aborting fetch to avoid wasting further API calls [2025-10-15T17:15:25.848540] [FATAL] [MAIN ] AOMD: Failed to fetch primary data. [2025-10-15T17:15:25.884312] [WARN ] [MAIN ] AOMD: Deleting existing primary and derivative data due to fetch failure. [2025-10-15T17:15:25.939174] [INFO ] [LOCAL ] AOMD: Starting deletion of primary data. [2025-10-15T17:15:26.044861] [DEBUG] [LOCAL ] AOMD: No primary data file found to delete. [2025-10-15T17:15:26.060939] [INFO ] [LOCAL ] AOMD: Starting deletion of derivative data. [2025-10-15T17:15:26.152351] [DEBUG] [LOCAL ] AOMD: No derivative data file found to delete. [2025-10-15T17:15:26.227095] [INFO ] [MAIN ] Update Progress: 121/2369 symbols completed. AOMD took 2.9s. Estimated remaining: 4h 45m 24s. Rate: 7.9 symbols/min [2025-10-15T17:15:26.209033] [INFO ] [REMOTE ] ANVS: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:15:26.238166] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2024-12. [2025-10-15T17:15:26.241609] [INFO ] [REMOTE ] AOMR: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:15:26.314053] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2024-12. [2025-10-15T17:15:26.357932] [INFO ] [REMOTE ] AOD: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:15:26.370022] [INFO ] [REMOTE ] AOD: Fetching primary data for 2024-12. [2025-10-15T17:15:26.497638] [INFO ] [MAIN ] AON: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:15:26.542736] [DEBUG] [LOCAL ] AON: Loaded 45116 existing records from primary storage. [2025-10-15T17:15:26.543058] [INFO ] [MAIN ] AON: Loaded 45116 existing records. [2025-10-15T17:15:26.720189] [WARN ] [MAIN ] AON: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:15:26.720435] [INFO ] [MAIN ] AON: Wiping existing primary data before full refresh. [2025-10-15T17:15:26.720484] [INFO ] [LOCAL ] AON: Starting deletion of primary data. [2025-10-15T17:15:26.720956] [DEBUG] [LOCAL ] AON: Deleted primary data file. [2025-10-15T17:15:26.721012] [INFO ] [MAIN ] AON: Starting full primary refresh. [2025-10-15T17:15:27.070980] [INFO ] [REMOTE ] AON: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:15:27.071284] [INFO ] [REMOTE ] AON: Fetching primary data for 2024-12. [2025-10-15T17:15:27.453708] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-15T17:15:27.456768] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-01. [2025-10-15T17:15:27.759983] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-15T17:15:27.766132] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-01. [2025-10-15T17:15:27.795272] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-15T17:15:27.801634] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-01. [2025-10-15T17:15:28.390090] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-15T17:15:28.393253] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-02. [2025-10-15T17:15:28.573299] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-15T17:15:28.581941] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-01. [2025-10-15T17:15:28.781896] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-15T17:15:28.789022] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-02. [2025-10-15T17:15:29.375989] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-15T17:15:29.381822] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-02. [2025-10-15T17:15:29.778297] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-15T17:15:29.784035] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-03. [2025-10-15T17:15:29.828097] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-15T17:15:29.832084] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-03. [2025-10-15T17:15:30.230125] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-15T17:15:30.244388] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-02. [2025-10-15T17:15:30.913303] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-15T17:15:30.922165] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-03. [2025-10-15T17:15:31.192059] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-15T17:15:31.196050] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-04. [2025-10-15T17:15:31.625758] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-15T17:15:31.632456] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-04. [2025-10-15T17:15:31.858618] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-15T17:15:31.933302] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-15T17:15:32.035468] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-15T17:15:32.113986] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-03. [2025-10-15T17:15:32.816244] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-15T17:15:32.914067] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-04. [2025-10-15T17:15:33.714092] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-05. [2025-10-15T17:15:34.527867] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-05. [2025-10-15T17:15:34.529400] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-03 (2.42 seconds). [2025-10-15T17:15:34.865911] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-15T17:15:35.260085] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-15T17:15:35.313966] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-04. [2025-10-15T17:15:35.486433] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-15T17:15:36.113988] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-06. [2025-10-15T17:15:36.914001] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-06. [2025-10-15T17:15:37.085017] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-15T17:15:37.348430] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-15T17:15:37.713965] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-05. [2025-10-15T17:15:37.755077] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-15T17:15:38.514054] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-07. [2025-10-15T17:15:39.313977] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-05. [2025-10-15T17:15:39.353780] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-15T17:15:39.489235] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-15T17:15:40.114021] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-07. [2025-10-15T17:15:40.625216] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-15T17:15:40.914068] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-08. [2025-10-15T17:15:41.108820] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-15T17:15:41.714012] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-06. [2025-10-15T17:15:42.084122] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-15T17:15:42.514010] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-06. [2025-10-15T17:15:42.842963] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-15T17:15:43.313979] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-07. [2025-10-15T17:15:44.110132] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-15T17:15:44.119409] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-08. [2025-10-15T17:15:44.913958] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-07. [2025-10-15T17:15:45.599238] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-07 (2.29 seconds). [2025-10-15T17:15:45.714073] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-08. [2025-10-15T17:15:46.415722] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-08 (2.30 seconds). [2025-10-15T17:15:46.519440] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-09. [2025-10-15T17:15:46.532047] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-15T17:15:46.747280] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-15T17:15:47.314003] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-08. [2025-10-15T17:15:47.879202] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-15T17:15:48.114001] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-10. [2025-10-15T17:15:48.913977] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-09. [2025-10-15T17:15:48.942868] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-15T17:15:49.423584] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-15T17:15:49.430873] [INFO ] [REMOTE ] AOD: Full fetch complete (44673 records). [2025-10-15T17:15:49.430992] [DEBUG] [VALIDATOR ] AOD: Validating primary data. [2025-10-15T17:15:49.720563] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-09. [2025-10-15T17:15:49.814143] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-15T17:15:49.829563] [DEBUG] [VALIDATOR ] AOD: All expected trading days are present. [2025-10-15T17:15:49.829806] [DEBUG] [VALIDATOR ] AOD: Primary data validation passed. [2025-10-15T17:15:49.830438] [INFO ] [MAIN ] AOD: Fetched primary data is valid. [2025-10-15T17:15:49.830519] [DEBUG] [LOCAL ] AOD: Saving primary data. [2025-10-15T17:15:49.831783] [DEBUG] [LOCAL ] AOD: Trimmed 44673 records to 30814 (keeping 200 days of data) [2025-10-15T17:15:50.016877] [DEBUG] [LOCAL ] AOD: Primary data saved (30814 records). [2025-10-15T17:15:50.017038] [INFO ] [MAIN ] AOD: Full history saved. [2025-10-15T17:15:50.017128] [INFO ] [MAIN ] Update Progress: 122/2369 symbols completed. AOD took 26.6s. Estimated remaining: 4h 50m 14s. Rate: 7.7 symbols/min [2025-10-15T17:15:50.189011] [INFO ] [MAIN ] AORT: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:15:50.222720] [DEBUG] [LOCAL ] AORT: Loaded 29205 existing records from primary storage. [2025-10-15T17:15:50.223053] [INFO ] [MAIN ] AORT: Loaded 29205 existing records. [2025-10-15T17:15:50.397954] [WARN ] [MAIN ] AORT: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:15:50.398178] [INFO ] [MAIN ] AORT: Wiping existing primary data before full refresh. [2025-10-15T17:15:50.398225] [INFO ] [LOCAL ] AORT: Starting deletion of primary data. [2025-10-15T17:15:50.398988] [DEBUG] [LOCAL ] AORT: Deleted primary data file. [2025-10-15T17:15:50.399047] [INFO ] [MAIN ] AORT: Starting full primary refresh. [2025-10-15T17:15:50.519075] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-10. [2025-10-15T17:15:50.799404] [INFO ] [REMOTE ] AORT: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:15:50.824638] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-15T17:15:51.314052] [INFO ] [REMOTE ] AORT: Fetching primary data for 2024-12. [2025-10-15T17:15:51.978599] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-15T17:15:51.982935] [INFO ] [REMOTE ] ANVS: Full fetch complete (36691 records). [2025-10-15T17:15:51.983067] [DEBUG] [VALIDATOR ] ANVS: Validating primary data. [2025-10-15T17:15:52.126573] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-10. [2025-10-15T17:15:52.375393] [DEBUG] [VALIDATOR ] ANVS: All expected trading days are present. [2025-10-15T17:15:52.375469] [DEBUG] [VALIDATOR ] ANVS: Primary data validation passed. [2025-10-15T17:15:52.376070] [INFO ] [MAIN ] ANVS: Fetched primary data is valid. [2025-10-15T17:15:52.376135] [DEBUG] [LOCAL ] ANVS: Saving primary data. [2025-10-15T17:15:52.377178] [DEBUG] [LOCAL ] ANVS: Trimmed 36691 records to 23750 (keeping 200 days of data) [2025-10-15T17:15:52.513276] [DEBUG] [LOCAL ] ANVS: Primary data saved (23750 records). [2025-10-15T17:15:52.513447] [INFO ] [MAIN ] ANVS: Full history saved. [2025-10-15T17:15:52.513542] [INFO ] [MAIN ] Update Progress: 123/2369 symbols completed. ANVS took 29.1s. Estimated remaining: 4h 48m 30s. Rate: 7.8 symbols/min [2025-10-15T17:15:52.656008] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-15T17:15:52.708119] [INFO ] [MAIN ] AOS: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:15:52.755050] [DEBUG] [LOCAL ] AOS: Loaded 48722 existing records from primary storage. [2025-10-15T17:15:52.755361] [INFO ] [MAIN ] AOS: Loaded 48722 existing records. [2025-10-15T17:15:52.930483] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-01. [2025-10-15T17:15:52.935530] [WARN ] [MAIN ] AOS: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:15:52.941083] [INFO ] [MAIN ] AOS: Wiping existing primary data before full refresh. [2025-10-15T17:15:52.941804] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-15T17:15:52.943707] [INFO ] [LOCAL ] AOS: Starting deletion of primary data. [2025-10-15T17:15:52.943810] [INFO ] [REMOTE ] AOMR: Full fetch complete (23217 records). [2025-10-15T17:15:52.943942] [DEBUG] [VALIDATOR ] AOMR: Validating primary data. [2025-10-15T17:15:52.974548] [DEBUG] [LOCAL ] AOS: Deleted primary data file. [2025-10-15T17:15:52.986302] [INFO ] [MAIN ] AOS: Starting full primary refresh. [2025-10-15T17:15:53.716616] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-09. [2025-10-15T17:15:53.751069] [INFO ] [REMOTE ] AOS: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:15:53.751771] [DEBUG] [VALIDATOR ] AOMR: All expected trading days are present. [2025-10-15T17:15:53.752732] [DEBUG] [VALIDATOR ] AOMR: Primary data validation passed. [2025-10-15T17:15:53.753360] [INFO ] [MAIN ] AOMR: Fetched primary data is valid. [2025-10-15T17:15:53.753520] [DEBUG] [LOCAL ] AOMR: Saving primary data. [2025-10-15T17:15:53.754804] [DEBUG] [LOCAL ] AOMR: Trimmed 23217 records to 16461 (keeping 200 days of data) [2025-10-15T17:15:53.883140] [DEBUG] [LOCAL ] AOMR: Primary data saved (16461 records). [2025-10-15T17:15:53.883315] [INFO ] [MAIN ] AOMR: Full history saved. [2025-10-15T17:15:53.883439] [INFO ] [MAIN ] Update Progress: 124/2369 symbols completed. AOMR took 30.5s. Estimated remaining: 4h 46m 28s. Rate: 7.8 symbols/min [2025-10-15T17:15:54.086146] [INFO ] [MAIN ] AP: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:15:54.096216] [DEBUG] [LOCAL ] AP: Loaded 7321 existing records from primary storage. [2025-10-15T17:15:54.096487] [INFO ] [MAIN ] AP: Loaded 7321 existing records. [2025-10-15T17:15:54.256155] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-15T17:15:54.318678] [WARN ] [MAIN ] AP: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:15:54.318904] [INFO ] [MAIN ] AP: Wiping existing primary data before full refresh. [2025-10-15T17:15:54.318953] [INFO ] [LOCAL ] AP: Starting deletion of primary data. [2025-10-15T17:15:54.319107] [DEBUG] [LOCAL ] AP: Deleted primary data file. [2025-10-15T17:15:54.319145] [INFO ] [MAIN ] AP: Starting full primary refresh. [2025-10-15T17:15:54.523628] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-02. [2025-10-15T17:15:54.667669] [INFO ] [REMOTE ] AP: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:15:55.314000] [INFO ] [REMOTE ] AOS: Fetching primary data for 2024-12. [2025-10-15T17:15:55.715994] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-10-15T17:15:56.114029] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-10. [2025-10-15T17:15:56.189631] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-15T17:15:56.913973] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-03. [2025-10-15T17:15:56.965681] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-15T17:15:57.713984] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-01. [2025-10-15T17:15:57.750034] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-15T17:15:57.757776] [INFO ] [REMOTE ] AON: Full fetch complete (64842 records). [2025-10-15T17:15:57.757979] [DEBUG] [VALIDATOR ] AON: Validating primary data. [2025-10-15T17:15:58.169191] [DEBUG] [VALIDATOR ] AON: All expected trading days are present. [2025-10-15T17:15:58.169387] [DEBUG] [VALIDATOR ] AON: Primary data validation passed. [2025-10-15T17:15:58.170137] [INFO ] [MAIN ] AON: Fetched primary data is valid. [2025-10-15T17:15:58.170201] [DEBUG] [LOCAL ] AON: Saving primary data. [2025-10-15T17:15:58.171569] [DEBUG] [LOCAL ] AON: Trimmed 64842 records to 45133 (keeping 200 days of data) [2025-10-15T17:15:58.323550] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-15T17:15:58.490918] [DEBUG] [LOCAL ] AON: Primary data saved (45133 records). [2025-10-15T17:15:58.491050] [INFO ] [MAIN ] AON: Full history saved. [2025-10-15T17:15:58.491733] [INFO ] [MAIN ] Update Progress: 125/2369 symbols completed. AON took 32.2s. Estimated remaining: 4h 45m 26s. Rate: 7.9 symbols/min [2025-10-15T17:15:58.521721] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-04. [2025-10-15T17:15:58.669101] [INFO ] [MAIN ] APAM: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:15:58.706845] [DEBUG] [LOCAL ] APAM: Loaded 36060 existing records from primary storage. [2025-10-15T17:15:58.707241] [INFO ] [MAIN ] APAM: Loaded 36060 existing records. [2025-10-15T17:15:58.889790] [WARN ] [MAIN ] APAM: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:15:58.890037] [INFO ] [MAIN ] APAM: Wiping existing primary data before full refresh. [2025-10-15T17:15:58.890107] [INFO ] [LOCAL ] APAM: Starting deletion of primary data. [2025-10-15T17:15:58.890535] [DEBUG] [LOCAL ] APAM: Deleted primary data file. [2025-10-15T17:15:58.890593] [INFO ] [MAIN ] APAM: Starting full primary refresh. [2025-10-15T17:15:59.248414] [INFO ] [REMOTE ] APAM: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:15:59.274853] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-15T17:15:59.313952] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-02. [2025-10-15T17:15:59.943400] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-15T17:16:00.114001] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-05. [2025-10-15T17:16:00.914058] [INFO ] [REMOTE ] APAM: Fetching primary data for 2024-12. [2025-10-15T17:16:01.083957] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-15T17:16:01.574773] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-15T17:16:01.714076] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-03. [2025-10-15T17:16:01.884467] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-10-15T17:16:02.514109] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-06. [2025-10-15T17:16:03.310040] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-15T17:16:03.314383] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-01. [2025-10-15T17:16:03.926790] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-15T17:16:04.114029] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-04. [2025-10-15T17:16:04.819327] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-15T17:16:04.914012] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-02. [2025-10-15T17:16:05.714003] [INFO ] [REMOTE ] AP: Fetching primary data for 2024-12. [2025-10-15T17:16:06.223071] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-15T17:16:06.264860] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-04 (2.15 seconds). [2025-10-15T17:16:06.310874] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-10-15T17:16:06.514014] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-07. [2025-10-15T17:16:07.314025] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-03. [2025-10-15T17:16:07.899757] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-15T17:16:08.113997] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-08. [2025-10-15T17:16:08.893592] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-15T17:16:08.913992] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-04. [2025-10-15T17:16:09.532496] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-15T17:16:09.714023] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-01. [2025-10-15T17:16:10.155711] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-10-15T17:16:10.397452] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-15T17:16:10.513982] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-09. [2025-10-15T17:16:11.314013] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-02. [2025-10-15T17:16:11.851765] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-10-15T17:16:11.854830] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-15T17:16:12.114069] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-05. [2025-10-15T17:16:12.914019] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-10. [2025-10-15T17:16:13.714024] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-03. [2025-10-15T17:16:13.885308] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-15T17:16:13.932156] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-15T17:16:13.935805] [INFO ] [REMOTE ] AORT: Full fetch complete (42278 records). [2025-10-15T17:16:13.935897] [DEBUG] [VALIDATOR ] AORT: Validating primary data. [2025-10-15T17:16:14.306565] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-15T17:16:14.342166] [DEBUG] [VALIDATOR ] AORT: All expected trading days are present. [2025-10-15T17:16:14.342256] [DEBUG] [VALIDATOR ] AORT: Primary data validation passed. [2025-10-15T17:16:14.342901] [INFO ] [MAIN ] AORT: Fetched primary data is valid. [2025-10-15T17:16:14.342967] [DEBUG] [LOCAL ] AORT: Saving primary data. [2025-10-15T17:16:14.344189] [DEBUG] [LOCAL ] AORT: Trimmed 42278 records to 29190 (keeping 200 days of data) [2025-10-15T17:16:14.515226] [DEBUG] [LOCAL ] AORT: Primary data saved (29190 records). [2025-10-15T17:16:14.515518] [INFO ] [MAIN ] AORT: Full history saved. [2025-10-15T17:16:14.515680] [INFO ] [MAIN ] Update Progress: 126/2369 symbols completed. AORT took 24.5s. Estimated remaining: 4h 47m 47s. Rate: 7.8 symbols/min [2025-10-15T17:16:14.514044] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-05. [2025-10-15T17:16:14.693010] [INFO ] [MAIN ] APD: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:16:14.737066] [DEBUG] [LOCAL ] APD: Loaded 45380 existing records from primary storage. [2025-10-15T17:16:14.737531] [INFO ] [MAIN ] APD: Loaded 45380 existing records. [2025-10-15T17:16:14.945094] [WARN ] [MAIN ] APD: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:16:14.945347] [INFO ] [MAIN ] APD: Wiping existing primary data before full refresh. [2025-10-15T17:16:14.945396] [INFO ] [LOCAL ] APD: Starting deletion of primary data. [2025-10-15T17:16:14.945969] [DEBUG] [LOCAL ] APD: Deleted primary data file. [2025-10-15T17:16:14.946026] [INFO ] [MAIN ] APD: Starting full primary refresh. [2025-10-15T17:16:15.290374] [INFO ] [REMOTE ] APD: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:16:15.313959] [INFO ] [REMOTE ] APD: Fetching primary data for 2024-12. [2025-10-15T17:16:16.113988] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-04. [2025-10-15T17:16:16.253340] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-15T17:16:16.779911] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-10-15T17:16:16.919119] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-06. [2025-10-15T17:16:16.937949] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-15T17:16:17.713983] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-05. [2025-10-15T17:16:18.374665] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-15T17:16:18.513964] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-01. [2025-10-15T17:16:18.687798] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-15T17:16:19.313995] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-06. [2025-10-15T17:16:20.086499] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-15T17:16:20.113956] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-02. [2025-10-15T17:16:20.663277] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-15T17:16:20.914007] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-07. [2025-10-15T17:16:21.713976] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-06. [2025-10-15T17:16:22.054427] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-10-15T17:16:22.396266] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-15T17:16:22.513980] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-07. [2025-10-15T17:16:22.916393] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-10-15T17:16:23.314017] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-03. [2025-10-15T17:16:23.952772] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-15T17:16:24.114006] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-08. [2025-10-15T17:16:24.914022] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-07. [2025-10-15T17:16:25.086301] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-15T17:16:25.529173] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-15T17:16:25.714004] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-08. [2025-10-15T17:16:25.856574] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-15T17:16:26.373796] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-15T17:16:26.514011] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-09. [2025-10-15T17:16:27.314007] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-08. [2025-10-15T17:16:27.992278] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-15T17:16:28.113988] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-10. [2025-10-15T17:16:28.914002] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-09. [2025-10-15T17:16:29.714004] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-04. [2025-10-15T17:16:29.737580] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-15T17:16:29.743730] [INFO ] [REMOTE ] AOS: Full fetch complete (70897 records). [2025-10-15T17:16:29.743853] [DEBUG] [VALIDATOR ] AOS: Validating primary data. [2025-10-15T17:16:30.131392] [DEBUG] [VALIDATOR ] AOS: All expected trading days are present. [2025-10-15T17:16:30.131465] [DEBUG] [VALIDATOR ] AOS: Primary data validation passed. [2025-10-15T17:16:30.132209] [INFO ] [MAIN ] AOS: Fetched primary data is valid. [2025-10-15T17:16:30.132279] [DEBUG] [LOCAL ] AOS: Saving primary data. [2025-10-15T17:16:30.133634] [DEBUG] [LOCAL ] AOS: Trimmed 70897 records to 48761 (keeping 200 days of data) [2025-10-15T17:16:30.365003] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-08 (3.05 seconds). [2025-10-15T17:16:30.460103] [DEBUG] [LOCAL ] AOS: Primary data saved (48761 records). [2025-10-15T17:16:30.460256] [INFO ] [MAIN ] AOS: Full history saved. [2025-10-15T17:16:30.462863] [INFO ] [MAIN ] Update Progress: 127/2369 symbols completed. AOS took 37.9s. Estimated remaining: 4h 50m 5s. Rate: 7.7 symbols/min [2025-10-15T17:16:30.521753] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-09. [2025-10-15T17:16:30.542741] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-15T17:16:30.640609] [INFO ] [MAIN ] APG: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:16:30.697168] [DEBUG] [LOCAL ] APG: Loaded 50586 existing records from primary storage. [2025-10-15T17:16:30.697464] [INFO ] [MAIN ] APG: Loaded 50586 existing records. [2025-10-15T17:16:30.868960] [WARN ] [MAIN ] APG: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:16:30.869179] [INFO ] [MAIN ] APG: Wiping existing primary data before full refresh. [2025-10-15T17:16:30.869233] [INFO ] [LOCAL ] APG: Starting deletion of primary data. [2025-10-15T17:16:30.869890] [DEBUG] [LOCAL ] APG: Deleted primary data file. [2025-10-15T17:16:30.869948] [INFO ] [MAIN ] APG: Starting full primary refresh. [2025-10-15T17:16:31.219796] [INFO ] [REMOTE ] APG: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:16:31.313958] [INFO ] [REMOTE ] APG: Fetching primary data for 2024-12. [2025-10-15T17:16:31.535789] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-15T17:16:31.564096] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-15T17:16:32.114004] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-05. [2025-10-15T17:16:32.811906] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-15T17:16:32.913981] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-10. [2025-10-15T17:16:33.598691] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-15T17:16:33.600451] [INFO ] [REMOTE ] AP: Full fetch complete (9062 records). [2025-10-15T17:16:33.600570] [DEBUG] [VALIDATOR ] AP: Validating primary data. [2025-10-15T17:16:33.719224] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-01. [2025-10-15T17:16:33.978460] [DEBUG] [VALIDATOR ] AP: All expected trading days are present. [2025-10-15T17:16:33.978565] [DEBUG] [VALIDATOR ] AP: Primary data validation passed. [2025-10-15T17:16:33.978894] [INFO ] [MAIN ] AP: Fetched primary data is valid. [2025-10-15T17:16:33.979114] [DEBUG] [LOCAL ] AP: Saving primary data. [2025-10-15T17:16:33.994374] [DEBUG] [LOCAL ] AP: Trimmed 9062 records to 7352 (keeping 200 days of data) [2025-10-15T17:16:34.022709] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-15T17:16:34.059019] [DEBUG] [LOCAL ] AP: Primary data saved (7352 records). [2025-10-15T17:16:34.059173] [INFO ] [MAIN ] AP: Full history saved. [2025-10-15T17:16:34.059271] [INFO ] [MAIN ] Update Progress: 128/2369 symbols completed. AP took 40.2s. Estimated remaining: 4h 48m 45s. Rate: 7.8 symbols/min [2025-10-15T17:16:34.226897] [INFO ] [MAIN ] APH: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:16:34.227106] [DEBUG] [LOCAL ] APH: No existing data file found in primary storage. [2025-10-15T17:16:34.227151] [WARN ] [MAIN ] APH: No existing data found, performing full refresh instead. [2025-10-15T17:16:34.227283] [INFO ] [MAIN ] APH: Wiping existing primary data before full refresh. [2025-10-15T17:16:34.227324] [INFO ] [LOCAL ] APH: Starting deletion of primary data. [2025-10-15T17:16:34.227387] [DEBUG] [LOCAL ] APH: No primary data file found to delete. [2025-10-15T17:16:34.227421] [INFO ] [MAIN ] APH: Starting full primary refresh. [2025-10-15T17:16:34.519215] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-06. [2025-10-15T17:16:34.593161] [INFO ] [REMOTE ] APH: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:16:35.314009] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-10. [2025-10-15T17:16:35.425536] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-15T17:16:36.109584] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-15T17:16:36.121745] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-02. [2025-10-15T17:16:36.628537] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-15T17:16:36.632470] [INFO ] [REMOTE ] APAM: Full fetch complete (51797 records). [2025-10-15T17:16:36.632592] [DEBUG] [VALIDATOR ] APAM: Validating primary data. [2025-10-15T17:16:36.633326] [FATAL] [VALIDATOR ] APAM: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T17:16:36.633411] [FATAL] [MAIN ] APAM: Fetched primary data is invalid. Refusing to save it. [2025-10-15T17:16:36.633455] [WARN ] [MAIN ] APAM: Deleting existing primary and derivative data due to validation failure. [2025-10-15T17:16:36.633519] [INFO ] [LOCAL ] APAM: Starting deletion of primary data. [2025-10-15T17:16:36.633584] [DEBUG] [LOCAL ] APAM: No primary data file found to delete. [2025-10-15T17:16:36.633619] [INFO ] [LOCAL ] APAM: Starting deletion of derivative data. [2025-10-15T17:16:36.633870] [DEBUG] [LOCAL ] APAM: Deleted derivative data file. [2025-10-15T17:16:36.633964] [INFO ] [MAIN ] Update Progress: 129/2369 symbols completed. APAM took 38.1s. Estimated remaining: 4h 47m 7s. Rate: 7.8 symbols/min [2025-10-15T17:16:36.811853] [INFO ] [MAIN ] APLE: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:16:36.865750] [DEBUG] [LOCAL ] APLE: Loaded 51970 existing records from primary storage. [2025-10-15T17:16:36.866148] [INFO ] [MAIN ] APLE: Loaded 51970 existing records. [2025-10-15T17:16:36.922495] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-07. [2025-10-15T17:16:37.055227] [WARN ] [MAIN ] APLE: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:16:37.055460] [INFO ] [MAIN ] APLE: Wiping existing primary data before full refresh. [2025-10-15T17:16:37.055526] [INFO ] [LOCAL ] APLE: Starting deletion of primary data. [2025-10-15T17:16:37.056060] [DEBUG] [LOCAL ] APLE: Deleted primary data file. [2025-10-15T17:16:37.056116] [INFO ] [MAIN ] APLE: Starting full primary refresh. [2025-10-15T17:16:37.405700] [INFO ] [REMOTE ] APLE: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:16:37.713989] [INFO ] [REMOTE ] APLE: Fetching primary data for 2024-12. [2025-10-15T17:16:38.120047] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-10-15T17:16:38.513994] [INFO ] [REMOTE ] APH: Fetching primary data for 2024-12. [2025-10-15T17:16:38.704249] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-15T17:16:39.174597] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-15T17:16:39.313994] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-01. [2025-10-15T17:16:40.113975] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-08. [2025-10-15T17:16:40.205848] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-15T17:16:40.866139] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-15T17:16:40.913966] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-02. [2025-10-15T17:16:41.600782] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-15T17:16:41.713965] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-09. [2025-10-15T17:16:42.513973] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-03. [2025-10-15T17:16:42.809491] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-10-15T17:16:43.314094] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-03. [2025-10-15T17:16:43.494248] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-15T17:16:44.114006] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-01. [2025-10-15T17:16:44.160627] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-15T17:16:44.913993] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-10. [2025-10-15T17:16:45.397352] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-10-15T17:16:45.713962] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-04. [2025-10-15T17:16:46.144137] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-01 (2.03 seconds). [2025-10-15T17:16:46.503477] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-15T17:16:46.509119] [INFO ] [REMOTE ] APD: Full fetch complete (67217 records). [2025-10-15T17:16:46.509236] [DEBUG] [VALIDATOR ] APD: Validating primary data. [2025-10-15T17:16:46.521174] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-04. [2025-10-15T17:16:46.900124] [DEBUG] [VALIDATOR ] APD: All expected trading days are present. [2025-10-15T17:16:46.900210] [DEBUG] [VALIDATOR ] APD: Primary data validation passed. [2025-10-15T17:16:46.900937] [INFO ] [MAIN ] APD: Fetched primary data is valid. [2025-10-15T17:16:46.901000] [DEBUG] [LOCAL ] APD: Saving primary data. [2025-10-15T17:16:46.902403] [DEBUG] [LOCAL ] APD: Trimmed 67217 records to 45470 (keeping 200 days of data) [2025-10-15T17:16:47.203269] [DEBUG] [LOCAL ] APD: Primary data saved (45470 records). [2025-10-15T17:16:47.203439] [INFO ] [MAIN ] APD: Full history saved. [2025-10-15T17:16:47.203551] [INFO ] [MAIN ] Update Progress: 130/2369 symbols completed. APD took 32.7s. Estimated remaining: 4h 47m 49s. Rate: 7.8 symbols/min [2025-10-15T17:16:47.319085] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-02. [2025-10-15T17:16:47.378389] [INFO ] [MAIN ] APO: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:16:47.433490] [DEBUG] [LOCAL ] APO: Loaded 53390 existing records from primary storage. [2025-10-15T17:16:47.433949] [INFO ] [MAIN ] APO: Loaded 53390 existing records. [2025-10-15T17:16:47.619402] [WARN ] [MAIN ] APO: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:16:47.619773] [INFO ] [MAIN ] APO: Wiping existing primary data before full refresh. [2025-10-15T17:16:47.619880] [INFO ] [LOCAL ] APO: Starting deletion of primary data. [2025-10-15T17:16:47.620463] [DEBUG] [LOCAL ] APO: Deleted primary data file. [2025-10-15T17:16:47.620519] [INFO ] [MAIN ] APO: Starting full primary refresh. [2025-10-15T17:16:47.848435] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-10-15T17:16:48.042109] [INFO ] [REMOTE ] APO: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:16:48.100162] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-15T17:16:48.113959] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-05. [2025-10-15T17:16:48.913974] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-05. [2025-10-15T17:16:49.253388] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-10-15T17:16:49.713983] [INFO ] [REMOTE ] APO: Fetching primary data for 2024-12. [2025-10-15T17:16:49.812996] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-15T17:16:50.513968] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-06. [2025-10-15T17:16:50.892219] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-10-15T17:16:51.313973] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-06. [2025-10-15T17:16:51.514914] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-15T17:16:51.961811] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-15T17:16:52.113979] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-07. [2025-10-15T17:16:52.913984] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-03. [2025-10-15T17:16:52.972589] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-15T17:16:53.713998] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-07. [2025-10-15T17:16:53.787293] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-15T17:16:54.513984] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-08. [2025-10-15T17:16:54.735640] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-15T17:16:55.314071] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-01. [2025-10-15T17:16:55.553430] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-15T17:16:56.114033] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-08. [2025-10-15T17:16:56.314378] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-15T17:16:56.913987] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-04. [2025-10-15T17:16:57.156183] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-15T17:16:57.714032] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-02. [2025-10-15T17:16:57.945555] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-15T17:16:58.514005] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-09. [2025-10-15T17:16:58.978856] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-10-15T17:16:59.068540] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-15T17:16:59.314037] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-03. [2025-10-15T17:17:00.114001] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-09. [2025-10-15T17:17:00.149845] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-15T17:17:00.914008] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-05. [2025-10-15T17:17:01.384130] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-10-15T17:17:01.713986] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-10. [2025-10-15T17:17:01.769568] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-15T17:17:02.514026] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-04. [2025-10-15T17:17:03.150356] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-15T17:17:03.156155] [INFO ] [REMOTE ] APLE: Full fetch complete (74296 records). [2025-10-15T17:17:03.156296] [DEBUG] [VALIDATOR ] APLE: Validating primary data. [2025-10-15T17:17:03.157143] [FATAL] [VALIDATOR ] APLE: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T17:17:03.157243] [FATAL] [MAIN ] APLE: Fetched primary data is invalid. Refusing to save it. [2025-10-15T17:17:03.157285] [WARN ] [MAIN ] APLE: Deleting existing primary and derivative data due to validation failure. [2025-10-15T17:17:03.157354] [INFO ] [LOCAL ] APLE: Starting deletion of primary data. [2025-10-15T17:17:03.157412] [DEBUG] [LOCAL ] APLE: No primary data file found to delete. [2025-10-15T17:17:03.157447] [INFO ] [LOCAL ] APLE: Starting deletion of derivative data. [2025-10-15T17:17:03.157672] [DEBUG] [LOCAL ] APLE: Deleted derivative data file. [2025-10-15T17:17:03.157767] [INFO ] [MAIN ] Update Progress: 131/2369 symbols completed. APLE took 26.5s. Estimated remaining: 4h 50m 2s. Rate: 7.7 symbols/min [2025-10-15T17:17:03.328104] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-10. [2025-10-15T17:17:03.330508] [INFO ] [MAIN ] APOS: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:17:03.330691] [DEBUG] [LOCAL ] APOS: No existing data file found in primary storage. [2025-10-15T17:17:03.330762] [WARN ] [MAIN ] APOS: No existing data found, performing full refresh instead. [2025-10-15T17:17:03.331628] [INFO ] [MAIN ] APOS: Wiping existing primary data before full refresh. [2025-10-15T17:17:03.331707] [INFO ] [LOCAL ] APOS: Starting deletion of primary data. [2025-10-15T17:17:03.331760] [DEBUG] [LOCAL ] APOS: No primary data file found to delete. [2025-10-15T17:17:03.331793] [INFO ] [MAIN ] APOS: Starting full primary refresh. [2025-10-15T17:17:03.691591] [INFO ] [REMOTE ] APOS: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:17:04.113998] [INFO ] [REMOTE ] APOS: Fetching primary data for 2024-12. [2025-10-15T17:17:04.208483] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-05 (3.29 seconds). [2025-10-15T17:17:04.571532] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-10-15T17:17:04.915030] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-06. [2025-10-15T17:17:04.915751] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-10-15T17:17:05.064068] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-15T17:17:05.070201] [INFO ] [REMOTE ] APG: Full fetch complete (72106 records). [2025-10-15T17:17:05.070314] [DEBUG] [VALIDATOR ] APG: Validating primary data. [2025-10-15T17:17:05.484845] [DEBUG] [VALIDATOR ] APG: All expected trading days are present. [2025-10-15T17:17:05.484948] [DEBUG] [VALIDATOR ] APG: Primary data validation passed. [2025-10-15T17:17:05.485952] [INFO ] [MAIN ] APG: Fetched primary data is valid. [2025-10-15T17:17:05.486018] [DEBUG] [LOCAL ] APG: Saving primary data. [2025-10-15T17:17:05.488221] [DEBUG] [LOCAL ] APG: Trimmed 72106 records to 50584 (keeping 200 days of data) [2025-10-15T17:17:05.714149] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-01. [2025-10-15T17:17:05.793825] [DEBUG] [LOCAL ] APG: Primary data saved (50584 records). [2025-10-15T17:17:05.793963] [INFO ] [MAIN ] APG: Full history saved. [2025-10-15T17:17:05.795896] [INFO ] [MAIN ] Update Progress: 132/2369 symbols completed. APG took 35.3s. Estimated remaining: 4h 48m 27s. Rate: 7.8 symbols/min [2025-10-15T17:17:05.966368] [INFO ] [MAIN ] APTV: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:17:06.026791] [DEBUG] [LOCAL ] APTV: Loaded 51980 existing records from primary storage. [2025-10-15T17:17:06.027164] [INFO ] [MAIN ] APTV: Loaded 51980 existing records. [2025-10-15T17:17:06.215012] [WARN ] [MAIN ] APTV: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:17:06.215470] [INFO ] [MAIN ] APTV: Wiping existing primary data before full refresh. [2025-10-15T17:17:06.215541] [INFO ] [LOCAL ] APTV: Starting deletion of primary data. [2025-10-15T17:17:06.215985] [DEBUG] [LOCAL ] APTV: Deleted primary data file. [2025-10-15T17:17:06.216042] [INFO ] [MAIN ] APTV: Starting full primary refresh. [2025-10-15T17:17:06.336171] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-15T17:17:06.515545] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-02. [2025-10-15T17:17:06.600246] [INFO ] [REMOTE ] APTV: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:17:07.048209] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-06 (2.13 seconds). [2025-10-15T17:17:07.314131] [INFO ] [REMOTE ] APTV: Fetching primary data for 2024-12. [2025-10-15T17:17:07.314055] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-15T17:17:08.114003] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-05. [2025-10-15T17:17:08.914057] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-07. [2025-10-15T17:17:09.091517] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-15T17:17:09.713970] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-01. [2025-10-15T17:17:10.149266] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-10-15T17:17:10.513981] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-06. [2025-10-15T17:17:11.036531] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-10-15T17:17:11.313972] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-03. [2025-10-15T17:17:11.532612] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-15T17:17:12.036251] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-15T17:17:12.114023] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-02. [2025-10-15T17:17:12.293781] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-15T17:17:12.914000] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-07. [2025-10-15T17:17:13.713982] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-04. [2025-10-15T17:17:14.049226] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-10-15T17:17:14.206736] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-10-15T17:17:14.513979] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-08. [2025-10-15T17:17:14.829297] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-15T17:17:15.313994] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-05. [2025-10-15T17:17:16.113979] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-08. [2025-10-15T17:17:16.124580] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-15T17:17:16.508562] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-10-15T17:17:16.914031] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-03. [2025-10-15T17:17:17.714135] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-06. [2025-10-15T17:17:17.918517] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-15T17:17:18.225196] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-10-15T17:17:18.513977] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-09. [2025-10-15T17:17:18.637860] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-15T17:17:19.314023] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-07. [2025-10-15T17:17:19.912933] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-15T17:17:20.113980] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-09. [2025-10-15T17:17:20.573939] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-10-15T17:17:20.914000] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-10. [2025-10-15T17:17:21.714009] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-04. [2025-10-15T17:17:21.882264] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-15T17:17:22.514023] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-10. [2025-10-15T17:17:23.177054] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-10 (2.26 seconds). [2025-10-15T17:17:23.183889] [INFO ] [REMOTE ] APH: Full fetch complete (77867 records). [2025-10-15T17:17:23.184064] [DEBUG] [VALIDATOR ] APH: Validating primary data. [2025-10-15T17:17:23.321840] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-08. [2025-10-15T17:17:23.606767] [DEBUG] [VALIDATOR ] APH: All expected trading days are present. [2025-10-15T17:17:23.606899] [DEBUG] [VALIDATOR ] APH: Primary data validation passed. [2025-10-15T17:17:23.607816] [INFO ] [MAIN ] APH: Fetched primary data is valid. [2025-10-15T17:17:23.607966] [DEBUG] [LOCAL ] APH: Saving primary data. [2025-10-15T17:17:23.609790] [DEBUG] [LOCAL ] APH: Trimmed 77867 records to 53691 (keeping 200 days of data) [2025-10-15T17:17:23.731104] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-10-15T17:17:23.910638] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-15T17:17:24.031277] [DEBUG] [LOCAL ] APH: Primary data saved (53691 records). [2025-10-15T17:17:24.031437] [INFO ] [MAIN ] APH: Full history saved. [2025-10-15T17:17:24.031517] [INFO ] [MAIN ] Update Progress: 133/2369 symbols completed. APH took 50.0s. Estimated remaining: 4h 51m 16s. Rate: 7.7 symbols/min [2025-10-15T17:17:24.116466] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-05. [2025-10-15T17:17:24.218780] [INFO ] [MAIN ] AQN: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:17:24.219089] [DEBUG] [LOCAL ] AQN: No existing data file found in primary storage. [2025-10-15T17:17:24.219135] [WARN ] [MAIN ] AQN: No existing data found, performing full refresh instead. [2025-10-15T17:17:24.219250] [INFO ] [MAIN ] AQN: Wiping existing primary data before full refresh. [2025-10-15T17:17:24.219295] [INFO ] [LOCAL ] AQN: Starting deletion of primary data. [2025-10-15T17:17:24.219346] [DEBUG] [LOCAL ] AQN: No primary data file found to delete. [2025-10-15T17:17:24.219384] [INFO ] [MAIN ] AQN: Starting full primary refresh. [2025-10-15T17:17:24.574865] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-10 (2.06 seconds). [2025-10-15T17:17:24.621900] [INFO ] [REMOTE ] APO: Full fetch complete (77460 records). [2025-10-15T17:17:24.642044] [INFO ] [REMOTE ] AQN: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:17:24.642318] [DEBUG] [VALIDATOR ] APO: Validating primary data. [2025-10-15T17:17:24.919251] [INFO ] [REMOTE ] AQN: Fetching primary data for 2024-12. [2025-10-15T17:17:25.045532] [DEBUG] [VALIDATOR ] APO: All expected trading days are present. [2025-10-15T17:17:25.045611] [DEBUG] [VALIDATOR ] APO: Primary data validation passed. [2025-10-15T17:17:25.046422] [INFO ] [MAIN ] APO: Fetched primary data is valid. [2025-10-15T17:17:25.046483] [DEBUG] [LOCAL ] APO: Saving primary data. [2025-10-15T17:17:25.048027] [DEBUG] [LOCAL ] APO: Trimmed 77460 records to 53389 (keeping 200 days of data) [2025-10-15T17:17:25.376611] [DEBUG] [LOCAL ] APO: Primary data saved (53389 records). [2025-10-15T17:17:25.376878] [INFO ] [MAIN ] APO: Full history saved. [2025-10-15T17:17:25.376977] [INFO ] [MAIN ] Update Progress: 134/2369 symbols completed. APO took 38.2s. Estimated remaining: 4h 49m 20s. Rate: 7.7 symbols/min [2025-10-15T17:17:25.542254] [INFO ] [MAIN ] AQNB: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:17:25.548332] [DEBUG] [LOCAL ] AQNB: Loaded 4087 existing records from primary storage. [2025-10-15T17:17:25.548492] [INFO ] [MAIN ] AQNB: Loaded 4087 existing records. [2025-10-15T17:17:25.720998] [WARN ] [MAIN ] AQNB: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:17:25.721198] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-09. [2025-10-15T17:17:25.722178] [INFO ] [MAIN ] AQNB: Wiping existing primary data before full refresh. [2025-10-15T17:17:25.722391] [INFO ] [LOCAL ] AQNB: Starting deletion of primary data. [2025-10-15T17:17:25.722728] [DEBUG] [LOCAL ] AQNB: Deleted primary data file. [2025-10-15T17:17:25.722787] [INFO ] [MAIN ] AQNB: Starting full primary refresh. [2025-10-15T17:17:26.078778] [INFO ] [REMOTE ] AQNB: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:17:26.110009] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-10-15T17:17:26.514033] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-06. [2025-10-15T17:17:26.707165] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-15T17:17:26.738464] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-15T17:17:27.313976] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2024-12. [2025-10-15T17:17:28.112299] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-10-15T17:17:28.112112] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-15T17:17:28.116063] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-01. [2025-10-15T17:17:28.913996] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-10. [2025-10-15T17:17:29.582966] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-15T17:17:29.584136] [INFO ] [REMOTE ] APOS: Full fetch complete (10354 records). [2025-10-15T17:17:29.584206] [DEBUG] [VALIDATOR ] APOS: Validating primary data. [2025-10-15T17:17:29.725842] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-01. [2025-10-15T17:17:29.952458] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-15T17:17:29.992333] [DEBUG] [VALIDATOR ] APOS: All expected trading days are present. [2025-10-15T17:17:29.992402] [DEBUG] [VALIDATOR ] APOS: Primary data validation passed. [2025-10-15T17:17:29.992729] [INFO ] [MAIN ] APOS: Fetched primary data is valid. [2025-10-15T17:17:29.992791] [DEBUG] [LOCAL ] APOS: Saving primary data. [2025-10-15T17:17:29.993203] [DEBUG] [LOCAL ] APOS: Trimmed 10354 records to 7314 (keeping 200 days of data) [2025-10-15T17:17:30.036068] [DEBUG] [LOCAL ] APOS: Primary data saved (7314 records). [2025-10-15T17:17:30.036195] [INFO ] [MAIN ] APOS: Full history saved. [2025-10-15T17:17:30.036268] [INFO ] [MAIN ] Update Progress: 135/2369 symbols completed. APOS took 26.9s. Estimated remaining: 4h 48m 21s. Rate: 7.7 symbols/min [2025-10-15T17:17:30.201537] [INFO ] [MAIN ] AR: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:17:30.215888] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-10-15T17:17:30.255037] [DEBUG] [LOCAL ] AR: Loaded 53587 existing records from primary storage. [2025-10-15T17:17:30.255349] [INFO ] [MAIN ] AR: Loaded 53587 existing records. [2025-10-15T17:17:30.455611] [WARN ] [MAIN ] AR: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:17:30.455897] [INFO ] [MAIN ] AR: Wiping existing primary data before full refresh. [2025-10-15T17:17:30.455955] [INFO ] [LOCAL ] AR: Starting deletion of primary data. [2025-10-15T17:17:30.456386] [DEBUG] [LOCAL ] AR: Deleted primary data file. [2025-10-15T17:17:30.456443] [INFO ] [MAIN ] AR: Starting full primary refresh. [2025-10-15T17:17:30.519127] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-02. [2025-10-15T17:17:30.814280] [INFO ] [REMOTE ] AR: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:17:31.314041] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-02. [2025-10-15T17:17:31.691503] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-02 (0.38 seconds). [2025-10-15T17:17:32.077059] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-15T17:17:32.113979] [INFO ] [REMOTE ] AR: Fetching primary data for 2024-12. [2025-10-15T17:17:32.914045] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-03. [2025-10-15T17:17:33.713966] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-03. [2025-10-15T17:17:33.897250] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-15T17:17:34.286406] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-15T17:17:34.513989] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-01. [2025-10-15T17:17:34.808290] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-15T17:17:35.314065] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-07. [2025-10-15T17:17:36.114026] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-04. [2025-10-15T17:17:36.288939] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-15T17:17:36.723034] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-15T17:17:36.913974] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-04. [2025-10-15T17:17:37.019486] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-15T17:17:37.714019] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-02. [2025-10-15T17:17:38.480701] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-15T17:17:38.513964] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-08. [2025-10-15T17:17:39.307740] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-15T17:17:39.317425] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-05. [2025-10-15T17:17:39.777166] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-15T17:17:40.114004] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-05. [2025-10-15T17:17:40.815024] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-15T17:17:40.913965] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-06. [2025-10-15T17:17:41.027549] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-15T17:17:41.357020] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-10-15T17:17:41.713993] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-09. [2025-10-15T17:17:42.514020] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-03. [2025-10-15T17:17:43.314079] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-07. [2025-10-15T17:17:43.518540] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-15T17:17:43.689192] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-07 (0.38 seconds). [2025-10-15T17:17:44.113977] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-06. [2025-10-15T17:17:44.335497] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-15T17:17:44.914010] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-10. [2025-10-15T17:17:45.700366] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-15T17:17:45.713945] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-07. [2025-10-15T17:17:46.514059] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-08. [2025-10-15T17:17:46.555044] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-15T17:17:46.565432] [INFO ] [REMOTE ] APTV: Full fetch complete (75564 records). [2025-10-15T17:17:46.565570] [DEBUG] [VALIDATOR ] APTV: Validating primary data. [2025-10-15T17:17:46.566440] [FATAL] [VALIDATOR ] APTV: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T17:17:46.566533] [FATAL] [MAIN ] APTV: Fetched primary data is invalid. Refusing to save it. [2025-10-15T17:17:46.566575] [WARN ] [MAIN ] APTV: Deleting existing primary and derivative data due to validation failure. [2025-10-15T17:17:46.566615] [INFO ] [LOCAL ] APTV: Starting deletion of primary data. [2025-10-15T17:17:46.566705] [DEBUG] [LOCAL ] APTV: No primary data file found to delete. [2025-10-15T17:17:46.566755] [INFO ] [LOCAL ] APTV: Starting deletion of derivative data. [2025-10-15T17:17:46.566959] [DEBUG] [LOCAL ] APTV: Deleted derivative data file. [2025-10-15T17:17:46.568353] [INFO ] [MAIN ] Update Progress: 136/2369 symbols completed. APTV took 40.8s. Estimated remaining: 4h 50m 38s. Rate: 7.7 symbols/min [2025-10-15T17:17:46.732631] [INFO ] [MAIN ] ARCO: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:17:46.780753] [DEBUG] [LOCAL ] ARCO: Loaded 44536 existing records from primary storage. [2025-10-15T17:17:46.781077] [INFO ] [MAIN ] ARCO: Loaded 44536 existing records. [2025-10-15T17:17:46.958399] [WARN ] [MAIN ] ARCO: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:17:46.958820] [INFO ] [MAIN ] ARCO: Wiping existing primary data before full refresh. [2025-10-15T17:17:46.958879] [INFO ] [LOCAL ] ARCO: Starting deletion of primary data. [2025-10-15T17:17:46.959352] [DEBUG] [LOCAL ] ARCO: Deleted primary data file. [2025-10-15T17:17:46.959390] [INFO ] [MAIN ] ARCO: Starting full primary refresh. [2025-10-15T17:17:47.065795] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-15T17:17:47.316413] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-04. [2025-10-15T17:17:47.322447] [INFO ] [REMOTE ] ARCO: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:17:47.353607] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-15T17:17:48.114024] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-08. [2025-10-15T17:17:48.914024] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2024-12. [2025-10-15T17:17:49.085565] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-15T17:17:49.713974] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-05. [2025-10-15T17:17:50.513980] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-09. [2025-10-15T17:17:50.586464] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-08 (2.47 seconds). [2025-10-15T17:17:51.193240] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-15T17:17:51.267293] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2024-12 (2.35 seconds). [2025-10-15T17:17:51.313955] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-01. [2025-10-15T17:17:51.400684] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-15T17:17:52.114007] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-09. [2025-10-15T17:17:52.859483] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-15T17:17:52.913969] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-10. [2025-10-15T17:17:53.289542] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-10 (0.38 seconds). [2025-10-15T17:17:53.290493] [INFO ] [REMOTE ] AQNB: Full fetch complete (5518 records). [2025-10-15T17:17:53.290585] [DEBUG] [VALIDATOR ] AQNB: Validating primary data. [2025-10-15T17:17:53.686501] [DEBUG] [VALIDATOR ] AQNB: All expected trading days are present. [2025-10-15T17:17:53.686600] [DEBUG] [VALIDATOR ] AQNB: Primary data validation passed. [2025-10-15T17:17:53.686905] [INFO ] [MAIN ] AQNB: Fetched primary data is valid. [2025-10-15T17:17:53.687050] [DEBUG] [LOCAL ] AQNB: Saving primary data. [2025-10-15T17:17:53.687733] [DEBUG] [LOCAL ] AQNB: Trimmed 5518 records to 4069 (keeping 200 days of data) [2025-10-15T17:17:53.712158] [DEBUG] [LOCAL ] AQNB: Primary data saved (4069 records). [2025-10-15T17:17:53.712250] [INFO ] [MAIN ] AQNB: Full history saved. [2025-10-15T17:17:53.712331] [INFO ] [MAIN ] Update Progress: 137/2369 symbols completed. AQNB took 28.3s. Estimated remaining: 4h 50m 19s. Rate: 7.7 symbols/min [2025-10-15T17:17:53.723434] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-02. [2025-10-15T17:17:53.899700] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-15T17:17:53.929450] [INFO ] [MAIN ] ARDC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:17:53.957292] [DEBUG] [LOCAL ] ARDC: Loaded 15257 existing records from primary storage. [2025-10-15T17:17:53.957576] [INFO ] [MAIN ] ARDC: Loaded 15257 existing records. [2025-10-15T17:17:54.128482] [WARN ] [MAIN ] ARDC: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:17:54.128724] [INFO ] [MAIN ] ARDC: Wiping existing primary data before full refresh. [2025-10-15T17:17:54.128782] [INFO ] [LOCAL ] ARDC: Starting deletion of primary data. [2025-10-15T17:17:54.128981] [DEBUG] [LOCAL ] ARDC: Deleted primary data file. [2025-10-15T17:17:54.129037] [INFO ] [MAIN ] ARDC: Starting full primary refresh. [2025-10-15T17:17:54.514873] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-10. [2025-10-15T17:17:54.514757] [INFO ] [REMOTE ] ARDC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:17:55.313981] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-06. [2025-10-15T17:17:55.409202] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-15T17:17:56.013049] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-15T17:17:56.020628] [INFO ] [REMOTE ] AQN: Full fetch complete (75024 records). [2025-10-15T17:17:56.020836] [DEBUG] [VALIDATOR ] AQN: Validating primary data. [2025-10-15T17:17:56.021817] [FATAL] [VALIDATOR ] AQN: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T17:17:56.021925] [FATAL] [MAIN ] AQN: Fetched primary data is invalid. Refusing to save it. [2025-10-15T17:17:56.022011] [WARN ] [MAIN ] AQN: Deleting existing primary and derivative data due to validation failure. [2025-10-15T17:17:56.022102] [INFO ] [LOCAL ] AQN: Starting deletion of primary data. [2025-10-15T17:17:56.022179] [DEBUG] [LOCAL ] AQN: No primary data file found to delete. [2025-10-15T17:17:56.022256] [INFO ] [LOCAL ] AQN: Starting deletion of derivative data. [2025-10-15T17:17:56.022372] [DEBUG] [LOCAL ] AQN: No derivative data file found to delete. [2025-10-15T17:17:56.022487] [INFO ] [MAIN ] Update Progress: 138/2369 symbols completed. AQN took 32.0s. Estimated remaining: 4h 48m 43s. Rate: 7.7 symbols/min [2025-10-15T17:17:56.119084] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-03. [2025-10-15T17:17:56.227220] [INFO ] [MAIN ] ARDT: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:17:56.255494] [DEBUG] [LOCAL ] ARDT: Loaded 27735 existing records from primary storage. [2025-10-15T17:17:56.255837] [INFO ] [MAIN ] ARDT: Loaded 27735 existing records. [2025-10-15T17:17:56.432122] [WARN ] [MAIN ] ARDT: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:17:56.432372] [INFO ] [MAIN ] ARDT: Wiping existing primary data before full refresh. [2025-10-15T17:17:56.432421] [INFO ] [LOCAL ] ARDT: Starting deletion of primary data. [2025-10-15T17:17:56.432834] [DEBUG] [LOCAL ] ARDT: Deleted primary data file. [2025-10-15T17:17:56.432889] [INFO ] [MAIN ] ARDT: Starting full primary refresh. [2025-10-15T17:17:56.773516] [INFO ] [REMOTE ] ARDT: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:17:56.913961] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2024-12. [2025-10-15T17:17:57.169662] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-15T17:17:57.714001] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-07. [2025-10-15T17:17:57.763625] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-15T17:17:58.063517] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-15T17:17:58.514092] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2024-12. [2025-10-15T17:17:59.293158] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-10-15T17:17:59.313980] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-04. [2025-10-15T17:17:59.660874] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-15T17:18:00.114023] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-01. [2025-10-15T17:18:00.914005] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-08. [2025-10-15T17:18:01.210611] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-15T17:18:01.373757] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-15T17:18:01.714043] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-02. [2025-10-15T17:18:02.513971] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-01. [2025-10-15T17:18:02.771455] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-15T17:18:02.932113] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-15T17:18:03.313993] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-05. [2025-10-15T17:18:03.323417] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-15T17:18:04.114012] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-09. [2025-10-15T17:18:04.910319] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-15T17:18:04.919400] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-03. [2025-10-15T17:18:05.714106] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-06. [2025-10-15T17:18:05.946133] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-15T17:18:06.323777] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-15T17:18:06.514037] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-10. [2025-10-15T17:18:07.186967] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-15T17:18:07.314050] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-02. [2025-10-15T17:18:08.113975] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-07. [2025-10-15T17:18:08.172779] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-15T17:18:08.260315] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-15T17:18:08.266121] [INFO ] [REMOTE ] AR: Full fetch complete (77337 records). [2025-10-15T17:18:08.266237] [DEBUG] [VALIDATOR ] AR: Validating primary data. [2025-10-15T17:18:08.267052] [FATAL] [VALIDATOR ] AR: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T17:18:08.267143] [FATAL] [MAIN ] AR: Fetched primary data is invalid. Refusing to save it. [2025-10-15T17:18:08.267208] [WARN ] [MAIN ] AR: Deleting existing primary and derivative data due to validation failure. [2025-10-15T17:18:08.267322] [INFO ] [LOCAL ] AR: Starting deletion of primary data. [2025-10-15T17:18:08.267394] [DEBUG] [LOCAL ] AR: No primary data file found to delete. [2025-10-15T17:18:08.267431] [INFO ] [LOCAL ] AR: Starting deletion of derivative data. [2025-10-15T17:18:08.267691] [DEBUG] [LOCAL ] AR: Deleted derivative data file. [2025-10-15T17:18:08.267786] [INFO ] [MAIN ] Update Progress: 139/2369 symbols completed. AR took 38.2s. Estimated remaining: 4h 49m 47s. Rate: 7.7 symbols/min [2025-10-15T17:18:08.436278] [INFO ] [MAIN ] ARE: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:18:08.483908] [DEBUG] [LOCAL ] ARE: Loaded 50917 existing records from primary storage. [2025-10-15T17:18:08.484204] [INFO ] [MAIN ] ARE: Loaded 50917 existing records. [2025-10-15T17:18:08.660753] [WARN ] [MAIN ] ARE: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:18:08.660993] [INFO ] [MAIN ] ARE: Wiping existing primary data before full refresh. [2025-10-15T17:18:08.661042] [INFO ] [LOCAL ] ARE: Starting deletion of primary data. [2025-10-15T17:18:08.661745] [DEBUG] [LOCAL ] ARE: Deleted primary data file. [2025-10-15T17:18:08.661802] [INFO ] [MAIN ] ARE: Starting full primary refresh. [2025-10-15T17:18:08.923214] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-03. [2025-10-15T17:18:09.011866] [INFO ] [REMOTE ] ARE: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:18:09.501318] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-15T17:18:09.714015] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-04. [2025-10-15T17:18:09.879805] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-15T17:18:10.514015] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-08. [2025-10-15T17:18:11.066395] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-15T17:18:11.314051] [INFO ] [REMOTE ] ARE: Fetching primary data for 2024-12. [2025-10-15T17:18:12.045945] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-15T17:18:12.113999] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-09. [2025-10-15T17:18:12.913987] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-04. [2025-10-15T17:18:13.034660] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-15T17:18:13.618249] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-15T17:18:13.680904] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-15T17:18:13.713972] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-05. [2025-10-15T17:18:14.313701] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-15T17:18:14.514025] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-05. [2025-10-15T17:18:15.321783] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-06. [2025-10-15T17:18:15.325493] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-15T17:18:16.114002] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-10. [2025-10-15T17:18:16.248015] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-15T17:18:16.914008] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-06. [2025-10-15T17:18:17.566535] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-15T17:18:17.571699] [INFO ] [REMOTE ] ARCO: Full fetch complete (65171 records). [2025-10-15T17:18:17.571796] [DEBUG] [VALIDATOR ] ARCO: Validating primary data. [2025-10-15T17:18:17.719124] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-07. [2025-10-15T17:18:17.991772] [DEBUG] [VALIDATOR ] ARCO: All expected trading days are present. [2025-10-15T17:18:17.991929] [DEBUG] [VALIDATOR ] ARCO: Primary data validation passed. [2025-10-15T17:18:17.992773] [INFO ] [MAIN ] ARCO: Fetched primary data is valid. [2025-10-15T17:18:17.992925] [DEBUG] [LOCAL ] ARCO: Saving primary data. [2025-10-15T17:18:17.994274] [DEBUG] [LOCAL ] ARCO: Trimmed 65171 records to 44501 (keeping 200 days of data) [2025-10-15T17:18:18.135407] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-15T17:18:18.284355] [DEBUG] [LOCAL ] ARCO: Primary data saved (44501 records). [2025-10-15T17:18:18.284500] [INFO ] [MAIN ] ARCO: Full history saved. [2025-10-15T17:18:18.284580] [INFO ] [MAIN ] Update Progress: 140/2369 symbols completed. ARCO took 31.7s. Estimated remaining: 4h 50m 14s. Rate: 7.7 symbols/min [2025-10-15T17:18:18.450472] [INFO ] [MAIN ] ARES: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:18:18.497418] [DEBUG] [LOCAL ] ARES: Loaded 49704 existing records from primary storage. [2025-10-15T17:18:18.497879] [INFO ] [MAIN ] ARES: Loaded 49704 existing records. [2025-10-15T17:18:18.519238] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-01. [2025-10-15T17:18:18.681682] [WARN ] [MAIN ] ARES: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:18:18.682094] [INFO ] [MAIN ] ARES: Wiping existing primary data before full refresh. [2025-10-15T17:18:18.682157] [INFO ] [LOCAL ] ARES: Starting deletion of primary data. [2025-10-15T17:18:18.683153] [DEBUG] [LOCAL ] ARES: Deleted primary data file. [2025-10-15T17:18:18.683211] [INFO ] [MAIN ] ARES: Starting full primary refresh. [2025-10-15T17:18:18.811775] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-15T17:18:19.074466] [INFO ] [REMOTE ] ARES: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:18:19.314061] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-07. [2025-10-15T17:18:20.114017] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-08. [2025-10-15T17:18:20.215359] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-15T17:18:20.792284] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-15T17:18:20.833006] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-15T17:18:20.913964] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-09. [2025-10-15T17:18:21.670978] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-15T17:18:21.713971] [INFO ] [REMOTE ] ARES: Fetching primary data for 2024-12. [2025-10-15T17:18:22.514010] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-10. [2025-10-15T17:18:23.291943] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-15T17:18:23.313952] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-01. [2025-10-15T17:18:23.570497] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-15T17:18:23.573578] [INFO ] [REMOTE ] ARDC: Full fetch complete (21450 records). [2025-10-15T17:18:23.573693] [DEBUG] [VALIDATOR ] ARDC: Validating primary data. [2025-10-15T17:18:23.940545] [DEBUG] [VALIDATOR ] ARDC: All expected trading days are present. [2025-10-15T17:18:23.940627] [DEBUG] [VALIDATOR ] ARDC: Primary data validation passed. [2025-10-15T17:18:23.941045] [INFO ] [MAIN ] ARDC: Fetched primary data is valid. [2025-10-15T17:18:23.941095] [DEBUG] [LOCAL ] ARDC: Saving primary data. [2025-10-15T17:18:23.941799] [DEBUG] [LOCAL ] ARDC: Trimmed 21450 records to 15318 (keeping 200 days of data) [2025-10-15T17:18:24.031476] [DEBUG] [LOCAL ] ARDC: Primary data saved (15318 records). [2025-10-15T17:18:24.031620] [INFO ] [MAIN ] ARDC: Full history saved. [2025-10-15T17:18:24.031747] [INFO ] [MAIN ] Update Progress: 141/2369 symbols completed. ARDC took 30.3s. Estimated remaining: 4h 49m 34s. Rate: 7.7 symbols/min [2025-10-15T17:18:24.123716] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-08. [2025-10-15T17:18:24.209124] [INFO ] [MAIN ] ARI: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:18:24.246913] [DEBUG] [LOCAL ] ARI: Loaded 43778 existing records from primary storage. [2025-10-15T17:18:24.247207] [INFO ] [MAIN ] ARI: Loaded 43778 existing records. [2025-10-15T17:18:24.452166] [WARN ] [MAIN ] ARI: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:18:24.452385] [INFO ] [MAIN ] ARI: Wiping existing primary data before full refresh. [2025-10-15T17:18:24.452436] [INFO ] [LOCAL ] ARI: Starting deletion of primary data. [2025-10-15T17:18:24.453276] [DEBUG] [LOCAL ] ARI: Deleted primary data file. [2025-10-15T17:18:24.453338] [INFO ] [MAIN ] ARI: Starting full primary refresh. [2025-10-15T17:18:24.809945] [INFO ] [REMOTE ] ARI: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:18:24.913972] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-02. [2025-10-15T17:18:24.961759] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-15T17:18:25.481512] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-15T17:18:25.714049] [INFO ] [REMOTE ] ARI: Fetching primary data for 2024-12. [2025-10-15T17:18:26.513966] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-02. [2025-10-15T17:18:26.626936] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-15T17:18:27.313975] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-09. [2025-10-15T17:18:27.419906] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-15T17:18:28.019102] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-15T17:18:28.113971] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-03. [2025-10-15T17:18:28.260885] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-15T17:18:28.914042] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-03. [2025-10-15T17:18:29.714025] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-01. [2025-10-15T17:18:29.943224] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-15T17:18:30.389083] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-15T17:18:30.513975] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-04. [2025-10-15T17:18:30.736487] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-15T17:18:31.314086] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-10. [2025-10-15T17:18:32.114034] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-04. [2025-10-15T17:18:32.365455] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-15T17:18:32.671484] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-15T17:18:32.675429] [INFO ] [REMOTE ] ARDT: Full fetch complete (41693 records). [2025-10-15T17:18:32.675530] [DEBUG] [VALIDATOR ] ARDT: Validating primary data. [2025-10-15T17:18:32.923124] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-05. [2025-10-15T17:18:33.060047] [DEBUG] [VALIDATOR ] ARDT: All expected trading days are present. [2025-10-15T17:18:33.060135] [DEBUG] [VALIDATOR ] ARDT: Primary data validation passed. [2025-10-15T17:18:33.060708] [INFO ] [MAIN ] ARDT: Fetched primary data is valid. [2025-10-15T17:18:33.060772] [DEBUG] [LOCAL ] ARDT: Saving primary data. [2025-10-15T17:18:33.061899] [DEBUG] [LOCAL ] ARDT: Trimmed 41693 records to 27721 (keeping 200 days of data) [2025-10-15T17:18:33.220943] [DEBUG] [LOCAL ] ARDT: Primary data saved (27721 records). [2025-10-15T17:18:33.221081] [INFO ] [MAIN ] ARDT: Full history saved. [2025-10-15T17:18:33.221162] [INFO ] [MAIN ] Update Progress: 142/2369 symbols completed. ARDT took 37.2s. Estimated remaining: 4h 49m 48s. Rate: 7.7 symbols/min [2025-10-15T17:18:33.388404] [INFO ] [MAIN ] ARLO: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:18:33.429321] [DEBUG] [LOCAL ] ARLO: Loaded 43765 existing records from primary storage. [2025-10-15T17:18:33.429612] [INFO ] [MAIN ] ARLO: Loaded 43765 existing records. [2025-10-15T17:18:33.632372] [WARN ] [MAIN ] ARLO: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:18:33.632617] [INFO ] [MAIN ] ARLO: Wiping existing primary data before full refresh. [2025-10-15T17:18:33.632746] [INFO ] [LOCAL ] ARLO: Starting deletion of primary data. [2025-10-15T17:18:33.633259] [DEBUG] [LOCAL ] ARLO: Deleted primary data file. [2025-10-15T17:18:33.633316] [INFO ] [MAIN ] ARLO: Starting full primary refresh. [2025-10-15T17:18:33.716689] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-02. [2025-10-15T17:18:34.013873] [INFO ] [REMOTE ] ARLO: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:18:34.141143] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-10-15T17:18:34.513981] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-05. [2025-10-15T17:18:34.781620] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-15T17:18:35.236931] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-15T17:18:35.314020] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-03. [2025-10-15T17:18:35.985956] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-15T17:18:36.113996] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-06. [2025-10-15T17:18:36.732220] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-15T17:18:36.913981] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2024-12. [2025-10-15T17:18:37.496530] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-15T17:18:37.714049] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-06. [2025-10-15T17:18:38.482780] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-15T17:18:38.513967] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-01. [2025-10-15T17:18:39.238913] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-15T17:18:39.313997] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-07. [2025-10-15T17:18:39.789498] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-15T17:18:40.114047] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-02. [2025-10-15T17:18:40.914008] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-04. [2025-10-15T17:18:40.949176] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-15T17:18:41.355967] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-15T17:18:41.714042] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-03. [2025-10-15T17:18:42.263542] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-15T17:18:42.514010] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-08. [2025-10-15T17:18:43.120351] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-15T17:18:43.314026] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-07. [2025-10-15T17:18:44.103041] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-15T17:18:44.113961] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-04. [2025-10-15T17:18:44.914051] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-09. [2025-10-15T17:18:45.155735] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-15T17:18:45.622868] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-15T17:18:45.714020] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-05. [2025-10-15T17:18:46.513981] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-08. [2025-10-15T17:18:46.558899] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-15T17:18:47.105333] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-15T17:18:47.314004] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-06. [2025-10-15T17:18:47.870364] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-15T17:18:48.113991] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-09. [2025-10-15T17:18:48.686540] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-15T17:18:48.913994] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-05. [2025-10-15T17:18:49.684595] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-15T17:18:49.714004] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-10. [2025-10-15T17:18:50.254987] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-15T17:18:50.514009] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-06. [2025-10-15T17:18:51.314075] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-07. [2025-10-15T17:18:51.431608] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-15T17:18:51.437877] [INFO ] [REMOTE ] ARES: Full fetch complete (70955 records). [2025-10-15T17:18:51.438084] [DEBUG] [VALIDATOR ] ARES: Validating primary data. [2025-10-15T17:18:51.438971] [FATAL] [VALIDATOR ] ARES: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T17:18:51.439083] [FATAL] [MAIN ] ARES: Fetched primary data is invalid. Refusing to save it. [2025-10-15T17:18:51.439156] [WARN ] [MAIN ] ARES: Deleting existing primary and derivative data due to validation failure. [2025-10-15T17:18:51.439261] [INFO ] [LOCAL ] ARES: Starting deletion of primary data. [2025-10-15T17:18:51.439347] [DEBUG] [LOCAL ] ARES: No primary data file found to delete. [2025-10-15T17:18:51.439392] [INFO ] [LOCAL ] ARES: Starting deletion of derivative data. [2025-10-15T17:18:51.439680] [DEBUG] [LOCAL ] ARES: Deleted derivative data file. [2025-10-15T17:18:51.440881] [INFO ] [MAIN ] Update Progress: 143/2369 symbols completed. ARES took 33.2s. Estimated remaining: 4h 52m 22s. Rate: 7.6 symbols/min [2025-10-15T17:18:51.618340] [INFO ] [MAIN ] ARMK: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:18:51.674112] [DEBUG] [LOCAL ] ARMK: Loaded 50356 existing records from primary storage. [2025-10-15T17:18:51.683320] [INFO ] [MAIN ] ARMK: Loaded 50356 existing records. [2025-10-15T17:18:51.798763] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-15T17:18:51.889174] [WARN ] [MAIN ] ARMK: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:18:51.889408] [INFO ] [MAIN ] ARMK: Wiping existing primary data before full refresh. [2025-10-15T17:18:51.889457] [INFO ] [LOCAL ] ARMK: Starting deletion of primary data. [2025-10-15T17:18:51.889949] [DEBUG] [LOCAL ] ARMK: Deleted primary data file. [2025-10-15T17:18:51.890009] [INFO ] [MAIN ] ARMK: Starting full primary refresh. [2025-10-15T17:18:52.121436] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-07. [2025-10-15T17:18:52.241088] [INFO ] [REMOTE ] ARMK: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:18:52.914082] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2024-12. [2025-10-15T17:18:53.713962] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-10. [2025-10-15T17:18:53.896281] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-15T17:18:54.308381] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-07 (2.99 seconds). [2025-10-15T17:18:54.514045] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-08. [2025-10-15T17:18:55.285446] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2024-12 (2.37 seconds). [2025-10-15T17:18:55.313949] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-08. [2025-10-15T17:18:55.623847] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-10 (1.91 seconds). [2025-10-15T17:18:55.634752] [INFO ] [REMOTE ] ARE: Full fetch complete (72990 records). [2025-10-15T17:18:55.634897] [DEBUG] [VALIDATOR ] ARE: Validating primary data. [2025-10-15T17:18:56.063283] [DEBUG] [VALIDATOR ] ARE: All expected trading days are present. [2025-10-15T17:18:56.063387] [DEBUG] [VALIDATOR ] ARE: Primary data validation passed. [2025-10-15T17:18:56.064150] [INFO ] [MAIN ] ARE: Fetched primary data is valid. [2025-10-15T17:18:56.064213] [DEBUG] [LOCAL ] ARE: Saving primary data. [2025-10-15T17:18:56.065717] [DEBUG] [LOCAL ] ARE: Trimmed 72990 records to 50973 (keeping 200 days of data) [2025-10-15T17:18:56.120693] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-01. [2025-10-15T17:18:56.227572] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-15T17:18:56.431114] [DEBUG] [LOCAL ] ARE: Primary data saved (50973 records). [2025-10-15T17:18:56.431353] [INFO ] [MAIN ] ARE: Full history saved. [2025-10-15T17:18:56.431903] [INFO ] [MAIN ] Update Progress: 144/2369 symbols completed. ARE took 48.2s. Estimated remaining: 4h 51m 30s. Rate: 7.6 symbols/min [2025-10-15T17:18:56.616203] [INFO ] [MAIN ] AROC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:18:56.652566] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-15T17:18:56.696104] [DEBUG] [LOCAL ] AROC: Loaded 49037 existing records from primary storage. [2025-10-15T17:18:56.696488] [INFO ] [MAIN ] AROC: Loaded 49037 existing records. [2025-10-15T17:18:56.871940] [WARN ] [MAIN ] AROC: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:18:56.872158] [INFO ] [MAIN ] AROC: Wiping existing primary data before full refresh. [2025-10-15T17:18:56.872206] [INFO ] [LOCAL ] AROC: Starting deletion of primary data. [2025-10-15T17:18:56.872588] [DEBUG] [LOCAL ] AROC: Deleted primary data file. [2025-10-15T17:18:56.872626] [INFO ] [MAIN ] AROC: Starting full primary refresh. [2025-10-15T17:18:56.925215] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-09. [2025-10-15T17:18:57.224388] [INFO ] [REMOTE ] AROC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:18:57.714043] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-09. [2025-10-15T17:18:57.808733] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-15T17:18:58.467889] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-15T17:18:58.514051] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-02. [2025-10-15T17:18:58.995785] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-15T17:18:59.314031] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-10. [2025-10-15T17:19:00.056860] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-15T17:19:00.113966] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-03. [2025-10-15T17:19:00.869729] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-15T17:19:00.874986] [INFO ] [REMOTE ] ARLO: Full fetch complete (63192 records). [2025-10-15T17:19:00.875080] [DEBUG] [VALIDATOR ] ARLO: Validating primary data. [2025-10-15T17:19:00.919153] [INFO ] [REMOTE ] AROC: Fetching primary data for 2024-12. [2025-10-15T17:19:01.294048] [DEBUG] [VALIDATOR ] ARLO: All expected trading days are present. [2025-10-15T17:19:01.294141] [DEBUG] [VALIDATOR ] ARLO: Primary data validation passed. [2025-10-15T17:19:01.294839] [INFO ] [MAIN ] ARLO: Fetched primary data is valid. [2025-10-15T17:19:01.294907] [DEBUG] [LOCAL ] ARLO: Saving primary data. [2025-10-15T17:19:01.296286] [DEBUG] [LOCAL ] ARLO: Trimmed 63192 records to 43803 (keeping 200 days of data) [2025-10-15T17:19:01.549579] [DEBUG] [LOCAL ] ARLO: Primary data saved (43803 records). [2025-10-15T17:19:01.549755] [INFO ] [MAIN ] ARLO: Full history saved. [2025-10-15T17:19:01.549843] [INFO ] [MAIN ] Update Progress: 145/2369 symbols completed. ARLO took 28.3s. Estimated remaining: 4h 50m 40s. Rate: 7.7 symbols/min [2025-10-15T17:19:01.723268] [INFO ] [MAIN ] ARR: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:19:01.719704] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-10. [2025-10-15T17:19:01.783697] [DEBUG] [LOCAL ] ARR: Loaded 52116 existing records from primary storage. [2025-10-15T17:19:01.784175] [INFO ] [MAIN ] ARR: Loaded 52116 existing records. [2025-10-15T17:19:01.999091] [WARN ] [MAIN ] ARR: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:19:01.999374] [INFO ] [MAIN ] ARR: Wiping existing primary data before full refresh. [2025-10-15T17:19:01.999979] [INFO ] [LOCAL ] ARR: Starting deletion of primary data. [2025-10-15T17:19:02.001319] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-15T17:19:02.011220] [DEBUG] [LOCAL ] ARR: Deleted primary data file. [2025-10-15T17:19:02.011410] [INFO ] [MAIN ] ARR: Starting full primary refresh. [2025-10-15T17:19:02.382258] [INFO ] [REMOTE ] ARR: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:19:02.514000] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-04. [2025-10-15T17:19:02.704093] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-15T17:19:03.259061] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-15T17:19:03.264450] [INFO ] [REMOTE ] ARI: Full fetch complete (62583 records). [2025-10-15T17:19:03.264602] [DEBUG] [VALIDATOR ] ARI: Validating primary data. [2025-10-15T17:19:03.320606] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-01. [2025-10-15T17:19:03.681726] [DEBUG] [VALIDATOR ] ARI: All expected trading days are present. [2025-10-15T17:19:03.681915] [DEBUG] [VALIDATOR ] ARI: Primary data validation passed. [2025-10-15T17:19:03.682748] [INFO ] [MAIN ] ARI: Fetched primary data is valid. [2025-10-15T17:19:03.682829] [DEBUG] [LOCAL ] ARI: Saving primary data. [2025-10-15T17:19:03.685000] [DEBUG] [LOCAL ] ARI: Trimmed 62583 records to 43733 (keeping 200 days of data) [2025-10-15T17:19:03.975625] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-15T17:19:03.990758] [DEBUG] [LOCAL ] ARI: Primary data saved (43733 records). [2025-10-15T17:19:03.991225] [INFO ] [MAIN ] ARI: Full history saved. [2025-10-15T17:19:03.991321] [INFO ] [MAIN ] Update Progress: 146/2369 symbols completed. ARI took 40.0s. Estimated remaining: 4h 49m 10s. Rate: 7.7 symbols/min [2025-10-15T17:19:04.126564] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-05. [2025-10-15T17:19:04.159071] [INFO ] [MAIN ] ARW: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:19:04.190289] [DEBUG] [LOCAL ] ARW: Loaded 33043 existing records from primary storage. [2025-10-15T17:19:04.190565] [INFO ] [MAIN ] ARW: Loaded 33043 existing records. [2025-10-15T17:19:04.365987] [WARN ] [MAIN ] ARW: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:19:04.366193] [INFO ] [MAIN ] ARW: Wiping existing primary data before full refresh. [2025-10-15T17:19:04.366241] [INFO ] [LOCAL ] ARW: Starting deletion of primary data. [2025-10-15T17:19:04.366920] [DEBUG] [LOCAL ] ARW: Deleted primary data file. [2025-10-15T17:19:04.366980] [INFO ] [MAIN ] ARW: Starting full primary refresh. [2025-10-15T17:19:04.720583] [INFO ] [REMOTE ] ARW: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:19:04.914007] [INFO ] [REMOTE ] ARR: Fetching primary data for 2024-12. [2025-10-15T17:19:04.965333] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-15T17:19:05.714002] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-02. [2025-10-15T17:19:06.513984] [INFO ] [REMOTE ] ARW: Fetching primary data for 2024-12. [2025-10-15T17:19:06.643070] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-15T17:19:07.065082] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-05 (2.94 seconds). [2025-10-15T17:19:07.253853] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-15T17:19:07.313961] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-03. [2025-10-15T17:19:07.948206] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-15T17:19:08.114000] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-01. [2025-10-15T17:19:08.914044] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-01. [2025-10-15T17:19:09.013461] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-15T17:19:09.714019] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-04. [2025-10-15T17:19:09.962128] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-15T17:19:10.057856] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-15T17:19:10.514012] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-02. [2025-10-15T17:19:11.314039] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-06. [2025-10-15T17:19:11.403133] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-15T17:19:12.114057] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-02. [2025-10-15T17:19:12.328017] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-15T17:19:12.913993] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-03. [2025-10-15T17:19:13.269701] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-15T17:19:13.656488] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-06 (2.34 seconds). [2025-10-15T17:19:13.713991] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-07. [2025-10-15T17:19:14.514029] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-03. [2025-10-15T17:19:14.729371] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-15T17:19:15.314004] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-05. [2025-10-15T17:19:15.997703] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-15T17:19:16.113982] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-04. [2025-10-15T17:19:16.914058] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-04. [2025-10-15T17:19:18.113208] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-15T17:19:18.124378] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-05. [2025-10-15T17:19:18.491986] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-15T17:19:18.513958] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-05. [2025-10-15T17:19:19.997557] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-15T17:19:20.005567] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-06. [2025-10-15T17:19:20.592263] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-07 (6.88 seconds). [2025-10-15T17:19:20.602910] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-08. [2025-10-15T17:19:22.241053] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-15T17:19:22.251676] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-09. [2025-10-15T17:19:22.550697] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-05 (4.43 seconds). [2025-10-15T17:19:22.561470] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-06. [2025-10-15T17:19:23.924308] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-05 (8.61 seconds). [2025-10-15T17:19:23.934305] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-06. [2025-10-15T17:19:24.324386] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-15T17:19:24.335587] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-07. [2025-10-15T17:19:25.199914] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-09 (2.95 seconds). [2025-10-15T17:19:25.210953] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-10. [2025-10-15T17:19:25.299886] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-06 (5.29 seconds). [2025-10-15T17:19:25.306601] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-07. [2025-10-15T17:19:25.521426] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-15T17:19:25.713997] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-07. [2025-10-15T17:19:26.361265] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-10-15T17:19:26.513973] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-08. [2025-10-15T17:19:26.805239] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-15T17:19:26.811174] [INFO ] [REMOTE ] ARMK: Full fetch complete (72533 records). [2025-10-15T17:19:26.811299] [DEBUG] [VALIDATOR ] ARMK: Validating primary data. [2025-10-15T17:19:26.812212] [FATAL] [VALIDATOR ] ARMK: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T17:19:26.812321] [FATAL] [MAIN ] ARMK: Fetched primary data is invalid. Refusing to save it. [2025-10-15T17:19:26.812368] [WARN ] [MAIN ] ARMK: Deleting existing primary and derivative data due to validation failure. [2025-10-15T17:19:26.812422] [INFO ] [LOCAL ] ARMK: Starting deletion of primary data. [2025-10-15T17:19:26.812502] [DEBUG] [LOCAL ] ARMK: No primary data file found to delete. [2025-10-15T17:19:26.812539] [INFO ] [LOCAL ] ARMK: Starting deletion of derivative data. [2025-10-15T17:19:26.812705] [DEBUG] [LOCAL ] ARMK: Deleted derivative data file. [2025-10-15T17:19:26.813638] [INFO ] [MAIN ] Update Progress: 147/2369 symbols completed. ARMK took 35.4s. Estimated remaining: 4h 52m 49s. Rate: 7.6 symbols/min [2025-10-15T17:19:27.005270] [INFO ] [MAIN ] ARX: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:19:27.002022] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-15T17:19:27.005518] [DEBUG] [LOCAL ] ARX: No existing data file found in primary storage. [2025-10-15T17:19:27.011606] [WARN ] [MAIN ] ARX: No existing data found, performing full refresh instead. [2025-10-15T17:19:27.012127] [INFO ] [MAIN ] ARX: Wiping existing primary data before full refresh. [2025-10-15T17:19:27.012289] [INFO ] [LOCAL ] ARX: Starting deletion of primary data. [2025-10-15T17:19:27.012357] [DEBUG] [LOCAL ] ARX: No primary data file found to delete. [2025-10-15T17:19:27.012396] [INFO ] [MAIN ] ARX: Starting full primary refresh. [2025-10-15T17:19:27.319096] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-08. [2025-10-15T17:19:27.378574] [INFO ] [REMOTE ] ARX: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:19:28.113977] [INFO ] [REMOTE ] ARX: Fetching primary data for 2024-12. [2025-10-15T17:19:28.315553] [DEBUG] [REMOTE ] ARX: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-15T17:19:28.315893] [WARN ] [REMOTE ] ARX: No data returned for month 2024-12 [2025-10-15T17:19:28.315991] [FATAL] [REMOTE ] ARX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-15T17:19:28.316058] [FATAL] [MAIN ] ARX: Failed to fetch primary data. [2025-10-15T17:19:28.316123] [WARN ] [MAIN ] ARX: Deleting existing primary and derivative data due to fetch failure. [2025-10-15T17:19:28.316195] [INFO ] [LOCAL ] ARX: Starting deletion of primary data. [2025-10-15T17:19:28.316295] [DEBUG] [LOCAL ] ARX: No primary data file found to delete. [2025-10-15T17:19:28.316339] [INFO ] [LOCAL ] ARX: Starting deletion of derivative data. [2025-10-15T17:19:28.316380] [DEBUG] [LOCAL ] ARX: No derivative data file found to delete. [2025-10-15T17:19:28.316425] [INFO ] [MAIN ] Update Progress: 148/2369 symbols completed. ARX took 1.5s. Estimated remaining: 4h 51m 5s. Rate: 7.6 symbols/min [2025-10-15T17:19:28.485744] [INFO ] [MAIN ] AS: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:19:28.539733] [DEBUG] [LOCAL ] AS: Loaded 53174 existing records from primary storage. [2025-10-15T17:19:28.540183] [INFO ] [MAIN ] AS: Loaded 53174 existing records. [2025-10-15T17:19:28.661210] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-08 (2.15 seconds). [2025-10-15T17:19:28.768384] [WARN ] [MAIN ] AS: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:19:28.768825] [INFO ] [MAIN ] AS: Wiping existing primary data before full refresh. [2025-10-15T17:19:28.768957] [INFO ] [LOCAL ] AS: Starting deletion of primary data. [2025-10-15T17:19:28.775381] [DEBUG] [LOCAL ] AS: Deleted primary data file. [2025-10-15T17:19:28.786153] [INFO ] [MAIN ] AS: Starting full primary refresh. [2025-10-15T17:19:28.819684] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-15T17:19:28.919084] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-09. [2025-10-15T17:19:29.159096] [INFO ] [REMOTE ] AS: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:19:29.728222] [INFO ] [REMOTE ] AS: Fetching primary data for 2024-12. [2025-10-15T17:19:29.730869] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-07 (4.02 seconds). [2025-10-15T17:19:30.513963] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-09. [2025-10-15T17:19:30.674523] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-15T17:19:31.313998] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-10. [2025-10-15T17:19:32.065028] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2024-12 (2.34 seconds). [2025-10-15T17:19:32.113958] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-01. [2025-10-15T17:19:32.545239] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-10-15T17:19:32.763162] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-15T17:19:32.767906] [INFO ] [REMOTE ] ARW: Full fetch complete (48373 records). [2025-10-15T17:19:32.768028] [DEBUG] [VALIDATOR ] ARW: Validating primary data. [2025-10-15T17:19:32.921874] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-10. [2025-10-15T17:19:33.161689] [DEBUG] [VALIDATOR ] ARW: All expected trading days are present. [2025-10-15T17:19:33.161796] [DEBUG] [VALIDATOR ] ARW: Primary data validation passed. [2025-10-15T17:19:33.162443] [INFO ] [MAIN ] ARW: Fetched primary data is valid. [2025-10-15T17:19:33.162485] [DEBUG] [LOCAL ] ARW: Saving primary data. [2025-10-15T17:19:33.163702] [DEBUG] [LOCAL ] ARW: Trimmed 48373 records to 33090 (keeping 200 days of data) [2025-10-15T17:19:33.374499] [DEBUG] [LOCAL ] ARW: Primary data saved (33090 records). [2025-10-15T17:19:33.374705] [INFO ] [MAIN ] ARW: Full history saved. [2025-10-15T17:19:33.374818] [INFO ] [MAIN ] Update Progress: 149/2369 symbols completed. ARW took 29.4s. Estimated remaining: 4h 50m 15s. Rate: 7.6 symbols/min [2025-10-15T17:19:33.556999] [INFO ] [MAIN ] ASA: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:19:33.576912] [DEBUG] [LOCAL ] ASA: Loaded 15119 existing records from primary storage. [2025-10-15T17:19:33.577237] [INFO ] [MAIN ] ASA: Loaded 15119 existing records. [2025-10-15T17:19:33.722950] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-08. [2025-10-15T17:19:33.770500] [WARN ] [MAIN ] ASA: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:19:33.771245] [INFO ] [MAIN ] ASA: Wiping existing primary data before full refresh. [2025-10-15T17:19:33.771435] [INFO ] [LOCAL ] ASA: Starting deletion of primary data. [2025-10-15T17:19:33.771919] [DEBUG] [LOCAL ] ASA: Deleted primary data file. [2025-10-15T17:19:33.772055] [INFO ] [MAIN ] ASA: Starting full primary refresh. [2025-10-15T17:19:33.911355] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-15T17:19:34.191914] [INFO ] [REMOTE ] ASA: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:19:34.514037] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-02. [2025-10-15T17:19:35.041285] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-10 (2.12 seconds). [2025-10-15T17:19:35.049050] [INFO ] [REMOTE ] ARR: Full fetch complete (75452 records). [2025-10-15T17:19:35.049242] [DEBUG] [VALIDATOR ] ARR: Validating primary data. [2025-10-15T17:19:35.326697] [INFO ] [REMOTE ] ASA: Fetching primary data for 2024-12. [2025-10-15T17:19:35.369038] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-15T17:19:35.518877] [DEBUG] [VALIDATOR ] ARR: All expected trading days are present. [2025-10-15T17:19:35.518981] [DEBUG] [VALIDATOR ] ARR: Primary data validation passed. [2025-10-15T17:19:35.519913] [INFO ] [MAIN ] ARR: Fetched primary data is valid. [2025-10-15T17:19:35.519995] [DEBUG] [LOCAL ] ARR: Saving primary data. [2025-10-15T17:19:35.522006] [DEBUG] [LOCAL ] ARR: Trimmed 75452 records to 52115 (keeping 200 days of data) [2025-10-15T17:19:35.869186] [DEBUG] [LOCAL ] ARR: Primary data saved (52115 records). [2025-10-15T17:19:35.869596] [INFO ] [MAIN ] ARR: Full history saved. [2025-10-15T17:19:35.869770] [INFO ] [MAIN ] Update Progress: 150/2369 symbols completed. ARR took 34.3s. Estimated remaining: 4h 48m 48s. Rate: 7.7 symbols/min [2025-10-15T17:19:36.057297] [INFO ] [MAIN ] ASAN: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:19:36.057558] [DEBUG] [LOCAL ] ASAN: No existing data file found in primary storage. [2025-10-15T17:19:36.057613] [WARN ] [MAIN ] ASAN: No existing data found, performing full refresh instead. [2025-10-15T17:19:36.057758] [INFO ] [MAIN ] ASAN: Wiping existing primary data before full refresh. [2025-10-15T17:19:36.057824] [INFO ] [LOCAL ] ASAN: Starting deletion of primary data. [2025-10-15T17:19:36.057868] [DEBUG] [LOCAL ] ASAN: No primary data file found to delete. [2025-10-15T17:19:36.057904] [INFO ] [MAIN ] ASAN: Starting full primary refresh. [2025-10-15T17:19:36.120768] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-09. [2025-10-15T17:19:36.207890] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-15T17:19:36.306111] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-10-15T17:19:36.503518] [INFO ] [REMOTE ] ASAN: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:19:36.914002] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-03. [2025-10-15T17:19:37.714055] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-01. [2025-10-15T17:19:37.954637] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-15T17:19:38.514081] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2024-12. [2025-10-15T17:19:39.314021] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-10. [2025-10-15T17:19:40.231587] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-03 (3.32 seconds). [2025-10-15T17:19:40.243274] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-04. [2025-10-15T17:19:40.710905] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2024-12 (2.20 seconds). [2025-10-15T17:19:40.759262] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-01 (3.05 seconds). [2025-10-15T17:19:40.914025] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-01. [2025-10-15T17:19:41.728364] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-02. [2025-10-15T17:19:41.734001] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-10 (2.42 seconds). [2025-10-15T17:19:41.741091] [INFO ] [REMOTE ] AROC: Full fetch complete (71189 records). [2025-10-15T17:19:41.741279] [DEBUG] [VALIDATOR ] AROC: Validating primary data. [2025-10-15T17:19:42.223638] [DEBUG] [VALIDATOR ] AROC: All expected trading days are present. [2025-10-15T17:19:42.223903] [DEBUG] [VALIDATOR ] AROC: Primary data validation passed. [2025-10-15T17:19:42.224870] [INFO ] [MAIN ] AROC: Fetched primary data is valid. [2025-10-15T17:19:42.224938] [DEBUG] [LOCAL ] AROC: Saving primary data. [2025-10-15T17:19:42.226820] [DEBUG] [LOCAL ] AROC: Trimmed 71189 records to 49062 (keeping 200 days of data) [2025-10-15T17:19:42.547029] [DEBUG] [LOCAL ] AROC: Primary data saved (49062 records). [2025-10-15T17:19:42.547249] [INFO ] [MAIN ] AROC: Full history saved. [2025-10-15T17:19:42.547385] [INFO ] [MAIN ] Update Progress: 151/2369 symbols completed. AROC took 46.1s. Estimated remaining: 4h 48m 24s. Rate: 7.7 symbols/min [2025-10-15T17:19:42.761769] [INFO ] [MAIN ] ASB: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:19:42.790094] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-15T17:19:42.810006] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-03. [2025-10-15T17:19:42.812760] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-10-15T17:19:42.871911] [DEBUG] [LOCAL ] ASB: Loaded 49600 existing records from primary storage. [2025-10-15T17:19:42.872347] [INFO ] [MAIN ] ASB: Loaded 49600 existing records. [2025-10-15T17:19:43.020806] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-04 (2.78 seconds). [2025-10-15T17:19:43.116158] [WARN ] [MAIN ] ASB: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:19:43.116927] [INFO ] [MAIN ] ASB: Wiping existing primary data before full refresh. [2025-10-15T17:19:43.117009] [INFO ] [LOCAL ] ASB: Starting deletion of primary data. [2025-10-15T17:19:43.117423] [DEBUG] [LOCAL ] ASB: Deleted primary data file. [2025-10-15T17:19:43.117502] [INFO ] [MAIN ] ASB: Starting full primary refresh. [2025-10-15T17:19:43.319230] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-05. [2025-10-15T17:19:43.491686] [INFO ] [REMOTE ] ASB: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:19:43.686411] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-15T17:19:44.114020] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-04. [2025-10-15T17:19:44.914009] [INFO ] [REMOTE ] ASB: Fetching primary data for 2024-12. [2025-10-15T17:19:45.142336] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-15T17:19:45.185285] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-15T17:19:45.714058] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-05. [2025-10-15T17:19:46.513971] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-06. [2025-10-15T17:19:46.645253] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-15T17:19:46.688994] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-15T17:19:47.313996] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-01. [2025-10-15T17:19:48.113970] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-06. [2025-10-15T17:19:48.167583] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-15T17:19:48.797230] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-15T17:19:48.838455] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-15T17:19:48.913990] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-07. [2025-10-15T17:19:49.714013] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-02. [2025-10-15T17:19:50.514095] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-02. [2025-10-15T17:19:50.712808] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-15T17:19:51.036410] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-15T17:19:51.314081] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-07. [2025-10-15T17:19:51.776116] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-15T17:19:51.847032] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-10-15T17:19:52.114094] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-03. [2025-10-15T17:19:52.914043] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-08. [2025-10-15T17:19:53.682038] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-15T17:19:53.713971] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-04. [2025-10-15T17:19:54.514063] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-03. [2025-10-15T17:19:55.080821] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-08 (2.17 seconds). [2025-10-15T17:19:55.314091] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-09. [2025-10-15T17:19:55.415809] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-15T17:19:56.099008] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-15T17:19:56.113958] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-04. [2025-10-15T17:19:56.602614] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-15T17:19:56.914006] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-08. [2025-10-15T17:19:57.713981] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-10. [2025-10-15T17:19:57.907955] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-15T17:19:58.169047] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-10-15T17:19:58.514011] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-05. [2025-10-15T17:19:59.281839] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-15T17:19:59.288535] [INFO ] [REMOTE ] AS: Full fetch complete (76862 records). [2025-10-15T17:19:59.288718] [DEBUG] [VALIDATOR ] AS: Validating primary data. [2025-10-15T17:19:59.322116] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-09. [2025-10-15T17:19:59.679370] [DEBUG] [VALIDATOR ] AS: All expected trading days are present. [2025-10-15T17:19:59.679450] [DEBUG] [VALIDATOR ] AS: Primary data validation passed. [2025-10-15T17:19:59.680229] [INFO ] [MAIN ] AS: Fetched primary data is valid. [2025-10-15T17:19:59.680292] [DEBUG] [LOCAL ] AS: Saving primary data. [2025-10-15T17:19:59.681691] [DEBUG] [LOCAL ] AS: Trimmed 76862 records to 53174 (keeping 200 days of data) [2025-10-15T17:19:59.986322] [DEBUG] [LOCAL ] AS: Primary data saved (53174 records). [2025-10-15T17:19:59.986467] [INFO ] [MAIN ] AS: Full history saved. [2025-10-15T17:19:59.987548] [INFO ] [MAIN ] Update Progress: 152/2369 symbols completed. AS took 31.7s. Estimated remaining: 4h 50m 36s. Rate: 7.6 symbols/min [2025-10-15T17:20:00.127205] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-05. [2025-10-15T17:20:00.158857] [INFO ] [MAIN ] ASBA: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:20:00.164780] [DEBUG] [LOCAL ] ASBA: Loaded 3448 existing records from primary storage. [2025-10-15T17:20:00.164976] [INFO ] [MAIN ] ASBA: Loaded 3448 existing records. [2025-10-15T17:20:00.347793] [WARN ] [MAIN ] ASBA: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:20:00.348831] [INFO ] [MAIN ] ASBA: Wiping existing primary data before full refresh. [2025-10-15T17:20:00.348969] [INFO ] [LOCAL ] ASBA: Starting deletion of primary data. [2025-10-15T17:20:00.349634] [DEBUG] [LOCAL ] ASBA: Deleted primary data file. [2025-10-15T17:20:00.360901] [INFO ] [MAIN ] ASBA: Starting full primary refresh. [2025-10-15T17:20:00.482585] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-15T17:20:00.631603] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-15T17:20:00.780399] [INFO ] [REMOTE ] ASBA: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:20:00.913978] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2024-12. [2025-10-15T17:20:01.714067] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-10. [2025-10-15T17:20:01.770057] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-10-15T17:20:01.875133] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-15T17:20:02.513991] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-01. [2025-10-15T17:20:02.776926] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-15T17:20:02.780998] [INFO ] [REMOTE ] ASA: Full fetch complete (20115 records). [2025-10-15T17:20:02.781196] [DEBUG] [VALIDATOR ] ASA: Validating primary data. [2025-10-15T17:20:03.217500] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-15T17:20:03.219718] [DEBUG] [VALIDATOR ] ASA: All expected trading days are present. [2025-10-15T17:20:03.219840] [DEBUG] [VALIDATOR ] ASA: Primary data validation passed. [2025-10-15T17:20:03.220315] [INFO ] [MAIN ] ASA: Fetched primary data is valid. [2025-10-15T17:20:03.220367] [DEBUG] [LOCAL ] ASA: Saving primary data. [2025-10-15T17:20:03.221567] [DEBUG] [LOCAL ] ASA: Trimmed 20115 records to 15215 (keeping 200 days of data) [2025-10-15T17:20:03.320923] [DEBUG] [LOCAL ] ASA: Primary data saved (15215 records). [2025-10-15T17:20:03.321128] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-02. [2025-10-15T17:20:03.321484] [INFO ] [MAIN ] ASA: Full history saved. [2025-10-15T17:20:03.322751] [INFO ] [MAIN ] Update Progress: 153/2369 symbols completed. ASA took 29.9s. Estimated remaining: 4h 49m 23s. Rate: 7.7 symbols/min [2025-10-15T17:20:03.514966] [INFO ] [MAIN ] ASC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:20:03.554729] [DEBUG] [LOCAL ] ASC: Loaded 37331 existing records from primary storage. [2025-10-15T17:20:03.555087] [INFO ] [MAIN ] ASC: Loaded 37331 existing records. [2025-10-15T17:20:03.736048] [WARN ] [MAIN ] ASC: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:20:03.736270] [INFO ] [MAIN ] ASC: Wiping existing primary data before full refresh. [2025-10-15T17:20:03.736319] [INFO ] [LOCAL ] ASC: Starting deletion of primary data. [2025-10-15T17:20:03.736761] [DEBUG] [LOCAL ] ASC: Deleted primary data file. [2025-10-15T17:20:03.736819] [INFO ] [MAIN ] ASC: Starting full primary refresh. [2025-10-15T17:20:03.840602] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-10-15T17:20:04.093459] [INFO ] [REMOTE ] ASC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:20:04.113988] [INFO ] [REMOTE ] ASC: Fetching primary data for 2024-12. [2025-10-15T17:20:04.913999] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-03. [2025-10-15T17:20:05.567743] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-15T17:20:05.714007] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-04. [2025-10-15T17:20:06.042459] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-10-15T17:20:06.131446] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-10-15T17:20:06.514027] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-01. [2025-10-15T17:20:07.313979] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-06. [2025-10-15T17:20:08.074341] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-15T17:20:08.113985] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-06. [2025-10-15T17:20:08.913975] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-02. [2025-10-15T17:20:08.986610] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-15T17:20:09.714022] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-07. [2025-10-15T17:20:10.123418] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-10-15T17:20:10.513988] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-07. [2025-10-15T17:20:11.286902] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-02 (2.37 seconds). [2025-10-15T17:20:11.313952] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-03. [2025-10-15T17:20:11.731294] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-15T17:20:12.114000] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-05. [2025-10-15T17:20:12.328142] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-15T17:20:12.608383] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-15T17:20:12.646564] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-15T17:20:12.913987] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-06. [2025-10-15T17:20:13.282474] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-06 (0.37 seconds). [2025-10-15T17:20:13.714056] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-08. [2025-10-15T17:20:14.513999] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-04. [2025-10-15T17:20:15.313974] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-07. [2025-10-15T17:20:15.399189] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-15T17:20:16.009453] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-15T17:20:16.033069] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-15T17:20:16.113990] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-05. [2025-10-15T17:20:16.914044] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-08. [2025-10-15T17:20:17.281341] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-08 (0.37 seconds). [2025-10-15T17:20:17.297590] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-15T17:20:17.714006] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-08. [2025-10-15T17:20:18.514007] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-09. [2025-10-15T17:20:19.313984] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-06. [2025-10-15T17:20:19.471689] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-15T17:20:20.114003] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-09. [2025-10-15T17:20:20.227201] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-15T17:20:20.693985] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-15T17:20:20.914002] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-09. [2025-10-15T17:20:21.480939] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-15T17:20:21.713969] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-07. [2025-10-15T17:20:22.092376] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-15T17:20:22.513990] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-10. [2025-10-15T17:20:23.090394] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-15T17:20:23.091832] [INFO ] [REMOTE ] ASBA: Full fetch complete (5224 records). [2025-10-15T17:20:23.091918] [DEBUG] [VALIDATOR ] ASBA: Validating primary data. [2025-10-15T17:20:23.317665] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-10. [2025-10-15T17:20:23.311278] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-15T17:20:23.532182] [DEBUG] [VALIDATOR ] ASBA: All expected trading days are present. [2025-10-15T17:20:23.532260] [DEBUG] [VALIDATOR ] ASBA: Primary data validation passed. [2025-10-15T17:20:23.532411] [INFO ] [MAIN ] ASBA: Fetched primary data is valid. [2025-10-15T17:20:23.532451] [DEBUG] [LOCAL ] ASBA: Saving primary data. [2025-10-15T17:20:23.532835] [DEBUG] [LOCAL ] ASBA: Trimmed 5224 records to 3459 (keeping 200 days of data) [2025-10-15T17:20:23.554044] [DEBUG] [LOCAL ] ASBA: Primary data saved (3459 records). [2025-10-15T17:20:23.554113] [INFO ] [MAIN ] ASBA: Full history saved. [2025-10-15T17:20:23.554183] [INFO ] [MAIN ] Update Progress: 154/2369 symbols completed. ASBA took 23.6s. Estimated remaining: 4h 52m 13s. Rate: 7.6 symbols/min [2025-10-15T17:20:23.718748] [INFO ] [MAIN ] ASG: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:20:23.739298] [DEBUG] [LOCAL ] ASG: Loaded 19552 existing records from primary storage. [2025-10-15T17:20:23.739538] [INFO ] [MAIN ] ASG: Loaded 19552 existing records. [2025-10-15T17:20:23.913731] [WARN ] [MAIN ] ASG: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:20:23.913927] [INFO ] [MAIN ] ASG: Wiping existing primary data before full refresh. [2025-10-15T17:20:23.913977] [INFO ] [LOCAL ] ASG: Starting deletion of primary data. [2025-10-15T17:20:23.914175] [DEBUG] [LOCAL ] ASG: Deleted primary data file. [2025-10-15T17:20:23.914213] [INFO ] [MAIN ] ASG: Starting full primary refresh. [2025-10-15T17:20:24.119146] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-10. [2025-10-15T17:20:24.264182] [INFO ] [REMOTE ] ASG: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:20:24.886712] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-15T17:20:24.893108] [INFO ] [REMOTE ] ASB: Full fetch complete (72061 records). [2025-10-15T17:20:24.893258] [DEBUG] [VALIDATOR ] ASB: Validating primary data. [2025-10-15T17:20:24.924846] [INFO ] [REMOTE ] ASG: Fetching primary data for 2024-12. [2025-10-15T17:20:25.308218] [DEBUG] [VALIDATOR ] ASB: All expected trading days are present. [2025-10-15T17:20:25.308304] [DEBUG] [VALIDATOR ] ASB: Primary data validation passed. [2025-10-15T17:20:25.309177] [INFO ] [MAIN ] ASB: Fetched primary data is valid. [2025-10-15T17:20:25.309242] [DEBUG] [LOCAL ] ASB: Saving primary data. [2025-10-15T17:20:25.310808] [DEBUG] [LOCAL ] ASB: Trimmed 72061 records to 49632 (keeping 200 days of data) [2025-10-15T17:20:25.617805] [DEBUG] [LOCAL ] ASB: Primary data saved (49632 records). [2025-10-15T17:20:25.617963] [INFO ] [MAIN ] ASB: Full history saved. [2025-10-15T17:20:25.618052] [INFO ] [MAIN ] Update Progress: 155/2369 symbols completed. ASB took 43.1s. Estimated remaining: 4h 50m 42s. Rate: 7.6 symbols/min [2025-10-15T17:20:25.722834] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-08. [2025-10-15T17:20:25.799882] [INFO ] [MAIN ] ASGI: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:20:25.821914] [DEBUG] [LOCAL ] ASGI: Loaded 22862 existing records from primary storage. [2025-10-15T17:20:25.822183] [INFO ] [MAIN ] ASGI: Loaded 22862 existing records. [2025-10-15T17:20:25.994104] [WARN ] [MAIN ] ASGI: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:20:25.994325] [INFO ] [MAIN ] ASGI: Wiping existing primary data before full refresh. [2025-10-15T17:20:25.994372] [INFO ] [LOCAL ] ASGI: Starting deletion of primary data. [2025-10-15T17:20:25.994793] [DEBUG] [LOCAL ] ASGI: Deleted primary data file. [2025-10-15T17:20:25.994851] [INFO ] [MAIN ] ASGI: Starting full primary refresh. [2025-10-15T17:20:26.334121] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-15T17:20:26.398494] [INFO ] [REMOTE ] ASGI: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:20:26.513991] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-01. [2025-10-15T17:20:26.595621] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-10 (2.48 seconds). [2025-10-15T17:20:26.602067] [INFO ] [REMOTE ] ASAN: Full fetch complete (76647 records). [2025-10-15T17:20:26.602227] [DEBUG] [VALIDATOR ] ASAN: Validating primary data. [2025-10-15T17:20:26.987946] [DEBUG] [VALIDATOR ] ASAN: All expected trading days are present. [2025-10-15T17:20:26.988038] [DEBUG] [VALIDATOR ] ASAN: Primary data validation passed. [2025-10-15T17:20:26.988870] [INFO ] [MAIN ] ASAN: Fetched primary data is valid. [2025-10-15T17:20:26.988935] [DEBUG] [LOCAL ] ASAN: Saving primary data. [2025-10-15T17:20:26.990397] [DEBUG] [LOCAL ] ASAN: Trimmed 76647 records to 52733 (keeping 200 days of data) [2025-10-15T17:20:27.298968] [DEBUG] [LOCAL ] ASAN: Primary data saved (52733 records). [2025-10-15T17:20:27.299238] [INFO ] [MAIN ] ASAN: Full history saved. [2025-10-15T17:20:27.299386] [INFO ] [MAIN ] Update Progress: 156/2369 symbols completed. ASAN took 51.4s. Estimated remaining: 4h 49m 6s. Rate: 7.7 symbols/min [2025-10-15T17:20:27.320487] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2024-12. [2025-10-15T17:20:27.483010] [INFO ] [MAIN ] ASGN: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:20:27.505389] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-15T17:20:27.542184] [DEBUG] [LOCAL ] ASGN: Loaded 36558 existing records from primary storage. [2025-10-15T17:20:27.542477] [INFO ] [MAIN ] ASGN: Loaded 36558 existing records. [2025-10-15T17:20:27.720039] [WARN ] [MAIN ] ASGN: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:20:27.720380] [INFO ] [MAIN ] ASGN: Wiping existing primary data before full refresh. [2025-10-15T17:20:27.720463] [INFO ] [LOCAL ] ASGN: Starting deletion of primary data. [2025-10-15T17:20:27.721159] [DEBUG] [LOCAL ] ASGN: Deleted primary data file. [2025-10-15T17:20:27.721257] [INFO ] [MAIN ] ASGN: Starting full primary refresh. [2025-10-15T17:20:27.921861] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-15T17:20:28.102197] [INFO ] [REMOTE ] ASGN: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:20:28.113945] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2024-12. [2025-10-15T17:20:28.707150] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-15T17:20:28.913993] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-02. [2025-10-15T17:20:29.580398] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-15T17:20:29.714000] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-01. [2025-10-15T17:20:29.972062] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-15T17:20:30.514032] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-09. [2025-10-15T17:20:31.042784] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-15T17:20:31.314069] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-03. [2025-10-15T17:20:31.822541] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-15T17:20:32.114078] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-10. [2025-10-15T17:20:32.608178] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-15T17:20:32.914065] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-04. [2025-10-15T17:20:33.271337] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-15T17:20:33.275772] [INFO ] [REMOTE ] ASC: Full fetch complete (56216 records). [2025-10-15T17:20:33.275866] [DEBUG] [VALIDATOR ] ASC: Validating primary data. [2025-10-15T17:20:33.652456] [DEBUG] [VALIDATOR ] ASC: All expected trading days are present. [2025-10-15T17:20:33.652533] [DEBUG] [VALIDATOR ] ASC: Primary data validation passed. [2025-10-15T17:20:33.653388] [INFO ] [MAIN ] ASC: Fetched primary data is valid. [2025-10-15T17:20:33.653449] [DEBUG] [LOCAL ] ASC: Saving primary data. [2025-10-15T17:20:33.654516] [DEBUG] [LOCAL ] ASC: Trimmed 56216 records to 37348 (keeping 200 days of data) [2025-10-15T17:20:33.714497] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-02. [2025-10-15T17:20:33.874918] [DEBUG] [LOCAL ] ASC: Primary data saved (37348 records). [2025-10-15T17:20:33.875051] [INFO ] [MAIN ] ASC: Full history saved. [2025-10-15T17:20:33.875129] [INFO ] [MAIN ] Update Progress: 157/2369 symbols completed. ASC took 30.6s. Estimated remaining: 4h 48m 41s. Rate: 7.7 symbols/min [2025-10-15T17:20:33.888522] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-15T17:20:34.514035] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-01. [2025-10-15T17:20:35.198825] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-15T17:20:35.314045] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-03. [2025-10-15T17:20:35.734023] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-15T17:20:36.114040] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-05. [2025-10-15T17:20:36.420701] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-15T17:20:36.914000] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-04. [2025-10-15T17:20:37.095214] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-15T17:20:37.714008] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-06. [2025-10-15T17:20:38.388183] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-15T17:20:38.513991] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-02. [2025-10-15T17:20:38.595869] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-15T17:20:39.313980] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-05. [2025-10-15T17:20:39.572342] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-15T17:20:40.114010] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-07. [2025-10-15T17:20:40.718926] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-15T17:20:40.883436] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-15T17:20:40.913972] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-08. [2025-10-15T17:20:41.713977] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-03. [2025-10-15T17:20:41.822621] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-15T17:20:42.513974] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-09. [2025-10-15T17:20:42.543319] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-15T17:20:43.313980] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-04. [2025-10-15T17:20:43.488504] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-15T17:20:44.114057] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-10. [2025-10-15T17:20:44.359970] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-15T17:20:44.914066] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-05. [2025-10-15T17:20:45.105621] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-15T17:20:45.110572] [INFO ] [REMOTE ] ASG: Full fetch complete (30993 records). [2025-10-15T17:20:45.110875] [DEBUG] [VALIDATOR ] ASG: Validating primary data. [2025-10-15T17:20:45.516329] [DEBUG] [VALIDATOR ] ASG: All expected trading days are present. [2025-10-15T17:20:45.516712] [DEBUG] [VALIDATOR ] ASG: Primary data validation passed. [2025-10-15T17:20:45.517248] [INFO ] [MAIN ] ASG: Fetched primary data is valid. [2025-10-15T17:20:45.517295] [DEBUG] [LOCAL ] ASG: Saving primary data. [2025-10-15T17:20:45.518256] [DEBUG] [LOCAL ] ASG: Trimmed 30993 records to 19561 (keeping 200 days of data) [2025-10-15T17:20:45.630175] [DEBUG] [LOCAL ] ASG: Primary data saved (19561 records). [2025-10-15T17:20:45.630326] [INFO ] [MAIN ] ASG: Full history saved. [2025-10-15T17:20:45.630408] [INFO ] [MAIN ] Update Progress: 158/2369 symbols completed. ASG took 22.1s. Estimated remaining: 4h 49m 28s. Rate: 7.6 symbols/min [2025-10-15T17:20:45.713981] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-06. [2025-10-15T17:20:46.140676] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-15T17:20:46.514044] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-06. [2025-10-15T17:20:47.289937] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-15T17:20:47.314008] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-07. [2025-10-15T17:20:47.861268] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-15T17:20:48.113991] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-07. [2025-10-15T17:20:48.800295] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-15T17:20:48.913963] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-08. [2025-10-15T17:20:49.185770] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-15T17:20:49.713966] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-08. [2025-10-15T17:20:50.274572] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-15T17:20:50.513984] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-09. [2025-10-15T17:20:50.624118] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-15T17:20:51.314045] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-09. [2025-10-15T17:20:51.967192] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-15T17:20:52.113996] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-10. [2025-10-15T17:20:52.525462] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-15T17:20:52.914065] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-10. [2025-10-15T17:20:53.340690] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-15T17:20:53.345547] [INFO ] [REMOTE ] ASGN: Full fetch complete (53167 records). [2025-10-15T17:20:53.345631] [DEBUG] [VALIDATOR ] ASGN: Validating primary data. [2025-10-15T17:20:53.759274] [DEBUG] [VALIDATOR ] ASGN: All expected trading days are present. [2025-10-15T17:20:53.759425] [DEBUG] [VALIDATOR ] ASGN: Primary data validation passed. [2025-10-15T17:20:53.760234] [INFO ] [MAIN ] ASGN: Fetched primary data is valid. [2025-10-15T17:20:53.760315] [DEBUG] [LOCAL ] ASGN: Saving primary data. [2025-10-15T17:20:53.761670] [DEBUG] [LOCAL ] ASGN: Trimmed 53167 records to 36578 (keeping 200 days of data) [2025-10-15T17:20:53.988020] [DEBUG] [LOCAL ] ASGN: Primary data saved (36578 records). [2025-10-15T17:20:53.988174] [INFO ] [MAIN ] ASGN: Full history saved. [2025-10-15T17:20:53.988276] [INFO ] [MAIN ] Update Progress: 159/2369 symbols completed. ASGN took 26.7s. Estimated remaining: 4h 49m 27s. Rate: 7.6 symbols/min [2025-10-15T17:20:54.064389] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-15T17:20:54.067699] [INFO ] [REMOTE ] ASGI: Full fetch complete (33327 records). [2025-10-15T17:20:54.067799] [DEBUG] [VALIDATOR ] ASGI: Validating primary data. [2025-10-15T17:20:54.497232] [DEBUG] [VALIDATOR ] ASGI: All expected trading days are present. [2025-10-15T17:20:54.497335] [DEBUG] [VALIDATOR ] ASGI: Primary data validation passed. [2025-10-15T17:20:54.497928] [INFO ] [MAIN ] ASGI: Fetched primary data is valid. [2025-10-15T17:20:54.497993] [DEBUG] [LOCAL ] ASGI: Saving primary data. [2025-10-15T17:20:54.498908] [DEBUG] [LOCAL ] ASGI: Trimmed 33327 records to 22951 (keeping 200 days of data) [2025-10-15T17:20:54.644619] [DEBUG] [LOCAL ] ASGI: Primary data saved (22951 records). [2025-10-15T17:20:54.644803] [INFO ] [MAIN ] ASGI: Full history saved. [2025-10-15T17:20:54.644996] [INFO ] [MAIN ] Update Progress: 160/2369 symbols completed. ASGI took 29.0s. Estimated remaining: 4h 47m 39s. Rate: 7.7 symbols/min [2025-10-15T17:20:55.269231] [INFO ] [MAIN ] ASR: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:20:55.347160] [INFO ] [MAIN ] ASH: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:20:55.346403] [INFO ] [MAIN ] ASIX: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:20:55.352488] [DEBUG] [LOCAL ] ASIX: No existing data file found in primary storage. [2025-10-15T17:20:55.375404] [WARN ] [MAIN ] ASIX: No existing data found, performing full refresh instead. [2025-10-15T17:20:55.399355] [INFO ] [MAIN ] ASPN: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:20:55.399614] [INFO ] [MAIN ] ASIX: Wiping existing primary data before full refresh. [2025-10-15T17:20:55.400109] [INFO ] [LOCAL ] ASIX: Starting deletion of primary data. [2025-10-15T17:20:55.400263] [DEBUG] [LOCAL ] ASIX: No primary data file found to delete. [2025-10-15T17:20:55.400314] [INFO ] [MAIN ] ASIX: Starting full primary refresh. [2025-10-15T17:20:55.512835] [DEBUG] [LOCAL ] ASR: Loaded 9384 existing records from primary storage. [2025-10-15T17:20:55.518723] [INFO ] [MAIN ] ASR: Loaded 9384 existing records. [2025-10-15T17:20:55.807684] [DEBUG] [LOCAL ] ASH: Loaded 37552 existing records from primary storage. [2025-10-15T17:20:55.879933] [INFO ] [MAIN ] ASH: Loaded 37552 existing records. [2025-10-15T17:20:55.958089] [DEBUG] [LOCAL ] ASPN: Loaded 49874 existing records from primary storage. [2025-10-15T17:20:55.952535] [WARN ] [MAIN ] ASR: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:20:55.982253] [INFO ] [MAIN ] ASR: Wiping existing primary data before full refresh. [2025-10-15T17:20:56.008231] [INFO ] [MAIN ] ASPN: Loaded 49874 existing records. [2025-10-15T17:20:56.008411] [INFO ] [LOCAL ] ASR: Starting deletion of primary data. [2025-10-15T17:20:56.158265] [DEBUG] [LOCAL ] ASR: Deleted primary data file. [2025-10-15T17:20:56.121377] [INFO ] [REMOTE ] ASIX: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:20:56.158699] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2024-12. [2025-10-15T17:20:56.169937] [INFO ] [MAIN ] ASR: Starting full primary refresh. [2025-10-15T17:20:56.396156] [WARN ] [MAIN ] ASH: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:20:56.411324] [INFO ] [MAIN ] ASH: Wiping existing primary data before full refresh. [2025-10-15T17:20:56.422007] [INFO ] [LOCAL ] ASH: Starting deletion of primary data. [2025-10-15T17:20:56.489112] [DEBUG] [LOCAL ] ASH: Deleted primary data file. [2025-10-15T17:20:56.554372] [INFO ] [MAIN ] ASH: Starting full primary refresh. [2025-10-15T17:20:56.541342] [WARN ] [MAIN ] ASPN: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:20:56.658707] [INFO ] [MAIN ] ASPN: Wiping existing primary data before full refresh. [2025-10-15T17:20:56.730801] [INFO ] [LOCAL ] ASPN: Starting deletion of primary data. [2025-10-15T17:20:56.755896] [DEBUG] [LOCAL ] ASPN: Deleted primary data file. [2025-10-15T17:20:56.764730] [INFO ] [MAIN ] ASPN: Starting full primary refresh. [2025-10-15T17:20:57.117742] [INFO ] [REMOTE ] ASR: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:20:57.132143] [INFO ] [REMOTE ] ASR: Fetching primary data for 2024-12. [2025-10-15T17:20:57.467356] [INFO ] [REMOTE ] ASH: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:20:57.492236] [INFO ] [REMOTE ] ASH: Fetching primary data for 2024-12. [2025-10-15T17:20:57.510487] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-15T17:20:57.572213] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-01. [2025-10-15T17:20:57.577163] [INFO ] [REMOTE ] ASPN: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:20:57.577485] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2024-12. [2025-10-15T17:20:57.816342] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-10-15T17:20:57.818391] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-01. [2025-10-15T17:20:58.612127] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-15T17:20:58.616483] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-02. [2025-10-15T17:20:58.622371] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-15T17:20:58.991986] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-15T17:20:59.314005] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-02. [2025-10-15T17:20:59.478360] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-10-15T17:20:59.567448] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-15T17:21:00.044234] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-15T17:21:00.114014] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-03. [2025-10-15T17:21:00.913975] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-01. [2025-10-15T17:21:01.292049] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-15T17:21:01.713995] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-01. [2025-10-15T17:21:02.429422] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-15T17:21:02.514003] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-02. [2025-10-15T17:21:03.314064] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-03. [2025-10-15T17:21:03.345800] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-15T17:21:03.800498] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-10-15T17:21:03.823344] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-15T17:21:04.114000] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-03. [2025-10-15T17:21:04.914050] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-04. [2025-10-15T17:21:05.621127] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-15T17:21:05.714008] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-04. [2025-10-15T17:21:05.829234] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-15T17:21:06.481081] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-15T17:21:06.513997] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-05. [2025-10-15T17:21:07.246043] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-15T17:21:07.314023] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-06. [2025-10-15T17:21:08.113922] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-15T17:21:08.113998] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-05. [2025-10-15T17:21:08.914001] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-04. [2025-10-15T17:21:09.713969] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-02. [2025-10-15T17:21:09.760045] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-15T17:21:10.514005] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-07. [2025-10-15T17:21:11.314003] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-06. [2025-10-15T17:21:11.409377] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-04 (2.50 seconds). [2025-10-15T17:21:11.477238] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-15T17:21:12.113980] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-05. [2025-10-15T17:21:12.309565] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-15T17:21:12.638740] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-02 (2.92 seconds). [2025-10-15T17:21:12.914046] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-07. [2025-10-15T17:21:13.458198] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-15T17:21:13.713976] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-06. [2025-10-15T17:21:13.940918] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-15T17:21:14.514033] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-03. [2025-10-15T17:21:15.065451] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-15T17:21:15.314016] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-08. [2025-10-15T17:21:16.113959] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-07. [2025-10-15T17:21:16.211147] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-15T17:21:16.513338] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-15T17:21:16.914026] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-04. [2025-10-15T17:21:17.513431] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-15T17:21:17.714023] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-08. [2025-10-15T17:21:18.513964] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-08. [2025-10-15T17:21:18.746739] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-15T17:21:18.786691] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-15T17:21:19.159936] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-10-15T17:21:19.314001] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-05. [2025-10-15T17:21:20.113988] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-09. [2025-10-15T17:21:20.914191] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-09. [2025-10-15T17:21:21.169265] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-15T17:21:21.555883] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-15T17:21:21.713985] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-09. [2025-10-15T17:21:21.804325] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-15T17:21:22.293042] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-15T17:21:22.514075] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-06. [2025-10-15T17:21:23.314012] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-10. [2025-10-15T17:21:23.988788] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-15T17:21:24.114054] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-10. [2025-10-15T17:21:24.671244] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-15T17:21:24.678773] [INFO ] [REMOTE ] ASH: Full fetch complete (55489 records). [2025-10-15T17:21:24.678966] [DEBUG] [VALIDATOR ] ASH: Validating primary data. [2025-10-15T17:21:24.919090] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-07. [2025-10-15T17:21:25.085542] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-15T17:21:25.107489] [DEBUG] [VALIDATOR ] ASH: All expected trading days are present. [2025-10-15T17:21:25.107281] [INFO ] [REMOTE ] ASIX: Full fetch complete (30856 records). [2025-10-15T17:21:25.107830] [DEBUG] [VALIDATOR ] ASIX: Validating primary data. [2025-10-15T17:21:25.107734] [DEBUG] [VALIDATOR ] ASH: Primary data validation passed. [2025-10-15T17:21:25.108967] [INFO ] [MAIN ] ASH: Fetched primary data is valid. [2025-10-15T17:21:25.109154] [DEBUG] [LOCAL ] ASH: Saving primary data. [2025-10-15T17:21:25.219623] [DEBUG] [LOCAL ] ASH: Trimmed 55489 records to 37552 (keeping 200 days of data) [2025-10-15T17:21:25.615337] [DEBUG] [VALIDATOR ] ASIX: All expected trading days are present. [2025-10-15T17:21:25.615717] [DEBUG] [VALIDATOR ] ASIX: Primary data validation passed. [2025-10-15T17:21:25.617293] [INFO ] [MAIN ] ASIX: Fetched primary data is valid. [2025-10-15T17:21:25.617682] [DEBUG] [LOCAL ] ASIX: Saving primary data. [2025-10-15T17:21:25.627840] [DEBUG] [LOCAL ] ASIX: Trimmed 30856 records to 23077 (keeping 200 days of data) [2025-10-15T17:21:25.717283] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-10. [2025-10-15T17:21:25.848712] [DEBUG] [LOCAL ] ASH: Primary data saved (37552 records). [2025-10-15T17:21:25.849954] [INFO ] [MAIN ] ASH: Full history saved. [2025-10-15T17:21:25.850083] [INFO ] [MAIN ] Update Progress: 161/2369 symbols completed. ASH took 31.2s. Estimated remaining: 4h 52m 52s. Rate: 7.5 symbols/min [2025-10-15T17:21:26.071104] [INFO ] [MAIN ] ASX: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:21:26.072029] [DEBUG] [LOCAL ] ASIX: Primary data saved (23077 records). [2025-10-15T17:21:26.072624] [INFO ] [MAIN ] ASIX: Full history saved. [2025-10-15T17:21:26.072839] [INFO ] [MAIN ] Update Progress: 162/2369 symbols completed. ASIX took 31.4s. Estimated remaining: 4h 50m 59s. Rate: 7.6 symbols/min [2025-10-15T17:21:26.253392] [INFO ] [MAIN ] ATEN: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:21:26.298470] [DEBUG] [LOCAL ] ASX: Loaded 52873 existing records from primary storage. [2025-10-15T17:21:26.308541] [INFO ] [MAIN ] ASX: Loaded 52873 existing records. [2025-10-15T17:21:26.427775] [DEBUG] [LOCAL ] ATEN: Loaded 38394 existing records from primary storage. [2025-10-15T17:21:26.444337] [INFO ] [MAIN ] ATEN: Loaded 38394 existing records. [2025-10-15T17:21:26.578756] [WARN ] [MAIN ] ASX: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:21:26.620904] [INFO ] [MAIN ] ASX: Wiping existing primary data before full refresh. [2025-10-15T17:21:26.621071] [INFO ] [LOCAL ] ASX: Starting deletion of primary data. [2025-10-15T17:21:26.627211] [DEBUG] [LOCAL ] ASX: Deleted primary data file. [2025-10-15T17:21:26.642972] [INFO ] [MAIN ] ASX: Starting full primary refresh. [2025-10-15T17:21:26.730054] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-15T17:21:26.819867] [WARN ] [MAIN ] ATEN: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:21:26.824501] [INFO ] [MAIN ] ATEN: Wiping existing primary data before full refresh. [2025-10-15T17:21:26.824202] [INFO ] [REMOTE ] ASR: Full fetch complete (12376 records). [2025-10-15T17:21:26.824874] [INFO ] [LOCAL ] ATEN: Starting deletion of primary data. [2025-10-15T17:21:26.825507] [DEBUG] [VALIDATOR ] ASR: Validating primary data. [2025-10-15T17:21:26.831520] [DEBUG] [LOCAL ] ATEN: Deleted primary data file. [2025-10-15T17:21:26.889498] [INFO ] [MAIN ] ATEN: Starting full primary refresh. [2025-10-15T17:21:27.326493] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-07 (2.41 seconds). [2025-10-15T17:21:27.462088] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-08. [2025-10-15T17:21:27.826283] [INFO ] [REMOTE ] ASX: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:21:27.862560] [INFO ] [REMOTE ] ASX: Fetching primary data for 2024-12. [2025-10-15T17:21:27.902000] [DEBUG] [VALIDATOR ] ASR: All expected trading days are present. [2025-10-15T17:21:27.902450] [DEBUG] [VALIDATOR ] ASR: Primary data validation passed. [2025-10-15T17:21:27.908200] [INFO ] [MAIN ] ASR: Fetched primary data is valid. [2025-10-15T17:21:27.908294] [DEBUG] [LOCAL ] ASR: Saving primary data. [2025-10-15T17:21:27.954262] [DEBUG] [LOCAL ] ASR: Trimmed 12376 records to 9379 (keeping 200 days of data) [2025-10-15T17:21:28.018014] [INFO ] [REMOTE ] ATEN: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:21:28.064936] [DEBUG] [LOCAL ] ASR: Primary data saved (9379 records). [2025-10-15T17:21:28.065193] [INFO ] [MAIN ] ASR: Full history saved. [2025-10-15T17:21:28.065385] [INFO ] [MAIN ] Update Progress: 163/2369 symbols completed. ASR took 33.4s. Estimated remaining: 4h 49m 31s. Rate: 7.6 symbols/min [2025-10-15T17:21:28.122330] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2024-12. [2025-10-15T17:21:28.262499] [INFO ] [MAIN ] ATGE: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:21:28.300621] [DEBUG] [LOCAL ] ATGE: Loaded 31110 existing records from primary storage. [2025-10-15T17:21:28.301134] [INFO ] [MAIN ] ATGE: Loaded 31110 existing records. [2025-10-15T17:21:28.490248] [WARN ] [MAIN ] ATGE: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:21:28.490530] [INFO ] [MAIN ] ATGE: Wiping existing primary data before full refresh. [2025-10-15T17:21:28.490580] [INFO ] [LOCAL ] ATGE: Starting deletion of primary data. [2025-10-15T17:21:28.491057] [DEBUG] [LOCAL ] ATGE: Deleted primary data file. [2025-10-15T17:21:28.491115] [INFO ] [MAIN ] ATGE: Starting full primary refresh. [2025-10-15T17:21:28.858817] [INFO ] [REMOTE ] ATGE: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:21:28.913993] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2024-12. [2025-10-15T17:21:29.362535] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-15T17:21:29.639784] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-15T17:21:29.713979] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-01. [2025-10-15T17:21:29.790585] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-10-15T17:21:30.260325] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-15T17:21:30.513992] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-01. [2025-10-15T17:21:30.777104] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-15T17:21:31.314010] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-01. [2025-10-15T17:21:32.113989] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-02. [2025-10-15T17:21:32.369747] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-15T17:21:32.496820] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-15T17:21:32.914058] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-02. [2025-10-15T17:21:33.299867] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-15T17:21:33.714050] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-03. [2025-10-15T17:21:34.500118] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-15T17:21:34.513961] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-03. [2025-10-15T17:21:35.147410] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-15T17:21:35.314009] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-09. [2025-10-15T17:21:36.113990] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-02. [2025-10-15T17:21:36.294074] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-15T17:21:36.772323] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-15T17:21:36.913967] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-04. [2025-10-15T17:21:37.292104] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-15T17:21:37.714000] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-10. [2025-10-15T17:21:38.514045] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-04. [2025-10-15T17:21:39.314083] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-03. [2025-10-15T17:21:39.400097] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-15T17:21:39.406531] [INFO ] [REMOTE ] ASPN: Full fetch complete (72635 records). [2025-10-15T17:21:39.406710] [DEBUG] [VALIDATOR ] ASPN: Validating primary data. [2025-10-15T17:21:39.807950] [DEBUG] [VALIDATOR ] ASPN: All expected trading days are present. [2025-10-15T17:21:39.808084] [DEBUG] [VALIDATOR ] ASPN: Primary data validation passed. [2025-10-15T17:21:39.809154] [INFO ] [MAIN ] ASPN: Fetched primary data is valid. [2025-10-15T17:21:39.809223] [DEBUG] [LOCAL ] ASPN: Saving primary data. [2025-10-15T17:21:39.811252] [DEBUG] [LOCAL ] ASPN: Trimmed 72635 records to 49893 (keeping 200 days of data) [2025-10-15T17:21:40.107150] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-04 (3.19 seconds). [2025-10-15T17:21:40.153540] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-05. [2025-10-15T17:21:40.158905] [DEBUG] [LOCAL ] ASPN: Primary data saved (49893 records). [2025-10-15T17:21:40.159977] [INFO ] [MAIN ] ASPN: Full history saved. [2025-10-15T17:21:40.160107] [INFO ] [MAIN ] Update Progress: 164/2369 symbols completed. ASPN took 45.5s. Estimated remaining: 4h 50m 20s. Rate: 7.6 symbols/min [2025-10-15T17:21:40.348296] [INFO ] [MAIN ] ATHM: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:21:40.380892] [DEBUG] [LOCAL ] ATHM: Loaded 31560 existing records from primary storage. [2025-10-15T17:21:40.381270] [INFO ] [MAIN ] ATHM: Loaded 31560 existing records. [2025-10-15T17:21:40.570225] [WARN ] [MAIN ] ATHM: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:21:40.570615] [INFO ] [MAIN ] ATHM: Wiping existing primary data before full refresh. [2025-10-15T17:21:40.570739] [INFO ] [LOCAL ] ATHM: Starting deletion of primary data. [2025-10-15T17:21:40.571418] [DEBUG] [LOCAL ] ATHM: Deleted primary data file. [2025-10-15T17:21:40.571478] [INFO ] [MAIN ] ATHM: Starting full primary refresh. [2025-10-15T17:21:40.883745] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-04 (2.37 seconds). [2025-10-15T17:21:40.959592] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-05. [2025-10-15T17:21:40.980905] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-15T17:21:41.039244] [INFO ] [REMOTE ] ATHM: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:21:41.713962] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-04. [2025-10-15T17:21:41.860872] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-15T17:21:42.131478] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-15T17:21:42.514017] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-06. [2025-10-15T17:21:43.231874] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-15T17:21:43.314076] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2024-12. [2025-10-15T17:21:44.114004] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-06. [2025-10-15T17:21:44.266841] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-15T17:21:44.894427] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-15T17:21:44.913975] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-01. [2025-10-15T17:21:45.428316] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-15T17:21:45.714004] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-05. [2025-10-15T17:21:46.437108] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-15T17:21:46.513994] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-02. [2025-10-15T17:21:47.154077] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-15T17:21:47.313997] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-07. [2025-10-15T17:21:47.691009] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-15T17:21:48.114002] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-07. [2025-10-15T17:21:48.913972] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-06. [2025-10-15T17:21:49.210918] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-15T17:21:49.651566] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-15T17:21:49.714012] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-08. [2025-10-15T17:21:49.867144] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-15T17:21:50.514041] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-03. [2025-10-15T17:21:51.093611] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-15T17:21:51.314042] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-07. [2025-10-15T17:21:51.643057] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-15T17:21:52.114016] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-08. [2025-10-15T17:21:52.684859] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-15T17:21:52.914229] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-04. [2025-10-15T17:21:53.714034] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-09. [2025-10-15T17:21:54.255499] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-08 (2.14 seconds). [2025-10-15T17:21:54.491930] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-15T17:21:54.513955] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-05. [2025-10-15T17:21:54.759382] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-15T17:21:55.314072] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-09. [2025-10-15T17:21:56.041239] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-15T17:21:56.113944] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-10. [2025-10-15T17:21:56.836402] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-15T17:21:56.914003] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-10. [2025-10-15T17:21:57.526372] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-15T17:21:57.530745] [INFO ] [REMOTE ] ATEN: Full fetch complete (56874 records). [2025-10-15T17:21:57.530859] [DEBUG] [VALIDATOR ] ATEN: Validating primary data. [2025-10-15T17:21:57.723944] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-06. [2025-10-15T17:21:57.920985] [DEBUG] [VALIDATOR ] ATEN: All expected trading days are present. [2025-10-15T17:21:57.921121] [DEBUG] [VALIDATOR ] ATEN: Primary data validation passed. [2025-10-15T17:21:57.921982] [INFO ] [MAIN ] ATEN: Fetched primary data is valid. [2025-10-15T17:21:57.922061] [DEBUG] [LOCAL ] ATEN: Saving primary data. [2025-10-15T17:21:57.923574] [DEBUG] [LOCAL ] ATEN: Trimmed 56874 records to 38334 (keeping 200 days of data) [2025-10-15T17:21:58.153343] [DEBUG] [LOCAL ] ATEN: Primary data saved (38334 records). [2025-10-15T17:21:58.153499] [INFO ] [MAIN ] ATEN: Full history saved. [2025-10-15T17:21:58.153584] [INFO ] [MAIN ] Update Progress: 165/2369 symbols completed. ATEN took 32.1s. Estimated remaining: 4h 52m 27s. Rate: 7.5 symbols/min [2025-10-15T17:21:58.321357] [INFO ] [MAIN ] ATHS: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:21:58.329256] [DEBUG] [LOCAL ] ATHS: Loaded 6717 existing records from primary storage. [2025-10-15T17:21:58.329706] [INFO ] [MAIN ] ATHS: Loaded 6717 existing records. [2025-10-15T17:21:58.512865] [WARN ] [MAIN ] ATHS: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:21:58.513207] [INFO ] [MAIN ] ATHS: Wiping existing primary data before full refresh. [2025-10-15T17:21:58.513285] [INFO ] [LOCAL ] ATHS: Starting deletion of primary data. [2025-10-15T17:21:58.513543] [DEBUG] [LOCAL ] ATHS: Deleted primary data file. [2025-10-15T17:21:58.513602] [INFO ] [MAIN ] ATHS: Starting full primary refresh. [2025-10-15T17:21:58.528024] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-08. [2025-10-15T17:21:58.685074] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-15T17:21:58.771430] [INFO ] [REMOTE ] ASX: Full fetch complete (76761 records). [2025-10-15T17:21:58.785234] [DEBUG] [VALIDATOR ] ASX: Validating primary data. [2025-10-15T17:21:59.107916] [INFO ] [REMOTE ] ATHS: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:21:59.197258] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-15T17:21:59.322929] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2024-12. [2025-10-15T17:21:59.437450] [DEBUG] [VALIDATOR ] ASX: All expected trading days are present. [2025-10-15T17:21:59.437584] [DEBUG] [VALIDATOR ] ASX: Primary data validation passed. [2025-10-15T17:21:59.438465] [INFO ] [MAIN ] ASX: Fetched primary data is valid. [2025-10-15T17:21:59.438535] [DEBUG] [LOCAL ] ASX: Saving primary data. [2025-10-15T17:21:59.440373] [DEBUG] [LOCAL ] ASX: Trimmed 76761 records to 52874 (keeping 200 days of data) [2025-10-15T17:21:59.762376] [DEBUG] [LOCAL ] ASX: Primary data saved (52874 records). [2025-10-15T17:21:59.762532] [INFO ] [MAIN ] ASX: Full history saved. [2025-10-15T17:21:59.762615] [INFO ] [MAIN ] Update Progress: 166/2369 symbols completed. ASX took 33.9s. Estimated remaining: 4h 50m 55s. Rate: 7.6 symbols/min [2025-10-15T17:21:59.944266] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-15T17:21:59.977165] [INFO ] [MAIN ] ATI: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:21:59.986217] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-10-15T17:22:00.036358] [DEBUG] [LOCAL ] ATI: Loaded 51381 existing records from primary storage. [2025-10-15T17:22:00.036743] [INFO ] [MAIN ] ATI: Loaded 51381 existing records. [2025-10-15T17:22:00.119164] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-07. [2025-10-15T17:22:00.246660] [WARN ] [MAIN ] ATI: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:22:00.247123] [INFO ] [MAIN ] ATI: Wiping existing primary data before full refresh. [2025-10-15T17:22:00.247170] [INFO ] [LOCAL ] ATI: Starting deletion of primary data. [2025-10-15T17:22:00.248300] [DEBUG] [LOCAL ] ATI: Deleted primary data file. [2025-10-15T17:22:00.248360] [INFO ] [MAIN ] ATI: Starting full primary refresh. [2025-10-15T17:22:00.609300] [INFO ] [REMOTE ] ATI: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:22:00.913977] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-09. [2025-10-15T17:22:01.247218] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-15T17:22:01.714051] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-08. [2025-10-15T17:22:02.116235] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-15T17:22:02.514003] [INFO ] [REMOTE ] ATI: Fetching primary data for 2024-12. [2025-10-15T17:22:02.854292] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-15T17:22:03.314015] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-01. [2025-10-15T17:22:03.884774] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-15T17:22:04.048378] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-15T17:22:04.114003] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-10. [2025-10-15T17:22:04.914037] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-02. [2025-10-15T17:22:05.473043] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-15T17:22:05.594813] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-15T17:22:05.598472] [INFO ] [REMOTE ] ATGE: Full fetch complete (46043 records). [2025-10-15T17:22:05.598582] [DEBUG] [VALIDATOR ] ATGE: Validating primary data. [2025-10-15T17:22:05.719091] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-01. [2025-10-15T17:22:05.975264] [DEBUG] [VALIDATOR ] ATGE: All expected trading days are present. [2025-10-15T17:22:05.975353] [DEBUG] [VALIDATOR ] ATGE: Primary data validation passed. [2025-10-15T17:22:05.975982] [INFO ] [MAIN ] ATGE: Fetched primary data is valid. [2025-10-15T17:22:05.976047] [DEBUG] [LOCAL ] ATGE: Saving primary data. [2025-10-15T17:22:05.977125] [DEBUG] [LOCAL ] ATGE: Trimmed 46043 records to 31064 (keeping 200 days of data) [2025-10-15T17:22:06.161970] [DEBUG] [LOCAL ] ATGE: Primary data saved (31064 records). [2025-10-15T17:22:06.162101] [INFO ] [MAIN ] ATGE: Full history saved. [2025-10-15T17:22:06.162178] [INFO ] [MAIN ] Update Progress: 167/2369 symbols completed. ATGE took 38.1s. Estimated remaining: 4h 50m 27s. Rate: 7.6 symbols/min [2025-10-15T17:22:06.327310] [INFO ] [MAIN ] ATKR: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:22:06.358265] [DEBUG] [LOCAL ] ATKR: Loaded 35205 existing records from primary storage. [2025-10-15T17:22:06.358539] [INFO ] [MAIN ] ATKR: Loaded 35205 existing records. [2025-10-15T17:22:06.519947] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-03. [2025-10-15T17:22:06.532702] [WARN ] [MAIN ] ATKR: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:22:06.533969] [INFO ] [MAIN ] ATKR: Wiping existing primary data before full refresh. [2025-10-15T17:22:06.534028] [INFO ] [LOCAL ] ATKR: Starting deletion of primary data. [2025-10-15T17:22:06.534421] [DEBUG] [LOCAL ] ATKR: Deleted primary data file. [2025-10-15T17:22:06.534460] [INFO ] [MAIN ] ATKR: Starting full primary refresh. [2025-10-15T17:22:06.883698] [INFO ] [REMOTE ] ATKR: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:22:07.314007] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2024-12. [2025-10-15T17:22:07.437351] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-15T17:22:07.515148] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-15T17:22:08.114050] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-04. [2025-10-15T17:22:08.623580] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-10-15T17:22:08.714112] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-15T17:22:08.914000] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-02. [2025-10-15T17:22:09.714008] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-09. [2025-10-15T17:22:10.513976] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-05. [2025-10-15T17:22:10.545932] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-15T17:22:10.721173] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-15T17:22:11.314036] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-01. [2025-10-15T17:22:11.424445] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-15T17:22:12.113996] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-06. [2025-10-15T17:22:12.445297] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-15T17:22:12.820072] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-15T17:22:12.914013] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-03. [2025-10-15T17:22:13.714050] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-07. [2025-10-15T17:22:14.385089] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-10-15T17:22:14.516238] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-08. [2025-10-15T17:22:14.518773] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-15T17:22:15.189096] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-10-15T17:22:15.314002] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-10. [2025-10-15T17:22:16.113963] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-09. [2025-10-15T17:22:16.505346] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-15T17:22:16.511074] [INFO ] [REMOTE ] ATHM: Full fetch complete (50139 records). [2025-10-15T17:22:16.511257] [DEBUG] [VALIDATOR ] ATHM: Validating primary data. [2025-10-15T17:22:16.640346] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-10-15T17:22:16.922746] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-04. [2025-10-15T17:22:16.942551] [DEBUG] [VALIDATOR ] ATHM: All expected trading days are present. [2025-10-15T17:22:16.942726] [DEBUG] [VALIDATOR ] ATHM: Primary data validation passed. [2025-10-15T17:22:16.943524] [INFO ] [MAIN ] ATHM: Fetched primary data is valid. [2025-10-15T17:22:16.943605] [DEBUG] [LOCAL ] ATHM: Saving primary data. [2025-10-15T17:22:16.944826] [DEBUG] [LOCAL ] ATHM: Trimmed 50139 records to 31512 (keeping 200 days of data) [2025-10-15T17:22:17.132968] [DEBUG] [LOCAL ] ATHM: Primary data saved (31512 records). [2025-10-15T17:22:17.133147] [INFO ] [MAIN ] ATHM: Full history saved. [2025-10-15T17:22:17.133248] [INFO ] [MAIN ] Update Progress: 168/2369 symbols completed. ATHM took 37.0s. Estimated remaining: 4h 50m 59s. Rate: 7.6 symbols/min [2025-10-15T17:22:17.330755] [INFO ] [MAIN ] ATMU: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:22:17.368584] [DEBUG] [LOCAL ] ATMU: Loaded 38890 existing records from primary storage. [2025-10-15T17:22:17.368911] [INFO ] [MAIN ] ATMU: Loaded 38890 existing records. [2025-10-15T17:22:17.553073] [WARN ] [MAIN ] ATMU: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:22:17.553291] [INFO ] [MAIN ] ATMU: Wiping existing primary data before full refresh. [2025-10-15T17:22:17.553339] [INFO ] [LOCAL ] ATMU: Starting deletion of primary data. [2025-10-15T17:22:17.553741] [DEBUG] [LOCAL ] ATMU: Deleted primary data file. [2025-10-15T17:22:17.553798] [INFO ] [MAIN ] ATMU: Starting full primary refresh. [2025-10-15T17:22:17.727791] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-10. [2025-10-15T17:22:17.917814] [INFO ] [REMOTE ] ATMU: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:22:18.313764] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-15T17:22:18.315119] [INFO ] [REMOTE ] ATHS: Full fetch complete (9670 records). [2025-10-15T17:22:18.315194] [DEBUG] [VALIDATOR ] ATHS: Validating primary data. [2025-10-15T17:22:18.519480] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2024-12. [2025-10-15T17:22:18.711682] [DEBUG] [VALIDATOR ] ATHS: All expected trading days are present. [2025-10-15T17:22:18.711776] [DEBUG] [VALIDATOR ] ATHS: Primary data validation passed. [2025-10-15T17:22:18.712103] [INFO ] [MAIN ] ATHS: Fetched primary data is valid. [2025-10-15T17:22:18.712144] [DEBUG] [LOCAL ] ATHS: Saving primary data. [2025-10-15T17:22:18.712710] [DEBUG] [LOCAL ] ATHS: Trimmed 9670 records to 6640 (keeping 200 days of data) [2025-10-15T17:22:18.756863] [DEBUG] [LOCAL ] ATHS: Primary data saved (6640 records). [2025-10-15T17:22:18.757060] [INFO ] [MAIN ] ATHS: Full history saved. [2025-10-15T17:22:18.757178] [INFO ] [MAIN ] Update Progress: 169/2369 symbols completed. ATHS took 20.6s. Estimated remaining: 4h 49m 29s. Rate: 7.6 symbols/min [2025-10-15T17:22:18.935607] [INFO ] [MAIN ] ATO: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:22:18.976929] [DEBUG] [LOCAL ] ATO: Loaded 41812 existing records from primary storage. [2025-10-15T17:22:18.977253] [INFO ] [MAIN ] ATO: Loaded 41812 existing records. [2025-10-15T17:22:19.155962] [WARN ] [MAIN ] ATO: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:22:19.156186] [INFO ] [MAIN ] ATO: Wiping existing primary data before full refresh. [2025-10-15T17:22:19.156233] [INFO ] [LOCAL ] ATO: Starting deletion of primary data. [2025-10-15T17:22:19.156893] [DEBUG] [LOCAL ] ATO: Deleted primary data file. [2025-10-15T17:22:19.156948] [INFO ] [MAIN ] ATO: Starting full primary refresh. [2025-10-15T17:22:19.331027] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-02. [2025-10-15T17:22:19.516778] [INFO ] [REMOTE ] ATO: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:22:19.549339] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-04 (2.63 seconds). [2025-10-15T17:22:20.114026] [INFO ] [REMOTE ] ATO: Fetching primary data for 2024-12. [2025-10-15T17:22:20.713210] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2024-12 (2.19 seconds). [2025-10-15T17:22:20.913971] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-01. [2025-10-15T17:22:21.174351] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-15T17:22:21.366518] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-15T17:22:21.714032] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-01. [2025-10-15T17:22:22.263997] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-15T17:22:22.514000] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-05. [2025-10-15T17:22:23.003270] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-15T17:22:23.314006] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-02. [2025-10-15T17:22:24.121020] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-03. [2025-10-15T17:22:24.146844] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-15T17:22:24.625577] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-15T17:22:24.914047] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-06. [2025-10-15T17:22:25.498206] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-15T17:22:25.714019] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-04. [2025-10-15T17:22:26.258665] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-15T17:22:26.514025] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-03. [2025-10-15T17:22:27.219066] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-15T17:22:27.313993] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-05. [2025-10-15T17:22:28.063531] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-15T17:22:28.113991] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-04. [2025-10-15T17:22:28.432707] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-15T17:22:28.914073] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-02. [2025-10-15T17:22:29.681140] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-15T17:22:29.714050] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-05. [2025-10-15T17:22:30.191793] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-15T17:22:30.514015] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-06. [2025-10-15T17:22:31.237243] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-15T17:22:31.313970] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-06. [2025-10-15T17:22:31.603812] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-15T17:22:32.114058] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-07. [2025-10-15T17:22:32.914017] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-03. [2025-10-15T17:22:33.051979] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-15T17:22:33.478213] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-15T17:22:33.714007] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-07. [2025-10-15T17:22:34.514090] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-08. [2025-10-15T17:22:34.746232] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-15T17:22:35.200685] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-15T17:22:35.314003] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-08. [2025-10-15T17:22:35.817491] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-15T17:22:36.114000] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-09. [2025-10-15T17:22:36.644248] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-15T17:22:36.914044] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-04. [2025-10-15T17:22:37.528472] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-15T17:22:37.714169] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-09. [2025-10-15T17:22:38.452359] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-15T17:22:38.513992] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-07. [2025-10-15T17:22:39.034887] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-15T17:22:39.314041] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-10. [2025-10-15T17:22:40.114028] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-10. [2025-10-15T17:22:40.377804] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-15T17:22:40.416212] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-15T17:22:40.420461] [INFO ] [REMOTE ] ATKR: Full fetch complete (53534 records). [2025-10-15T17:22:40.420577] [DEBUG] [VALIDATOR ] ATKR: Validating primary data. [2025-10-15T17:22:40.804393] [DEBUG] [VALIDATOR ] ATKR: All expected trading days are present. [2025-10-15T17:22:40.804487] [DEBUG] [VALIDATOR ] ATKR: Primary data validation passed. [2025-10-15T17:22:40.805123] [INFO ] [MAIN ] ATKR: Fetched primary data is valid. [2025-10-15T17:22:40.805184] [DEBUG] [LOCAL ] ATKR: Saving primary data. [2025-10-15T17:22:40.806277] [DEBUG] [LOCAL ] ATKR: Trimmed 53534 records to 35206 (keeping 200 days of data) [2025-10-15T17:22:40.913995] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-08. [2025-10-15T17:22:41.015832] [DEBUG] [LOCAL ] ATKR: Primary data saved (35206 records). [2025-10-15T17:22:41.015945] [INFO ] [MAIN ] ATKR: Full history saved. [2025-10-15T17:22:41.016034] [INFO ] [MAIN ] Update Progress: 170/2369 symbols completed. ATKR took 34.9s. Estimated remaining: 4h 52m 27s. Rate: 7.5 symbols/min [2025-10-15T17:22:41.180282] [INFO ] [MAIN ] ATR: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:22:41.210524] [DEBUG] [LOCAL ] ATR: Loaded 30558 existing records from primary storage. [2025-10-15T17:22:41.210825] [INFO ] [MAIN ] ATR: Loaded 30558 existing records. [2025-10-15T17:22:41.383466] [WARN ] [MAIN ] ATR: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:22:41.383663] [INFO ] [MAIN ] ATR: Wiping existing primary data before full refresh. [2025-10-15T17:22:41.383723] [INFO ] [LOCAL ] ATR: Starting deletion of primary data. [2025-10-15T17:22:41.384091] [DEBUG] [LOCAL ] ATR: Deleted primary data file. [2025-10-15T17:22:41.384146] [INFO ] [MAIN ] ATR: Starting full primary refresh. [2025-10-15T17:22:41.678291] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-15T17:22:41.704039] [INFO ] [REMOTE ] ATO: Full fetch complete (60567 records). [2025-10-15T17:22:41.721886] [DEBUG] [VALIDATOR ] ATO: Validating primary data. [2025-10-15T17:22:41.721781] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-05. [2025-10-15T17:22:41.768908] [INFO ] [REMOTE ] ATR: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:22:42.140231] [DEBUG] [VALIDATOR ] ATO: All expected trading days are present. [2025-10-15T17:22:42.140303] [DEBUG] [VALIDATOR ] ATO: Primary data validation passed. [2025-10-15T17:22:42.140922] [INFO ] [MAIN ] ATO: Fetched primary data is valid. [2025-10-15T17:22:42.140983] [DEBUG] [LOCAL ] ATO: Saving primary data. [2025-10-15T17:22:42.142089] [DEBUG] [LOCAL ] ATO: Trimmed 60567 records to 41759 (keeping 200 days of data) [2025-10-15T17:22:42.399637] [DEBUG] [LOCAL ] ATO: Primary data saved (41759 records). [2025-10-15T17:22:42.399784] [INFO ] [MAIN ] ATO: Full history saved. [2025-10-15T17:22:42.399880] [INFO ] [MAIN ] Update Progress: 171/2369 symbols completed. ATO took 23.6s. Estimated remaining: 4h 50m 54s. Rate: 7.6 symbols/min [2025-10-15T17:22:42.520738] [INFO ] [REMOTE ] ATR: Fetching primary data for 2024-12. [2025-10-15T17:22:42.569098] [INFO ] [MAIN ] ATS: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:22:42.588171] [DEBUG] [LOCAL ] ATS: Loaded 17644 existing records from primary storage. [2025-10-15T17:22:42.588404] [INFO ] [MAIN ] ATS: Loaded 17644 existing records. [2025-10-15T17:22:42.762473] [WARN ] [MAIN ] ATS: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:22:42.762726] [INFO ] [MAIN ] ATS: Wiping existing primary data before full refresh. [2025-10-15T17:22:42.762798] [INFO ] [LOCAL ] ATS: Starting deletion of primary data. [2025-10-15T17:22:42.763322] [DEBUG] [LOCAL ] ATS: Deleted primary data file. [2025-10-15T17:22:42.763384] [INFO ] [MAIN ] ATS: Starting full primary refresh. [2025-10-15T17:22:42.898554] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-10-15T17:22:43.157450] [INFO ] [REMOTE ] ATS: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:22:43.228106] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-15T17:22:43.313956] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-06. [2025-10-15T17:22:43.566081] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-15T17:22:44.114001] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-09. [2025-10-15T17:22:44.744629] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-15T17:22:44.914055] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-01. [2025-10-15T17:22:45.713980] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-07. [2025-10-15T17:22:46.011144] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-15T17:22:46.084622] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-15T17:22:46.513988] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-02. [2025-10-15T17:22:47.101007] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-15T17:22:47.314000] [INFO ] [REMOTE ] ATS: Fetching primary data for 2024-12. [2025-10-15T17:22:47.823228] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-15T17:22:48.114018] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-03. [2025-10-15T17:22:48.398858] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-15T17:22:48.914121] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-10. [2025-10-15T17:22:49.456051] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-15T17:22:49.714136] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-08. [2025-10-15T17:22:50.514011] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-01. [2025-10-15T17:22:51.281556] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-15T17:22:51.313995] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-09. [2025-10-15T17:22:51.431954] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-10 (2.52 seconds). [2025-10-15T17:22:51.439294] [INFO ] [REMOTE ] ATI: Full fetch complete (73616 records). [2025-10-15T17:22:51.439459] [DEBUG] [VALIDATOR ] ATI: Validating primary data. [2025-10-15T17:22:51.440563] [FATAL] [VALIDATOR ] ATI: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T17:22:51.440700] [FATAL] [MAIN ] ATI: Fetched primary data is invalid. Refusing to save it. [2025-10-15T17:22:51.440754] [WARN ] [MAIN ] ATI: Deleting existing primary and derivative data due to validation failure. [2025-10-15T17:22:51.440833] [INFO ] [LOCAL ] ATI: Starting deletion of primary data. [2025-10-15T17:22:51.440915] [DEBUG] [LOCAL ] ATI: No primary data file found to delete. [2025-10-15T17:22:51.440953] [INFO ] [LOCAL ] ATI: Starting deletion of derivative data. [2025-10-15T17:22:51.441474] [DEBUG] [LOCAL ] ATI: Deleted derivative data file. [2025-10-15T17:22:51.442020] [INFO ] [MAIN ] Update Progress: 172/2369 symbols completed. ATI took 51.7s. Estimated remaining: 4h 50m 60s. Rate: 7.5 symbols/min [2025-10-15T17:22:51.640424] [INFO ] [MAIN ] ATUS: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:22:51.696047] [DEBUG] [LOCAL ] ATUS: Loaded 49800 existing records from primary storage. [2025-10-15T17:22:51.696562] [INFO ] [MAIN ] ATUS: Loaded 49800 existing records. [2025-10-15T17:22:51.888907] [WARN ] [MAIN ] ATUS: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:22:51.889192] [INFO ] [MAIN ] ATUS: Wiping existing primary data before full refresh. [2025-10-15T17:22:51.889245] [INFO ] [LOCAL ] ATUS: Starting deletion of primary data. [2025-10-15T17:22:51.889915] [DEBUG] [LOCAL ] ATUS: Deleted primary data file. [2025-10-15T17:22:51.890000] [INFO ] [MAIN ] ATUS: Starting full primary refresh. [2025-10-15T17:22:52.121480] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-04. [2025-10-15T17:22:52.298558] [INFO ] [REMOTE ] ATUS: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:22:52.914085] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2024-12. [2025-10-15T17:23:05.169964] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-01 (14.66 seconds). [2025-10-15T17:23:05.176512] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-02. [2025-10-15T17:23:05.396470] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-04 (13.27 seconds). [2025-10-15T17:23:05.402994] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-05. [2025-10-15T17:23:05.853587] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-09 (14.54 seconds). [2025-10-15T17:23:05.863373] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-10. [2025-10-15T17:23:06.278447] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2024-12 (13.36 seconds). [2025-10-15T17:23:06.288375] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-01. [2025-10-15T17:23:07.099628] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-15T17:23:07.108032] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-06. [2025-10-15T17:23:07.207106] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-02 (2.03 seconds). [2025-10-15T17:23:07.210940] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-03. [2025-10-15T17:23:07.352285] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-15T17:23:07.359156] [INFO ] [REMOTE ] ATMU: Full fetch complete (56427 records). [2025-10-15T17:23:07.359332] [DEBUG] [VALIDATOR ] ATMU: Validating primary data. [2025-10-15T17:23:07.360373] [FATAL] [VALIDATOR ] ATMU: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T17:23:07.360492] [FATAL] [MAIN ] ATMU: Fetched primary data is invalid. Refusing to save it. [2025-10-15T17:23:07.360783] [WARN ] [MAIN ] ATMU: Deleting existing primary and derivative data due to validation failure. [2025-10-15T17:23:07.360870] [INFO ] [LOCAL ] ATMU: Starting deletion of primary data. [2025-10-15T17:23:07.360961] [DEBUG] [LOCAL ] ATMU: No primary data file found to delete. [2025-10-15T17:23:07.361016] [INFO ] [LOCAL ] ATMU: Starting deletion of derivative data. [2025-10-15T17:23:07.361268] [DEBUG] [LOCAL ] ATMU: Deleted derivative data file. [2025-10-15T17:23:07.361424] [INFO ] [MAIN ] Update Progress: 173/2369 symbols completed. ATMU took 50.2s. Estimated remaining: 4h 52m 33s. Rate: 7.5 symbols/min [2025-10-15T17:23:07.554566] [INFO ] [MAIN ] AU: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:23:07.554768] [DEBUG] [LOCAL ] AU: No existing data file found in primary storage. [2025-10-15T17:23:07.554815] [WARN ] [MAIN ] AU: No existing data found, performing full refresh instead. [2025-10-15T17:23:07.554947] [INFO ] [MAIN ] AU: Wiping existing primary data before full refresh. [2025-10-15T17:23:07.555005] [INFO ] [LOCAL ] AU: Starting deletion of primary data. [2025-10-15T17:23:07.555051] [DEBUG] [LOCAL ] AU: No primary data file found to delete. [2025-10-15T17:23:07.555084] [INFO ] [MAIN ] AU: Starting full primary refresh. [2025-10-15T17:23:08.017816] [INFO ] [REMOTE ] AU: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:23:08.018418] [INFO ] [REMOTE ] AU: Fetching primary data for 2024-12. [2025-10-15T17:23:08.046465] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-15T17:23:08.056821] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-02. [2025-10-15T17:23:08.461736] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-15T17:23:08.474100] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-15T17:23:08.479020] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-04. [2025-10-15T17:23:08.480188] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-07. [2025-10-15T17:23:09.601811] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-15T17:23:09.607947] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-05. [2025-10-15T17:23:09.634020] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-15T17:23:09.643469] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-03. [2025-10-15T17:23:09.699455] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-15T17:23:09.706327] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-08. [2025-10-15T17:23:10.325887] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2024-12 (2.31 seconds). [2025-10-15T17:23:10.336415] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-01. [2025-10-15T17:23:10.673594] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-15T17:23:10.678243] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-06. [2025-10-15T17:23:10.775112] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-15T17:23:10.783239] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-09. [2025-10-15T17:23:11.091088] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-15T17:23:11.101184] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-04. [2025-10-15T17:23:11.786712] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-15T17:23:11.790969] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-07. [2025-10-15T17:23:11.858135] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-15T17:23:11.868919] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-02. [2025-10-15T17:23:12.505065] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-15T17:23:12.512423] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-10. [2025-10-15T17:23:12.637489] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-15T17:23:12.642519] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-08. [2025-10-15T17:23:13.323007] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-04 (2.22 seconds). [2025-10-15T17:23:13.334170] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-05. [2025-10-15T17:23:13.841906] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-15T17:23:13.846063] [INFO ] [REMOTE ] ATR: Full fetch complete (43924 records). [2025-10-15T17:23:13.846158] [DEBUG] [VALIDATOR ] ATR: Validating primary data. [2025-10-15T17:23:14.004767] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-02 (2.14 seconds). [2025-10-15T17:23:14.066607] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-03. [2025-10-15T17:23:14.212562] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-15T17:23:14.257773] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-09. [2025-10-15T17:23:14.300488] [DEBUG] [VALIDATOR ] ATR: All expected trading days are present. [2025-10-15T17:23:14.300591] [DEBUG] [VALIDATOR ] ATR: Primary data validation passed. [2025-10-15T17:23:14.301186] [INFO ] [MAIN ] ATR: Fetched primary data is valid. [2025-10-15T17:23:14.301248] [DEBUG] [LOCAL ] ATR: Saving primary data. [2025-10-15T17:23:14.302348] [DEBUG] [LOCAL ] ATR: Trimmed 43924 records to 30562 (keeping 200 days of data) [2025-10-15T17:23:14.500998] [DEBUG] [LOCAL ] ATR: Primary data saved (30562 records). [2025-10-15T17:23:14.501133] [INFO ] [MAIN ] ATR: Full history saved. [2025-10-15T17:23:14.501215] [INFO ] [MAIN ] Update Progress: 174/2369 symbols completed. ATR took 33.5s. Estimated remaining: 4h 52m 14s. Rate: 7.5 symbols/min [2025-10-15T17:23:14.671767] [INFO ] [MAIN ] AUB: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:23:14.715484] [DEBUG] [LOCAL ] AUB: Loaded 46046 existing records from primary storage. [2025-10-15T17:23:14.715793] [INFO ] [MAIN ] AUB: Loaded 46046 existing records. [2025-10-15T17:23:14.901560] [WARN ] [MAIN ] AUB: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:23:14.901906] [INFO ] [MAIN ] AUB: Wiping existing primary data before full refresh. [2025-10-15T17:23:14.901965] [INFO ] [LOCAL ] AUB: Starting deletion of primary data. [2025-10-15T17:23:14.902448] [DEBUG] [LOCAL ] AUB: Deleted primary data file. [2025-10-15T17:23:14.902504] [INFO ] [MAIN ] AUB: Starting full primary refresh. [2025-10-15T17:23:15.047753] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-15T17:23:15.126371] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-06. [2025-10-15T17:23:15.339583] [INFO ] [REMOTE ] AUB: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:23:15.339939] [INFO ] [REMOTE ] AUB: Fetching primary data for 2024-12. [2025-10-15T17:23:15.349778] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-15T17:23:15.353368] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-10. [2025-10-15T17:23:16.189165] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-10-15T17:23:16.200838] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-04. [2025-10-15T17:23:16.453106] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-15T17:23:16.455097] [INFO ] [REMOTE ] ATS: Full fetch complete (25488 records). [2025-10-15T17:23:16.455191] [DEBUG] [VALIDATOR ] ATS: Validating primary data. [2025-10-15T17:23:16.455682] [FATAL] [VALIDATOR ] ATS: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T17:23:16.455783] [FATAL] [MAIN ] ATS: Fetched primary data is invalid. Refusing to save it. [2025-10-15T17:23:16.455857] [WARN ] [MAIN ] ATS: Deleting existing primary and derivative data due to validation failure. [2025-10-15T17:23:16.455949] [INFO ] [LOCAL ] ATS: Starting deletion of primary data. [2025-10-15T17:23:16.456029] [DEBUG] [LOCAL ] ATS: No primary data file found to delete. [2025-10-15T17:23:16.456067] [INFO ] [LOCAL ] ATS: Starting deletion of derivative data. [2025-10-15T17:23:16.456344] [DEBUG] [LOCAL ] ATS: Deleted derivative data file. [2025-10-15T17:23:16.456438] [INFO ] [MAIN ] Update Progress: 175/2369 symbols completed. ATS took 34.1s. Estimated remaining: 4h 50m 51s. Rate: 7.5 symbols/min [2025-10-15T17:23:16.641116] [INFO ] [MAIN ] AUNA: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:23:16.648520] [DEBUG] [LOCAL ] AUNA: Loaded 5113 existing records from primary storage. [2025-10-15T17:23:16.648933] [INFO ] [MAIN ] AUNA: Loaded 5113 existing records. [2025-10-15T17:23:16.840700] [WARN ] [MAIN ] AUNA: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:23:16.841394] [INFO ] [MAIN ] AUNA: Wiping existing primary data before full refresh. [2025-10-15T17:23:16.841838] [INFO ] [LOCAL ] AUNA: Starting deletion of primary data. [2025-10-15T17:23:16.842692] [DEBUG] [LOCAL ] AUNA: Deleted primary data file. [2025-10-15T17:23:16.842845] [INFO ] [MAIN ] AUNA: Starting full primary refresh. [2025-10-15T17:23:16.941203] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-15T17:23:17.043539] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-07. [2025-10-15T17:23:17.068561] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-15T17:23:17.158494] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-01. [2025-10-15T17:23:17.293391] [INFO ] [REMOTE ] AUNA: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:23:17.714035] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2024-12. [2025-10-15T17:23:17.900076] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-15T17:23:18.455962] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-10-15T17:23:18.513979] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-01. [2025-10-15T17:23:18.913836] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-15T17:23:18.963115] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-15T17:23:19.055535] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-10-15T17:23:19.314022] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-02. [2025-10-15T17:23:19.897490] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-15T17:23:20.114010] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-02. [2025-10-15T17:23:20.914028] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-05. [2025-10-15T17:23:21.398149] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-15T17:23:21.714109] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-08. [2025-10-15T17:23:22.514133] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-03. [2025-10-15T17:23:22.922761] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-10-15T17:23:23.027019] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-05 (2.11 seconds). [2025-10-15T17:23:23.100544] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-15T17:23:23.314051] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-09. [2025-10-15T17:23:24.113992] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-04. [2025-10-15T17:23:24.447920] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-04 (0.33 seconds). [2025-10-15T17:23:24.925769] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-03. [2025-10-15T17:23:24.947312] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-15T17:23:25.714008] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-06. [2025-10-15T17:23:26.514025] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-05. [2025-10-15T17:23:26.684466] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-15T17:23:26.991730] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-10-15T17:23:27.313973] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-06. [2025-10-15T17:23:27.373674] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-15T17:23:27.928873] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-15T17:23:28.114012] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-10. [2025-10-15T17:23:28.914041] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-07. [2025-10-15T17:23:29.718363] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-04. [2025-10-15T17:23:29.720792] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-15T17:23:29.726812] [INFO ] [REMOTE ] ATUS: Full fetch complete (71337 records). [2025-10-15T17:23:29.726912] [DEBUG] [VALIDATOR ] ATUS: Validating primary data. [2025-10-15T17:23:30.138325] [DEBUG] [VALIDATOR ] ATUS: All expected trading days are present. [2025-10-15T17:23:30.138412] [DEBUG] [VALIDATOR ] ATUS: Primary data validation passed. [2025-10-15T17:23:30.139336] [INFO ] [MAIN ] ATUS: Fetched primary data is valid. [2025-10-15T17:23:30.139403] [DEBUG] [LOCAL ] ATUS: Saving primary data. [2025-10-15T17:23:30.140889] [DEBUG] [LOCAL ] ATUS: Trimmed 71337 records to 49869 (keeping 200 days of data) [2025-10-15T17:23:30.441384] [DEBUG] [LOCAL ] ATUS: Primary data saved (49869 records). [2025-10-15T17:23:30.441547] [INFO ] [MAIN ] ATUS: Full history saved. [2025-10-15T17:23:30.441705] [INFO ] [MAIN ] Update Progress: 176/2369 symbols completed. ATUS took 39.0s. Estimated remaining: 4h 51m 58s. Rate: 7.5 symbols/min [2025-10-15T17:23:30.515464] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-07. [2025-10-15T17:23:30.650277] [INFO ] [MAIN ] AVA: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:23:30.689598] [DEBUG] [LOCAL ] AVA: Loaded 38899 existing records from primary storage. [2025-10-15T17:23:30.689963] [INFO ] [MAIN ] AVA: Loaded 38899 existing records. [2025-10-15T17:23:30.857775] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-15T17:23:30.932911] [WARN ] [MAIN ] AVA: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:23:30.933133] [INFO ] [MAIN ] AVA: Wiping existing primary data before full refresh. [2025-10-15T17:23:30.933201] [INFO ] [LOCAL ] AVA: Starting deletion of primary data. [2025-10-15T17:23:30.933591] [DEBUG] [LOCAL ] AVA: Deleted primary data file. [2025-10-15T17:23:30.933679] [INFO ] [MAIN ] AVA: Starting full primary refresh. [2025-10-15T17:23:31.266209] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-15T17:23:31.292189] [INFO ] [REMOTE ] AVA: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:23:31.313947] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-08. [2025-10-15T17:23:31.366502] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-15T17:23:31.952724] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-15T17:23:32.113997] [INFO ] [REMOTE ] AVA: Fetching primary data for 2024-12. [2025-10-15T17:23:32.914049] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-09. [2025-10-15T17:23:33.714057] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-05. [2025-10-15T17:23:34.398547] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2024-12 (2.28 seconds). [2025-10-15T17:23:34.514010] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-01. [2025-10-15T17:23:35.314078] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-08. [2025-10-15T17:23:35.619161] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-09 (2.71 seconds). [2025-10-15T17:23:36.114020] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-10. [2025-10-15T17:23:36.219434] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-15T17:23:36.505973] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-05 (2.79 seconds). [2025-10-15T17:23:36.913110] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-15T17:23:36.914679] [INFO ] [REMOTE ] AUNA: Full fetch complete (7795 records). [2025-10-15T17:23:36.914788] [DEBUG] [VALIDATOR ] AUNA: Validating primary data. [2025-10-15T17:23:36.914178] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-02. [2025-10-15T17:23:37.319099] [DEBUG] [VALIDATOR ] AUNA: All expected trading days are present. [2025-10-15T17:23:37.319183] [DEBUG] [VALIDATOR ] AUNA: Primary data validation passed. [2025-10-15T17:23:37.319412] [INFO ] [MAIN ] AUNA: Fetched primary data is valid. [2025-10-15T17:23:37.319451] [DEBUG] [LOCAL ] AUNA: Saving primary data. [2025-10-15T17:23:37.319901] [DEBUG] [LOCAL ] AUNA: Trimmed 7795 records to 5131 (keeping 200 days of data) [2025-10-15T17:23:37.347767] [DEBUG] [LOCAL ] AUNA: Primary data saved (5131 records). [2025-10-15T17:23:37.347880] [INFO ] [MAIN ] AUNA: Full history saved. [2025-10-15T17:23:37.347960] [INFO ] [MAIN ] Update Progress: 177/2369 symbols completed. AUNA took 20.9s. Estimated remaining: 4h 51m 37s. Rate: 7.5 symbols/min [2025-10-15T17:23:37.529993] [INFO ] [MAIN ] AVAL: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:23:37.540302] [DEBUG] [LOCAL ] AVAL: Loaded 8611 existing records from primary storage. [2025-10-15T17:23:37.540540] [INFO ] [MAIN ] AVAL: Loaded 8611 existing records. [2025-10-15T17:23:37.720727] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-06. [2025-10-15T17:23:37.726344] [WARN ] [MAIN ] AVAL: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:23:37.726824] [INFO ] [MAIN ] AVAL: Wiping existing primary data before full refresh. [2025-10-15T17:23:37.728152] [INFO ] [LOCAL ] AVAL: Starting deletion of primary data. [2025-10-15T17:23:37.728437] [DEBUG] [LOCAL ] AVAL: Deleted primary data file. [2025-10-15T17:23:37.728614] [INFO ] [MAIN ] AVAL: Starting full primary refresh. [2025-10-15T17:23:37.944887] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-08 (2.63 seconds). [2025-10-15T17:23:38.150940] [INFO ] [REMOTE ] AVAL: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:23:38.376725] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-15T17:23:38.514006] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-03. [2025-10-15T17:23:39.314075] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-09. [2025-10-15T17:23:39.448590] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-15T17:23:40.020447] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-15T17:23:40.113982] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-07. [2025-10-15T17:23:40.914064] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-04. [2025-10-15T17:23:41.359686] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-10-15T17:23:41.714097] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-10. [2025-10-15T17:23:41.790093] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-15T17:23:41.984537] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-15T17:23:42.514076] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-05. [2025-10-15T17:23:43.314008] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-08. [2025-10-15T17:23:43.553020] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-15T17:23:43.559531] [INFO ] [REMOTE ] AU: Full fetch complete (76541 records). [2025-10-15T17:23:43.559678] [DEBUG] [VALIDATOR ] AU: Validating primary data. [2025-10-15T17:23:43.960665] [DEBUG] [VALIDATOR ] AU: All expected trading days are present. [2025-10-15T17:23:43.960868] [DEBUG] [VALIDATOR ] AU: Primary data validation passed. [2025-10-15T17:23:43.961775] [INFO ] [MAIN ] AU: Fetched primary data is valid. [2025-10-15T17:23:43.982379] [DEBUG] [LOCAL ] AU: Saving primary data. [2025-10-15T17:23:43.984161] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-15T17:23:43.993328] [DEBUG] [LOCAL ] AU: Trimmed 76541 records to 53079 (keeping 200 days of data) [2025-10-15T17:23:44.113986] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-06. [2025-10-15T17:23:44.328767] [DEBUG] [LOCAL ] AU: Primary data saved (53079 records). [2025-10-15T17:23:44.329009] [INFO ] [MAIN ] AU: Full history saved. [2025-10-15T17:23:44.329101] [INFO ] [MAIN ] Update Progress: 178/2369 symbols completed. AU took 37.0s. Estimated remaining: 4h 51m 16s. Rate: 7.5 symbols/min [2025-10-15T17:23:44.519638] [INFO ] [MAIN ] AVB: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:23:44.567310] [DEBUG] [LOCAL ] AVB: Loaded 42213 existing records from primary storage. [2025-10-15T17:23:44.567845] [INFO ] [MAIN ] AVB: Loaded 42213 existing records. [2025-10-15T17:23:44.760113] [WARN ] [MAIN ] AVB: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:23:44.760764] [INFO ] [MAIN ] AVB: Wiping existing primary data before full refresh. [2025-10-15T17:23:44.760916] [INFO ] [LOCAL ] AVB: Starting deletion of primary data. [2025-10-15T17:23:44.761514] [DEBUG] [LOCAL ] AVB: Deleted primary data file. [2025-10-15T17:23:44.761593] [INFO ] [MAIN ] AVB: Starting full primary refresh. [2025-10-15T17:23:44.919183] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2024-12. [2025-10-15T17:23:45.184765] [INFO ] [REMOTE ] AVB: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:23:45.187413] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-15T17:23:45.358122] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-15T17:23:45.619887] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-10-15T17:23:45.714007] [INFO ] [REMOTE ] AVB: Fetching primary data for 2024-12. [2025-10-15T17:23:46.513992] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-01. [2025-10-15T17:23:47.152261] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-15T17:23:47.299090] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-15T17:23:47.313952] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-02. [2025-10-15T17:23:47.988833] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-15T17:23:48.113989] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-09. [2025-10-15T17:23:48.914022] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-03. [2025-10-15T17:23:49.607311] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-15T17:23:49.714004] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-10. [2025-10-15T17:23:49.895288] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-15T17:23:50.514048] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-04. [2025-10-15T17:23:51.260869] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-15T17:23:51.266721] [INFO ] [REMOTE ] AUB: Full fetch complete (66030 records). [2025-10-15T17:23:51.266835] [DEBUG] [VALIDATOR ] AUB: Validating primary data. [2025-10-15T17:23:51.320962] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-07. [2025-10-15T17:23:51.392837] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-15T17:23:51.676964] [DEBUG] [VALIDATOR ] AUB: All expected trading days are present. [2025-10-15T17:23:51.677041] [DEBUG] [VALIDATOR ] AUB: Primary data validation passed. [2025-10-15T17:23:51.677853] [INFO ] [MAIN ] AUB: Fetched primary data is valid. [2025-10-15T17:23:51.677924] [DEBUG] [LOCAL ] AUB: Saving primary data. [2025-10-15T17:23:51.679175] [DEBUG] [LOCAL ] AUB: Trimmed 66030 records to 46010 (keeping 200 days of data) [2025-10-15T17:23:51.947098] [DEBUG] [LOCAL ] AUB: Primary data saved (46010 records). [2025-10-15T17:23:51.947221] [INFO ] [MAIN ] AUB: Full history saved. [2025-10-15T17:23:51.947543] [INFO ] [MAIN ] Update Progress: 179/2369 symbols completed. AUB took 37.4s. Estimated remaining: 4h 51m 4s. Rate: 7.5 symbols/min [2025-10-15T17:23:52.119495] [INFO ] [MAIN ] AVBC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:23:52.119793] [DEBUG] [LOCAL ] AVBC: No existing data file found in primary storage. [2025-10-15T17:23:52.117987] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-05. [2025-10-15T17:23:52.119868] [WARN ] [MAIN ] AVBC: No existing data found, performing full refresh instead. [2025-10-15T17:23:52.121005] [INFO ] [MAIN ] AVBC: Wiping existing primary data before full refresh. [2025-10-15T17:23:52.121050] [INFO ] [LOCAL ] AVBC: Starting deletion of primary data. [2025-10-15T17:23:52.121093] [DEBUG] [LOCAL ] AVBC: No primary data file found to delete. [2025-10-15T17:23:52.121125] [INFO ] [MAIN ] AVBC: Starting full primary refresh. [2025-10-15T17:23:52.501972] [INFO ] [REMOTE ] AVBC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:23:52.801384] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-15T17:23:52.913973] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-08. [2025-10-15T17:23:52.968161] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-15T17:23:53.714001] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-01. [2025-10-15T17:23:54.299224] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-15T17:23:54.514011] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-09. [2025-10-15T17:23:55.314110] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-06. [2025-10-15T17:23:55.357398] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-15T17:23:55.894551] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-15T17:23:55.961446] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-15T17:23:56.113983] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-10. [2025-10-15T17:23:56.914030] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-02. [2025-10-15T17:23:57.714068] [INFO ] [REMOTE ] AVBC: Fetching primary data for 2024-12. [2025-10-15T17:23:58.111260] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-10 (2.00 seconds). [2025-10-15T17:23:58.115676] [INFO ] [REMOTE ] AVA: Full fetch complete (55532 records). [2025-10-15T17:23:58.115809] [DEBUG] [VALIDATOR ] AVA: Validating primary data. [2025-10-15T17:23:58.161796] [DEBUG] [REMOTE ] AVBC: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-15T17:23:58.195305] [WARN ] [REMOTE ] AVBC: No data returned for month 2024-12 [2025-10-15T17:23:58.219461] [FATAL] [REMOTE ] AVBC: API call failed - aborting fetch to avoid wasting further API calls [2025-10-15T17:23:58.221872] [FATAL] [MAIN ] AVBC: Failed to fetch primary data. [2025-10-15T17:23:58.221993] [WARN ] [MAIN ] AVBC: Deleting existing primary and derivative data due to fetch failure. [2025-10-15T17:23:58.222072] [INFO ] [LOCAL ] AVBC: Starting deletion of primary data. [2025-10-15T17:23:58.232961] [DEBUG] [LOCAL ] AVBC: No primary data file found to delete. [2025-10-15T17:23:58.243291] [INFO ] [LOCAL ] AVBC: Starting deletion of derivative data. [2025-10-15T17:23:58.272163] [DEBUG] [LOCAL ] AVBC: No derivative data file found to delete. [2025-10-15T17:23:58.281920] [INFO ] [MAIN ] Update Progress: 180/2369 symbols completed. AVBC took 6.3s. Estimated remaining: 4h 50m 36s. Rate: 7.5 symbols/min [2025-10-15T17:23:58.516474] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-07. [2025-10-15T17:23:58.718488] [INFO ] [MAIN ] AVD: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:23:58.755700] [DEBUG] [VALIDATOR ] AVA: All expected trading days are present. [2025-10-15T17:23:58.755875] [DEBUG] [VALIDATOR ] AVA: Primary data validation passed. [2025-10-15T17:23:58.757191] [INFO ] [MAIN ] AVA: Fetched primary data is valid. [2025-10-15T17:23:58.757294] [DEBUG] [LOCAL ] AVA: Saving primary data. [2025-10-15T17:23:58.758812] [DEBUG] [LOCAL ] AVA: Trimmed 55532 records to 38779 (keeping 200 days of data) [2025-10-15T17:23:58.867507] [DEBUG] [LOCAL ] AVD: Loaded 21954 existing records from primary storage. [2025-10-15T17:23:58.869249] [INFO ] [MAIN ] AVD: Loaded 21954 existing records. [2025-10-15T17:23:59.095318] [WARN ] [MAIN ] AVD: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:23:59.098048] [INFO ] [MAIN ] AVD: Wiping existing primary data before full refresh. [2025-10-15T17:23:59.098222] [INFO ] [LOCAL ] AVD: Starting deletion of primary data. [2025-10-15T17:23:59.104247] [DEBUG] [LOCAL ] AVD: Deleted primary data file. [2025-10-15T17:23:59.104553] [INFO ] [MAIN ] AVD: Starting full primary refresh. [2025-10-15T17:23:59.231430] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-15T17:23:59.328727] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-08. [2025-10-15T17:23:59.342383] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-02 (2.43 seconds). [2025-10-15T17:23:59.560089] [DEBUG] [LOCAL ] AVA: Primary data saved (38779 records). [2025-10-15T17:23:59.576002] [INFO ] [MAIN ] AVA: Full history saved. [2025-10-15T17:23:59.586447] [INFO ] [MAIN ] Update Progress: 181/2369 symbols completed. AVA took 29.1s. Estimated remaining: 4h 49m 8s. Rate: 7.6 symbols/min [2025-10-15T17:23:59.756120] [INFO ] [REMOTE ] AVD: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:23:59.841591] [INFO ] [MAIN ] AVK: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:23:59.863400] [DEBUG] [LOCAL ] AVK: Loaded 18602 existing records from primary storage. [2025-10-15T17:23:59.863790] [INFO ] [MAIN ] AVK: Loaded 18602 existing records. [2025-10-15T17:24:00.047467] [WARN ] [MAIN ] AVK: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:24:00.047843] [INFO ] [MAIN ] AVK: Wiping existing primary data before full refresh. [2025-10-15T17:24:00.047897] [INFO ] [LOCAL ] AVK: Starting deletion of primary data. [2025-10-15T17:24:00.048190] [DEBUG] [LOCAL ] AVK: Deleted primary data file. [2025-10-15T17:24:00.048230] [INFO ] [MAIN ] AVK: Starting full primary refresh. [2025-10-15T17:24:00.127300] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-03. [2025-10-15T17:24:00.147742] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-15T17:24:00.433206] [INFO ] [REMOTE ] AVK: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:24:00.914050] [INFO ] [REMOTE ] AVD: Fetching primary data for 2024-12. [2025-10-15T17:24:01.721102] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-09. [2025-10-15T17:24:01.726046] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-15T17:24:01.823230] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-10-15T17:24:02.289270] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-15T17:24:02.514016] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-10. [2025-10-15T17:24:03.213885] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-15T17:24:03.215563] [INFO ] [REMOTE ] AVAL: Full fetch complete (14909 records). [2025-10-15T17:24:03.215637] [DEBUG] [VALIDATOR ] AVAL: Validating primary data. [2025-10-15T17:24:03.314197] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-04. [2025-10-15T17:24:03.575175] [DEBUG] [VALIDATOR ] AVAL: All expected trading days are present. [2025-10-15T17:24:03.575253] [DEBUG] [VALIDATOR ] AVAL: Primary data validation passed. [2025-10-15T17:24:03.575576] [INFO ] [MAIN ] AVAL: Fetched primary data is valid. [2025-10-15T17:24:03.575614] [DEBUG] [LOCAL ] AVAL: Saving primary data. [2025-10-15T17:24:03.576101] [DEBUG] [LOCAL ] AVAL: Trimmed 14909 records to 8592 (keeping 200 days of data) [2025-10-15T17:24:03.626560] [DEBUG] [LOCAL ] AVAL: Primary data saved (8592 records). [2025-10-15T17:24:03.626716] [INFO ] [MAIN ] AVAL: Full history saved. [2025-10-15T17:24:03.626805] [INFO ] [MAIN ] Update Progress: 182/2369 symbols completed. AVAL took 26.3s. Estimated remaining: 4h 48m 13s. Rate: 7.6 symbols/min [2025-10-15T17:24:03.796260] [INFO ] [MAIN ] AVNS: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:24:03.831472] [DEBUG] [LOCAL ] AVNS: Loaded 33614 existing records from primary storage. [2025-10-15T17:24:03.831803] [INFO ] [MAIN ] AVNS: Loaded 33614 existing records. [2025-10-15T17:24:04.013802] [WARN ] [MAIN ] AVNS: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:24:04.014001] [INFO ] [MAIN ] AVNS: Wiping existing primary data before full refresh. [2025-10-15T17:24:04.014050] [INFO ] [LOCAL ] AVNS: Starting deletion of primary data. [2025-10-15T17:24:04.014388] [DEBUG] [LOCAL ] AVNS: Deleted primary data file. [2025-10-15T17:24:04.014429] [INFO ] [MAIN ] AVNS: Starting full primary refresh. [2025-10-15T17:24:04.115902] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-01. [2025-10-15T17:24:04.368092] [INFO ] [REMOTE ] AVNS: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:24:04.913958] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2024-12. [2025-10-15T17:24:05.099420] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-15T17:24:05.318895] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-15T17:24:05.714000] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-05. [2025-10-15T17:24:06.182235] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-15T17:24:06.514008] [INFO ] [REMOTE ] AVK: Fetching primary data for 2024-12. [2025-10-15T17:24:07.313996] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-02. [2025-10-15T17:24:07.423358] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-15T17:24:07.476170] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-10-15T17:24:08.114003] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-06. [2025-10-15T17:24:08.174091] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-15T17:24:08.914000] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-03. [2025-10-15T17:24:09.713958] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-01. [2025-10-15T17:24:09.744921] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-15T17:24:10.173343] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-15T17:24:10.513962] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-01. [2025-10-15T17:24:10.755765] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-15T17:24:11.313993] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-02. [2025-10-15T17:24:12.113999] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-07. [2025-10-15T17:24:12.176063] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-15T17:24:12.296862] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-15T17:24:12.914057] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-03. [2025-10-15T17:24:13.714131] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-02. [2025-10-15T17:24:14.250248] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-07 (2.14 seconds). [2025-10-15T17:24:14.298064] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-15T17:24:14.514060] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-08. [2025-10-15T17:24:14.761328] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-15T17:24:15.314060] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-04. [2025-10-15T17:24:16.114029] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-04. [2025-10-15T17:24:16.177281] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-15T17:24:16.592306] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-15T17:24:16.913962] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-05. [2025-10-15T17:24:16.943122] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-15T17:24:17.714013] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-05. [2025-10-15T17:24:17.975466] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-15T17:24:18.514020] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-06. [2025-10-15T17:24:18.678273] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-15T17:24:19.313965] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-06. [2025-10-15T17:24:19.573299] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-15T17:24:20.113968] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-09. [2025-10-15T17:24:20.268933] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-15T17:24:20.914007] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-07. [2025-10-15T17:24:21.714043] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-03. [2025-10-15T17:24:21.876460] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-15T17:24:21.960985] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-15T17:24:22.513996] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-10. [2025-10-15T17:24:23.080320] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-15T17:24:23.314029] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-04. [2025-10-15T17:24:23.879980] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-15T17:24:23.884518] [INFO ] [REMOTE ] AVB: Full fetch complete (58688 records). [2025-10-15T17:24:23.884612] [DEBUG] [VALIDATOR ] AVB: Validating primary data. [2025-10-15T17:24:23.885343] [FATAL] [VALIDATOR ] AVB: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T17:24:23.885426] [FATAL] [MAIN ] AVB: Fetched primary data is invalid. Refusing to save it. [2025-10-15T17:24:23.885467] [WARN ] [MAIN ] AVB: Deleting existing primary and derivative data due to validation failure. [2025-10-15T17:24:23.885505] [INFO ] [LOCAL ] AVB: Starting deletion of primary data. [2025-10-15T17:24:23.885560] [DEBUG] [LOCAL ] AVB: No primary data file found to delete. [2025-10-15T17:24:23.885593] [INFO ] [LOCAL ] AVB: Starting deletion of derivative data. [2025-10-15T17:24:23.885798] [DEBUG] [LOCAL ] AVB: Deleted derivative data file. [2025-10-15T17:24:23.885886] [INFO ] [MAIN ] Update Progress: 183/2369 symbols completed. AVB took 39.6s. Estimated remaining: 4h 50m 33s. Rate: 7.5 symbols/min [2025-10-15T17:24:24.052440] [INFO ] [MAIN ] AVNT: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:24:24.089361] [DEBUG] [LOCAL ] AVNT: Loaded 39087 existing records from primary storage. [2025-10-15T17:24:24.089630] [INFO ] [MAIN ] AVNT: Loaded 39087 existing records. [2025-10-15T17:24:24.119461] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-07. [2025-10-15T17:24:24.267976] [WARN ] [MAIN ] AVNT: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:24:24.268179] [INFO ] [MAIN ] AVNT: Wiping existing primary data before full refresh. [2025-10-15T17:24:24.268226] [INFO ] [LOCAL ] AVNT: Starting deletion of primary data. [2025-10-15T17:24:24.268674] [DEBUG] [LOCAL ] AVNT: Deleted primary data file. [2025-10-15T17:24:24.268731] [INFO ] [MAIN ] AVNT: Starting full primary refresh. [2025-10-15T17:24:24.615160] [INFO ] [REMOTE ] AVNT: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:24:24.721942] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-15T17:24:24.913966] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2024-12. [2025-10-15T17:24:25.713979] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-05. [2025-10-15T17:24:25.816783] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-15T17:24:26.326696] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-15T17:24:26.514006] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-08. [2025-10-15T17:24:27.313979] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-01. [2025-10-15T17:24:27.332808] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-15T17:24:27.416472] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-15T17:24:28.114021] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-08. [2025-10-15T17:24:28.636050] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-15T17:24:28.914004] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-02. [2025-10-15T17:24:29.242871] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-15T17:24:29.713999] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-06. [2025-10-15T17:24:30.041184] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-15T17:24:30.514004] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-09. [2025-10-15T17:24:30.966872] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-15T17:24:31.203684] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-10-15T17:24:31.313980] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-10. [2025-10-15T17:24:32.113996] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-07. [2025-10-15T17:24:32.441030] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-15T17:24:32.443420] [INFO ] [REMOTE ] AVD: Full fetch complete (32903 records). [2025-10-15T17:24:32.443513] [DEBUG] [VALIDATOR ] AVD: Validating primary data. [2025-10-15T17:24:32.804632] [DEBUG] [VALIDATOR ] AVD: All expected trading days are present. [2025-10-15T17:24:32.804742] [DEBUG] [VALIDATOR ] AVD: Primary data validation passed. [2025-10-15T17:24:32.805205] [INFO ] [MAIN ] AVD: Fetched primary data is valid. [2025-10-15T17:24:32.805246] [DEBUG] [LOCAL ] AVD: Saving primary data. [2025-10-15T17:24:32.806012] [DEBUG] [LOCAL ] AVD: Trimmed 32903 records to 21808 (keeping 200 days of data) [2025-10-15T17:24:32.921379] [DEBUG] [LOCAL ] AVD: Primary data saved (21808 records). [2025-10-15T17:24:32.921490] [INFO ] [MAIN ] AVD: Full history saved. [2025-10-15T17:24:32.921603] [INFO ] [MAIN ] Update Progress: 184/2369 symbols completed. AVD took 34.6s. Estimated remaining: 4h 50m 37s. Rate: 7.5 symbols/min [2025-10-15T17:24:32.916013] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-03. [2025-10-15T17:24:33.096546] [INFO ] [MAIN ] AVTR: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:24:33.148603] [DEBUG] [LOCAL ] AVTR: Loaded 53571 existing records from primary storage. [2025-10-15T17:24:33.149170] [INFO ] [MAIN ] AVTR: Loaded 53571 existing records. [2025-10-15T17:24:33.279062] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-15T17:24:33.365199] [WARN ] [MAIN ] AVTR: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:24:33.365420] [INFO ] [MAIN ] AVTR: Wiping existing primary data before full refresh. [2025-10-15T17:24:33.365473] [INFO ] [LOCAL ] AVTR: Starting deletion of primary data. [2025-10-15T17:24:33.365984] [DEBUG] [LOCAL ] AVTR: Deleted primary data file. [2025-10-15T17:24:33.366046] [INFO ] [MAIN ] AVTR: Starting full primary refresh. [2025-10-15T17:24:33.711014] [INFO ] [REMOTE ] AVTR: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:24:33.713951] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2024-12. [2025-10-15T17:24:34.519185] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-08. [2025-10-15T17:24:34.544746] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-15T17:24:35.314044] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-04. [2025-10-15T17:24:35.436577] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-15T17:24:35.680903] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-15T17:24:36.114082] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-09. [2025-10-15T17:24:36.848967] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-15T17:24:36.914002] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-09. [2025-10-15T17:24:37.712144] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-15T17:24:37.718983] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-01. [2025-10-15T17:24:38.045512] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-15T17:24:38.513998] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-10. [2025-10-15T17:24:39.313969] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-10. [2025-10-15T17:24:39.413547] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-15T17:24:39.452908] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-15T17:24:39.455970] [INFO ] [REMOTE ] AVK: Full fetch complete (26678 records). [2025-10-15T17:24:39.456046] [DEBUG] [VALIDATOR ] AVK: Validating primary data. [2025-10-15T17:24:39.819093] [DEBUG] [VALIDATOR ] AVK: All expected trading days are present. [2025-10-15T17:24:39.819167] [DEBUG] [VALIDATOR ] AVK: Primary data validation passed. [2025-10-15T17:24:39.819693] [INFO ] [MAIN ] AVK: Fetched primary data is valid. [2025-10-15T17:24:39.819754] [DEBUG] [LOCAL ] AVK: Saving primary data. [2025-10-15T17:24:39.820442] [DEBUG] [LOCAL ] AVK: Trimmed 26678 records to 18628 (keeping 200 days of data) [2025-10-15T17:24:39.929751] [DEBUG] [LOCAL ] AVK: Primary data saved (18628 records). [2025-10-15T17:24:39.929896] [INFO ] [MAIN ] AVK: Full history saved. [2025-10-15T17:24:39.929973] [INFO ] [MAIN ] Update Progress: 185/2369 symbols completed. AVK took 40.3s. Estimated remaining: 4h 50m 18s. Rate: 7.5 symbols/min [2025-10-15T17:24:40.104607] [INFO ] [MAIN ] AVY: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:24:40.104955] [DEBUG] [LOCAL ] AVY: No existing data file found in primary storage. [2025-10-15T17:24:40.105004] [WARN ] [MAIN ] AVY: No existing data found, performing full refresh instead. [2025-10-15T17:24:40.105144] [INFO ] [MAIN ] AVY: Wiping existing primary data before full refresh. [2025-10-15T17:24:40.105202] [INFO ] [LOCAL ] AVY: Starting deletion of primary data. [2025-10-15T17:24:40.105286] [DEBUG] [LOCAL ] AVY: No primary data file found to delete. [2025-10-15T17:24:40.105331] [INFO ] [MAIN ] AVY: Starting full primary refresh. [2025-10-15T17:24:40.119195] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-02. [2025-10-15T17:24:40.460191] [INFO ] [REMOTE ] AVY: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:24:40.655761] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-15T17:24:40.659881] [INFO ] [REMOTE ] AVNS: Full fetch complete (48410 records). [2025-10-15T17:24:40.659962] [DEBUG] [VALIDATOR ] AVNS: Validating primary data. [2025-10-15T17:24:40.914105] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-05. [2025-10-15T17:24:41.045043] [DEBUG] [VALIDATOR ] AVNS: All expected trading days are present. [2025-10-15T17:24:41.045129] [DEBUG] [VALIDATOR ] AVNS: Primary data validation passed. [2025-10-15T17:24:41.045868] [INFO ] [MAIN ] AVNS: Fetched primary data is valid. [2025-10-15T17:24:41.045931] [DEBUG] [LOCAL ] AVNS: Saving primary data. [2025-10-15T17:24:41.047018] [DEBUG] [LOCAL ] AVNS: Trimmed 48410 records to 33666 (keeping 200 days of data) [2025-10-15T17:24:41.251088] [DEBUG] [LOCAL ] AVNS: Primary data saved (33666 records). [2025-10-15T17:24:41.251222] [INFO ] [MAIN ] AVNS: Full history saved. [2025-10-15T17:24:41.251300] [INFO ] [MAIN ] Update Progress: 186/2369 symbols completed. AVNS took 37.6s. Estimated remaining: 4h 48m 52s. Rate: 7.6 symbols/min [2025-10-15T17:24:41.419681] [INFO ] [MAIN ] AWF: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:24:41.443717] [DEBUG] [LOCAL ] AWF: Loaded 23950 existing records from primary storage. [2025-10-15T17:24:41.443990] [INFO ] [MAIN ] AWF: Loaded 23950 existing records. [2025-10-15T17:24:41.630775] [WARN ] [MAIN ] AWF: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:24:41.631109] [INFO ] [MAIN ] AWF: Wiping existing primary data before full refresh. [2025-10-15T17:24:41.631165] [INFO ] [LOCAL ] AWF: Starting deletion of primary data. [2025-10-15T17:24:41.631604] [DEBUG] [LOCAL ] AWF: Deleted primary data file. [2025-10-15T17:24:41.631701] [INFO ] [MAIN ] AWF: Starting full primary refresh. [2025-10-15T17:24:41.720151] [INFO ] [REMOTE ] AVY: Fetching primary data for 2024-12. [2025-10-15T17:24:41.991569] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-10-15T17:24:42.031346] [INFO ] [REMOTE ] AWF: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:24:42.346680] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-15T17:24:42.514015] [INFO ] [REMOTE ] AWF: Fetching primary data for 2024-12. [2025-10-15T17:24:43.314025] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-06. [2025-10-15T17:24:43.369211] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-15T17:24:43.819897] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-15T17:24:44.114010] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-01. [2025-10-15T17:24:44.859862] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-15T17:24:44.913959] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-07. [2025-10-15T17:24:45.658968] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-15T17:24:45.713977] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-01. [2025-10-15T17:24:46.407189] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-15T17:24:46.514006] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-08. [2025-10-15T17:24:46.686555] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-15T17:24:47.313980] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-02. [2025-10-15T17:24:47.937110] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-15T17:24:48.114022] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-09. [2025-10-15T17:24:48.484145] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-15T17:24:48.913989] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-03. [2025-10-15T17:24:49.319146] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-15T17:24:49.714057] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-02. [2025-10-15T17:24:50.513964] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-03. [2025-10-15T17:24:50.732193] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-15T17:24:51.289740] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-15T17:24:51.313994] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-04. [2025-10-15T17:24:51.747511] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-15T17:24:52.114014] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-03. [2025-10-15T17:24:52.914019] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-10. [2025-10-15T17:24:53.356496] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-15T17:24:53.494505] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-15T17:24:53.713998] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-04. [2025-10-15T17:24:54.019172] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-15T17:24:54.025871] [INFO ] [REMOTE ] AVNT: Full fetch complete (56396 records). [2025-10-15T17:24:54.026104] [DEBUG] [VALIDATOR ] AVNT: Validating primary data. [2025-10-15T17:24:54.461939] [DEBUG] [VALIDATOR ] AVNT: All expected trading days are present. [2025-10-15T17:24:54.462045] [DEBUG] [VALIDATOR ] AVNT: Primary data validation passed. [2025-10-15T17:24:54.462833] [INFO ] [MAIN ] AVNT: Fetched primary data is valid. [2025-10-15T17:24:54.462906] [DEBUG] [LOCAL ] AVNT: Saving primary data. [2025-10-15T17:24:54.464509] [DEBUG] [LOCAL ] AVNT: Trimmed 56396 records to 39045 (keeping 200 days of data) [2025-10-15T17:24:54.520339] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-04. [2025-10-15T17:24:54.719868] [DEBUG] [LOCAL ] AVNT: Primary data saved (39045 records). [2025-10-15T17:24:54.720088] [INFO ] [MAIN ] AVNT: Full history saved. [2025-10-15T17:24:54.720216] [INFO ] [MAIN ] Update Progress: 187/2369 symbols completed. AVNT took 30.8s. Estimated remaining: 4h 49m 48s. Rate: 7.5 symbols/min [2025-10-15T17:24:54.896859] [INFO ] [MAIN ] AWI: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:24:54.933758] [DEBUG] [LOCAL ] AWI: Loaded 25384 existing records from primary storage. [2025-10-15T17:24:54.934910] [INFO ] [MAIN ] AWI: Loaded 25384 existing records. [2025-10-15T17:24:55.133487] [WARN ] [MAIN ] AWI: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:24:55.134074] [INFO ] [MAIN ] AWI: Wiping existing primary data before full refresh. [2025-10-15T17:24:55.134161] [INFO ] [LOCAL ] AWI: Starting deletion of primary data. [2025-10-15T17:24:55.135070] [DEBUG] [LOCAL ] AWI: Deleted primary data file. [2025-10-15T17:24:55.135133] [INFO ] [MAIN ] AWI: Starting full primary refresh. [2025-10-15T17:24:55.325740] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-05. [2025-10-15T17:24:55.607151] [INFO ] [REMOTE ] AWI: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:24:55.634165] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-15T17:24:55.683827] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-15T17:24:56.113994] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-05. [2025-10-15T17:24:56.914058] [INFO ] [REMOTE ] AWI: Fetching primary data for 2024-12. [2025-10-15T17:24:57.146712] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-15T17:24:57.399705] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-15T17:24:57.714070] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-06. [2025-10-15T17:24:57.865082] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-10-15T17:24:58.514043] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-01. [2025-10-15T17:24:59.066313] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-15T17:24:59.313980] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-05. [2025-10-15T17:24:59.472562] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-15T17:25:00.113992] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-02. [2025-10-15T17:25:00.192962] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-15T17:25:00.914023] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-06. [2025-10-15T17:25:01.244224] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-15T17:25:01.714083] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-03. [2025-10-15T17:25:02.100848] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-15T17:25:02.514024] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-07. [2025-10-15T17:25:03.064294] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-15T17:25:03.314028] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-04. [2025-10-15T17:25:03.764932] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-15T17:25:04.114040] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-08. [2025-10-15T17:25:04.593542] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-15T17:25:04.914022] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-07. [2025-10-15T17:25:05.000354] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-15T17:25:05.714037] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-05. [2025-10-15T17:25:06.410796] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-15T17:25:06.513987] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-06. [2025-10-15T17:25:06.897937] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-15T17:25:07.314013] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-06. [2025-10-15T17:25:08.114021] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-09. [2025-10-15T17:25:08.242262] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-15T17:25:08.271066] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-15T17:25:08.914005] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-07. [2025-10-15T17:25:09.339493] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-15T17:25:09.714025] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-08. [2025-10-15T17:25:09.918008] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-15T17:25:10.514005] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-07. [2025-10-15T17:25:10.966464] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-15T17:25:11.314078] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-08. [2025-10-15T17:25:12.114011] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-09. [2025-10-15T17:25:12.457483] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-15T17:25:12.635209] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-15T17:25:12.914045] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-08. [2025-10-15T17:25:13.714062] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-09. [2025-10-15T17:25:13.781200] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-15T17:25:14.516751] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-10. [2025-10-15T17:25:14.520066] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-15T17:25:14.803067] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-15T17:25:15.313955] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-10. [2025-10-15T17:25:15.425862] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-15T17:25:15.430216] [INFO ] [REMOTE ] AWF: Full fetch complete (35523 records). [2025-10-15T17:25:15.430311] [DEBUG] [VALIDATOR ] AWF: Validating primary data. [2025-10-15T17:25:15.431004] [FATAL] [VALIDATOR ] AWF: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T17:25:15.431099] [FATAL] [MAIN ] AWF: Fetched primary data is invalid. Refusing to save it. [2025-10-15T17:25:15.431149] [WARN ] [MAIN ] AWF: Deleting existing primary and derivative data due to validation failure. [2025-10-15T17:25:15.431198] [INFO ] [LOCAL ] AWF: Starting deletion of primary data. [2025-10-15T17:25:15.431285] [DEBUG] [LOCAL ] AWF: No primary data file found to delete. [2025-10-15T17:25:15.431342] [INFO ] [LOCAL ] AWF: Starting deletion of derivative data. [2025-10-15T17:25:15.431563] [DEBUG] [LOCAL ] AWF: Deleted derivative data file. [2025-10-15T17:25:15.431693] [INFO ] [MAIN ] Update Progress: 188/2369 symbols completed. AWF took 34.2s. Estimated remaining: 4h 52m 8s. Rate: 7.5 symbols/min [2025-10-15T17:25:15.601126] [INFO ] [MAIN ] AWK: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:25:15.654225] [DEBUG] [LOCAL ] AWK: Loaded 48593 existing records from primary storage. [2025-10-15T17:25:15.654568] [INFO ] [MAIN ] AWK: Loaded 48593 existing records. [2025-10-15T17:25:15.827978] [WARN ] [MAIN ] AWK: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:25:15.828188] [INFO ] [MAIN ] AWK: Wiping existing primary data before full refresh. [2025-10-15T17:25:15.828235] [INFO ] [LOCAL ] AWK: Starting deletion of primary data. [2025-10-15T17:25:15.828725] [DEBUG] [LOCAL ] AWK: Deleted primary data file. [2025-10-15T17:25:15.828780] [INFO ] [MAIN ] AWK: Starting full primary refresh. [2025-10-15T17:25:16.115483] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-10. [2025-10-15T17:25:16.195794] [INFO ] [REMOTE ] AWK: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:25:16.389737] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-15T17:25:16.393059] [INFO ] [REMOTE ] AWI: Full fetch complete (35787 records). [2025-10-15T17:25:16.393142] [DEBUG] [VALIDATOR ] AWI: Validating primary data. [2025-10-15T17:25:16.393685] [FATAL] [VALIDATOR ] AWI: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T17:25:16.393764] [FATAL] [MAIN ] AWI: Fetched primary data is invalid. Refusing to save it. [2025-10-15T17:25:16.393828] [WARN ] [MAIN ] AWI: Deleting existing primary and derivative data due to validation failure. [2025-10-15T17:25:16.393896] [INFO ] [LOCAL ] AWI: Starting deletion of primary data. [2025-10-15T17:25:16.393959] [DEBUG] [LOCAL ] AWI: No primary data file found to delete. [2025-10-15T17:25:16.393993] [INFO ] [LOCAL ] AWI: Starting deletion of derivative data. [2025-10-15T17:25:16.394147] [DEBUG] [LOCAL ] AWI: Deleted derivative data file. [2025-10-15T17:25:16.394250] [INFO ] [MAIN ] Update Progress: 189/2369 symbols completed. AWI took 21.7s. Estimated remaining: 4h 50m 38s. Rate: 7.5 symbols/min [2025-10-15T17:25:16.560891] [INFO ] [MAIN ] AWP: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:25:16.581672] [DEBUG] [LOCAL ] AWP: Loaded 21577 existing records from primary storage. [2025-10-15T17:25:16.581945] [INFO ] [MAIN ] AWP: Loaded 21577 existing records. [2025-10-15T17:25:16.759521] [WARN ] [MAIN ] AWP: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:25:16.759771] [INFO ] [MAIN ] AWP: Wiping existing primary data before full refresh. [2025-10-15T17:25:16.759824] [INFO ] [LOCAL ] AWP: Starting deletion of primary data. [2025-10-15T17:25:16.760103] [DEBUG] [LOCAL ] AWP: Deleted primary data file. [2025-10-15T17:25:16.760158] [INFO ] [MAIN ] AWP: Starting full primary refresh. [2025-10-15T17:25:16.917213] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-09. [2025-10-15T17:25:17.135359] [INFO ] [REMOTE ] AWP: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:25:17.554578] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-15T17:25:17.559529] [INFO ] [REMOTE ] AVY: Full fetch complete (56300 records). [2025-10-15T17:25:17.559664] [DEBUG] [VALIDATOR ] AVY: Validating primary data. [2025-10-15T17:25:17.560369] [FATAL] [VALIDATOR ] AVY: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T17:25:17.560479] [FATAL] [MAIN ] AVY: Fetched primary data is invalid. Refusing to save it. [2025-10-15T17:25:17.560551] [WARN ] [MAIN ] AVY: Deleting existing primary and derivative data due to validation failure. [2025-10-15T17:25:17.560667] [INFO ] [LOCAL ] AVY: Starting deletion of primary data. [2025-10-15T17:25:17.560752] [DEBUG] [LOCAL ] AVY: No primary data file found to delete. [2025-10-15T17:25:17.560790] [INFO ] [LOCAL ] AVY: Starting deletion of derivative data. [2025-10-15T17:25:17.560831] [DEBUG] [LOCAL ] AVY: No derivative data file found to delete. [2025-10-15T17:25:17.560886] [INFO ] [MAIN ] Update Progress: 190/2369 symbols completed. AVY took 37.6s. Estimated remaining: 4h 49m 12s. Rate: 7.5 symbols/min [2025-10-15T17:25:17.715370] [INFO ] [REMOTE ] AWK: Fetching primary data for 2024-12. [2025-10-15T17:25:17.740141] [INFO ] [MAIN ] AWR: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:25:17.762388] [DEBUG] [LOCAL ] AWR: Loaded 22835 existing records from primary storage. [2025-10-15T17:25:17.762675] [INFO ] [MAIN ] AWR: Loaded 22835 existing records. [2025-10-15T17:25:17.943669] [WARN ] [MAIN ] AWR: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:25:17.943889] [INFO ] [MAIN ] AWR: Wiping existing primary data before full refresh. [2025-10-15T17:25:17.943937] [INFO ] [LOCAL ] AWR: Starting deletion of primary data. [2025-10-15T17:25:17.944214] [DEBUG] [LOCAL ] AWR: Deleted primary data file. [2025-10-15T17:25:17.944269] [INFO ] [MAIN ] AWR: Starting full primary refresh. [2025-10-15T17:25:18.298081] [INFO ] [REMOTE ] AWR: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:25:18.514029] [INFO ] [REMOTE ] AWP: Fetching primary data for 2024-12. [2025-10-15T17:25:18.877244] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-10-15T17:25:19.249277] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-15T17:25:19.313959] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-01. [2025-10-15T17:25:19.609364] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-15T17:25:20.113991] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-01. [2025-10-15T17:25:20.913965] [INFO ] [REMOTE ] AWR: Fetching primary data for 2024-12. [2025-10-15T17:25:20.976229] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-15T17:25:21.089851] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-15T17:25:21.713979] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-02. [2025-10-15T17:25:21.950240] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-10-15T17:25:22.514063] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-01. [2025-10-15T17:25:23.299866] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-15T17:25:23.313941] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-03. [2025-10-15T17:25:23.398822] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-15T17:25:24.113996] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-02. [2025-10-15T17:25:24.913994] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-10. [2025-10-15T17:25:25.195164] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-15T17:25:25.232718] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-15T17:25:25.713998] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-03. [2025-10-15T17:25:26.514056] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-02. [2025-10-15T17:25:26.550876] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-15T17:25:26.562053] [INFO ] [REMOTE ] AVTR: Full fetch complete (77634 records). [2025-10-15T17:25:26.562281] [DEBUG] [VALIDATOR ] AVTR: Validating primary data. [2025-10-15T17:25:26.917737] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-15T17:25:26.999253] [DEBUG] [VALIDATOR ] AVTR: All expected trading days are present. [2025-10-15T17:25:26.999343] [DEBUG] [VALIDATOR ] AVTR: Primary data validation passed. [2025-10-15T17:25:27.000362] [INFO ] [MAIN ] AVTR: Fetched primary data is valid. [2025-10-15T17:25:27.000438] [DEBUG] [LOCAL ] AVTR: Saving primary data. [2025-10-15T17:25:27.002046] [DEBUG] [LOCAL ] AVTR: Trimmed 77634 records to 53572 (keeping 200 days of data) [2025-10-15T17:25:27.312786] [DEBUG] [LOCAL ] AVTR: Primary data saved (53572 records). [2025-10-15T17:25:27.312926] [INFO ] [MAIN ] AVTR: Full history saved. [2025-10-15T17:25:27.313242] [INFO ] [MAIN ] Update Progress: 191/2369 symbols completed. AVTR took 54.4s. Estimated remaining: 4h 49m 25s. Rate: 7.5 symbols/min [2025-10-15T17:25:27.324737] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-04. [2025-10-15T17:25:27.487144] [INFO ] [MAIN ] AX: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:25:27.517050] [DEBUG] [LOCAL ] AX: Loaded 28003 existing records from primary storage. [2025-10-15T17:25:27.517318] [INFO ] [MAIN ] AX: Loaded 28003 existing records. [2025-10-15T17:25:27.695921] [WARN ] [MAIN ] AX: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:25:27.696219] [INFO ] [MAIN ] AX: Wiping existing primary data before full refresh. [2025-10-15T17:25:27.696344] [INFO ] [LOCAL ] AX: Starting deletion of primary data. [2025-10-15T17:25:27.701892] [DEBUG] [LOCAL ] AX: Deleted primary data file. [2025-10-15T17:25:27.707536] [INFO ] [MAIN ] AX: Starting full primary refresh. [2025-10-15T17:25:27.707923] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-15T17:25:28.060590] [INFO ] [REMOTE ] AX: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:25:28.113992] [INFO ] [REMOTE ] AX: Fetching primary data for 2024-12. [2025-10-15T17:25:28.670831] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-15T17:25:28.914001] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-05. [2025-10-15T17:25:29.356633] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-15T17:25:29.714026] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-04. [2025-10-15T17:25:30.009440] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-15T17:25:30.514019] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-06. [2025-10-15T17:25:31.314049] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-03. [2025-10-15T17:25:31.464538] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-15T17:25:31.501003] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-15T17:25:32.114025] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-07. [2025-10-15T17:25:32.429836] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-15T17:25:32.913963] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-01. [2025-10-15T17:25:33.123051] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-15T17:25:33.714034] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-04. [2025-10-15T17:25:34.080997] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-15T17:25:34.514072] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-08. [2025-10-15T17:25:34.943509] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-15T17:25:35.314011] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-05. [2025-10-15T17:25:35.407507] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-15T17:25:36.087316] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-15T17:25:36.113957] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-06. [2025-10-15T17:25:36.914017] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-09. [2025-10-15T17:25:37.001014] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-15T17:25:37.713981] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-07. [2025-10-15T17:25:38.113329] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-15T17:25:38.514014] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-05. [2025-10-15T17:25:39.313985] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-10. [2025-10-15T17:25:39.413053] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-15T17:25:40.114030] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-08. [2025-10-15T17:25:40.196392] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-15T17:25:40.485392] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-15T17:25:40.488483] [INFO ] [REMOTE ] AWR: Full fetch complete (32300 records). [2025-10-15T17:25:40.488560] [DEBUG] [VALIDATOR ] AWR: Validating primary data. [2025-10-15T17:25:40.856748] [DEBUG] [VALIDATOR ] AWR: All expected trading days are present. [2025-10-15T17:25:40.856822] [DEBUG] [VALIDATOR ] AWR: Primary data validation passed. [2025-10-15T17:25:40.857286] [INFO ] [MAIN ] AWR: Fetched primary data is valid. [2025-10-15T17:25:40.857327] [DEBUG] [LOCAL ] AWR: Saving primary data. [2025-10-15T17:25:40.858072] [DEBUG] [LOCAL ] AWR: Trimmed 32300 records to 22839 (keeping 200 days of data) [2025-10-15T17:25:40.918903] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-06. [2025-10-15T17:25:41.000193] [DEBUG] [LOCAL ] AWR: Primary data saved (22839 records). [2025-10-15T17:25:41.000353] [INFO ] [MAIN ] AWR: Full history saved. [2025-10-15T17:25:41.000444] [INFO ] [MAIN ] Update Progress: 192/2369 symbols completed. AWR took 23.4s. Estimated remaining: 4h 50m 21s. Rate: 7.5 symbols/min [2025-10-15T17:25:41.110728] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-15T17:25:41.194010] [INFO ] [MAIN ] AXL: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:25:41.239224] [DEBUG] [LOCAL ] AXL: Loaded 50552 existing records from primary storage. [2025-10-15T17:25:41.239532] [INFO ] [MAIN ] AXL: Loaded 50552 existing records. [2025-10-15T17:25:41.414105] [WARN ] [MAIN ] AXL: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:25:41.414309] [INFO ] [MAIN ] AXL: Wiping existing primary data before full refresh. [2025-10-15T17:25:41.414354] [INFO ] [LOCAL ] AXL: Starting deletion of primary data. [2025-10-15T17:25:41.414842] [DEBUG] [LOCAL ] AXL: Deleted primary data file. [2025-10-15T17:25:41.414897] [INFO ] [MAIN ] AXL: Starting full primary refresh. [2025-10-15T17:25:41.719088] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-02. [2025-10-15T17:25:41.781521] [INFO ] [REMOTE ] AXL: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:25:42.478631] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-15T17:25:42.514021] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-07. [2025-10-15T17:25:43.151057] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-15T17:25:43.314054] [INFO ] [REMOTE ] AXL: Fetching primary data for 2024-12. [2025-10-15T17:25:44.082429] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-15T17:25:44.114116] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-03. [2025-10-15T17:25:44.567765] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-15T17:25:44.914065] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-08. [2025-10-15T17:25:45.464591] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-15T17:25:45.713977] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-04. [2025-10-15T17:25:46.287922] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-15T17:25:46.514007] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-09. [2025-10-15T17:25:47.048486] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-15T17:25:47.314031] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-09. [2025-10-15T17:25:48.017927] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-15T17:25:48.091472] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-15T17:25:48.113987] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-10. [2025-10-15T17:25:48.914000] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-10. [2025-10-15T17:25:49.078353] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-15T17:25:49.081007] [INFO ] [REMOTE ] AWP: Full fetch complete (31965 records). [2025-10-15T17:25:49.081090] [DEBUG] [VALIDATOR ] AWP: Validating primary data. [2025-10-15T17:25:49.468902] [DEBUG] [VALIDATOR ] AWP: All expected trading days are present. [2025-10-15T17:25:49.468997] [DEBUG] [VALIDATOR ] AWP: Primary data validation passed. [2025-10-15T17:25:49.469585] [INFO ] [MAIN ] AWP: Fetched primary data is valid. [2025-10-15T17:25:49.469679] [DEBUG] [LOCAL ] AWP: Saving primary data. [2025-10-15T17:25:49.470436] [DEBUG] [LOCAL ] AWP: Trimmed 31965 records to 21616 (keeping 200 days of data) [2025-10-15T17:25:49.599219] [DEBUG] [LOCAL ] AWP: Primary data saved (21616 records). [2025-10-15T17:25:49.599343] [INFO ] [MAIN ] AWP: Full history saved. [2025-10-15T17:25:49.599421] [INFO ] [MAIN ] Update Progress: 193/2369 symbols completed. AWP took 33.2s. Estimated remaining: 4h 50m 20s. Rate: 7.5 symbols/min [2025-10-15T17:25:49.719094] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-05. [2025-10-15T17:25:49.780573] [INFO ] [MAIN ] AXP: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:25:49.832146] [DEBUG] [LOCAL ] AXP: Loaded 53167 existing records from primary storage. [2025-10-15T17:25:49.832454] [INFO ] [MAIN ] AXP: Loaded 53167 existing records. [2025-10-15T17:25:50.021891] [WARN ] [MAIN ] AXP: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:25:50.022110] [INFO ] [MAIN ] AXP: Wiping existing primary data before full refresh. [2025-10-15T17:25:50.022158] [INFO ] [LOCAL ] AXP: Starting deletion of primary data. [2025-10-15T17:25:50.022772] [DEBUG] [LOCAL ] AXP: Deleted primary data file. [2025-10-15T17:25:50.022835] [INFO ] [MAIN ] AXP: Starting full primary refresh. [2025-10-15T17:25:50.405428] [INFO ] [REMOTE ] AXP: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:25:50.513961] [INFO ] [REMOTE ] AXP: Fetching primary data for 2024-12. [2025-10-15T17:25:50.774549] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-10 (1.86 seconds). [2025-10-15T17:25:50.780620] [INFO ] [REMOTE ] AWK: Full fetch complete (70863 records). [2025-10-15T17:25:50.780824] [DEBUG] [VALIDATOR ] AWK: Validating primary data. [2025-10-15T17:25:51.097362] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-15T17:25:51.196395] [DEBUG] [VALIDATOR ] AWK: All expected trading days are present. [2025-10-15T17:25:51.196487] [DEBUG] [VALIDATOR ] AWK: Primary data validation passed. [2025-10-15T17:25:51.197269] [INFO ] [MAIN ] AWK: Fetched primary data is valid. [2025-10-15T17:25:51.197334] [DEBUG] [LOCAL ] AWK: Saving primary data. [2025-10-15T17:25:51.198997] [DEBUG] [LOCAL ] AWK: Trimmed 70863 records to 48557 (keeping 200 days of data) [2025-10-15T17:25:51.314049] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-01. [2025-10-15T17:25:51.513758] [DEBUG] [LOCAL ] AWK: Primary data saved (48557 records). [2025-10-15T17:25:51.513893] [INFO ] [MAIN ] AWK: Full history saved. [2025-10-15T17:25:51.515111] [INFO ] [MAIN ] Update Progress: 194/2369 symbols completed. AWK took 36.1s. Estimated remaining: 4h 49m 4s. Rate: 7.5 symbols/min [2025-10-15T17:25:51.702826] [INFO ] [MAIN ] AXR: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:25:51.713015] [DEBUG] [LOCAL ] AXR: Loaded 2948 existing records from primary storage. [2025-10-15T17:25:51.713326] [INFO ] [MAIN ] AXR: Loaded 2948 existing records. [2025-10-15T17:25:51.921803] [WARN ] [MAIN ] AXR: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:25:51.922025] [INFO ] [MAIN ] AXR: Wiping existing primary data before full refresh. [2025-10-15T17:25:51.922087] [INFO ] [LOCAL ] AXR: Starting deletion of primary data. [2025-10-15T17:25:51.922269] [DEBUG] [LOCAL ] AXR: Deleted primary data file. [2025-10-15T17:25:51.922341] [INFO ] [MAIN ] AXR: Starting full primary refresh. [2025-10-15T17:25:52.147373] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-06. [2025-10-15T17:25:52.293364] [INFO ] [REMOTE ] AXR: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:25:52.758217] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2024-12 (2.24 seconds). [2025-10-15T17:25:52.872403] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-15T17:25:52.913975] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-01. [2025-10-15T17:25:53.489163] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-15T17:25:53.714028] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-02. [2025-10-15T17:25:54.513977] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-07. [2025-10-15T17:25:54.745044] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-15T17:25:55.314016] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-02. [2025-10-15T17:25:55.398841] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-15T17:25:55.754277] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-15T17:25:56.114015] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-03. [2025-10-15T17:25:56.913929] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-08. [2025-10-15T17:25:57.154477] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-15T17:25:57.616139] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-15T17:25:57.713975] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-04. [2025-10-15T17:25:58.163678] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-15T17:25:58.514007] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-09. [2025-10-15T17:25:59.313961] [INFO ] [REMOTE ] AXR: Fetching primary data for 2024-12. [2025-10-15T17:25:59.390099] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-15T17:25:59.530194] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-15T17:26:00.048428] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-10-15T17:26:00.113956] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-01. [2025-10-15T17:26:00.715726] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-15T17:26:00.913986] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-05. [2025-10-15T17:26:01.714007] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-10. [2025-10-15T17:26:02.514034] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-03. [2025-10-15T17:26:02.646463] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-15T17:26:02.649850] [INFO ] [REMOTE ] AX: Full fetch complete (42208 records). [2025-10-15T17:26:02.649953] [DEBUG] [VALIDATOR ] AX: Validating primary data. [2025-10-15T17:26:02.937747] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-10-15T17:26:03.068760] [DEBUG] [VALIDATOR ] AX: All expected trading days are present. [2025-10-15T17:26:03.068838] [DEBUG] [VALIDATOR ] AX: Primary data validation passed. [2025-10-15T17:26:03.069365] [INFO ] [MAIN ] AX: Fetched primary data is valid. [2025-10-15T17:26:03.069406] [DEBUG] [LOCAL ] AX: Saving primary data. [2025-10-15T17:26:03.070278] [DEBUG] [LOCAL ] AX: Trimmed 42208 records to 28036 (keeping 200 days of data) [2025-10-15T17:26:03.244734] [DEBUG] [LOCAL ] AX: Primary data saved (28036 records). [2025-10-15T17:26:03.244929] [INFO ] [MAIN ] AX: Full history saved. [2025-10-15T17:26:03.245047] [INFO ] [MAIN ] Update Progress: 195/2369 symbols completed. AX took 35.9s. Estimated remaining: 4h 49m 38s. Rate: 7.5 symbols/min [2025-10-15T17:26:03.319103] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-06. [2025-10-15T17:26:03.445016] [INFO ] [MAIN ] AXS: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:26:03.479831] [DEBUG] [LOCAL ] AXS: Loaded 38625 existing records from primary storage. [2025-10-15T17:26:03.480128] [INFO ] [MAIN ] AXS: Loaded 38625 existing records. [2025-10-15T17:26:03.654974] [WARN ] [MAIN ] AXS: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:26:03.655182] [INFO ] [MAIN ] AXS: Wiping existing primary data before full refresh. [2025-10-15T17:26:03.655229] [INFO ] [LOCAL ] AXS: Starting deletion of primary data. [2025-10-15T17:26:03.655636] [DEBUG] [LOCAL ] AXS: Deleted primary data file. [2025-10-15T17:26:03.655726] [INFO ] [MAIN ] AXS: Starting full primary refresh. [2025-10-15T17:26:04.004003] [INFO ] [REMOTE ] AXS: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:26:04.113992] [INFO ] [REMOTE ] AXS: Fetching primary data for 2024-12. [2025-10-15T17:26:04.692849] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-03 (2.18 seconds). [2025-10-15T17:26:04.732763] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-15T17:26:04.913989] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-07. [2025-10-15T17:26:05.677396] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-15T17:26:05.714013] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-01. [2025-10-15T17:26:06.514004] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-02. [2025-10-15T17:26:06.823948] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-15T17:26:07.003906] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-15T17:26:07.017170] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-10-15T17:26:07.313992] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-08. [2025-10-15T17:26:08.114005] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-03. [2025-10-15T17:26:08.632621] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-10-15T17:26:08.913982] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-02. [2025-10-15T17:26:09.028818] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-15T17:26:09.714047] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-09. [2025-10-15T17:26:10.365730] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-15T17:26:10.514041] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-04. [2025-10-15T17:26:11.313959] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-03. [2025-10-15T17:26:11.601917] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-15T17:26:12.113976] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-10. [2025-10-15T17:26:12.628779] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-15T17:26:12.840826] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-04 (2.33 seconds). [2025-10-15T17:26:12.913981] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-04. [2025-10-15T17:26:13.714068] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-04. [2025-10-15T17:26:13.808559] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-15T17:26:13.815584] [INFO ] [REMOTE ] AXL: Full fetch complete (73001 records). [2025-10-15T17:26:13.815846] [DEBUG] [VALIDATOR ] AXL: Validating primary data. [2025-10-15T17:26:14.211760] [DEBUG] [VALIDATOR ] AXL: All expected trading days are present. [2025-10-15T17:26:14.211878] [DEBUG] [VALIDATOR ] AXL: Primary data validation passed. [2025-10-15T17:26:14.212881] [INFO ] [MAIN ] AXL: Fetched primary data is valid. [2025-10-15T17:26:14.212949] [DEBUG] [LOCAL ] AXL: Saving primary data. [2025-10-15T17:26:14.214412] [DEBUG] [LOCAL ] AXL: Trimmed 73001 records to 50565 (keeping 200 days of data) [2025-10-15T17:26:14.493327] [DEBUG] [LOCAL ] AXL: Primary data saved (50565 records). [2025-10-15T17:26:14.493456] [INFO ] [MAIN ] AXL: Full history saved. [2025-10-15T17:26:14.493536] [INFO ] [MAIN ] Update Progress: 196/2369 symbols completed. AXL took 33.5s. Estimated remaining: 4h 50m 6s. Rate: 7.5 symbols/min [2025-10-15T17:26:14.523014] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-05. [2025-10-15T17:26:14.665703] [INFO ] [MAIN ] AXTA: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:26:14.675624] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-15T17:26:14.719145] [DEBUG] [LOCAL ] AXTA: Loaded 52240 existing records from primary storage. [2025-10-15T17:26:14.719488] [INFO ] [MAIN ] AXTA: Loaded 52240 existing records. [2025-10-15T17:26:14.902095] [WARN ] [MAIN ] AXTA: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:26:14.902553] [INFO ] [MAIN ] AXTA: Wiping existing primary data before full refresh. [2025-10-15T17:26:14.902628] [INFO ] [LOCAL ] AXTA: Starting deletion of primary data. [2025-10-15T17:26:14.903256] [DEBUG] [LOCAL ] AXTA: Deleted primary data file. [2025-10-15T17:26:14.903315] [INFO ] [MAIN ] AXTA: Starting full primary refresh. [2025-10-15T17:26:15.275123] [INFO ] [REMOTE ] AXTA: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:26:15.293623] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-15T17:26:15.313962] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2024-12. [2025-10-15T17:26:16.113994] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-05. [2025-10-15T17:26:16.787417] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-05 (2.26 seconds). [2025-10-15T17:26:16.858392] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-15T17:26:16.913960] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-01. [2025-10-15T17:26:17.432045] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-15T17:26:17.714094] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-06. [2025-10-15T17:26:18.500192] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-15T17:26:18.513946] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-02. [2025-10-15T17:26:19.281578] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-15T17:26:19.313982] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-07. [2025-10-15T17:26:19.845711] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-15T17:26:20.113996] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-06. [2025-10-15T17:26:20.761063] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-15T17:26:20.913985] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-08. [2025-10-15T17:26:21.713970] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-05. [2025-10-15T17:26:22.029907] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-10-15T17:26:22.160951] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-10-15T17:26:22.163850] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-15T17:26:22.514005] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-06. [2025-10-15T17:26:22.993070] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-10-15T17:26:23.314011] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-09. [2025-10-15T17:26:24.113978] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-03. [2025-10-15T17:26:24.743534] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-15T17:26:24.913983] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-10. [2025-10-15T17:26:25.714003] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-07. [2025-10-15T17:26:25.761084] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-15T17:26:26.152066] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-15T17:26:26.156935] [INFO ] [REMOTE ] AXS: Full fetch complete (55809 records). [2025-10-15T17:26:26.157074] [DEBUG] [VALIDATOR ] AXS: Validating primary data. [2025-10-15T17:26:26.519418] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-07. [2025-10-15T17:26:26.561087] [DEBUG] [VALIDATOR ] AXS: All expected trading days are present. [2025-10-15T17:26:26.561195] [DEBUG] [VALIDATOR ] AXS: Primary data validation passed. [2025-10-15T17:26:26.562032] [INFO ] [MAIN ] AXS: Fetched primary data is valid. [2025-10-15T17:26:26.562109] [DEBUG] [LOCAL ] AXS: Saving primary data. [2025-10-15T17:26:26.563699] [DEBUG] [LOCAL ] AXS: Trimmed 55809 records to 38593 (keeping 200 days of data) [2025-10-15T17:26:26.800812] [DEBUG] [LOCAL ] AXS: Primary data saved (38593 records). [2025-10-15T17:26:26.800950] [INFO ] [MAIN ] AXS: Full history saved. [2025-10-15T17:26:26.801032] [INFO ] [MAIN ] Update Progress: 197/2369 symbols completed. AXS took 23.6s. Estimated remaining: 4h 50m 45s. Rate: 7.5 symbols/min [2025-10-15T17:26:27.314054] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-04. [2025-10-15T17:26:31.357258] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-07 (5.64 seconds). [2025-10-15T17:26:31.358743] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-08. [2025-10-15T17:26:32.037018] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-15T17:26:32.038239] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-09. [2025-10-15T17:26:32.106135] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-04 (4.79 seconds). [2025-10-15T17:26:32.118444] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-05. [2025-10-15T17:26:32.614425] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-15T17:26:32.616008] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-10. [2025-10-15T17:26:33.105080] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-15T17:26:33.105864] [INFO ] [REMOTE ] AXR: Full fetch complete (4424 records). [2025-10-15T17:26:33.105933] [DEBUG] [VALIDATOR ] AXR: Validating primary data. [2025-10-15T17:26:33.106278] [FATAL] [VALIDATOR ] AXR: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T17:26:33.106385] [FATAL] [MAIN ] AXR: Fetched primary data is invalid. Refusing to save it. [2025-10-15T17:26:33.106431] [WARN ] [MAIN ] AXR: Deleting existing primary and derivative data due to validation failure. [2025-10-15T17:26:33.106469] [INFO ] [LOCAL ] AXR: Starting deletion of primary data. [2025-10-15T17:26:33.106524] [DEBUG] [LOCAL ] AXR: No primary data file found to delete. [2025-10-15T17:26:33.106597] [INFO ] [LOCAL ] AXR: Starting deletion of derivative data. [2025-10-15T17:26:33.106847] [DEBUG] [LOCAL ] AXR: Deleted derivative data file. [2025-10-15T17:26:33.107043] [INFO ] [MAIN ] Update Progress: 198/2369 symbols completed. AXR took 41.6s. Estimated remaining: 4h 50m 18s. Rate: 7.5 symbols/min [2025-10-15T17:26:33.392265] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-07 (6.87 seconds). [2025-10-15T17:26:33.404485] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-08. [2025-10-15T17:26:33.642866] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-15T17:26:33.654484] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-06. [2025-10-15T17:26:35.338770] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-15T17:26:35.349429] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-07. [2025-10-15T17:26:35.437865] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-10-15T17:26:35.449023] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-09. [2025-10-15T17:26:36.786678] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-15T17:26:36.798265] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-08. [2025-10-15T17:26:37.537165] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-09 (2.09 seconds). [2025-10-15T17:26:37.549036] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-10. [2025-10-15T17:26:38.402319] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-15T17:26:38.414589] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-09. [2025-10-15T17:26:39.728501] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-10 (2.18 seconds). [2025-10-15T17:26:39.736172] [INFO ] [REMOTE ] AXP: Full fetch complete (77073 records). [2025-10-15T17:26:39.736381] [DEBUG] [VALIDATOR ] AXP: Validating primary data. [2025-10-15T17:26:39.957225] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-15T17:26:40.060751] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-10. [2025-10-15T17:26:40.200269] [DEBUG] [VALIDATOR ] AXP: All expected trading days are present. [2025-10-15T17:26:40.200387] [DEBUG] [VALIDATOR ] AXP: Primary data validation passed. [2025-10-15T17:26:40.201483] [INFO ] [MAIN ] AXP: Fetched primary data is valid. [2025-10-15T17:26:40.201557] [DEBUG] [LOCAL ] AXP: Saving primary data. [2025-10-15T17:26:40.203700] [DEBUG] [LOCAL ] AXP: Trimmed 77073 records to 53166 (keeping 200 days of data) [2025-10-15T17:26:40.569702] [DEBUG] [LOCAL ] AXP: Primary data saved (53166 records). [2025-10-15T17:26:40.569911] [INFO ] [MAIN ] AXP: Full history saved. [2025-10-15T17:26:40.570011] [INFO ] [MAIN ] Update Progress: 199/2369 symbols completed. AXP took 51.0s. Estimated remaining: 4h 50m 4s. Rate: 7.5 symbols/min [2025-10-15T17:26:41.934183] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-10 (1.87 seconds). [2025-10-15T17:26:41.941342] [INFO ] [REMOTE ] AXTA: Full fetch complete (75354 records). [2025-10-15T17:26:41.941515] [DEBUG] [VALIDATOR ] AXTA: Validating primary data. [2025-10-15T17:26:42.359916] [DEBUG] [VALIDATOR ] AXTA: All expected trading days are present. [2025-10-15T17:26:42.360036] [DEBUG] [VALIDATOR ] AXTA: Primary data validation passed. [2025-10-15T17:26:42.361297] [INFO ] [MAIN ] AXTA: Fetched primary data is valid. [2025-10-15T17:26:42.361381] [DEBUG] [LOCAL ] AXTA: Saving primary data. [2025-10-15T17:26:42.363502] [DEBUG] [LOCAL ] AXTA: Trimmed 75354 records to 52253 (keeping 200 days of data) [2025-10-15T17:26:42.686844] [DEBUG] [LOCAL ] AXTA: Primary data saved (52253 records). [2025-10-15T17:26:42.687033] [INFO ] [MAIN ] AXTA: Full history saved. [2025-10-15T17:26:42.687137] [INFO ] [MAIN ] Update Progress: 200/2369 symbols completed. AXTA took 28.2s. Estimated remaining: 4h 48m 52s. Rate: 7.5 symbols/min [2025-10-15T17:26:43.305912] [INFO ] [MAIN ] AZO: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:26:43.384775] [INFO ] [MAIN ] AYI: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:26:43.460432] [INFO ] [MAIN ] B: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:26:43.482098] [INFO ] [MAIN ] AZZ: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:26:43.482820] [DEBUG] [LOCAL ] B: No existing data file found in primary storage. [2025-10-15T17:26:43.483242] [WARN ] [MAIN ] B: No existing data found, performing full refresh instead. [2025-10-15T17:26:43.487890] [INFO ] [MAIN ] B: Wiping existing primary data before full refresh. [2025-10-15T17:26:43.488088] [INFO ] [LOCAL ] B: Starting deletion of primary data. [2025-10-15T17:26:43.488167] [DEBUG] [LOCAL ] B: No primary data file found to delete. [2025-10-15T17:26:43.488586] [INFO ] [MAIN ] B: Starting full primary refresh. [2025-10-15T17:26:43.543103] [DEBUG] [LOCAL ] AZO: Loaded 11054 existing records from primary storage. [2025-10-15T17:26:43.574672] [INFO ] [MAIN ] AZO: Loaded 11054 existing records. [2025-10-15T17:26:43.757090] [DEBUG] [LOCAL ] AZZ: Loaded 22646 existing records from primary storage. [2025-10-15T17:26:43.830091] [INFO ] [MAIN ] AZZ: Loaded 22646 existing records. [2025-10-15T17:26:43.866210] [DEBUG] [LOCAL ] AYI: Loaded 25008 existing records from primary storage. [2025-10-15T17:26:43.927010] [INFO ] [MAIN ] AYI: Loaded 25008 existing records. [2025-10-15T17:26:44.142977] [WARN ] [MAIN ] AZO: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:26:44.182811] [INFO ] [MAIN ] AZO: Wiping existing primary data before full refresh. [2025-10-15T17:26:44.221816] [INFO ] [LOCAL ] AZO: Starting deletion of primary data. [2025-10-15T17:26:44.250299] [DEBUG] [LOCAL ] AZO: Deleted primary data file. [2025-10-15T17:26:44.327863] [INFO ] [MAIN ] AZO: Starting full primary refresh. [2025-10-15T17:26:44.495907] [WARN ] [MAIN ] AZZ: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:26:44.516901] [INFO ] [MAIN ] AZZ: Wiping existing primary data before full refresh. [2025-10-15T17:26:44.485478] [INFO ] [REMOTE ] B: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:26:44.522921] [INFO ] [REMOTE ] B: Fetching primary data for 2024-12. [2025-10-15T17:26:44.522529] [INFO ] [LOCAL ] AZZ: Starting deletion of primary data. [2025-10-15T17:26:44.635002] [DEBUG] [LOCAL ] AZZ: Deleted primary data file. [2025-10-15T17:26:44.681434] [INFO ] [MAIN ] AZZ: Starting full primary refresh. [2025-10-15T17:26:44.681287] [WARN ] [MAIN ] AYI: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:26:44.707854] [INFO ] [MAIN ] AYI: Wiping existing primary data before full refresh. [2025-10-15T17:26:44.755247] [INFO ] [LOCAL ] AYI: Starting deletion of primary data. [2025-10-15T17:26:44.819589] [DEBUG] [LOCAL ] AYI: Deleted primary data file. [2025-10-15T17:26:44.838442] [INFO ] [MAIN ] AYI: Starting full primary refresh. [2025-10-15T17:26:45.306263] [INFO ] [REMOTE ] AZO: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:26:45.393177] [INFO ] [REMOTE ] AZO: Fetching primary data for 2024-12. [2025-10-15T17:26:45.664273] [INFO ] [REMOTE ] AZZ: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:26:45.708236] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2024-12. [2025-10-15T17:26:45.744127] [INFO ] [REMOTE ] AYI: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:26:45.744884] [INFO ] [REMOTE ] AYI: Fetching primary data for 2024-12. [2025-10-15T17:26:46.031638] [INFO ] [REMOTE ] B: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-15T17:26:46.038430] [INFO ] [REMOTE ] B: Fetching primary data for 2025-01. [2025-10-15T17:26:46.887202] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-15T17:26:46.892355] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-01. [2025-10-15T17:26:46.934027] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-10-15T17:26:46.938207] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-01. [2025-10-15T17:26:47.024012] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-15T17:26:47.027317] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-01. [2025-10-15T17:26:47.058377] [INFO ] [REMOTE ] B: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-15T17:26:47.064608] [INFO ] [REMOTE ] B: Fetching primary data for 2025-02. [2025-10-15T17:26:47.248317] [DEBUG] [REMOTE ] B: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-15T17:26:47.248698] [WARN ] [REMOTE ] B: No data returned for month 2025-02 [2025-10-15T17:26:47.248817] [FATAL] [REMOTE ] B: API call failed - aborting fetch to avoid wasting further API calls [2025-10-15T17:26:47.248921] [FATAL] [MAIN ] B: Failed to fetch primary data. [2025-10-15T17:26:47.248991] [WARN ] [MAIN ] B: Deleting existing primary and derivative data due to fetch failure. [2025-10-15T17:26:47.249089] [INFO ] [LOCAL ] B: Starting deletion of primary data. [2025-10-15T17:26:47.249202] [DEBUG] [LOCAL ] B: No primary data file found to delete. [2025-10-15T17:26:47.249260] [INFO ] [LOCAL ] B: Starting deletion of derivative data. [2025-10-15T17:26:47.249307] [DEBUG] [LOCAL ] B: No derivative data file found to delete. [2025-10-15T17:26:47.249354] [INFO ] [MAIN ] Update Progress: 201/2369 symbols completed. B took 4.6s. Estimated remaining: 4h 48m 7s. Rate: 7.5 symbols/min [2025-10-15T17:26:47.427890] [INFO ] [MAIN ] BA: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:26:47.487294] [DEBUG] [LOCAL ] BA: Loaded 53790 existing records from primary storage. [2025-10-15T17:26:47.487791] [INFO ] [MAIN ] BA: Loaded 53790 existing records. [2025-10-15T17:26:47.683909] [WARN ] [MAIN ] BA: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:26:47.684207] [INFO ] [MAIN ] BA: Wiping existing primary data before full refresh. [2025-10-15T17:26:47.684272] [INFO ] [LOCAL ] BA: Starting deletion of primary data. [2025-10-15T17:26:47.684823] [DEBUG] [LOCAL ] BA: Deleted primary data file. [2025-10-15T17:26:47.684879] [INFO ] [MAIN ] BA: Starting full primary refresh. [2025-10-15T17:26:47.997252] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-15T17:26:48.016600] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-15T17:26:48.031255] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-02. [2025-10-15T17:26:48.097075] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-02. [2025-10-15T17:26:48.101154] [INFO ] [REMOTE ] BA: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:26:48.102952] [INFO ] [REMOTE ] BA: Fetching primary data for 2024-12. [2025-10-15T17:26:48.153710] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-15T17:26:48.160229] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-02. [2025-10-15T17:26:48.866406] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-15T17:26:48.868923] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-03. [2025-10-15T17:26:49.251587] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-15T17:26:49.257303] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-03. [2025-10-15T17:26:49.324399] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-15T17:26:49.713995] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-03. [2025-10-15T17:26:49.742517] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-15T17:26:50.077831] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-10-15T17:26:50.129087] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-15T17:26:50.514003] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-04. [2025-10-15T17:26:51.049799] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-15T17:26:51.314002] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-01. [2025-10-15T17:26:51.545729] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-15T17:26:52.114014] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-05. [2025-10-15T17:26:52.914220] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-04. [2025-10-15T17:26:52.916037] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-15T17:26:53.714019] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-06. [2025-10-15T17:26:53.772028] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-01 (2.46 seconds). [2025-10-15T17:26:53.784430] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-15T17:26:54.513988] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-02. [2025-10-15T17:26:54.836606] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-15T17:26:55.314050] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-05. [2025-10-15T17:26:56.114009] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-07. [2025-10-15T17:26:56.164109] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-15T17:26:56.659817] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-02 (2.15 seconds). [2025-10-15T17:26:56.914059] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-06. [2025-10-15T17:26:57.293288] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-15T17:26:57.715246] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-04. [2025-10-15T17:26:57.718980] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-15T17:26:58.513967] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-07. [2025-10-15T17:26:59.314959] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-08. [2025-10-15T17:26:59.318083] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-15T17:26:59.333733] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-15T17:27:00.114329] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-08. [2025-10-15T17:27:00.118040] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-15T17:27:00.914004] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-05. [2025-10-15T17:27:01.075351] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-15T17:27:01.714042] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-09. [2025-10-15T17:27:01.785046] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-15T17:27:02.514029] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-03. [2025-10-15T17:27:02.728636] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-15T17:27:03.314026] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-06. [2025-10-15T17:27:04.114026] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-09. [2025-10-15T17:27:04.364128] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-15T17:27:04.914061] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-10. [2025-10-15T17:27:05.101885] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-03 (2.59 seconds). [2025-10-15T17:27:05.123767] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-15T17:27:05.714020] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-04. [2025-10-15T17:27:06.232362] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-15T17:27:06.236700] [INFO ] [REMOTE ] AZZ: Full fetch complete (31803 records). [2025-10-15T17:27:06.236808] [DEBUG] [VALIDATOR ] AZZ: Validating primary data. [2025-10-15T17:27:06.519170] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-10. [2025-10-15T17:27:06.635433] [DEBUG] [VALIDATOR ] AZZ: All expected trading days are present. [2025-10-15T17:27:06.635542] [DEBUG] [VALIDATOR ] AZZ: Primary data validation passed. [2025-10-15T17:27:06.636192] [INFO ] [MAIN ] AZZ: Fetched primary data is valid. [2025-10-15T17:27:06.636259] [DEBUG] [LOCAL ] AZZ: Saving primary data. [2025-10-15T17:27:06.637338] [DEBUG] [LOCAL ] AZZ: Trimmed 31803 records to 22700 (keeping 200 days of data) [2025-10-15T17:27:06.782292] [DEBUG] [LOCAL ] AZZ: Primary data saved (22700 records). [2025-10-15T17:27:06.782476] [INFO ] [MAIN ] AZZ: Full history saved. [2025-10-15T17:27:06.782580] [INFO ] [MAIN ] Update Progress: 202/2369 symbols completed. AZZ took 24.1s. Estimated remaining: 4h 50m 3s. Rate: 7.5 symbols/min [2025-10-15T17:27:06.976350] [INFO ] [MAIN ] BABA: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:27:07.048427] [DEBUG] [LOCAL ] BABA: Loaded 53820 existing records from primary storage. [2025-10-15T17:27:07.049294] [INFO ] [MAIN ] BABA: Loaded 53820 existing records. [2025-10-15T17:27:07.241353] [WARN ] [MAIN ] BABA: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:27:07.241703] [INFO ] [MAIN ] BABA: Wiping existing primary data before full refresh. [2025-10-15T17:27:07.241768] [INFO ] [LOCAL ] BABA: Starting deletion of primary data. [2025-10-15T17:27:07.242377] [DEBUG] [LOCAL ] BABA: Deleted primary data file. [2025-10-15T17:27:07.242435] [INFO ] [MAIN ] BABA: Starting full primary refresh. [2025-10-15T17:27:07.321040] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-07. [2025-10-15T17:27:07.554901] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-15T17:27:07.584532] [INFO ] [REMOTE ] AZO: Full fetch complete (15981 records). [2025-10-15T17:27:07.585267] [DEBUG] [VALIDATOR ] AZO: Validating primary data. [2025-10-15T17:27:07.742982] [INFO ] [REMOTE ] BABA: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:27:08.050834] [DEBUG] [VALIDATOR ] AZO: All expected trading days are present. [2025-10-15T17:27:08.050951] [DEBUG] [VALIDATOR ] AZO: Primary data validation passed. [2025-10-15T17:27:08.051494] [INFO ] [MAIN ] AZO: Fetched primary data is valid. [2025-10-15T17:27:08.051537] [DEBUG] [LOCAL ] AZO: Saving primary data. [2025-10-15T17:27:08.052176] [DEBUG] [LOCAL ] AZO: Trimmed 15981 records to 11036 (keeping 200 days of data) [2025-10-15T17:27:08.114054] [INFO ] [REMOTE ] BABA: Fetching primary data for 2024-12. [2025-10-15T17:27:08.140135] [DEBUG] [LOCAL ] AZO: Primary data saved (11036 records). [2025-10-15T17:27:08.140336] [INFO ] [MAIN ] AZO: Full history saved. [2025-10-15T17:27:08.140495] [INFO ] [MAIN ] Update Progress: 203/2369 symbols completed. AZO took 25.5s. Estimated remaining: 4h 48m 44s. Rate: 7.5 symbols/min [2025-10-15T17:27:08.324183] [INFO ] [MAIN ] BAC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:27:08.380411] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-04 (2.67 seconds). [2025-10-15T17:27:08.382733] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-15T17:27:08.475423] [DEBUG] [LOCAL ] BAC: Loaded 53808 existing records from primary storage. [2025-10-15T17:27:08.476056] [INFO ] [MAIN ] BAC: Loaded 53808 existing records. [2025-10-15T17:27:08.682353] [WARN ] [MAIN ] BAC: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:27:08.682665] [INFO ] [MAIN ] BAC: Wiping existing primary data before full refresh. [2025-10-15T17:27:08.682733] [INFO ] [LOCAL ] BAC: Starting deletion of primary data. [2025-10-15T17:27:08.684259] [DEBUG] [LOCAL ] BAC: Deleted primary data file. [2025-10-15T17:27:08.684322] [INFO ] [MAIN ] BAC: Starting full primary refresh. [2025-10-15T17:27:08.919218] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-05. [2025-10-15T17:27:09.084408] [INFO ] [REMOTE ] BAC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:27:09.714043] [INFO ] [REMOTE ] BAC: Fetching primary data for 2024-12. [2025-10-15T17:27:10.514056] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-08. [2025-10-15T17:27:10.835047] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2024-12 (2.72 seconds). [2025-10-15T17:27:11.313992] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-01. [2025-10-15T17:27:11.379626] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-05 (2.46 seconds). [2025-10-15T17:27:11.481632] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-15T17:27:11.960395] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2024-12 (2.25 seconds). [2025-10-15T17:27:12.114008] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-06. [2025-10-15T17:27:12.914130] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-09. [2025-10-15T17:27:13.714033] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-01. [2025-10-15T17:27:13.854812] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-01 (2.54 seconds). [2025-10-15T17:27:13.892694] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-15T17:27:14.509141] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-06 (2.40 seconds). [2025-10-15T17:27:14.519817] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-02. [2025-10-15T17:27:15.314090] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-07. [2025-10-15T17:27:15.755337] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-01 (2.04 seconds). [2025-10-15T17:27:16.114046] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-10. [2025-10-15T17:27:16.919123] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-02. [2025-10-15T17:27:16.936271] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-02 (2.42 seconds). [2025-10-15T17:27:17.128394] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-15T17:27:17.131863] [INFO ] [REMOTE ] AYI: Full fetch complete (37072 records). [2025-10-15T17:27:17.131976] [DEBUG] [VALIDATOR ] AYI: Validating primary data. [2025-10-15T17:27:17.531972] [DEBUG] [VALIDATOR ] AYI: All expected trading days are present. [2025-10-15T17:27:17.532154] [DEBUG] [VALIDATOR ] AYI: Primary data validation passed. [2025-10-15T17:27:17.532788] [INFO ] [MAIN ] AYI: Fetched primary data is valid. [2025-10-15T17:27:17.532853] [DEBUG] [LOCAL ] AYI: Saving primary data. [2025-10-15T17:27:17.533851] [DEBUG] [LOCAL ] AYI: Trimmed 37072 records to 24967 (keeping 200 days of data) [2025-10-15T17:27:17.694815] [DEBUG] [LOCAL ] AYI: Primary data saved (24967 records). [2025-10-15T17:27:17.695041] [INFO ] [MAIN ] AYI: Full history saved. [2025-10-15T17:27:17.695208] [INFO ] [MAIN ] Update Progress: 204/2369 symbols completed. AYI took 35.0s. Estimated remaining: 4h 48m 52s. Rate: 7.5 symbols/min [2025-10-15T17:27:17.727936] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-03. [2025-10-15T17:27:17.892746] [INFO ] [MAIN ] BAH: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:27:17.929043] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-07 (2.61 seconds). [2025-10-15T17:27:17.985163] [DEBUG] [LOCAL ] BAH: Loaded 51734 existing records from primary storage. [2025-10-15T17:27:17.985542] [INFO ] [MAIN ] BAH: Loaded 51734 existing records. [2025-10-15T17:27:18.170744] [WARN ] [MAIN ] BAH: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:27:18.171049] [INFO ] [MAIN ] BAH: Wiping existing primary data before full refresh. [2025-10-15T17:27:18.171112] [INFO ] [LOCAL ] BAH: Starting deletion of primary data. [2025-10-15T17:27:18.171840] [DEBUG] [LOCAL ] BAH: Deleted primary data file. [2025-10-15T17:27:18.171912] [INFO ] [MAIN ] BAH: Starting full primary refresh. [2025-10-15T17:27:18.517782] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-08. [2025-10-15T17:27:18.521478] [INFO ] [REMOTE ] BAH: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:27:18.997200] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-02 (2.08 seconds). [2025-10-15T17:27:19.314050] [INFO ] [REMOTE ] BAH: Fetching primary data for 2024-12. [2025-10-15T17:27:20.114024] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-03. [2025-10-15T17:27:20.305144] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-03 (2.58 seconds). [2025-10-15T17:27:20.823660] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-08 (2.31 seconds). [2025-10-15T17:27:20.914097] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-09. [2025-10-15T17:27:21.156848] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-15T17:27:21.714019] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-01. [2025-10-15T17:27:22.416020] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-03 (2.30 seconds). [2025-10-15T17:27:22.514107] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-04. [2025-10-15T17:27:23.313989] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-04. [2025-10-15T17:27:23.383819] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-09 (2.47 seconds). [2025-10-15T17:27:23.504590] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-15T17:27:24.114057] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-10. [2025-10-15T17:27:24.913973] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-02. [2025-10-15T17:27:25.026184] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-04 (2.51 seconds). [2025-10-15T17:27:25.063996] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-15T17:27:25.071305] [INFO ] [REMOTE ] BA: Full fetch complete (77969 records). [2025-10-15T17:27:25.071495] [DEBUG] [VALIDATOR ] BA: Validating primary data. [2025-10-15T17:27:25.482295] [DEBUG] [VALIDATOR ] BA: All expected trading days are present. [2025-10-15T17:27:25.482401] [DEBUG] [VALIDATOR ] BA: Primary data validation passed. [2025-10-15T17:27:25.483387] [INFO ] [MAIN ] BA: Fetched primary data is valid. [2025-10-15T17:27:25.483457] [DEBUG] [LOCAL ] BA: Saving primary data. [2025-10-15T17:27:25.485427] [DEBUG] [LOCAL ] BA: Trimmed 77969 records to 53790 (keeping 200 days of data) [2025-10-15T17:27:25.717583] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-05. [2025-10-15T17:27:25.835401] [DEBUG] [LOCAL ] BA: Primary data saved (53790 records). [2025-10-15T17:27:25.835732] [INFO ] [MAIN ] BA: Full history saved. [2025-10-15T17:27:25.836036] [INFO ] [MAIN ] Update Progress: 205/2369 symbols completed. BA took 38.6s. Estimated remaining: 4h 48m 46s. Rate: 7.5 symbols/min [2025-10-15T17:27:25.993365] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-04 (2.68 seconds). [2025-10-15T17:27:26.070133] [INFO ] [MAIN ] BAK: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:27:26.106116] [DEBUG] [LOCAL ] BAK: Loaded 39300 existing records from primary storage. [2025-10-15T17:27:26.106453] [INFO ] [MAIN ] BAK: Loaded 39300 existing records. [2025-10-15T17:27:26.292080] [WARN ] [MAIN ] BAK: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:27:26.292358] [INFO ] [MAIN ] BAK: Wiping existing primary data before full refresh. [2025-10-15T17:27:26.292410] [INFO ] [LOCAL ] BAK: Starting deletion of primary data. [2025-10-15T17:27:26.292885] [DEBUG] [LOCAL ] BAK: Deleted primary data file. [2025-10-15T17:27:26.292944] [INFO ] [MAIN ] BAK: Starting full primary refresh. [2025-10-15T17:27:26.523986] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-05. [2025-10-15T17:27:26.694982] [INFO ] [REMOTE ] BAK: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:27:26.725886] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-15T17:27:27.314057] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-03. [2025-10-15T17:27:27.985493] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-05 (2.27 seconds). [2025-10-15T17:27:28.114011] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-06. [2025-10-15T17:27:28.914057] [INFO ] [REMOTE ] BAK: Fetching primary data for 2024-12. [2025-10-15T17:27:29.041844] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-15T17:27:29.269366] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-05 (2.75 seconds). [2025-10-15T17:27:29.714043] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-06. [2025-10-15T17:27:30.294800] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-06 (2.18 seconds). [2025-10-15T17:27:30.358442] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-15T17:27:30.514085] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-01. [2025-10-15T17:27:31.314073] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-04. [2025-10-15T17:27:32.060324] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-15T17:27:32.099790] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-06 (2.39 seconds). [2025-10-15T17:27:32.113942] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-07. [2025-10-15T17:27:32.914055] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-07. [2025-10-15T17:27:33.282385] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-15T17:27:33.713997] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-05. [2025-10-15T17:27:34.513975] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-02. [2025-10-15T17:27:34.795860] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-07 (2.68 seconds). [2025-10-15T17:27:35.251933] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-07 (2.34 seconds). [2025-10-15T17:27:35.313962] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-08. [2025-10-15T17:27:35.549424] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-15T17:27:35.585754] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-15T17:27:36.114068] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-08. [2025-10-15T17:27:36.914056] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-03. [2025-10-15T17:27:37.466842] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-08 (2.15 seconds). [2025-10-15T17:27:37.714031] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-06. [2025-10-15T17:27:37.885060] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-15T17:27:38.514104] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-04. [2025-10-15T17:27:38.923910] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-08 (2.81 seconds). [2025-10-15T17:27:39.314035] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-09. [2025-10-15T17:27:39.481827] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-15T17:27:39.549051] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-15T17:27:40.114103] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-05. [2025-10-15T17:27:40.914023] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-09. [2025-10-15T17:27:41.713978] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-07. [2025-10-15T17:27:41.921907] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-09 (2.61 seconds). [2025-10-15T17:27:41.935457] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-15T17:27:42.514069] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-06. [2025-10-15T17:27:43.313993] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-10. [2025-10-15T17:27:43.571773] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-09 (2.66 seconds). [2025-10-15T17:27:44.113979] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-10. [2025-10-15T17:27:44.256856] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-07 (2.54 seconds). [2025-10-15T17:27:44.642260] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-06 (2.13 seconds). [2025-10-15T17:27:44.913996] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-08. [2025-10-15T17:27:45.714052] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-07. [2025-10-15T17:27:46.262160] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-10 (2.95 seconds). [2025-10-15T17:27:46.268550] [INFO ] [REMOTE ] BABA: Full fetch complete (78000 records). [2025-10-15T17:27:46.268700] [DEBUG] [VALIDATOR ] BABA: Validating primary data. [2025-10-15T17:27:46.676406] [DEBUG] [VALIDATOR ] BABA: All expected trading days are present. [2025-10-15T17:27:46.677762] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-10 (2.56 seconds). [2025-10-15T17:27:46.677109] [DEBUG] [VALIDATOR ] BABA: Primary data validation passed. [2025-10-15T17:27:46.684533] [INFO ] [MAIN ] BABA: Fetched primary data is valid. [2025-10-15T17:27:46.685077] [DEBUG] [LOCAL ] BABA: Saving primary data. [2025-10-15T17:27:46.685772] [INFO ] [REMOTE ] BAC: Full fetch complete (77988 records). [2025-10-15T17:27:46.686255] [DEBUG] [VALIDATOR ] BAC: Validating primary data. [2025-10-15T17:27:46.718430] [DEBUG] [LOCAL ] BABA: Trimmed 78000 records to 53820 (keeping 200 days of data) [2025-10-15T17:27:47.401249] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-08 (2.49 seconds). [2025-10-15T17:27:47.524855] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-09. [2025-10-15T17:27:47.521501] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-15T17:27:47.530209] [DEBUG] [LOCAL ] BABA: Primary data saved (53820 records). [2025-10-15T17:27:47.541683] [INFO ] [MAIN ] BABA: Full history saved. [2025-10-15T17:27:47.542456] [INFO ] [MAIN ] Update Progress: 206/2369 symbols completed. BABA took 40.8s. Estimated remaining: 4h 51m 2s. Rate: 7.4 symbols/min [2025-10-15T17:27:47.563211] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-08. [2025-10-15T17:27:47.687733] [DEBUG] [VALIDATOR ] BAC: All expected trading days are present. [2025-10-15T17:27:47.705733] [DEBUG] [VALIDATOR ] BAC: Primary data validation passed. [2025-10-15T17:27:47.706782] [INFO ] [MAIN ] BAC: Fetched primary data is valid. [2025-10-15T17:27:47.707169] [DEBUG] [LOCAL ] BAC: Saving primary data. [2025-10-15T17:27:47.761143] [DEBUG] [LOCAL ] BAC: Trimmed 77988 records to 53808 (keeping 200 days of data) [2025-10-15T17:27:47.780505] [INFO ] [MAIN ] BALL: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:27:47.948294] [DEBUG] [LOCAL ] BALL: Loaded 51865 existing records from primary storage. [2025-10-15T17:27:48.009821] [INFO ] [MAIN ] BALL: Loaded 51865 existing records. [2025-10-15T17:27:48.258316] [WARN ] [MAIN ] BALL: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:27:48.262957] [INFO ] [MAIN ] BALL: Wiping existing primary data before full refresh. [2025-10-15T17:27:48.266360] [INFO ] [LOCAL ] BALL: Starting deletion of primary data. [2025-10-15T17:27:48.269112] [DEBUG] [LOCAL ] BALL: Deleted primary data file. [2025-10-15T17:27:48.269434] [INFO ] [MAIN ] BALL: Starting full primary refresh. [2025-10-15T17:27:48.677021] [DEBUG] [LOCAL ] BAC: Primary data saved (53808 records). [2025-10-15T17:27:48.716209] [INFO ] [MAIN ] BAC: Full history saved. [2025-10-15T17:27:48.736162] [INFO ] [REMOTE ] BALL: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:27:48.736679] [INFO ] [MAIN ] Update Progress: 207/2369 symbols completed. BAC took 40.6s. Estimated remaining: 4h 49m 42s. Rate: 7.5 symbols/min [2025-10-15T17:27:48.737232] [INFO ] [REMOTE ] BALL: Fetching primary data for 2024-12. [2025-10-15T17:27:48.917959] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-15T17:27:48.951281] [INFO ] [MAIN ] BALY: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:27:48.951630] [DEBUG] [LOCAL ] BALY: No existing data file found in primary storage. [2025-10-15T17:27:48.952067] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-09. [2025-10-15T17:27:48.951718] [WARN ] [MAIN ] BALY: No existing data found, performing full refresh instead. [2025-10-15T17:27:48.952331] [INFO ] [MAIN ] BALY: Wiping existing primary data before full refresh. [2025-10-15T17:27:48.953192] [INFO ] [LOCAL ] BALY: Starting deletion of primary data. [2025-10-15T17:27:48.953254] [DEBUG] [LOCAL ] BALY: No primary data file found to delete. [2025-10-15T17:27:48.953288] [INFO ] [MAIN ] BALY: Starting full primary refresh. [2025-10-15T17:27:49.309231] [INFO ] [REMOTE ] BALY: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:27:49.406266] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-15T17:27:49.714013] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-10. [2025-10-15T17:27:50.443448] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-15T17:27:50.513963] [INFO ] [REMOTE ] BALY: Fetching primary data for 2024-12. [2025-10-15T17:27:50.843612] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2024-12 (2.11 seconds). [2025-10-15T17:27:51.313983] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-10. [2025-10-15T17:27:51.509432] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-15T17:27:51.515621] [INFO ] [REMOTE ] BAH: Full fetch complete (75189 records). [2025-10-15T17:27:51.515781] [DEBUG] [VALIDATOR ] BAH: Validating primary data. [2025-10-15T17:27:51.785428] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-15T17:27:51.943215] [DEBUG] [VALIDATOR ] BAH: All expected trading days are present. [2025-10-15T17:27:51.943322] [DEBUG] [VALIDATOR ] BAH: Primary data validation passed. [2025-10-15T17:27:51.944225] [INFO ] [MAIN ] BAH: Fetched primary data is valid. [2025-10-15T17:27:51.944292] [DEBUG] [LOCAL ] BAH: Saving primary data. [2025-10-15T17:27:51.945788] [DEBUG] [LOCAL ] BAH: Trimmed 75189 records to 51719 (keeping 200 days of data) [2025-10-15T17:27:52.124446] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-01. [2025-10-15T17:27:52.277139] [DEBUG] [LOCAL ] BAH: Primary data saved (51719 records). [2025-10-15T17:27:52.277329] [INFO ] [MAIN ] BAH: Full history saved. [2025-10-15T17:27:52.277836] [INFO ] [MAIN ] Update Progress: 208/2369 symbols completed. BAH took 34.6s. Estimated remaining: 4h 48m 47s. Rate: 7.5 symbols/min [2025-10-15T17:27:52.445492] [INFO ] [MAIN ] BAM: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:27:52.497748] [DEBUG] [LOCAL ] BAM: Loaded 52087 existing records from primary storage. [2025-10-15T17:27:52.498111] [INFO ] [MAIN ] BAM: Loaded 52087 existing records. [2025-10-15T17:27:52.676385] [WARN ] [MAIN ] BAM: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:27:52.676628] [INFO ] [MAIN ] BAM: Wiping existing primary data before full refresh. [2025-10-15T17:27:52.676733] [INFO ] [LOCAL ] BAM: Starting deletion of primary data. [2025-10-15T17:27:52.677309] [DEBUG] [LOCAL ] BAM: Deleted primary data file. [2025-10-15T17:27:52.677367] [INFO ] [MAIN ] BAM: Starting full primary refresh. [2025-10-15T17:27:52.919108] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-01. [2025-10-15T17:27:53.051496] [INFO ] [REMOTE ] BAM: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:27:53.065085] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-15T17:27:53.070930] [INFO ] [REMOTE ] BAK: Full fetch complete (56996 records). [2025-10-15T17:27:53.071147] [DEBUG] [VALIDATOR ] BAK: Validating primary data. [2025-10-15T17:27:53.523040] [DEBUG] [VALIDATOR ] BAK: All expected trading days are present. [2025-10-15T17:27:53.523181] [DEBUG] [VALIDATOR ] BAK: Primary data validation passed. [2025-10-15T17:27:53.524172] [INFO ] [MAIN ] BAK: Fetched primary data is valid. [2025-10-15T17:27:53.524260] [DEBUG] [LOCAL ] BAK: Saving primary data. [2025-10-15T17:27:53.526016] [DEBUG] [LOCAL ] BAK: Trimmed 56996 records to 39305 (keeping 200 days of data) [2025-10-15T17:27:53.732555] [INFO ] [REMOTE ] BAM: Fetching primary data for 2024-12. [2025-10-15T17:27:53.762721] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-15T17:27:53.805301] [DEBUG] [LOCAL ] BAK: Primary data saved (39305 records). [2025-10-15T17:27:53.805479] [INFO ] [MAIN ] BAK: Full history saved. [2025-10-15T17:27:53.805570] [INFO ] [MAIN ] Update Progress: 209/2369 symbols completed. BAK took 28.0s. Estimated remaining: 4h 47m 32s. Rate: 7.5 symbols/min [2025-10-15T17:27:53.977068] [INFO ] [MAIN ] BANC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:27:54.027993] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-15T17:27:54.051531] [DEBUG] [LOCAL ] BANC: Loaded 51342 existing records from primary storage. [2025-10-15T17:27:54.051977] [INFO ] [MAIN ] BANC: Loaded 51342 existing records. [2025-10-15T17:27:54.230611] [WARN ] [MAIN ] BANC: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:27:54.230887] [INFO ] [MAIN ] BANC: Wiping existing primary data before full refresh. [2025-10-15T17:27:54.230946] [INFO ] [LOCAL ] BANC: Starting deletion of primary data. [2025-10-15T17:27:54.231459] [DEBUG] [LOCAL ] BANC: Deleted primary data file. [2025-10-15T17:27:54.231540] [INFO ] [MAIN ] BANC: Starting full primary refresh. [2025-10-15T17:27:54.519179] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-02. [2025-10-15T17:27:54.577199] [INFO ] [REMOTE ] BANC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:27:55.314024] [INFO ] [REMOTE ] BANC: Fetching primary data for 2024-12. [2025-10-15T17:27:55.368467] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-15T17:27:56.000770] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-15T17:27:56.114033] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-03. [2025-10-15T17:27:56.914035] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-01. [2025-10-15T17:27:57.673459] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2024-12 (2.36 seconds). [2025-10-15T17:27:57.713993] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-01. [2025-10-15T17:27:58.441291] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-03 (2.33 seconds). [2025-10-15T17:27:58.514017] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-04. [2025-10-15T17:27:58.714929] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-15T17:27:59.314010] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-02. [2025-10-15T17:27:59.501042] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-15T17:27:59.836471] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-10-15T17:28:00.113992] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-02. [2025-10-15T17:28:00.241105] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-15T17:28:00.913993] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-05. [2025-10-15T17:28:01.695137] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-15T17:28:01.713953] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-03. [2025-10-15T17:28:02.514054] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-02. [2025-10-15T17:28:02.684957] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-15T17:28:03.313996] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-03. [2025-10-15T17:28:03.712822] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-10-15T17:28:04.114009] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-04. [2025-10-15T17:28:04.145515] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-15T17:28:04.193264] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-15T17:28:04.914030] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-03. [2025-10-15T17:28:05.714009] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-04. [2025-10-15T17:28:05.837985] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-15T17:28:06.183044] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-10-15T17:28:06.513967] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-06. [2025-10-15T17:28:06.592309] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-15T17:28:07.314013] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-05. [2025-10-15T17:28:08.113977] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-04. [2025-10-15T17:28:08.213925] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-15T17:28:08.914025] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-07. [2025-10-15T17:28:09.162866] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-15T17:28:09.714085] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-06. [2025-10-15T17:28:09.897886] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-15T17:28:10.513999] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-05. [2025-10-15T17:28:11.323969] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-05. [2025-10-15T17:28:11.326782] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-15T17:28:12.113972] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-07. [2025-10-15T17:28:12.239716] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-15T17:28:12.259592] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-15T17:28:12.522795] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-07 (3.61 seconds). [2025-10-15T17:28:12.914066] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-06. [2025-10-15T17:28:13.714036] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-06. [2025-10-15T17:28:14.404156] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-07 (2.29 seconds). [2025-10-15T17:28:14.500925] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-15T17:28:14.513949] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-07. [2025-10-15T17:28:14.533395] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-15T17:28:15.314028] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-08. [2025-10-15T17:28:16.114013] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-08. [2025-10-15T17:28:16.502910] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-15T17:28:16.913999] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-08. [2025-10-15T17:28:17.719307] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-07. [2025-10-15T17:28:17.722111] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-08 (2.41 seconds). [2025-10-15T17:28:18.004134] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-15T17:28:18.336172] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-15T17:28:18.369522] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-15T17:28:18.514076] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-09. [2025-10-15T17:28:19.314038] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-08. [2025-10-15T17:28:19.762808] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-15T17:28:20.114043] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-09. [2025-10-15T17:28:20.306105] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-15T17:28:20.913996] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-10. [2025-10-15T17:28:21.714097] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-09. [2025-10-15T17:28:21.860359] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-15T17:28:22.514067] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-10. [2025-10-15T17:28:22.575621] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-15T17:28:22.581963] [INFO ] [REMOTE ] BAM: Full fetch complete (74945 records). [2025-10-15T17:28:22.582116] [DEBUG] [VALIDATOR ] BAM: Validating primary data. [2025-10-15T17:28:23.009752] [DEBUG] [VALIDATOR ] BAM: All expected trading days are present. [2025-10-15T17:28:23.009877] [DEBUG] [VALIDATOR ] BAM: Primary data validation passed. [2025-10-15T17:28:23.011044] [INFO ] [MAIN ] BAM: Fetched primary data is valid. [2025-10-15T17:28:23.011199] [DEBUG] [LOCAL ] BAM: Saving primary data. [2025-10-15T17:28:23.013142] [DEBUG] [LOCAL ] BAM: Trimmed 74945 records to 52107 (keeping 200 days of data) [2025-10-15T17:28:23.314150] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-09. [2025-10-15T17:28:23.454464] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-15T17:28:23.527662] [DEBUG] [LOCAL ] BAM: Primary data saved (52107 records). [2025-10-15T17:28:23.527862] [INFO ] [MAIN ] BAM: Full history saved. [2025-10-15T17:28:23.528241] [INFO ] [MAIN ] Update Progress: 210/2369 symbols completed. BAM took 31.3s. Estimated remaining: 4h 51m 7s. Rate: 7.4 symbols/min [2025-10-15T17:28:23.749633] [INFO ] [MAIN ] BAP: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:28:23.778763] [DEBUG] [LOCAL ] BAP: Loaded 25720 existing records from primary storage. [2025-10-15T17:28:23.779123] [INFO ] [MAIN ] BAP: Loaded 25720 existing records. [2025-10-15T17:28:23.969991] [WARN ] [MAIN ] BAP: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:28:23.970311] [INFO ] [MAIN ] BAP: Wiping existing primary data before full refresh. [2025-10-15T17:28:23.970391] [INFO ] [LOCAL ] BAP: Starting deletion of primary data. [2025-10-15T17:28:23.970815] [DEBUG] [LOCAL ] BAP: Deleted primary data file. [2025-10-15T17:28:23.970873] [INFO ] [MAIN ] BAP: Starting full primary refresh. [2025-10-15T17:28:24.139603] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-10. [2025-10-15T17:28:24.169304] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-15T17:28:24.366809] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-10 (1.85 seconds). [2025-10-15T17:28:24.397505] [INFO ] [REMOTE ] BAP: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:28:24.398725] [INFO ] [REMOTE ] BANC: Full fetch complete (74148 records). [2025-10-15T17:28:24.398918] [DEBUG] [VALIDATOR ] BANC: Validating primary data. [2025-10-15T17:28:24.399757] [FATAL] [VALIDATOR ] BANC: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T17:28:24.399845] [FATAL] [MAIN ] BANC: Fetched primary data is invalid. Refusing to save it. [2025-10-15T17:28:24.399927] [WARN ] [MAIN ] BANC: Deleting existing primary and derivative data due to validation failure. [2025-10-15T17:28:24.400003] [INFO ] [LOCAL ] BANC: Starting deletion of primary data. [2025-10-15T17:28:24.400069] [DEBUG] [LOCAL ] BANC: No primary data file found to delete. [2025-10-15T17:28:24.400103] [INFO ] [LOCAL ] BANC: Starting deletion of derivative data. [2025-10-15T17:28:24.400316] [DEBUG] [LOCAL ] BANC: Deleted derivative data file. [2025-10-15T17:28:24.400412] [INFO ] [MAIN ] Update Progress: 211/2369 symbols completed. BANC took 30.6s. Estimated remaining: 4h 49m 45s. Rate: 7.4 symbols/min [2025-10-15T17:28:24.568138] [INFO ] [MAIN ] BARK: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:28:24.604201] [DEBUG] [LOCAL ] BARK: Loaded 38229 existing records from primary storage. [2025-10-15T17:28:24.604511] [INFO ] [MAIN ] BARK: Loaded 38229 existing records. [2025-10-15T17:28:24.784264] [WARN ] [MAIN ] BARK: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:28:24.784522] [INFO ] [MAIN ] BARK: Wiping existing primary data before full refresh. [2025-10-15T17:28:24.784570] [INFO ] [LOCAL ] BARK: Starting deletion of primary data. [2025-10-15T17:28:24.784943] [DEBUG] [LOCAL ] BARK: Deleted primary data file. [2025-10-15T17:28:24.785005] [INFO ] [MAIN ] BARK: Starting full primary refresh. [2025-10-15T17:28:24.919812] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-10. [2025-10-15T17:28:25.132000] [INFO ] [REMOTE ] BARK: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:28:25.714024] [INFO ] [REMOTE ] BARK: Fetching primary data for 2024-12. [2025-10-15T17:28:26.184181] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-10 (2.04 seconds). [2025-10-15T17:28:26.184981] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-15T17:28:26.192879] [INFO ] [REMOTE ] BALY: Full fetch complete (16499 records). [2025-10-15T17:28:26.193042] [DEBUG] [VALIDATOR ] BALY: Validating primary data. [2025-10-15T17:28:26.235258] [INFO ] [REMOTE ] BALL: Full fetch complete (75560 records). [2025-10-15T17:28:26.266429] [DEBUG] [VALIDATOR ] BALL: Validating primary data. [2025-10-15T17:28:26.519757] [INFO ] [REMOTE ] BAP: Fetching primary data for 2024-12. [2025-10-15T17:28:26.531847] [WARN ] [VALIDATOR ] BALY: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-15T17:28:26.640396] [FATAL] [MAIN ] BALY: Fetched primary data is invalid. Refusing to save it. [2025-10-15T17:28:26.664480] [WARN ] [MAIN ] BALY: Deleting existing primary and derivative data due to validation failure. [2025-10-15T17:28:26.694415] [INFO ] [LOCAL ] BALY: Starting deletion of primary data. [2025-10-15T17:28:26.706219] [DEBUG] [LOCAL ] BALY: No primary data file found to delete. [2025-10-15T17:28:26.713561] [INFO ] [LOCAL ] BALY: Starting deletion of derivative data. [2025-10-15T17:28:26.729803] [DEBUG] [LOCAL ] BALY: No derivative data file found to delete. [2025-10-15T17:28:26.733632] [INFO ] [MAIN ] Update Progress: 212/2369 symbols completed. BALY took 38.0s. Estimated remaining: 4h 48m 39s. Rate: 7.5 symbols/min [2025-10-15T17:28:27.032210] [DEBUG] [VALIDATOR ] BALL: All expected trading days are present. [2025-10-15T17:28:27.037455] [DEBUG] [VALIDATOR ] BALL: Primary data validation passed. [2025-10-15T17:28:27.054125] [INFO ] [MAIN ] BALL: Fetched primary data is valid. [2025-10-15T17:28:27.054352] [DEBUG] [LOCAL ] BALL: Saving primary data. [2025-10-15T17:28:27.109202] [INFO ] [MAIN ] BAX: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:28:27.111202] [DEBUG] [LOCAL ] BALL: Trimmed 75560 records to 51888 (keeping 200 days of data) [2025-10-15T17:28:27.367142] [DEBUG] [LOCAL ] BAX: Loaded 53525 existing records from primary storage. [2025-10-15T17:28:27.376932] [INFO ] [MAIN ] BAX: Loaded 53525 existing records. [2025-10-15T17:28:27.584092] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-10-15T17:28:27.614579] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-01. [2025-10-15T17:28:27.692930] [DEBUG] [LOCAL ] BALL: Primary data saved (51888 records). [2025-10-15T17:28:27.709080] [INFO ] [MAIN ] BALL: Full history saved. [2025-10-15T17:28:27.714486] [INFO ] [MAIN ] Update Progress: 213/2369 symbols completed. BALL took 40.2s. Estimated remaining: 4h 47m 20s. Rate: 7.5 symbols/min [2025-10-15T17:28:27.714278] [WARN ] [MAIN ] BAX: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:28:27.784667] [INFO ] [MAIN ] BAX: Wiping existing primary data before full refresh. [2025-10-15T17:28:27.801363] [INFO ] [LOCAL ] BAX: Starting deletion of primary data. [2025-10-15T17:28:27.823987] [DEBUG] [LOCAL ] BAX: Deleted primary data file. [2025-10-15T17:28:27.834336] [INFO ] [MAIN ] BAX: Starting full primary refresh. [2025-10-15T17:28:27.950299] [INFO ] [MAIN ] BB: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:28:28.215562] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-15T17:28:28.264220] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-01. [2025-10-15T17:28:28.306406] [INFO ] [REMOTE ] BAX: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:28:28.307581] [DEBUG] [LOCAL ] BB: Loaded 52924 existing records from primary storage. [2025-10-15T17:28:28.308026] [INFO ] [MAIN ] BB: Loaded 52924 existing records. [2025-10-15T17:28:28.491456] [WARN ] [MAIN ] BB: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:28:28.491717] [INFO ] [MAIN ] BB: Wiping existing primary data before full refresh. [2025-10-15T17:28:28.491813] [INFO ] [LOCAL ] BB: Starting deletion of primary data. [2025-10-15T17:28:28.492243] [DEBUG] [LOCAL ] BB: Deleted primary data file. [2025-10-15T17:28:28.492301] [INFO ] [MAIN ] BB: Starting full primary refresh. [2025-10-15T17:28:28.883561] [INFO ] [REMOTE ] BB: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:28:28.913970] [INFO ] [REMOTE ] BB: Fetching primary data for 2024-12. [2025-10-15T17:28:29.173086] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-15T17:28:29.559720] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-15T17:28:29.713995] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-02. [2025-10-15T17:28:30.513999] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-02. [2025-10-15T17:28:30.766485] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-15T17:28:30.887379] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-10-15T17:28:31.314009] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-01. [2025-10-15T17:28:31.677742] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-15T17:28:32.114013] [INFO ] [REMOTE ] BAX: Fetching primary data for 2024-12. [2025-10-15T17:28:32.913975] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-03. [2025-10-15T17:28:33.206223] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-10-15T17:28:33.714063] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-03. [2025-10-15T17:28:33.970264] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-15T17:28:34.096184] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-10-15T17:28:34.514018] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-01. [2025-10-15T17:28:34.958461] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-15T17:28:35.314025] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-02. [2025-10-15T17:28:36.113986] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-04. [2025-10-15T17:28:36.292823] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-15T17:28:36.913956] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-02. [2025-10-15T17:28:37.408428] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-02 (2.09 seconds). [2025-10-15T17:28:37.617735] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-15T17:28:37.713978] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-05. [2025-10-15T17:28:38.513972] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-03. [2025-10-15T17:28:38.598535] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-15T17:28:39.029605] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-15T17:28:39.313992] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-06. [2025-10-15T17:28:40.114053] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-03. [2025-10-15T17:28:40.622587] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-03 (2.11 seconds). [2025-10-15T17:28:40.913969] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-04. [2025-10-15T17:28:41.014827] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-15T17:28:41.713974] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-04. [2025-10-15T17:28:41.836953] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-15T17:28:42.514029] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-04. [2025-10-15T17:28:42.913601] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-15T17:28:43.104629] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-15T17:28:43.313990] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-05. [2025-10-15T17:28:44.113968] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-05. [2025-10-15T17:28:44.435247] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-15T17:28:44.914021] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-05. [2025-10-15T17:28:45.541023] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-05 (2.23 seconds). [2025-10-15T17:28:45.714003] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-06. [2025-10-15T17:28:45.804136] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-15T17:28:46.513996] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-06. [2025-10-15T17:28:46.739278] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-15T17:28:47.313961] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-06. [2025-10-15T17:28:47.585833] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-10-15T17:28:47.726630] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-15T17:28:48.113999] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-07. [2025-10-15T17:28:48.914040] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-07. [2025-10-15T17:28:49.071057] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-15T17:28:49.714072] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-07. [2025-10-15T17:28:49.750158] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-15T17:28:50.223536] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-15T17:28:50.514033] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-08. [2025-10-15T17:28:51.272671] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-15T17:28:51.314072] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-08. [2025-10-15T17:28:51.783224] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-15T17:28:52.114047] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-09. [2025-10-15T17:28:52.913991] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-08. [2025-10-15T17:28:53.188400] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-15T17:28:53.532805] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-15T17:28:53.714003] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-10. [2025-10-15T17:28:54.168201] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-15T17:28:54.514083] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-07. [2025-10-15T17:28:54.943784] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-15T17:28:54.951697] [INFO ] [REMOTE ] BARK: Full fetch complete (56201 records). [2025-10-15T17:28:54.951873] [DEBUG] [VALIDATOR ] BARK: Validating primary data. [2025-10-15T17:28:55.325319] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-09. [2025-10-15T17:28:55.363211] [DEBUG] [VALIDATOR ] BARK: All expected trading days are present. [2025-10-15T17:28:55.363411] [DEBUG] [VALIDATOR ] BARK: Primary data validation passed. [2025-10-15T17:28:55.364511] [INFO ] [MAIN ] BARK: Fetched primary data is valid. [2025-10-15T17:28:55.364613] [DEBUG] [LOCAL ] BARK: Saving primary data. [2025-10-15T17:28:55.366486] [DEBUG] [LOCAL ] BARK: Trimmed 56201 records to 38160 (keeping 200 days of data) [2025-10-15T17:28:55.596532] [DEBUG] [LOCAL ] BARK: Primary data saved (38160 records). [2025-10-15T17:28:55.596765] [INFO ] [MAIN ] BARK: Full history saved. [2025-10-15T17:28:55.596877] [INFO ] [MAIN ] Update Progress: 214/2369 symbols completed. BARK took 31.2s. Estimated remaining: 4h 50m 32s. Rate: 7.4 symbols/min [2025-10-15T17:28:55.778087] [INFO ] [MAIN ] BBAI: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:28:55.827937] [DEBUG] [LOCAL ] BBAI: Loaded 53820 existing records from primary storage. [2025-10-15T17:28:55.828305] [INFO ] [MAIN ] BBAI: Loaded 53820 existing records. [2025-10-15T17:28:56.018877] [WARN ] [MAIN ] BBAI: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:28:56.019134] [INFO ] [MAIN ] BBAI: Wiping existing primary data before full refresh. [2025-10-15T17:28:56.019183] [INFO ] [LOCAL ] BBAI: Starting deletion of primary data. [2025-10-15T17:28:56.020087] [DEBUG] [LOCAL ] BBAI: Deleted primary data file. [2025-10-15T17:28:56.020146] [INFO ] [MAIN ] BBAI: Starting full primary refresh. [2025-10-15T17:28:56.120304] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-09. [2025-10-15T17:28:56.383850] [INFO ] [REMOTE ] BBAI: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:28:56.914074] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2024-12. [2025-10-15T17:28:57.291357] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-10-15T17:28:57.322907] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-15T17:28:57.714002] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-10. [2025-10-15T17:28:57.885444] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-07 (3.37 seconds). [2025-10-15T17:28:58.514027] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-10. [2025-10-15T17:28:59.314039] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-08. [2025-10-15T17:29:00.912054] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2024-12 (4.00 seconds). [2025-10-15T17:29:00.925000] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-01. [2025-10-15T17:29:01.117606] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-10 (3.40 seconds). [2025-10-15T17:29:01.124072] [INFO ] [REMOTE ] BAX: Full fetch complete (77609 records). [2025-10-15T17:29:01.124204] [DEBUG] [VALIDATOR ] BAX: Validating primary data. [2025-10-15T17:29:01.283310] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-10 (2.77 seconds). [2025-10-15T17:29:01.329458] [INFO ] [REMOTE ] BAP: Full fetch complete (37514 records). [2025-10-15T17:29:01.336156] [DEBUG] [VALIDATOR ] BAP: Validating primary data. [2025-10-15T17:29:01.870547] [DEBUG] [VALIDATOR ] BAX: All expected trading days are present. [2025-10-15T17:29:01.870738] [DEBUG] [VALIDATOR ] BAX: Primary data validation passed. [2025-10-15T17:29:01.871967] [INFO ] [MAIN ] BAX: Fetched primary data is valid. [2025-10-15T17:29:01.872400] [DEBUG] [LOCAL ] BAX: Saving primary data. [2025-10-15T17:29:01.934807] [DEBUG] [LOCAL ] BAX: Trimmed 77609 records to 53529 (keeping 200 days of data) [2025-10-15T17:29:01.966477] [DEBUG] [VALIDATOR ] BAP: All expected trading days are present. [2025-10-15T17:29:01.966802] [DEBUG] [VALIDATOR ] BAP: Primary data validation passed. [2025-10-15T17:29:01.967254] [INFO ] [MAIN ] BAP: Fetched primary data is valid. [2025-10-15T17:29:01.967323] [DEBUG] [LOCAL ] BAP: Saving primary data. [2025-10-15T17:29:01.972156] [DEBUG] [LOCAL ] BAP: Trimmed 37514 records to 25781 (keeping 200 days of data) [2025-10-15T17:29:02.244220] [DEBUG] [LOCAL ] BAP: Primary data saved (25781 records). [2025-10-15T17:29:02.245013] [INFO ] [MAIN ] BAP: Full history saved. [2025-10-15T17:29:02.245699] [INFO ] [MAIN ] Update Progress: 215/2369 symbols completed. BAP took 38.7s. Estimated remaining: 4h 50m 10s. Rate: 7.4 symbols/min [2025-10-15T17:29:02.459187] [INFO ] [MAIN ] BBAR: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:29:02.636602] [DEBUG] [LOCAL ] BBAR: Loaded 42247 existing records from primary storage. [2025-10-15T17:29:02.644827] [INFO ] [MAIN ] BBAR: Loaded 42247 existing records. [2025-10-15T17:29:02.915901] [WARN ] [MAIN ] BBAR: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:29:02.921554] [INFO ] [MAIN ] BBAR: Wiping existing primary data before full refresh. [2025-10-15T17:29:02.926737] [INFO ] [LOCAL ] BBAR: Starting deletion of primary data. [2025-10-15T17:29:02.934681] [DEBUG] [LOCAL ] BAX: Primary data saved (53529 records). [2025-10-15T17:29:02.934798] [INFO ] [MAIN ] BAX: Full history saved. [2025-10-15T17:29:02.934967] [INFO ] [MAIN ] Update Progress: 216/2369 symbols completed. BAX took 36.2s. Estimated remaining: 4h 48m 48s. Rate: 7.5 symbols/min [2025-10-15T17:29:02.940291] [DEBUG] [LOCAL ] BBAR: Deleted primary data file. [2025-10-15T17:29:02.958252] [INFO ] [MAIN ] BBAR: Starting full primary refresh. [2025-10-15T17:29:03.306269] [INFO ] [MAIN ] BBD: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:29:03.580743] [INFO ] [REMOTE ] BBAR: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:29:03.586197] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2024-12. [2025-10-15T17:29:03.590481] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-08 (4.28 seconds). [2025-10-15T17:29:03.619193] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-09. [2025-10-15T17:29:03.641627] [DEBUG] [LOCAL ] BBD: Loaded 53260 existing records from primary storage. [2025-10-15T17:29:03.642073] [INFO ] [MAIN ] BBD: Loaded 53260 existing records. [2025-10-15T17:29:03.796775] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-01 (2.87 seconds). [2025-10-15T17:29:03.857919] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-02. [2025-10-15T17:29:03.898708] [WARN ] [MAIN ] BBD: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:29:03.898987] [INFO ] [MAIN ] BBD: Wiping existing primary data before full refresh. [2025-10-15T17:29:03.899040] [INFO ] [LOCAL ] BBD: Starting deletion of primary data. [2025-10-15T17:29:03.900008] [DEBUG] [LOCAL ] BBD: Deleted primary data file. [2025-10-15T17:29:03.900067] [INFO ] [MAIN ] BBD: Starting full primary refresh. [2025-10-15T17:29:04.287406] [INFO ] [REMOTE ] BBD: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:29:04.288111] [INFO ] [REMOTE ] BBD: Fetching primary data for 2024-12. [2025-10-15T17:29:05.234569] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-15T17:29:05.243977] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-01. [2025-10-15T17:29:05.662376] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-10-15T17:29:05.674222] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-10. [2025-10-15T17:29:06.166756] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-10-15T17:29:06.178353] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-01. [2025-10-15T17:29:06.295306] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-02 (2.44 seconds). [2025-10-15T17:29:06.382474] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-15T17:29:06.514056] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-03. [2025-10-15T17:29:07.314119] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-02. [2025-10-15T17:29:07.717348] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-10 (2.04 seconds). [2025-10-15T17:29:07.724678] [INFO ] [REMOTE ] BB: Full fetch complete (77009 records). [2025-10-15T17:29:07.724869] [DEBUG] [VALIDATOR ] BB: Validating primary data. [2025-10-15T17:29:08.147771] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-10-15T17:29:08.168169] [DEBUG] [VALIDATOR ] BB: All expected trading days are present. [2025-10-15T17:29:08.179239] [DEBUG] [VALIDATOR ] BB: Primary data validation passed. [2025-10-15T17:29:08.181052] [INFO ] [MAIN ] BB: Fetched primary data is valid. [2025-10-15T17:29:08.181157] [DEBUG] [LOCAL ] BB: Saving primary data. [2025-10-15T17:29:08.181935] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-02. [2025-10-15T17:29:08.184527] [DEBUG] [LOCAL ] BB: Trimmed 77009 records to 52914 (keeping 200 days of data) [2025-10-15T17:29:08.513199] [DEBUG] [LOCAL ] BB: Primary data saved (52914 records). [2025-10-15T17:29:08.513447] [INFO ] [MAIN ] BB: Full history saved. [2025-10-15T17:29:08.513603] [INFO ] [MAIN ] Update Progress: 217/2369 symbols completed. BB took 40.8s. Estimated remaining: 4h 48m 15s. Rate: 7.5 symbols/min [2025-10-15T17:29:08.730500] [INFO ] [MAIN ] BBDC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:29:08.732700] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-15T17:29:08.778430] [DEBUG] [LOCAL ] BBDC: Loaded 33129 existing records from primary storage. [2025-10-15T17:29:08.778810] [INFO ] [MAIN ] BBDC: Loaded 33129 existing records. [2025-10-15T17:29:08.927887] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-03. [2025-10-15T17:29:08.975146] [WARN ] [MAIN ] BBDC: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:29:08.975882] [INFO ] [MAIN ] BBDC: Wiping existing primary data before full refresh. [2025-10-15T17:29:08.976025] [INFO ] [LOCAL ] BBDC: Starting deletion of primary data. [2025-10-15T17:29:08.976923] [DEBUG] [LOCAL ] BBDC: Deleted primary data file. [2025-10-15T17:29:08.977006] [INFO ] [MAIN ] BBDC: Starting full primary refresh. [2025-10-15T17:29:09.224275] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-03 (2.71 seconds). [2025-10-15T17:29:09.483064] [INFO ] [REMOTE ] BBDC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:29:09.713983] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2024-12. [2025-10-15T17:29:09.823261] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-15T17:29:10.227999] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-15T17:29:10.514000] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-04. [2025-10-15T17:29:11.156390] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-15T17:29:11.314026] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-03. [2025-10-15T17:29:12.114049] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-01. [2025-10-15T17:29:12.923213] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-04. [2025-10-15T17:29:12.933908] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-15T17:29:13.276963] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-15T17:29:13.287050] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-04 (2.77 seconds). [2025-10-15T17:29:13.714002] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-02. [2025-10-15T17:29:13.994602] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-15T17:29:14.514031] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-05. [2025-10-15T17:29:15.034260] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-15T17:29:15.313996] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-03. [2025-10-15T17:29:16.097881] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-15T17:29:16.113956] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-06. [2025-10-15T17:29:16.695689] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-15T17:29:16.914027] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-04. [2025-10-15T17:29:17.575920] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-15T17:29:17.713978] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-05. [2025-10-15T17:29:18.514016] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-04. [2025-10-15T17:29:18.714786] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-15T17:29:19.314020] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-07. [2025-10-15T17:29:19.564886] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-15T17:29:20.113989] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-05. [2025-10-15T17:29:20.350951] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-05 (2.64 seconds). [2025-10-15T17:29:20.424807] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-15T17:29:20.914053] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-06. [2025-10-15T17:29:21.208872] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-15T17:29:21.714073] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-05. [2025-10-15T17:29:22.513998] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-06. [2025-10-15T17:29:23.261431] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-06 (2.35 seconds). [2025-10-15T17:29:23.314038] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-07. [2025-10-15T17:29:23.427049] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-15T17:29:23.699976] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-15T17:29:24.114020] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-07. [2025-10-15T17:29:24.914049] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-06. [2025-10-15T17:29:25.109789] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-15T17:29:25.713980] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-08. [2025-10-15T17:29:25.926418] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-07 (2.61 seconds). [2025-10-15T17:29:26.514025] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-08. [2025-10-15T17:29:26.723325] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-15T17:29:26.953524] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-15T17:29:27.314021] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-07. [2025-10-15T17:29:28.114033] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-09. [2025-10-15T17:29:28.145086] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-15T17:29:28.914059] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-09. [2025-10-15T17:29:29.129671] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-15T17:29:29.491096] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-15T17:29:29.714024] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-10. [2025-10-15T17:29:30.521487] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-08. [2025-10-15T17:29:30.544768] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-15T17:29:30.978362] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-15T17:29:30.983676] [INFO ] [REMOTE ] BBDC: Full fetch complete (48812 records). [2025-10-15T17:29:30.983814] [DEBUG] [VALIDATOR ] BBDC: Validating primary data. [2025-10-15T17:29:31.322208] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-08. [2025-10-15T17:29:31.366376] [DEBUG] [VALIDATOR ] BBDC: All expected trading days are present. [2025-10-15T17:29:31.366463] [DEBUG] [VALIDATOR ] BBDC: Primary data validation passed. [2025-10-15T17:29:31.367239] [INFO ] [MAIN ] BBDC: Fetched primary data is valid. [2025-10-15T17:29:31.367300] [DEBUG] [LOCAL ] BBDC: Saving primary data. [2025-10-15T17:29:31.368344] [DEBUG] [LOCAL ] BBDC: Trimmed 48812 records to 33095 (keeping 200 days of data) [2025-10-15T17:29:31.562526] [DEBUG] [LOCAL ] BBDC: Primary data saved (33095 records). [2025-10-15T17:29:31.562712] [INFO ] [MAIN ] BBDC: Full history saved. [2025-10-15T17:29:31.562806] [INFO ] [MAIN ] Update Progress: 218/2369 symbols completed. BBDC took 23.0s. Estimated remaining: 4h 50m 35s. Rate: 7.4 symbols/min [2025-10-15T17:29:31.738519] [INFO ] [MAIN ] BBDO: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:29:31.745120] [DEBUG] [LOCAL ] BBDO: Loaded 5044 existing records from primary storage. [2025-10-15T17:29:31.745351] [INFO ] [MAIN ] BBDO: Loaded 5044 existing records. [2025-10-15T17:29:31.954349] [WARN ] [MAIN ] BBDO: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:29:31.954587] [INFO ] [MAIN ] BBDO: Wiping existing primary data before full refresh. [2025-10-15T17:29:31.954665] [INFO ] [LOCAL ] BBDO: Starting deletion of primary data. [2025-10-15T17:29:31.954974] [DEBUG] [LOCAL ] BBDO: Deleted primary data file. [2025-10-15T17:29:31.955032] [INFO ] [MAIN ] BBDO: Starting full primary refresh. [2025-10-15T17:29:32.119868] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-10. [2025-10-15T17:29:32.348225] [INFO ] [REMOTE ] BBDO: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:29:32.914053] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2024-12. [2025-10-15T17:29:33.164741] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-08 (2.64 seconds). [2025-10-15T17:29:33.603841] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-08 (2.28 seconds). [2025-10-15T17:29:33.714066] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-09. [2025-10-15T17:29:33.789080] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-15T17:29:33.874153] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-15T17:29:33.885983] [INFO ] [REMOTE ] BBAR: Full fetch complete (61285 records). [2025-10-15T17:29:33.886262] [DEBUG] [VALIDATOR ] BBAR: Validating primary data. [2025-10-15T17:29:34.260212] [DEBUG] [VALIDATOR ] BBAR: All expected trading days are present. [2025-10-15T17:29:34.260317] [DEBUG] [VALIDATOR ] BBAR: Primary data validation passed. [2025-10-15T17:29:34.261106] [INFO ] [MAIN ] BBAR: Fetched primary data is valid. [2025-10-15T17:29:34.261170] [DEBUG] [LOCAL ] BBAR: Saving primary data. [2025-10-15T17:29:34.262533] [DEBUG] [LOCAL ] BBAR: Trimmed 61285 records to 42354 (keeping 200 days of data) [2025-10-15T17:29:34.517482] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-01. [2025-10-15T17:29:34.522463] [DEBUG] [LOCAL ] BBAR: Primary data saved (42354 records). [2025-10-15T17:29:34.522538] [INFO ] [MAIN ] BBAR: Full history saved. [2025-10-15T17:29:34.522922] [INFO ] [MAIN ] Update Progress: 219/2369 symbols completed. BBAR took 32.3s. Estimated remaining: 4h 49m 37s. Rate: 7.4 symbols/min [2025-10-15T17:29:34.696942] [INFO ] [MAIN ] BBN: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:29:34.718635] [DEBUG] [LOCAL ] BBN: Loaded 18085 existing records from primary storage. [2025-10-15T17:29:34.718988] [INFO ] [MAIN ] BBN: Loaded 18085 existing records. [2025-10-15T17:29:34.923513] [WARN ] [MAIN ] BBN: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:29:34.923795] [INFO ] [MAIN ] BBN: Wiping existing primary data before full refresh. [2025-10-15T17:29:34.923843] [INFO ] [LOCAL ] BBN: Starting deletion of primary data. [2025-10-15T17:29:34.924086] [DEBUG] [LOCAL ] BBN: Deleted primary data file. [2025-10-15T17:29:34.924125] [INFO ] [MAIN ] BBN: Starting full primary refresh. [2025-10-15T17:29:35.145598] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-15T17:29:35.293196] [INFO ] [REMOTE ] BBN: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:29:35.314036] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-02. [2025-10-15T17:29:35.797495] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-10-15T17:29:36.114017] [INFO ] [REMOTE ] BBN: Fetching primary data for 2024-12. [2025-10-15T17:29:36.541105] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-09 (2.83 seconds). [2025-10-15T17:29:36.914026] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-03. [2025-10-15T17:29:37.371417] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-10-15T17:29:37.377219] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-15T17:29:37.713983] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-04. [2025-10-15T17:29:38.472786] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-15T17:29:38.514003] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-05. [2025-10-15T17:29:39.173049] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-15T17:29:39.313998] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-01. [2025-10-15T17:29:40.114036] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-06. [2025-10-15T17:29:40.243416] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-15T17:29:40.797494] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-15T17:29:40.914009] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-02. [2025-10-15T17:29:41.713997] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-09. [2025-10-15T17:29:41.820726] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-15T17:29:42.514023] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-10. [2025-10-15T17:29:43.313983] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-03. [2025-10-15T17:29:43.504427] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-15T17:29:44.113967] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-10. [2025-10-15T17:29:44.268630] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-15T17:29:44.913966] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-04. [2025-10-15T17:29:45.714062] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-07. [2025-10-15T17:29:45.738694] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-15T17:29:45.745736] [INFO ] [REMOTE ] BBD: Full fetch complete (77277 records). [2025-10-15T17:29:45.745922] [DEBUG] [VALIDATOR ] BBD: Validating primary data. [2025-10-15T17:29:46.090589] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-15T17:29:46.199868] [DEBUG] [VALIDATOR ] BBD: All expected trading days are present. [2025-10-15T17:29:46.218629] [DEBUG] [VALIDATOR ] BBD: Primary data validation passed. [2025-10-15T17:29:46.221887] [INFO ] [MAIN ] BBD: Fetched primary data is valid. [2025-10-15T17:29:46.220401] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-10 (3.71 seconds). [2025-10-15T17:29:46.228294] [DEBUG] [LOCAL ] BBD: Saving primary data. [2025-10-15T17:29:46.230307] [INFO ] [REMOTE ] BBAI: Full fetch complete (78000 records). [2025-10-15T17:29:46.230619] [DEBUG] [VALIDATOR ] BBAI: Validating primary data. [2025-10-15T17:29:46.237313] [DEBUG] [LOCAL ] BBD: Trimmed 77277 records to 53260 (keeping 200 days of data) [2025-10-15T17:29:46.402546] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-15T17:29:46.514035] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-08. [2025-10-15T17:29:46.858019] [DEBUG] [VALIDATOR ] BBAI: All expected trading days are present. [2025-10-15T17:29:46.885040] [DEBUG] [VALIDATOR ] BBAI: Primary data validation passed. [2025-10-15T17:29:46.887728] [INFO ] [MAIN ] BBAI: Fetched primary data is valid. [2025-10-15T17:29:46.888091] [DEBUG] [LOCAL ] BBAI: Saving primary data. [2025-10-15T17:29:46.894887] [DEBUG] [LOCAL ] BBAI: Trimmed 78000 records to 53820 (keeping 200 days of data) [2025-10-15T17:29:47.083272] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-15T17:29:47.217730] [DEBUG] [LOCAL ] BBD: Primary data saved (53260 records). [2025-10-15T17:29:47.225693] [INFO ] [MAIN ] BBD: Full history saved. [2025-10-15T17:29:47.226562] [INFO ] [MAIN ] Update Progress: 220/2369 symbols completed. BBD took 44.3s. Estimated remaining: 4h 50m 14s. Rate: 7.4 symbols/min [2025-10-15T17:29:47.314503] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-05. [2025-10-15T17:29:47.482714] [DEBUG] [LOCAL ] BBAI: Primary data saved (53820 records). [2025-10-15T17:29:47.501323] [INFO ] [MAIN ] BBAI: Full history saved. [2025-10-15T17:29:47.501243] [INFO ] [MAIN ] BBT: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:29:47.501519] [INFO ] [MAIN ] Update Progress: 221/2369 symbols completed. BBAI took 51.9s. Estimated remaining: 4h 48m 50s. Rate: 7.4 symbols/min [2025-10-15T17:29:47.512985] [DEBUG] [LOCAL ] BBT: No existing data file found in primary storage. [2025-10-15T17:29:47.570079] [WARN ] [MAIN ] BBT: No existing data found, performing full refresh instead. [2025-10-15T17:29:47.586606] [INFO ] [MAIN ] BBT: Wiping existing primary data before full refresh. [2025-10-15T17:29:47.605416] [INFO ] [LOCAL ] BBT: Starting deletion of primary data. [2025-10-15T17:29:47.608124] [DEBUG] [LOCAL ] BBT: No primary data file found to delete. [2025-10-15T17:29:47.608183] [INFO ] [MAIN ] BBT: Starting full primary refresh. [2025-10-15T17:29:47.803271] [INFO ] [MAIN ] BBU: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:29:47.842019] [DEBUG] [LOCAL ] BBU: No existing data file found in primary storage. [2025-10-15T17:29:47.858580] [WARN ] [MAIN ] BBU: No existing data found, performing full refresh instead. [2025-10-15T17:29:47.905885] [INFO ] [MAIN ] BBU: Wiping existing primary data before full refresh. [2025-10-15T17:29:47.932434] [INFO ] [LOCAL ] BBU: Starting deletion of primary data. [2025-10-15T17:29:47.964611] [DEBUG] [LOCAL ] BBU: No primary data file found to delete. [2025-10-15T17:29:47.964841] [INFO ] [MAIN ] BBU: Starting full primary refresh. [2025-10-15T17:29:48.117061] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-09. [2025-10-15T17:29:48.153062] [INFO ] [REMOTE ] BBT: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:29:48.409428] [INFO ] [REMOTE ] BBU: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:29:48.421086] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-15T17:29:48.780390] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-15T17:29:48.913964] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-10. [2025-10-15T17:29:49.671545] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-15T17:29:49.673135] [INFO ] [REMOTE ] BBDO: Full fetch complete (7501 records). [2025-10-15T17:29:49.673210] [DEBUG] [VALIDATOR ] BBDO: Validating primary data. [2025-10-15T17:29:49.719084] [INFO ] [REMOTE ] BBT: Fetching primary data for 2024-12. [2025-10-15T17:29:49.977270] [DEBUG] [REMOTE ] BBT: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-15T17:29:50.005842] [WARN ] [REMOTE ] BBT: No data returned for month 2024-12 [2025-10-15T17:29:50.037126] [FATAL] [REMOTE ] BBT: API call failed - aborting fetch to avoid wasting further API calls [2025-10-15T17:29:50.037346] [DEBUG] [VALIDATOR ] BBDO: All expected trading days are present. [2025-10-15T17:29:50.037439] [DEBUG] [VALIDATOR ] BBDO: Primary data validation passed. [2025-10-15T17:29:50.037267] [FATAL] [MAIN ] BBT: Failed to fetch primary data. [2025-10-15T17:29:50.037831] [INFO ] [MAIN ] BBDO: Fetched primary data is valid. [2025-10-15T17:29:50.037908] [DEBUG] [LOCAL ] BBDO: Saving primary data. [2025-10-15T17:29:50.037564] [WARN ] [MAIN ] BBT: Deleting existing primary and derivative data due to fetch failure. [2025-10-15T17:29:50.038091] [INFO ] [LOCAL ] BBT: Starting deletion of primary data. [2025-10-15T17:29:50.038577] [DEBUG] [LOCAL ] BBDO: Trimmed 7501 records to 5027 (keeping 200 days of data) [2025-10-15T17:29:50.038499] [DEBUG] [LOCAL ] BBT: No primary data file found to delete. [2025-10-15T17:29:50.038691] [INFO ] [LOCAL ] BBT: Starting deletion of derivative data. [2025-10-15T17:29:50.039043] [DEBUG] [LOCAL ] BBT: No derivative data file found to delete. [2025-10-15T17:29:50.039264] [INFO ] [MAIN ] Update Progress: 222/2369 symbols completed. BBT took 2.8s. Estimated remaining: 4h 47m 48s. Rate: 7.5 symbols/min [2025-10-15T17:29:50.191500] [DEBUG] [LOCAL ] BBDO: Primary data saved (5027 records). [2025-10-15T17:29:50.209795] [INFO ] [MAIN ] BBDO: Full history saved. [2025-10-15T17:29:50.223001] [INFO ] [MAIN ] Update Progress: 223/2369 symbols completed. BBDO took 18.7s. Estimated remaining: 4h 46m 24s. Rate: 7.5 symbols/min [2025-10-15T17:29:50.241687] [INFO ] [MAIN ] BBUC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:29:50.388179] [DEBUG] [LOCAL ] BBUC: Loaded 13635 existing records from primary storage. [2025-10-15T17:29:50.418813] [INFO ] [MAIN ] BBVA: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:29:50.417397] [INFO ] [MAIN ] BBUC: Loaded 13635 existing records. [2025-10-15T17:29:50.519057] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-06. [2025-10-15T17:29:50.607103] [WARN ] [MAIN ] BBUC: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:29:50.607556] [INFO ] [MAIN ] BBUC: Wiping existing primary data before full refresh. [2025-10-15T17:29:50.607632] [INFO ] [LOCAL ] BBUC: Starting deletion of primary data. [2025-10-15T17:29:50.607942] [DEBUG] [LOCAL ] BBUC: Deleted primary data file. [2025-10-15T17:29:50.608009] [INFO ] [MAIN ] BBUC: Starting full primary refresh. [2025-10-15T17:29:50.821416] [DEBUG] [LOCAL ] BBVA: Loaded 49107 existing records from primary storage. [2025-10-15T17:29:50.900878] [INFO ] [MAIN ] BBVA: Loaded 49107 existing records. [2025-10-15T17:29:51.188973] [INFO ] [REMOTE ] BBUC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:29:51.217935] [WARN ] [MAIN ] BBVA: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:29:51.218165] [INFO ] [MAIN ] BBVA: Wiping existing primary data before full refresh. [2025-10-15T17:29:51.218223] [INFO ] [LOCAL ] BBVA: Starting deletion of primary data. [2025-10-15T17:29:51.218605] [DEBUG] [LOCAL ] BBVA: Deleted primary data file. [2025-10-15T17:29:51.218693] [INFO ] [MAIN ] BBVA: Starting full primary refresh. [2025-10-15T17:29:51.319267] [INFO ] [REMOTE ] BBU: Fetching primary data for 2024-12. [2025-10-15T17:29:51.592675] [INFO ] [REMOTE ] BBVA: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:29:51.657249] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-15T17:29:52.034260] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-10-15T17:29:52.114048] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-01. [2025-10-15T17:29:52.738496] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-15T17:29:52.914051] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-02. [2025-10-15T17:29:53.427571] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-10-15T17:29:53.714012] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-03. [2025-10-15T17:29:54.256167] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-10-15T17:29:54.513996] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-07. [2025-10-15T17:29:55.313986] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-04. [2025-10-15T17:29:55.431028] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-15T17:29:55.742884] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-10-15T17:29:56.114038] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-05. [2025-10-15T17:29:56.624463] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-10-15T17:29:56.914011] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-08. [2025-10-15T17:29:57.714003] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2024-12. [2025-10-15T17:29:57.769174] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-15T17:29:58.513995] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2024-12. [2025-10-15T17:29:59.313999] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-06. [2025-10-15T17:29:59.674079] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-10-15T17:29:59.769710] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2024-12 (2.06 seconds). [2025-10-15T17:29:59.849949] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-15T17:30:00.114020] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-07. [2025-10-15T17:30:00.878338] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-15T17:30:00.914024] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-09. [2025-10-15T17:30:01.714086] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-01. [2025-10-15T17:30:02.012376] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-15T17:30:02.321303] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-15T17:30:02.514070] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-01. [2025-10-15T17:30:03.314056] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-08. [2025-10-15T17:30:04.114063] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-10. [2025-10-15T17:30:04.199774] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-15T17:30:04.609802] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-01 (2.10 seconds). [2025-10-15T17:30:04.906276] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-15T17:30:04.908513] [INFO ] [REMOTE ] BBN: Full fetch complete (25519 records). [2025-10-15T17:30:04.908598] [DEBUG] [VALIDATOR ] BBN: Validating primary data. [2025-10-15T17:30:04.909262] [FATAL] [VALIDATOR ] BBN: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T17:30:04.909366] [FATAL] [MAIN ] BBN: Fetched primary data is invalid. Refusing to save it. [2025-10-15T17:30:04.909418] [WARN ] [MAIN ] BBN: Deleting existing primary and derivative data due to validation failure. [2025-10-15T17:30:04.909492] [INFO ] [LOCAL ] BBN: Starting deletion of primary data. [2025-10-15T17:30:04.909563] [DEBUG] [LOCAL ] BBN: No primary data file found to delete. [2025-10-15T17:30:04.909608] [INFO ] [LOCAL ] BBN: Starting deletion of derivative data. [2025-10-15T17:30:04.909848] [DEBUG] [LOCAL ] BBN: Deleted derivative data file. [2025-10-15T17:30:04.909958] [INFO ] [MAIN ] Update Progress: 224/2369 symbols completed. BBN took 30.4s. Estimated remaining: 4h 47m 20s. Rate: 7.5 symbols/min [2025-10-15T17:30:04.921246] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-02. [2025-10-15T17:30:05.099015] [INFO ] [MAIN ] BBW: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:30:05.132008] [DEBUG] [LOCAL ] BBW: Loaded 27403 existing records from primary storage. [2025-10-15T17:30:05.132599] [INFO ] [MAIN ] BBW: Loaded 27403 existing records. [2025-10-15T17:30:05.326958] [WARN ] [MAIN ] BBW: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:30:05.327205] [INFO ] [MAIN ] BBW: Wiping existing primary data before full refresh. [2025-10-15T17:30:05.327259] [INFO ] [LOCAL ] BBW: Starting deletion of primary data. [2025-10-15T17:30:05.327634] [DEBUG] [LOCAL ] BBW: Deleted primary data file. [2025-10-15T17:30:05.327729] [INFO ] [MAIN ] BBW: Starting full primary refresh. [2025-10-15T17:30:05.727380] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-02. [2025-10-15T17:30:05.734750] [INFO ] [REMOTE ] BBW: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:30:06.485814] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-15T17:30:06.514022] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-03. [2025-10-15T17:30:06.730611] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-15T17:30:07.314022] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-03. [2025-10-15T17:30:07.551766] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-15T17:30:08.114016] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-04. [2025-10-15T17:30:08.914061] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-09. [2025-10-15T17:30:09.012149] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-15T17:30:09.273938] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-15T17:30:09.437051] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-10-15T17:30:09.714058] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-04. [2025-10-15T17:30:10.514050] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-10. [2025-10-15T17:30:11.299213] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-15T17:30:11.301496] [INFO ] [REMOTE ] BBU: Full fetch complete (7156 records). [2025-10-15T17:30:11.301578] [DEBUG] [VALIDATOR ] BBU: Validating primary data. [2025-10-15T17:30:11.302133] [FATAL] [VALIDATOR ] BBU: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T17:30:11.302223] [FATAL] [MAIN ] BBU: Fetched primary data is invalid. Refusing to save it. [2025-10-15T17:30:11.302297] [WARN ] [MAIN ] BBU: Deleting existing primary and derivative data due to validation failure. [2025-10-15T17:30:11.302385] [INFO ] [LOCAL ] BBU: Starting deletion of primary data. [2025-10-15T17:30:11.302474] [DEBUG] [LOCAL ] BBU: No primary data file found to delete. [2025-10-15T17:30:11.302531] [INFO ] [LOCAL ] BBU: Starting deletion of derivative data. [2025-10-15T17:30:11.302593] [DEBUG] [LOCAL ] BBU: No derivative data file found to delete. [2025-10-15T17:30:11.302678] [INFO ] [MAIN ] Update Progress: 225/2369 symbols completed. BBU took 23.8s. Estimated remaining: 4h 46m 57s. Rate: 7.5 symbols/min [2025-10-15T17:30:11.319074] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-05. [2025-10-15T17:30:11.496777] [INFO ] [MAIN ] BBWI: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:30:11.552371] [DEBUG] [LOCAL ] BBWI: Loaded 53584 existing records from primary storage. [2025-10-15T17:30:11.552825] [INFO ] [MAIN ] BBWI: Loaded 53584 existing records. [2025-10-15T17:30:11.741945] [WARN ] [MAIN ] BBWI: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:30:11.742295] [INFO ] [MAIN ] BBWI: Wiping existing primary data before full refresh. [2025-10-15T17:30:11.742349] [INFO ] [LOCAL ] BBWI: Starting deletion of primary data. [2025-10-15T17:30:11.742980] [DEBUG] [LOCAL ] BBWI: Deleted primary data file. [2025-10-15T17:30:11.743040] [INFO ] [MAIN ] BBWI: Starting full primary refresh. [2025-10-15T17:30:12.114928] [INFO ] [REMOTE ] BBW: Fetching primary data for 2024-12. [2025-10-15T17:30:12.154441] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-04 (2.44 seconds). [2025-10-15T17:30:12.188885] [INFO ] [REMOTE ] BBWI: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:30:12.441046] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-15T17:30:12.914091] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2024-12. [2025-10-15T17:30:13.581949] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-15T17:30:13.714039] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-06. [2025-10-15T17:30:14.459787] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-15T17:30:14.514032] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-07. [2025-10-15T17:30:14.779446] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-10-15T17:30:15.314012] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-05. [2025-10-15T17:30:15.373810] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-15T17:30:16.114030] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-01. [2025-10-15T17:30:16.922313] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-08. [2025-10-15T17:30:16.947967] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-15T17:30:17.648885] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-15T17:30:17.714024] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-01. [2025-10-15T17:30:17.856749] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-15T17:30:18.514021] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-09. [2025-10-15T17:30:18.742975] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-15T17:30:19.177245] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-15T17:30:19.314029] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-02. [2025-10-15T17:30:20.114024] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-10. [2025-10-15T17:30:20.253968] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-15T17:30:20.892864] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-15T17:30:20.895531] [INFO ] [REMOTE ] BBUC: Full fetch complete (18704 records). [2025-10-15T17:30:20.895609] [DEBUG] [VALIDATOR ] BBUC: Validating primary data. [2025-10-15T17:30:20.896193] [FATAL] [VALIDATOR ] BBUC: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T17:30:20.896307] [FATAL] [MAIN ] BBUC: Fetched primary data is invalid. Refusing to save it. [2025-10-15T17:30:20.896421] [WARN ] [MAIN ] BBUC: Deleting existing primary and derivative data due to validation failure. [2025-10-15T17:30:20.896481] [INFO ] [LOCAL ] BBUC: Starting deletion of primary data. [2025-10-15T17:30:20.896583] [DEBUG] [LOCAL ] BBUC: No primary data file found to delete. [2025-10-15T17:30:20.896637] [INFO ] [LOCAL ] BBUC: Starting deletion of derivative data. [2025-10-15T17:30:20.897008] [DEBUG] [LOCAL ] BBUC: Deleted derivative data file. [2025-10-15T17:30:20.897126] [INFO ] [MAIN ] Update Progress: 226/2369 symbols completed. BBUC took 30.9s. Estimated remaining: 4h 47m 3s. Rate: 7.5 symbols/min [2025-10-15T17:30:20.919146] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-02. [2025-10-15T17:30:21.079909] [INFO ] [MAIN ] BBY: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:30:21.080144] [DEBUG] [LOCAL ] BBY: No existing data file found in primary storage. [2025-10-15T17:30:21.080193] [WARN ] [MAIN ] BBY: No existing data found, performing full refresh instead. [2025-10-15T17:30:21.080316] [INFO ] [MAIN ] BBY: Wiping existing primary data before full refresh. [2025-10-15T17:30:21.080360] [INFO ] [LOCAL ] BBY: Starting deletion of primary data. [2025-10-15T17:30:21.080436] [DEBUG] [LOCAL ] BBY: No primary data file found to delete. [2025-10-15T17:30:21.080496] [INFO ] [MAIN ] BBY: Starting full primary refresh. [2025-10-15T17:30:21.469887] [INFO ] [REMOTE ] BBY: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:30:21.714038] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-06. [2025-10-15T17:30:22.514086] [INFO ] [REMOTE ] BBY: Fetching primary data for 2024-12. [2025-10-15T17:30:22.675014] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-15T17:30:23.314052] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-03. [2025-10-15T17:30:23.388951] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-15T17:30:24.114005] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-03. [2025-10-15T17:30:24.272995] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-15T17:30:24.657824] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-15T17:30:24.914108] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-04. [2025-10-15T17:30:25.714047] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-07. [2025-10-15T17:30:25.933570] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-15T17:30:26.101856] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-15T17:30:26.514099] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-01. [2025-10-15T17:30:27.314063] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-05. [2025-10-15T17:30:27.655253] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-15T17:30:28.114055] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-08. [2025-10-15T17:30:28.315325] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-15T17:30:28.393918] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-15T17:30:28.914060] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-02. [2025-10-15T17:30:29.713986] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-04. [2025-10-15T17:30:29.914072] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-15T17:30:30.514000] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-09. [2025-10-15T17:30:30.865314] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-10-15T17:30:31.006795] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-15T17:30:31.314070] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-05. [2025-10-15T17:30:32.113999] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-03. [2025-10-15T17:30:32.518546] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-10-15T17:30:32.914035] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-10. [2025-10-15T17:30:33.055302] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-15T17:30:33.714028] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-06. [2025-10-15T17:30:34.133678] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-10-15T17:30:34.514231] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-04. [2025-10-15T17:30:35.314008] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-06. [2025-10-15T17:30:35.611393] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-10 (2.70 seconds). [2025-10-15T17:30:35.618097] [INFO ] [REMOTE ] BBVA: Full fetch complete (71747 records). [2025-10-15T17:30:35.618279] [DEBUG] [VALIDATOR ] BBVA: Validating primary data. [2025-10-15T17:30:36.047750] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-06 (2.33 seconds). [2025-10-15T17:30:36.100326] [DEBUG] [VALIDATOR ] BBVA: All expected trading days are present. [2025-10-15T17:30:36.100561] [DEBUG] [VALIDATOR ] BBVA: Primary data validation passed. [2025-10-15T17:30:36.101826] [INFO ] [MAIN ] BBVA: Fetched primary data is valid. [2025-10-15T17:30:36.112551] [DEBUG] [LOCAL ] BBVA: Saving primary data. [2025-10-15T17:30:36.114629] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-07. [2025-10-15T17:30:36.119751] [DEBUG] [LOCAL ] BBVA: Trimmed 71747 records to 49092 (keeping 200 days of data) [2025-10-15T17:30:36.264724] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-15T17:30:36.495007] [DEBUG] [LOCAL ] BBVA: Primary data saved (49092 records). [2025-10-15T17:30:36.495206] [INFO ] [MAIN ] BBVA: Full history saved. [2025-10-15T17:30:36.495309] [INFO ] [MAIN ] Update Progress: 227/2369 symbols completed. BBVA took 46.3s. Estimated remaining: 4h 48m 7s. Rate: 7.4 symbols/min [2025-10-15T17:30:36.689007] [INFO ] [MAIN ] BC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:30:36.706611] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-15T17:30:36.755156] [DEBUG] [LOCAL ] BC: Loaded 44123 existing records from primary storage. [2025-10-15T17:30:36.755566] [INFO ] [MAIN ] BC: Loaded 44123 existing records. [2025-10-15T17:30:36.917247] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-05. [2025-10-15T17:30:36.948120] [WARN ] [MAIN ] BC: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:30:36.948443] [INFO ] [MAIN ] BC: Wiping existing primary data before full refresh. [2025-10-15T17:30:36.948496] [INFO ] [LOCAL ] BC: Starting deletion of primary data. [2025-10-15T17:30:36.949070] [DEBUG] [LOCAL ] BC: Deleted primary data file. [2025-10-15T17:30:36.949148] [INFO ] [MAIN ] BC: Starting full primary refresh. [2025-10-15T17:30:37.329026] [INFO ] [REMOTE ] BC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:30:37.714033] [INFO ] [REMOTE ] BC: Fetching primary data for 2024-12. [2025-10-15T17:30:38.044519] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-15T17:30:38.513996] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-08. [2025-10-15T17:30:38.635973] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-15T17:30:39.037212] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-15T17:30:39.314047] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-01. [2025-10-15T17:30:40.113989] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-06. [2025-10-15T17:30:40.251799] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-15T17:30:40.483929] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-15T17:30:40.914023] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-02. [2025-10-15T17:30:41.714054] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-09. [2025-10-15T17:30:41.865573] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-15T17:30:42.514033] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-07. [2025-10-15T17:30:42.560695] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-15T17:30:43.314066] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-07. [2025-10-15T17:30:43.584555] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-15T17:30:44.172394] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-10. [2025-10-15T17:30:44.202459] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-15T17:30:44.367011] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-15T17:30:44.914023] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-08. [2025-10-15T17:30:45.714000] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-03. [2025-10-15T17:30:45.816986] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-15T17:30:45.824036] [INFO ] [REMOTE ] BBWI: Full fetch complete (77622 records). [2025-10-15T17:30:45.824240] [DEBUG] [VALIDATOR ] BBWI: Validating primary data. [2025-10-15T17:30:46.219170] [DEBUG] [VALIDATOR ] BBWI: All expected trading days are present. [2025-10-15T17:30:46.219308] [DEBUG] [VALIDATOR ] BBWI: Primary data validation passed. [2025-10-15T17:30:46.220285] [INFO ] [MAIN ] BBWI: Fetched primary data is valid. [2025-10-15T17:30:46.220360] [DEBUG] [LOCAL ] BBWI: Saving primary data. [2025-10-15T17:30:46.222015] [DEBUG] [LOCAL ] BBWI: Trimmed 77622 records to 53584 (keeping 200 days of data) [2025-10-15T17:30:46.329555] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-15T17:30:46.520519] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-09. [2025-10-15T17:30:46.568288] [DEBUG] [LOCAL ] BBWI: Primary data saved (53584 records). [2025-10-15T17:30:46.568445] [INFO ] [MAIN ] BBWI: Full history saved. [2025-10-15T17:30:46.568528] [INFO ] [MAIN ] Update Progress: 228/2369 symbols completed. BBWI took 35.3s. Estimated remaining: 4h 48m 17s. Rate: 7.4 symbols/min [2025-10-15T17:30:46.744159] [INFO ] [MAIN ] BCAT: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:30:46.778597] [DEBUG] [LOCAL ] BCAT: Loaded 34173 existing records from primary storage. [2025-10-15T17:30:46.778987] [INFO ] [MAIN ] BCAT: Loaded 34173 existing records. [2025-10-15T17:30:46.964755] [WARN ] [MAIN ] BCAT: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:30:46.965358] [INFO ] [MAIN ] BCAT: Wiping existing primary data before full refresh. [2025-10-15T17:30:46.965559] [INFO ] [LOCAL ] BCAT: Starting deletion of primary data. [2025-10-15T17:30:46.966438] [DEBUG] [LOCAL ] BCAT: Deleted primary data file. [2025-10-15T17:30:46.966498] [INFO ] [MAIN ] BCAT: Starting full primary refresh. [2025-10-15T17:30:47.143141] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-15T17:30:47.319185] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-08. [2025-10-15T17:30:47.388612] [INFO ] [REMOTE ] BCAT: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:30:48.007860] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-15T17:30:48.113991] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2024-12. [2025-10-15T17:30:48.914021] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-10. [2025-10-15T17:30:49.062672] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-15T17:30:49.561511] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-15T17:30:49.714039] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-01. [2025-10-15T17:30:50.153401] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-15T17:30:50.157906] [INFO ] [REMOTE ] BBW: Full fetch complete (39570 records). [2025-10-15T17:30:50.158039] [DEBUG] [VALIDATOR ] BBW: Validating primary data. [2025-10-15T17:30:50.158801] [FATAL] [VALIDATOR ] BBW: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T17:30:50.158892] [FATAL] [MAIN ] BBW: Fetched primary data is invalid. Refusing to save it. [2025-10-15T17:30:50.158936] [WARN ] [MAIN ] BBW: Deleting existing primary and derivative data due to validation failure. [2025-10-15T17:30:50.158979] [INFO ] [LOCAL ] BBW: Starting deletion of primary data. [2025-10-15T17:30:50.159044] [DEBUG] [LOCAL ] BBW: No primary data file found to delete. [2025-10-15T17:30:50.159082] [INFO ] [LOCAL ] BBW: Starting deletion of derivative data. [2025-10-15T17:30:50.159412] [DEBUG] [LOCAL ] BBW: Deleted derivative data file. [2025-10-15T17:30:50.159518] [INFO ] [MAIN ] Update Progress: 229/2369 symbols completed. BBW took 45.2s. Estimated remaining: 4h 47m 27s. Rate: 7.4 symbols/min [2025-10-15T17:30:50.343170] [INFO ] [MAIN ] BCC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:30:50.377409] [DEBUG] [LOCAL ] BCC: Loaded 28478 existing records from primary storage. [2025-10-15T17:30:50.377819] [INFO ] [MAIN ] BCC: Loaded 28478 existing records. [2025-10-15T17:30:50.520329] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-04. [2025-10-15T17:30:50.564232] [WARN ] [MAIN ] BCC: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:30:50.564481] [INFO ] [MAIN ] BCC: Wiping existing primary data before full refresh. [2025-10-15T17:30:50.564531] [INFO ] [LOCAL ] BCC: Starting deletion of primary data. [2025-10-15T17:30:50.565152] [DEBUG] [LOCAL ] BCC: Deleted primary data file. [2025-10-15T17:30:50.565212] [INFO ] [MAIN ] BCC: Starting full primary refresh. [2025-10-15T17:30:50.966773] [INFO ] [REMOTE ] BCC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:30:50.980076] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-15T17:30:51.313999] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-09. [2025-10-15T17:30:52.114073] [INFO ] [REMOTE ] BCC: Fetching primary data for 2024-12. [2025-10-15T17:30:52.185612] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-15T17:30:52.914017] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-05. [2025-10-15T17:30:53.087721] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-15T17:30:53.228027] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-15T17:30:53.714013] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-01. [2025-10-15T17:30:54.439811] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-15T17:30:54.513968] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-06. [2025-10-15T17:30:54.626554] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-15T17:30:55.314008] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-02. [2025-10-15T17:30:56.043521] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-15T17:30:56.113978] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-02. [2025-10-15T17:30:56.554326] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-15T17:30:56.914049] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-03. [2025-10-15T17:30:57.400724] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-15T17:30:57.714019] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-03. [2025-10-15T17:30:58.361830] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-15T17:30:58.514025] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-10. [2025-10-15T17:30:59.054323] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-15T17:30:59.314024] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-04. [2025-10-15T17:31:00.113966] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-04. [2025-10-15T17:31:00.276510] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-15T17:31:00.282872] [INFO ] [REMOTE ] BBY: Full fetch complete (77394 records). [2025-10-15T17:31:00.283001] [DEBUG] [VALIDATOR ] BBY: Validating primary data. [2025-10-15T17:31:00.693792] [DEBUG] [VALIDATOR ] BBY: All expected trading days are present. [2025-10-15T17:31:00.694037] [DEBUG] [VALIDATOR ] BBY: Primary data validation passed. [2025-10-15T17:31:00.695119] [INFO ] [MAIN ] BBY: Fetched primary data is valid. [2025-10-15T17:31:00.695222] [DEBUG] [LOCAL ] BBY: Saving primary data. [2025-10-15T17:31:00.716964] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-15T17:31:00.717118] [DEBUG] [LOCAL ] BBY: Trimmed 77394 records to 53445 (keeping 200 days of data) [2025-10-15T17:31:00.915182] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-07. [2025-10-15T17:31:01.058735] [DEBUG] [LOCAL ] BBY: Primary data saved (53445 records). [2025-10-15T17:31:01.058890] [INFO ] [MAIN ] BBY: Full history saved. [2025-10-15T17:31:01.058971] [INFO ] [MAIN ] Update Progress: 230/2369 symbols completed. BBY took 40.2s. Estimated remaining: 4h 47m 46s. Rate: 7.4 symbols/min [2025-10-15T17:31:01.236161] [INFO ] [MAIN ] BCE: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:31:01.255808] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-15T17:31:01.311804] [DEBUG] [LOCAL ] BCE: Loaded 52241 existing records from primary storage. [2025-10-15T17:31:01.312121] [INFO ] [MAIN ] BCE: Loaded 52241 existing records. [2025-10-15T17:31:01.494834] [WARN ] [MAIN ] BCE: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:31:01.495103] [INFO ] [MAIN ] BCE: Wiping existing primary data before full refresh. [2025-10-15T17:31:01.495159] [INFO ] [LOCAL ] BCE: Starting deletion of primary data. [2025-10-15T17:31:01.496078] [DEBUG] [LOCAL ] BCE: Deleted primary data file. [2025-10-15T17:31:01.496137] [INFO ] [MAIN ] BCE: Starting full primary refresh. [2025-10-15T17:31:01.722739] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-05. [2025-10-15T17:31:01.889915] [INFO ] [REMOTE ] BCE: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:31:02.514015] [INFO ] [REMOTE ] BCE: Fetching primary data for 2024-12. [2025-10-15T17:31:02.644827] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-15T17:31:03.319900] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-08. [2025-10-15T17:31:03.325095] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-15T17:31:04.114014] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-05. [2025-10-15T17:31:04.522179] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-10-15T17:31:04.836100] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-15T17:31:04.913979] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-09. [2025-10-15T17:31:05.396191] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-15T17:31:05.714004] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-01. [2025-10-15T17:31:06.368138] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-15T17:31:06.514112] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-06. [2025-10-15T17:31:07.313976] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-10. [2025-10-15T17:31:07.366320] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-15T17:31:07.803994] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-15T17:31:08.114056] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-06. [2025-10-15T17:31:08.739983] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-15T17:31:08.744915] [INFO ] [REMOTE ] BC: Full fetch complete (63748 records). [2025-10-15T17:31:08.745022] [DEBUG] [VALIDATOR ] BC: Validating primary data. [2025-10-15T17:31:08.920249] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-07. [2025-10-15T17:31:09.137754] [DEBUG] [VALIDATOR ] BC: All expected trading days are present. [2025-10-15T17:31:09.137857] [DEBUG] [VALIDATOR ] BC: Primary data validation passed. [2025-10-15T17:31:09.138780] [INFO ] [MAIN ] BC: Fetched primary data is valid. [2025-10-15T17:31:09.138855] [DEBUG] [LOCAL ] BC: Saving primary data. [2025-10-15T17:31:09.155099] [DEBUG] [LOCAL ] BC: Trimmed 63748 records to 44083 (keeping 200 days of data) [2025-10-15T17:31:09.154800] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-15T17:31:09.428263] [DEBUG] [LOCAL ] BC: Primary data saved (44083 records). [2025-10-15T17:31:09.428403] [INFO ] [MAIN ] BC: Full history saved. [2025-10-15T17:31:09.428481] [INFO ] [MAIN ] Update Progress: 231/2369 symbols completed. BC took 32.9s. Estimated remaining: 4h 47m 40s. Rate: 7.4 symbols/min [2025-10-15T17:31:09.592893] [INFO ] [MAIN ] BCH: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:31:09.623083] [DEBUG] [LOCAL ] BCH: Loaded 30171 existing records from primary storage. [2025-10-15T17:31:09.623397] [INFO ] [MAIN ] BCH: Loaded 30171 existing records. [2025-10-15T17:31:09.719121] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-07. [2025-10-15T17:31:09.812402] [WARN ] [MAIN ] BCH: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:31:09.812689] [INFO ] [MAIN ] BCH: Wiping existing primary data before full refresh. [2025-10-15T17:31:09.812750] [INFO ] [LOCAL ] BCH: Starting deletion of primary data. [2025-10-15T17:31:09.813379] [DEBUG] [LOCAL ] BCH: Deleted primary data file. [2025-10-15T17:31:09.813437] [INFO ] [MAIN ] BCH: Starting full primary refresh. [2025-10-15T17:31:10.198664] [INFO ] [REMOTE ] BCH: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:31:10.284296] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-15T17:31:10.514037] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-02. [2025-10-15T17:31:11.246816] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-15T17:31:11.314053] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-08. [2025-10-15T17:31:12.020602] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-15T17:31:12.114008] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-03. [2025-10-15T17:31:12.809890] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-15T17:31:12.914005] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-09. [2025-10-15T17:31:13.713974] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-08. [2025-10-15T17:31:13.839407] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-15T17:31:14.214797] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-15T17:31:14.514014] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-04. [2025-10-15T17:31:14.829812] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-15T17:31:15.313993] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-09. [2025-10-15T17:31:16.113977] [INFO ] [REMOTE ] BCH: Fetching primary data for 2024-12. [2025-10-15T17:31:16.253921] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-15T17:31:16.593969] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-15T17:31:16.914044] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-10. [2025-10-15T17:31:17.393563] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-15T17:31:17.713991] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-01. [2025-10-15T17:31:18.037249] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-15T17:31:18.045006] [INFO ] [REMOTE ] BCAT: Full fetch complete (49983 records). [2025-10-15T17:31:18.045159] [DEBUG] [VALIDATOR ] BCAT: Validating primary data. [2025-10-15T17:31:18.426965] [DEBUG] [VALIDATOR ] BCAT: All expected trading days are present. [2025-10-15T17:31:18.427056] [DEBUG] [VALIDATOR ] BCAT: Primary data validation passed. [2025-10-15T17:31:18.427786] [INFO ] [MAIN ] BCAT: Fetched primary data is valid. [2025-10-15T17:31:18.427851] [DEBUG] [LOCAL ] BCAT: Saving primary data. [2025-10-15T17:31:18.428949] [DEBUG] [LOCAL ] BCAT: Trimmed 49983 records to 34198 (keeping 200 days of data) [2025-10-15T17:31:18.516374] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-10. [2025-10-15T17:31:18.651350] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-15T17:31:18.664813] [DEBUG] [LOCAL ] BCAT: Primary data saved (34198 records). [2025-10-15T17:31:18.664961] [INFO ] [MAIN ] BCAT: Full history saved. [2025-10-15T17:31:18.665232] [INFO ] [MAIN ] Update Progress: 232/2369 symbols completed. BCAT took 32.1s. Estimated remaining: 4h 47m 43s. Rate: 7.4 symbols/min [2025-10-15T17:31:18.842783] [INFO ] [MAIN ] BCO: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:31:18.869394] [DEBUG] [LOCAL ] BCO: Loaded 25488 existing records from primary storage. [2025-10-15T17:31:18.869727] [INFO ] [MAIN ] BCO: Loaded 25488 existing records. [2025-10-15T17:31:19.072329] [WARN ] [MAIN ] BCO: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:31:19.072623] [INFO ] [MAIN ] BCO: Wiping existing primary data before full refresh. [2025-10-15T17:31:19.072704] [INFO ] [LOCAL ] BCO: Starting deletion of primary data. [2025-10-15T17:31:19.073352] [DEBUG] [LOCAL ] BCO: Deleted primary data file. [2025-10-15T17:31:19.073437] [INFO ] [MAIN ] BCO: Starting full primary refresh. [2025-10-15T17:31:19.319233] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-02. [2025-10-15T17:31:19.559525] [INFO ] [REMOTE ] BCO: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:31:19.872914] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-15T17:31:19.881056] [INFO ] [REMOTE ] BCC: Full fetch complete (41224 records). [2025-10-15T17:31:19.881329] [DEBUG] [VALIDATOR ] BCC: Validating primary data. [2025-10-15T17:31:20.119158] [INFO ] [REMOTE ] BCO: Fetching primary data for 2024-12. [2025-10-15T17:31:20.417586] [DEBUG] [VALIDATOR ] BCC: All expected trading days are present. [2025-10-15T17:31:20.417731] [DEBUG] [VALIDATOR ] BCC: Primary data validation passed. [2025-10-15T17:31:20.418553] [INFO ] [MAIN ] BCC: Fetched primary data is valid. [2025-10-15T17:31:20.418636] [DEBUG] [LOCAL ] BCC: Saving primary data. [2025-10-15T17:31:20.419880] [DEBUG] [LOCAL ] BCC: Trimmed 41224 records to 28504 (keeping 200 days of data) [2025-10-15T17:31:20.541693] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-15T17:31:20.631706] [DEBUG] [LOCAL ] BCC: Primary data saved (28504 records). [2025-10-15T17:31:20.631874] [INFO ] [MAIN ] BCC: Full history saved. [2025-10-15T17:31:20.631967] [INFO ] [MAIN ] Update Progress: 233/2369 symbols completed. BCC took 30.5s. Estimated remaining: 4h 46m 39s. Rate: 7.5 symbols/min [2025-10-15T17:31:20.823052] [INFO ] [MAIN ] BCS: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:31:20.877571] [DEBUG] [LOCAL ] BCS: Loaded 53441 existing records from primary storage. [2025-10-15T17:31:20.878003] [INFO ] [MAIN ] BCS: Loaded 53441 existing records. [2025-10-15T17:31:20.924084] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-03. [2025-10-15T17:31:21.084986] [WARN ] [MAIN ] BCS: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:31:21.085297] [INFO ] [MAIN ] BCS: Wiping existing primary data before full refresh. [2025-10-15T17:31:21.085380] [INFO ] [LOCAL ] BCS: Starting deletion of primary data. [2025-10-15T17:31:21.086531] [DEBUG] [LOCAL ] BCS: Deleted primary data file. [2025-10-15T17:31:21.086688] [INFO ] [MAIN ] BCS: Starting full primary refresh. [2025-10-15T17:31:21.471151] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-15T17:31:21.517243] [INFO ] [REMOTE ] BCS: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:31:21.714037] [INFO ] [REMOTE ] BCS: Fetching primary data for 2024-12. [2025-10-15T17:31:21.962802] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-15T17:31:22.514017] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-01. [2025-10-15T17:31:23.314042] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-04. [2025-10-15T17:31:23.513286] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-15T17:31:23.560606] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-15T17:31:24.113988] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-02. [2025-10-15T17:31:24.467686] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-15T17:31:24.913964] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-05. [2025-10-15T17:31:25.213295] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-15T17:31:25.713974] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-01. [2025-10-15T17:31:26.058521] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-15T17:31:26.513982] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-05. [2025-10-15T17:31:27.272213] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-15T17:31:27.313963] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-06. [2025-10-15T17:31:28.113998] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-03. [2025-10-15T17:31:28.327811] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-15T17:31:28.512363] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-10-15T17:31:28.913948] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-07. [2025-10-15T17:31:29.128808] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-15T17:31:29.714013] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-06. [2025-10-15T17:31:30.087380] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-15T17:31:30.514126] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-02. [2025-10-15T17:31:31.314017] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-08. [2025-10-15T17:31:31.494693] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-15T17:31:32.114034] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-07. [2025-10-15T17:31:32.333039] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-15T17:31:32.389269] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-15T17:31:32.914051] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-09. [2025-10-15T17:31:33.713997] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-03. [2025-10-15T17:31:34.020331] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-15T17:31:34.173014] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-15T17:31:34.514015] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-08. [2025-10-15T17:31:35.313998] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-10. [2025-10-15T17:31:35.814767] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-03 (2.10 seconds). [2025-10-15T17:31:36.100045] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-15T17:31:36.113947] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-09. [2025-10-15T17:31:36.282165] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-15T17:31:36.286588] [INFO ] [REMOTE ] BCH: Full fetch complete (41483 records). [2025-10-15T17:31:36.286715] [DEBUG] [VALIDATOR ] BCH: Validating primary data. [2025-10-15T17:31:36.287212] [FATAL] [VALIDATOR ] BCH: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T17:31:36.287292] [FATAL] [MAIN ] BCH: Fetched primary data is invalid. Refusing to save it. [2025-10-15T17:31:36.287334] [WARN ] [MAIN ] BCH: Deleting existing primary and derivative data due to validation failure. [2025-10-15T17:31:36.287377] [INFO ] [LOCAL ] BCH: Starting deletion of primary data. [2025-10-15T17:31:36.287473] [DEBUG] [LOCAL ] BCH: No primary data file found to delete. [2025-10-15T17:31:36.287588] [INFO ] [LOCAL ] BCH: Starting deletion of derivative data. [2025-10-15T17:31:36.287847] [DEBUG] [LOCAL ] BCH: Deleted derivative data file. [2025-10-15T17:31:36.287934] [INFO ] [MAIN ] Update Progress: 234/2369 symbols completed. BCH took 26.9s. Estimated remaining: 4h 47m 40s. Rate: 7.4 symbols/min [2025-10-15T17:31:36.463270] [INFO ] [MAIN ] BCSF: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:31:36.491795] [DEBUG] [LOCAL ] BCSF: Loaded 28261 existing records from primary storage. [2025-10-15T17:31:36.492110] [INFO ] [MAIN ] BCSF: Loaded 28261 existing records. [2025-10-15T17:31:36.675957] [WARN ] [MAIN ] BCSF: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:31:36.676224] [INFO ] [MAIN ] BCSF: Wiping existing primary data before full refresh. [2025-10-15T17:31:36.676282] [INFO ] [LOCAL ] BCSF: Starting deletion of primary data. [2025-10-15T17:31:36.676890] [DEBUG] [LOCAL ] BCSF: Deleted primary data file. [2025-10-15T17:31:36.676947] [INFO ] [MAIN ] BCSF: Starting full primary refresh. [2025-10-15T17:31:36.919164] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-04. [2025-10-15T17:31:37.038719] [INFO ] [REMOTE ] BCSF: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:31:37.424119] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-15T17:31:37.714025] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2024-12. [2025-10-15T17:31:38.284988] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-15T17:31:38.491607] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-10-15T17:31:38.513952] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-01. [2025-10-15T17:31:39.313978] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-10. [2025-10-15T17:31:39.405934] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-15T17:31:40.114008] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-05. [2025-10-15T17:31:40.812253] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-15T17:31:40.818623] [INFO ] [REMOTE ] BCE: Full fetch complete (76116 records). [2025-10-15T17:31:40.818824] [DEBUG] [VALIDATOR ] BCE: Validating primary data. [2025-10-15T17:31:40.917344] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-02. [2025-10-15T17:31:41.232418] [DEBUG] [VALIDATOR ] BCE: All expected trading days are present. [2025-10-15T17:31:41.232801] [DEBUG] [VALIDATOR ] BCE: Primary data validation passed. [2025-10-15T17:31:41.233849] [INFO ] [MAIN ] BCE: Fetched primary data is valid. [2025-10-15T17:31:41.233916] [DEBUG] [LOCAL ] BCE: Saving primary data. [2025-10-15T17:31:41.235458] [DEBUG] [LOCAL ] BCE: Trimmed 76116 records to 52247 (keeping 200 days of data) [2025-10-15T17:31:41.344780] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-15T17:31:41.580265] [DEBUG] [LOCAL ] BCE: Primary data saved (52247 records). [2025-10-15T17:31:41.580387] [INFO ] [MAIN ] BCE: Full history saved. [2025-10-15T17:31:41.581422] [INFO ] [MAIN ] Update Progress: 235/2369 symbols completed. BCE took 40.5s. Estimated remaining: 4h 47m 7s. Rate: 7.4 symbols/min [2025-10-15T17:31:41.731698] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-04. [2025-10-15T17:31:41.771309] [INFO ] [MAIN ] BCX: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:31:41.797336] [DEBUG] [LOCAL ] BCX: Loaded 21952 existing records from primary storage. [2025-10-15T17:31:41.797753] [INFO ] [MAIN ] BCX: Loaded 21952 existing records. [2025-10-15T17:31:41.934397] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-15T17:31:42.004612] [WARN ] [MAIN ] BCX: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:31:42.004946] [INFO ] [MAIN ] BCX: Wiping existing primary data before full refresh. [2025-10-15T17:31:42.004998] [INFO ] [LOCAL ] BCX: Starting deletion of primary data. [2025-10-15T17:31:42.005863] [DEBUG] [LOCAL ] BCX: Deleted primary data file. [2025-10-15T17:31:42.005926] [INFO ] [MAIN ] BCX: Starting full primary refresh. [2025-10-15T17:31:42.373791] [INFO ] [REMOTE ] BCX: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:31:42.514011] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-06. [2025-10-15T17:31:43.313978] [INFO ] [REMOTE ] BCX: Fetching primary data for 2024-12. [2025-10-15T17:31:43.732369] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-15T17:31:43.763175] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-15T17:31:44.113998] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-07. [2025-10-15T17:31:44.244393] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-10-15T17:31:44.913966] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-03. [2025-10-15T17:31:45.084250] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-15T17:31:45.714003] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-08. [2025-10-15T17:31:45.845809] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-15T17:31:46.513980] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-04. [2025-10-15T17:31:46.738551] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-15T17:31:47.314025] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-01. [2025-10-15T17:31:47.651527] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-15T17:31:48.114020] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-09. [2025-10-15T17:31:48.451830] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-15T17:31:48.914006] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-02. [2025-10-15T17:31:49.277303] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-15T17:31:49.713989] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-10. [2025-10-15T17:31:49.936752] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-15T17:31:50.513999] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-03. [2025-10-15T17:31:50.641953] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-15T17:31:50.645052] [INFO ] [REMOTE ] BCO: Full fetch complete (36288 records). [2025-10-15T17:31:50.645189] [DEBUG] [VALIDATOR ] BCO: Validating primary data. [2025-10-15T17:31:51.037901] [DEBUG] [VALIDATOR ] BCO: All expected trading days are present. [2025-10-15T17:31:51.038015] [DEBUG] [VALIDATOR ] BCO: Primary data validation passed. [2025-10-15T17:31:51.038948] [INFO ] [MAIN ] BCO: Fetched primary data is valid. [2025-10-15T17:31:51.039016] [DEBUG] [LOCAL ] BCO: Saving primary data. [2025-10-15T17:31:51.043418] [DEBUG] [LOCAL ] BCO: Trimmed 36288 records to 25461 (keeping 200 days of data) [2025-10-15T17:31:51.211392] [DEBUG] [LOCAL ] BCO: Primary data saved (25461 records). [2025-10-15T17:31:51.211729] [INFO ] [MAIN ] BCO: Full history saved. [2025-10-15T17:31:51.211887] [INFO ] [MAIN ] Update Progress: 236/2369 symbols completed. BCO took 32.5s. Estimated remaining: 4h 47m 13s. Rate: 7.4 symbols/min [2025-10-15T17:31:51.316719] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-05. [2025-10-15T17:31:51.410776] [INFO ] [MAIN ] BDC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:31:51.454783] [DEBUG] [LOCAL ] BDC: Loaded 24554 existing records from primary storage. [2025-10-15T17:31:51.456311] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-15T17:31:51.456831] [INFO ] [MAIN ] BDC: Loaded 24554 existing records. [2025-10-15T17:31:51.667946] [WARN ] [MAIN ] BDC: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:31:51.668210] [INFO ] [MAIN ] BDC: Wiping existing primary data before full refresh. [2025-10-15T17:31:51.668304] [INFO ] [LOCAL ] BDC: Starting deletion of primary data. [2025-10-15T17:31:51.668715] [DEBUG] [LOCAL ] BDC: Deleted primary data file. [2025-10-15T17:31:51.668775] [INFO ] [MAIN ] BDC: Starting full primary refresh. [2025-10-15T17:31:52.065907] [INFO ] [REMOTE ] BDC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:31:52.114004] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-04. [2025-10-15T17:31:52.914025] [INFO ] [REMOTE ] BDC: Fetching primary data for 2024-12. [2025-10-15T17:31:53.348235] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-10-15T17:31:53.534571] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-15T17:31:53.713997] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-05. [2025-10-15T17:31:54.244726] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-15T17:31:54.514080] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-05. [2025-10-15T17:31:54.563927] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-15T17:31:55.313997] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-06. [2025-10-15T17:31:55.597446] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-15T17:31:56.114042] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-06. [2025-10-15T17:31:56.332471] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-15T17:31:56.914023] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-07. [2025-10-15T17:31:57.185370] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-15T17:31:57.713985] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-06. [2025-10-15T17:31:57.844243] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-15T17:31:58.514060] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-08. [2025-10-15T17:31:59.313984] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-07. [2025-10-15T17:31:59.407630] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-15T17:32:00.114005] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-09. [2025-10-15T17:32:00.477192] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-06 (2.76 seconds). [2025-10-15T17:32:00.913973] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-01. [2025-10-15T17:32:01.164341] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-15T17:32:01.182766] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-15T17:32:01.714082] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-10. [2025-10-15T17:32:02.037094] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-15T17:32:02.514032] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-07. [2025-10-15T17:32:02.642338] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-15T17:32:02.645796] [INFO ] [REMOTE ] BCX: Full fetch complete (33882 records). [2025-10-15T17:32:02.645873] [DEBUG] [VALIDATOR ] BCX: Validating primary data. [2025-10-15T17:32:03.044495] [DEBUG] [VALIDATOR ] BCX: All expected trading days are present. [2025-10-15T17:32:03.044592] [DEBUG] [VALIDATOR ] BCX: Primary data validation passed. [2025-10-15T17:32:03.045138] [INFO ] [MAIN ] BCX: Fetched primary data is valid. [2025-10-15T17:32:03.045198] [DEBUG] [LOCAL ] BCX: Saving primary data. [2025-10-15T17:32:03.045947] [DEBUG] [LOCAL ] BCX: Trimmed 33882 records to 22028 (keeping 200 days of data) [2025-10-15T17:32:03.172382] [DEBUG] [LOCAL ] BCX: Primary data saved (22028 records). [2025-10-15T17:32:03.172515] [INFO ] [MAIN ] BCX: Full history saved. [2025-10-15T17:32:03.172589] [INFO ] [MAIN ] Update Progress: 237/2369 symbols completed. BCX took 21.6s. Estimated remaining: 4h 47m 40s. Rate: 7.4 symbols/min [2025-10-15T17:32:03.314078] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-08. [2025-10-15T17:32:04.040383] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-15T17:32:04.113974] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-09. [2025-10-15T17:32:04.477152] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-15T17:32:04.913997] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-02. [2025-10-15T17:32:05.432174] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-15T17:32:05.713997] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-10. [2025-10-15T17:32:06.341568] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-15T17:32:06.514040] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-08. [2025-10-15T17:32:07.196792] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-15T17:32:07.201718] [INFO ] [REMOTE ] BCSF: Full fetch complete (39378 records). [2025-10-15T17:32:07.201811] [DEBUG] [VALIDATOR ] BCSF: Validating primary data. [2025-10-15T17:32:07.319135] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-03. [2025-10-15T17:32:07.602064] [DEBUG] [VALIDATOR ] BCSF: All expected trading days are present. [2025-10-15T17:32:07.602147] [DEBUG] [VALIDATOR ] BCSF: Primary data validation passed. [2025-10-15T17:32:07.602778] [INFO ] [MAIN ] BCSF: Fetched primary data is valid. [2025-10-15T17:32:07.602839] [DEBUG] [LOCAL ] BCSF: Saving primary data. [2025-10-15T17:32:07.603734] [DEBUG] [LOCAL ] BCSF: Trimmed 39378 records to 28156 (keeping 200 days of data) [2025-10-15T17:32:07.774751] [DEBUG] [LOCAL ] BCSF: Primary data saved (28156 records). [2025-10-15T17:32:07.774902] [INFO ] [MAIN ] BCSF: Full history saved. [2025-10-15T17:32:07.774982] [INFO ] [MAIN ] Update Progress: 238/2369 symbols completed. BCSF took 31.5s. Estimated remaining: 4h 47m 0s. Rate: 7.4 symbols/min [2025-10-15T17:32:08.390417] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-15T17:32:08.401944] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-09. [2025-10-15T17:32:08.766137] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-15T17:32:08.913966] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-04. [2025-10-15T17:32:10.288718] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-15T17:32:10.300783] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-10. [2025-10-15T17:32:10.334084] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-15T17:32:10.513999] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-05. [2025-10-15T17:32:11.698209] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-15T17:32:11.704975] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-06. [2025-10-15T17:32:11.814491] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-15T17:32:11.821343] [INFO ] [REMOTE ] BCS: Full fetch complete (77507 records). [2025-10-15T17:32:11.821548] [DEBUG] [VALIDATOR ] BCS: Validating primary data. [2025-10-15T17:32:12.351314] [DEBUG] [VALIDATOR ] BCS: All expected trading days are present. [2025-10-15T17:32:12.351485] [DEBUG] [VALIDATOR ] BCS: Primary data validation passed. [2025-10-15T17:32:12.352854] [INFO ] [MAIN ] BCS: Fetched primary data is valid. [2025-10-15T17:32:12.352945] [DEBUG] [LOCAL ] BCS: Saving primary data. [2025-10-15T17:32:12.355089] [DEBUG] [LOCAL ] BCS: Trimmed 77507 records to 53442 (keeping 200 days of data) [2025-10-15T17:32:12.636916] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-15T17:32:12.666422] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-07. [2025-10-15T17:32:12.802422] [DEBUG] [LOCAL ] BCS: Primary data saved (53442 records). [2025-10-15T17:32:12.802621] [INFO ] [MAIN ] BCS: Full history saved. [2025-10-15T17:32:12.802993] [INFO ] [MAIN ] Update Progress: 239/2369 symbols completed. BCS took 52.2s. Estimated remaining: 4h 46m 25s. Rate: 7.4 symbols/min [2025-10-15T17:32:13.842365] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-15T17:32:13.848499] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-08. [2025-10-15T17:32:15.102636] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-15T17:32:15.108687] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-09. [2025-10-15T17:32:16.151953] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-15T17:32:16.158281] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-10. [2025-10-15T17:32:17.514385] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-15T17:32:17.518137] [INFO ] [REMOTE ] BDC: Full fetch complete (35751 records). [2025-10-15T17:32:17.518297] [DEBUG] [VALIDATOR ] BDC: Validating primary data. [2025-10-15T17:32:17.518949] [FATAL] [VALIDATOR ] BDC: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T17:32:17.519041] [FATAL] [MAIN ] BDC: Fetched primary data is invalid. Refusing to save it. [2025-10-15T17:32:17.519085] [WARN ] [MAIN ] BDC: Deleting existing primary and derivative data due to validation failure. [2025-10-15T17:32:17.519125] [INFO ] [LOCAL ] BDC: Starting deletion of primary data. [2025-10-15T17:32:17.519182] [DEBUG] [LOCAL ] BDC: No primary data file found to delete. [2025-10-15T17:32:17.519218] [INFO ] [LOCAL ] BDC: Starting deletion of derivative data. [2025-10-15T17:32:17.519369] [DEBUG] [LOCAL ] BDC: Deleted derivative data file. [2025-10-15T17:32:17.519460] [INFO ] [MAIN ] Update Progress: 240/2369 symbols completed. BDC took 26.3s. Estimated remaining: 4h 45m 47s. Rate: 7.4 symbols/min [2025-10-15T17:32:18.123991] [INFO ] [MAIN ] BDX: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:32:18.273213] [INFO ] [MAIN ] BE: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:32:18.296638] [INFO ] [MAIN ] BDJ: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:32:18.296880] [DEBUG] [LOCAL ] BE: No existing data file found in primary storage. [2025-10-15T17:32:18.279194] [INFO ] [MAIN ] BDN: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:32:18.297257] [WARN ] [MAIN ] BE: No existing data found, performing full refresh instead. [2025-10-15T17:32:18.297808] [INFO ] [MAIN ] BE: Wiping existing primary data before full refresh. [2025-10-15T17:32:18.297878] [INFO ] [LOCAL ] BE: Starting deletion of primary data. [2025-10-15T17:32:18.298055] [DEBUG] [LOCAL ] BE: No primary data file found to delete. [2025-10-15T17:32:18.298107] [INFO ] [MAIN ] BE: Starting full primary refresh. [2025-10-15T17:32:18.575613] [DEBUG] [LOCAL ] BDJ: Loaded 29403 existing records from primary storage. [2025-10-15T17:32:18.592803] [INFO ] [MAIN ] BDJ: Loaded 29403 existing records. [2025-10-15T17:32:18.761372] [DEBUG] [LOCAL ] BDX: Loaded 52180 existing records from primary storage. [2025-10-15T17:32:18.813555] [DEBUG] [LOCAL ] BDN: Loaded 47627 existing records from primary storage. [2025-10-15T17:32:18.813710] [INFO ] [MAIN ] BDX: Loaded 52180 existing records. [2025-10-15T17:32:18.857759] [INFO ] [REMOTE ] BE: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:32:18.891927] [INFO ] [REMOTE ] BE: Fetching primary data for 2024-12. [2025-10-15T17:32:18.875308] [INFO ] [MAIN ] BDN: Loaded 47627 existing records. [2025-10-15T17:32:19.112700] [WARN ] [MAIN ] BDJ: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:32:19.174805] [INFO ] [MAIN ] BDJ: Wiping existing primary data before full refresh. [2025-10-15T17:32:19.201560] [INFO ] [LOCAL ] BDJ: Starting deletion of primary data. [2025-10-15T17:32:19.212119] [DEBUG] [LOCAL ] BDJ: Deleted primary data file. [2025-10-15T17:32:19.281864] [INFO ] [MAIN ] BDJ: Starting full primary refresh. [2025-10-15T17:32:19.323349] [WARN ] [MAIN ] BDX: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:32:19.357372] [INFO ] [MAIN ] BDX: Wiping existing primary data before full refresh. [2025-10-15T17:32:19.357279] [WARN ] [MAIN ] BDN: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:32:19.365804] [INFO ] [LOCAL ] BDX: Starting deletion of primary data. [2025-10-15T17:32:19.357613] [INFO ] [MAIN ] BDN: Wiping existing primary data before full refresh. [2025-10-15T17:32:19.394017] [DEBUG] [LOCAL ] BDX: Deleted primary data file. [2025-10-15T17:32:19.414793] [INFO ] [LOCAL ] BDN: Starting deletion of primary data. [2025-10-15T17:32:19.406477] [INFO ] [MAIN ] BDX: Starting full primary refresh. [2025-10-15T17:32:19.480092] [DEBUG] [LOCAL ] BDN: Deleted primary data file. [2025-10-15T17:32:19.523038] [INFO ] [MAIN ] BDN: Starting full primary refresh. [2025-10-15T17:32:20.366008] [INFO ] [REMOTE ] BDJ: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:32:20.410155] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2024-12. [2025-10-15T17:32:20.488059] [INFO ] [REMOTE ] BDX: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:32:20.510759] [INFO ] [REMOTE ] BDX: Fetching primary data for 2024-12. [2025-10-15T17:32:20.600371] [INFO ] [REMOTE ] BDN: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:32:20.600878] [INFO ] [REMOTE ] BDN: Fetching primary data for 2024-12. [2025-10-15T17:32:21.334123] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2024-12 (2.44 seconds). [2025-10-15T17:32:21.344991] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-01. [2025-10-15T17:32:21.614616] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-15T17:32:21.621415] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-01. [2025-10-15T17:32:22.116457] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-15T17:32:22.127224] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-01. [2025-10-15T17:32:22.328589] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-15T17:32:22.340253] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-01. [2025-10-15T17:32:22.820258] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-15T17:32:22.827127] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-02. [2025-10-15T17:32:23.396467] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-01 (2.05 seconds). [2025-10-15T17:32:23.407614] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-02. [2025-10-15T17:32:23.621612] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-15T17:32:23.633512] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-02. [2025-10-15T17:32:23.682868] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-15T17:32:23.718528] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-15T17:32:24.114022] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-02. [2025-10-15T17:32:24.914006] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-03. [2025-10-15T17:32:25.421960] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-02 (2.01 seconds). [2025-10-15T17:32:25.547788] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-10-15T17:32:25.615432] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-15T17:32:25.713965] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-03. [2025-10-15T17:32:26.152711] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-15T17:32:26.514010] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-03. [2025-10-15T17:32:27.314028] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-03. [2025-10-15T17:32:27.618220] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-15T17:32:28.114044] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-04. [2025-10-15T17:32:28.648480] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-03 (2.13 seconds). [2025-10-15T17:32:28.763327] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-15T17:32:28.914090] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-04. [2025-10-15T17:32:29.714029] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-04. [2025-10-15T17:32:30.043682] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-15T17:32:30.513985] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-05. [2025-10-15T17:32:31.313971] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-04. [2025-10-15T17:32:31.425588] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-15T17:32:31.535591] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-04 (2.62 seconds). [2025-10-15T17:32:32.114016] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-05. [2025-10-15T17:32:32.729204] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-05 (2.22 seconds). [2025-10-15T17:32:32.747029] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-15T17:32:32.914035] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-05. [2025-10-15T17:32:33.229258] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-15T17:32:33.714026] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-06. [2025-10-15T17:32:34.125955] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-15T17:32:34.514070] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-06. [2025-10-15T17:32:35.071350] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-15T17:32:35.313991] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-07. [2025-10-15T17:32:35.613559] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-15T17:32:36.113993] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-06. [2025-10-15T17:32:36.921566] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-05. [2025-10-15T17:32:36.924485] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-15T17:32:37.713956] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-07. [2025-10-15T17:32:38.037476] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-10-15T17:32:38.514013] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-07. [2025-10-15T17:32:39.314031] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-08. [2025-10-15T17:32:39.469114] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-15T17:32:39.583353] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-05 (2.66 seconds). [2025-10-15T17:32:40.114075] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-08. [2025-10-15T17:32:40.754380] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-07 (2.24 seconds). [2025-10-15T17:32:40.907802] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-15T17:32:40.917361] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-08. [2025-10-15T17:32:41.117682] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-15T17:32:41.714015] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-09. [2025-10-15T17:32:42.513992] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-06. [2025-10-15T17:32:43.179586] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-15T17:32:43.313971] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-09. [2025-10-15T17:32:43.356361] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-08 (2.44 seconds). [2025-10-15T17:32:44.114034] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-09. [2025-10-15T17:32:44.211716] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-15T17:32:44.914036] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-10. [2025-10-15T17:32:45.064105] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-15T17:32:45.714006] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-07. [2025-10-15T17:32:46.250394] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-15T17:32:46.254496] [INFO ] [REMOTE ] BDJ: Full fetch complete (43106 records). [2025-10-15T17:32:46.254586] [DEBUG] [VALIDATOR ] BDJ: Validating primary data. [2025-10-15T17:32:46.467561] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-09 (2.35 seconds). [2025-10-15T17:32:46.513977] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-10. [2025-10-15T17:32:46.725178] [DEBUG] [VALIDATOR ] BDJ: All expected trading days are present. [2025-10-15T17:32:46.725285] [DEBUG] [VALIDATOR ] BDJ: Primary data validation passed. [2025-10-15T17:32:46.725945] [INFO ] [MAIN ] BDJ: Fetched primary data is valid. [2025-10-15T17:32:46.726014] [DEBUG] [LOCAL ] BDJ: Saving primary data. [2025-10-15T17:32:46.727126] [DEBUG] [LOCAL ] BDJ: Trimmed 43106 records to 29470 (keeping 200 days of data) [2025-10-15T17:32:46.901317] [DEBUG] [LOCAL ] BDJ: Primary data saved (29470 records). [2025-10-15T17:32:46.901461] [INFO ] [MAIN ] BDJ: Full history saved. [2025-10-15T17:32:46.901541] [INFO ] [MAIN ] Update Progress: 241/2369 symbols completed. BDJ took 29.4s. Estimated remaining: 4h 48m 48s. Rate: 7.4 symbols/min [2025-10-15T17:32:47.073970] [INFO ] [MAIN ] BEDU: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:32:47.074179] [DEBUG] [LOCAL ] BEDU: No existing data file found in primary storage. [2025-10-15T17:32:47.074216] [WARN ] [MAIN ] BEDU: No existing data found, performing full refresh instead. [2025-10-15T17:32:47.074324] [INFO ] [MAIN ] BEDU: Wiping existing primary data before full refresh. [2025-10-15T17:32:47.074365] [INFO ] [LOCAL ] BEDU: Starting deletion of primary data. [2025-10-15T17:32:47.074404] [DEBUG] [LOCAL ] BEDU: No primary data file found to delete. [2025-10-15T17:32:47.074436] [INFO ] [MAIN ] BEDU: Starting full primary refresh. [2025-10-15T17:32:47.317746] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-10. [2025-10-15T17:32:47.452097] [INFO ] [REMOTE ] BEDU: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:32:47.619350] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-15T17:32:48.113985] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-08. [2025-10-15T17:32:48.233685] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-15T17:32:48.239742] [INFO ] [REMOTE ] BDN: Full fetch complete (69342 records). [2025-10-15T17:32:48.239889] [DEBUG] [VALIDATOR ] BDN: Validating primary data. [2025-10-15T17:32:48.631928] [DEBUG] [VALIDATOR ] BDN: All expected trading days are present. [2025-10-15T17:32:48.632024] [DEBUG] [VALIDATOR ] BDN: Primary data validation passed. [2025-10-15T17:32:48.632955] [INFO ] [MAIN ] BDN: Fetched primary data is valid. [2025-10-15T17:32:48.633030] [DEBUG] [LOCAL ] BDN: Saving primary data. [2025-10-15T17:32:48.634482] [DEBUG] [LOCAL ] BDN: Trimmed 69342 records to 47666 (keeping 200 days of data) [2025-10-15T17:32:48.909080] [DEBUG] [LOCAL ] BDN: Primary data saved (47666 records). [2025-10-15T17:32:48.909237] [INFO ] [MAIN ] BDN: Full history saved. [2025-10-15T17:32:48.909322] [INFO ] [MAIN ] Update Progress: 242/2369 symbols completed. BDN took 31.4s. Estimated remaining: 4h 47m 45s. Rate: 7.4 symbols/min [2025-10-15T17:32:48.941168] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2024-12. [2025-10-15T17:32:49.084908] [INFO ] [MAIN ] BEKE: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:32:49.138889] [DEBUG] [LOCAL ] BEKE: Loaded 53218 existing records from primary storage. [2025-10-15T17:32:49.139247] [INFO ] [MAIN ] BEKE: Loaded 53218 existing records. [2025-10-15T17:32:49.315161] [WARN ] [MAIN ] BEKE: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:32:49.315394] [INFO ] [MAIN ] BEKE: Wiping existing primary data before full refresh. [2025-10-15T17:32:49.315441] [INFO ] [LOCAL ] BEKE: Starting deletion of primary data. [2025-10-15T17:32:49.315849] [DEBUG] [LOCAL ] BEKE: Deleted primary data file. [2025-10-15T17:32:49.315904] [INFO ] [MAIN ] BEKE: Starting full primary refresh. [2025-10-15T17:32:49.532234] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-10-15T17:32:49.678319] [INFO ] [REMOTE ] BEKE: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:32:49.713968] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-01. [2025-10-15T17:32:50.035554] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-15T17:32:50.050093] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-01 (0.34 seconds). [2025-10-15T17:32:50.325431] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-10 (3.01 seconds). [2025-10-15T17:32:50.335054] [INFO ] [REMOTE ] BE: Full fetch complete (77813 records). [2025-10-15T17:32:50.335264] [DEBUG] [VALIDATOR ] BE: Validating primary data. [2025-10-15T17:32:50.522846] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-02. [2025-10-15T17:32:50.741622] [DEBUG] [VALIDATOR ] BE: All expected trading days are present. [2025-10-15T17:32:50.741752] [DEBUG] [VALIDATOR ] BE: Primary data validation passed. [2025-10-15T17:32:50.742595] [INFO ] [MAIN ] BE: Fetched primary data is valid. [2025-10-15T17:32:50.742637] [DEBUG] [LOCAL ] BE: Saving primary data. [2025-10-15T17:32:50.744100] [DEBUG] [LOCAL ] BE: Trimmed 77813 records to 53661 (keeping 200 days of data) [2025-10-15T17:32:50.919725] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-10-15T17:32:51.062765] [DEBUG] [LOCAL ] BE: Primary data saved (53661 records). [2025-10-15T17:32:51.062926] [INFO ] [MAIN ] BE: Full history saved. [2025-10-15T17:32:51.062998] [INFO ] [MAIN ] Update Progress: 243/2369 symbols completed. BE took 33.5s. Estimated remaining: 4h 46m 45s. Rate: 7.4 symbols/min [2025-10-15T17:32:51.232920] [INFO ] [MAIN ] BEN: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:32:51.281628] [DEBUG] [LOCAL ] BEN: Loaded 53122 existing records from primary storage. [2025-10-15T17:32:51.282024] [INFO ] [MAIN ] BEN: Loaded 53122 existing records. [2025-10-15T17:32:51.319134] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2024-12. [2025-10-15T17:32:51.465730] [WARN ] [MAIN ] BEN: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:32:51.465956] [INFO ] [MAIN ] BEN: Wiping existing primary data before full refresh. [2025-10-15T17:32:51.466003] [INFO ] [LOCAL ] BEN: Starting deletion of primary data. [2025-10-15T17:32:51.466565] [DEBUG] [LOCAL ] BEN: Deleted primary data file. [2025-10-15T17:32:51.466623] [INFO ] [MAIN ] BEN: Starting full primary refresh. [2025-10-15T17:32:51.846584] [INFO ] [REMOTE ] BEN: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:32:52.114009] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-03. [2025-10-15T17:32:52.531064] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-10-15T17:32:52.914025] [INFO ] [REMOTE ] BEN: Fetching primary data for 2024-12. [2025-10-15T17:32:53.272019] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-10-15T17:32:53.714009] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-04. [2025-10-15T17:32:54.156529] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-10-15T17:32:54.513982] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-05. [2025-10-15T17:32:54.615421] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-15T17:32:54.857265] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-10-15T17:32:55.314070] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-09. [2025-10-15T17:32:56.113990] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-01. [2025-10-15T17:32:56.913981] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-06. [2025-10-15T17:32:57.232824] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-06 (0.32 seconds). [2025-10-15T17:32:57.235428] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-15T17:32:57.714000] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-07. [2025-10-15T17:32:57.808204] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-15T17:32:57.982156] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-07 (0.27 seconds). [2025-10-15T17:32:58.514019] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-10. [2025-10-15T17:32:59.314047] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-02. [2025-10-15T17:33:00.005427] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-15T17:33:00.012223] [INFO ] [REMOTE ] BDX: Full fetch complete (75561 records). [2025-10-15T17:33:00.012440] [DEBUG] [VALIDATOR ] BDX: Validating primary data. [2025-10-15T17:33:00.119102] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-08. [2025-10-15T17:33:00.426485] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-08 (0.31 seconds). [2025-10-15T17:33:00.451464] [DEBUG] [VALIDATOR ] BDX: All expected trading days are present. [2025-10-15T17:33:00.451569] [DEBUG] [VALIDATOR ] BDX: Primary data validation passed. [2025-10-15T17:33:00.452547] [INFO ] [MAIN ] BDX: Fetched primary data is valid. [2025-10-15T17:33:00.452616] [DEBUG] [LOCAL ] BDX: Saving primary data. [2025-10-15T17:33:00.454260] [DEBUG] [LOCAL ] BDX: Trimmed 75561 records to 52176 (keeping 200 days of data) [2025-10-15T17:33:00.781614] [DEBUG] [LOCAL ] BDX: Primary data saved (52176 records). [2025-10-15T17:33:00.781815] [INFO ] [MAIN ] BDX: Full history saved. [2025-10-15T17:33:00.781902] [INFO ] [MAIN ] Update Progress: 244/2369 symbols completed. BDX took 43.2s. Estimated remaining: 4h 46m 51s. Rate: 7.4 symbols/min [2025-10-15T17:33:00.926007] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-01. [2025-10-15T17:33:00.958756] [INFO ] [MAIN ] BEP: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:33:01.000748] [DEBUG] [LOCAL ] BEP: Loaded 38935 existing records from primary storage. [2025-10-15T17:33:01.001090] [INFO ] [MAIN ] BEP: Loaded 38935 existing records. [2025-10-15T17:33:01.215509] [WARN ] [MAIN ] BEP: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:33:01.215959] [INFO ] [MAIN ] BEP: Wiping existing primary data before full refresh. [2025-10-15T17:33:01.216162] [INFO ] [LOCAL ] BEP: Starting deletion of primary data. [2025-10-15T17:33:01.225971] [DEBUG] [LOCAL ] BEP: Deleted primary data file. [2025-10-15T17:33:01.241313] [INFO ] [MAIN ] BEP: Starting full primary refresh. [2025-10-15T17:33:01.307388] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-10-15T17:33:01.662867] [INFO ] [REMOTE ] BEP: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:33:01.713948] [INFO ] [REMOTE ] BEP: Fetching primary data for 2024-12. [2025-10-15T17:33:02.514040] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-03. [2025-10-15T17:33:02.789956] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-15T17:33:03.170840] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-15T17:33:03.314077] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-02. [2025-10-15T17:33:04.113975] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-09. [2025-10-15T17:33:04.200140] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-15T17:33:04.765396] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-15T17:33:04.913978] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-04. [2025-10-15T17:33:05.211301] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-10-15T17:33:05.713997] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-03. [2025-10-15T17:33:06.514017] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-10. [2025-10-15T17:33:06.563844] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-15T17:33:06.976223] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-15T17:33:06.977036] [INFO ] [REMOTE ] BEDU: Full fetch complete (1342 records). [2025-10-15T17:33:06.977104] [DEBUG] [VALIDATOR ] BEDU: Validating primary data. [2025-10-15T17:33:07.149945] [WARN ] [VALIDATOR ] BEDU: Validation failed - insufficient historical data. Have 169 unique days, need 200 days [2025-10-15T17:33:07.150118] [FATAL] [MAIN ] BEDU: Fetched primary data is invalid. Refusing to save it. [2025-10-15T17:33:07.150224] [WARN ] [MAIN ] BEDU: Deleting existing primary and derivative data due to validation failure. [2025-10-15T17:33:07.150313] [INFO ] [LOCAL ] BEDU: Starting deletion of primary data. [2025-10-15T17:33:07.150391] [DEBUG] [LOCAL ] BEDU: No primary data file found to delete. [2025-10-15T17:33:07.150430] [INFO ] [LOCAL ] BEDU: Starting deletion of derivative data. [2025-10-15T17:33:07.150475] [DEBUG] [LOCAL ] BEDU: No derivative data file found to delete. [2025-10-15T17:33:07.150528] [INFO ] [MAIN ] Update Progress: 245/2369 symbols completed. BEDU took 20.2s. Estimated remaining: 4h 46m 28s. Rate: 7.4 symbols/min [2025-10-15T17:33:07.317732] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-01. [2025-10-15T17:33:07.322976] [INFO ] [MAIN ] BEPC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:33:07.377389] [DEBUG] [LOCAL ] BEPC: Loaded 46493 existing records from primary storage. [2025-10-15T17:33:07.377871] [INFO ] [MAIN ] BEPC: Loaded 46493 existing records. [2025-10-15T17:33:07.568488] [WARN ] [MAIN ] BEPC: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:33:07.598122] [INFO ] [MAIN ] BEPC: Wiping existing primary data before full refresh. [2025-10-15T17:33:07.598302] [INFO ] [LOCAL ] BEPC: Starting deletion of primary data. [2025-10-15T17:33:07.599200] [DEBUG] [LOCAL ] BEPC: Deleted primary data file. [2025-10-15T17:33:07.600427] [INFO ] [MAIN ] BEPC: Starting full primary refresh. [2025-10-15T17:33:07.600338] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-15T17:33:07.995813] [INFO ] [REMOTE ] BEPC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:33:08.113973] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-05. [2025-10-15T17:33:08.903122] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-15T17:33:08.913950] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-02. [2025-10-15T17:33:09.713980] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-04. [2025-10-15T17:33:09.903161] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-15T17:33:10.469433] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-15T17:33:10.513962] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-06. [2025-10-15T17:33:11.314021] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2024-12. [2025-10-15T17:33:12.114028] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-03. [2025-10-15T17:33:12.752457] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-04 (3.04 seconds). [2025-10-15T17:33:12.865513] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-15T17:33:12.913953] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-01. [2025-10-15T17:33:13.714134] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-05. [2025-10-15T17:33:14.001039] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-06 (3.49 seconds). [2025-10-15T17:33:14.349511] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-15T17:33:14.513976] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-07. [2025-10-15T17:33:14.835834] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-03 (2.72 seconds). [2025-10-15T17:33:15.234509] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-15T17:33:15.313998] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-06. [2025-10-15T17:33:16.114001] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-02. [2025-10-15T17:33:16.365021] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-15T17:33:16.913976] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-08. [2025-10-15T17:33:17.184186] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-10-15T17:33:17.714039] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-07. [2025-10-15T17:33:17.799574] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-15T17:33:18.352135] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-15T17:33:18.514007] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-04. [2025-10-15T17:33:19.313989] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-03. [2025-10-15T17:33:19.411414] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-15T17:33:19.754688] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-15T17:33:20.114083] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-05. [2025-10-15T17:33:20.740309] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-15T17:33:20.914020] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-08. [2025-10-15T17:33:21.372124] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-15T17:33:21.714084] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-09. [2025-10-15T17:33:22.514117] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-04. [2025-10-15T17:33:22.854978] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-15T17:33:23.314064] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-09. [2025-10-15T17:33:23.507361] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-15T17:33:23.594167] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-15T17:33:24.114024] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-10. [2025-10-15T17:33:24.638079] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-15T17:33:24.914028] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-10. [2025-10-15T17:33:25.714095] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-05. [2025-10-15T17:33:25.986134] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-10 (1.87 seconds). [2025-10-15T17:33:25.993180] [INFO ] [REMOTE ] BEN: Full fetch complete (77088 records). [2025-10-15T17:33:25.993357] [DEBUG] [VALIDATOR ] BEN: Validating primary data. [2025-10-15T17:33:26.408443] [DEBUG] [VALIDATOR ] BEN: All expected trading days are present. [2025-10-15T17:33:26.408549] [DEBUG] [VALIDATOR ] BEN: Primary data validation passed. [2025-10-15T17:33:26.409722] [INFO ] [MAIN ] BEN: Fetched primary data is valid. [2025-10-15T17:33:26.409788] [DEBUG] [LOCAL ] BEN: Saving primary data. [2025-10-15T17:33:26.412062] [DEBUG] [LOCAL ] BEN: Trimmed 77088 records to 53122 (keeping 200 days of data) [2025-10-15T17:33:26.515846] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-06. [2025-10-15T17:33:26.769028] [DEBUG] [LOCAL ] BEN: Primary data saved (53122 records). [2025-10-15T17:33:26.769248] [INFO ] [MAIN ] BEN: Full history saved. [2025-10-15T17:33:26.769365] [INFO ] [MAIN ] Update Progress: 246/2369 symbols completed. BEN took 35.7s. Estimated remaining: 4h 47m 60s. Rate: 7.4 symbols/min [2025-10-15T17:33:26.961602] [INFO ] [MAIN ] BEPH: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:33:26.978185] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-10 (2.06 seconds). [2025-10-15T17:33:26.985716] [INFO ] [REMOTE ] BEKE: Full fetch complete (76963 records). [2025-10-15T17:33:26.987891] [DEBUG] [VALIDATOR ] BEKE: Validating primary data. [2025-10-15T17:33:26.989508] [FATAL] [VALIDATOR ] BEKE: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T17:33:26.993287] [DEBUG] [LOCAL ] BEPH: Loaded 5235 existing records from primary storage. [2025-10-15T17:33:26.993397] [FATAL] [MAIN ] BEKE: Fetched primary data is invalid. Refusing to save it. [2025-10-15T17:33:26.993811] [INFO ] [MAIN ] BEPH: Loaded 5235 existing records. [2025-10-15T17:33:26.993925] [WARN ] [MAIN ] BEKE: Deleting existing primary and derivative data due to validation failure. [2025-10-15T17:33:27.039769] [INFO ] [LOCAL ] BEKE: Starting deletion of primary data. [2025-10-15T17:33:27.067489] [DEBUG] [LOCAL ] BEKE: No primary data file found to delete. [2025-10-15T17:33:27.074872] [INFO ] [LOCAL ] BEKE: Starting deletion of derivative data. [2025-10-15T17:33:27.102560] [DEBUG] [LOCAL ] BEKE: Deleted derivative data file. [2025-10-15T17:33:27.102893] [INFO ] [MAIN ] Update Progress: 247/2369 symbols completed. BEKE took 38.2s. Estimated remaining: 4h 46m 44s. Rate: 7.4 symbols/min [2025-10-15T17:33:27.276198] [WARN ] [MAIN ] BEPH: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:33:27.312998] [INFO ] [MAIN ] BEPH: Wiping existing primary data before full refresh. [2025-10-15T17:33:27.332196] [INFO ] [LOCAL ] BEPH: Starting deletion of primary data. [2025-10-15T17:33:27.348171] [DEBUG] [LOCAL ] BEPH: Deleted primary data file. [2025-10-15T17:33:27.353532] [INFO ] [MAIN ] BEPH: Starting full primary refresh. [2025-10-15T17:33:27.436696] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-15T17:33:27.469223] [INFO ] [MAIN ] BEPI: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:33:27.531693] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-06. [2025-10-15T17:33:27.567022] [DEBUG] [LOCAL ] BEPI: Loaded 3611 existing records from primary storage. [2025-10-15T17:33:27.567474] [INFO ] [MAIN ] BEPI: Loaded 3611 existing records. [2025-10-15T17:33:28.078895] [INFO ] [REMOTE ] BEPH: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:33:28.099407] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-15T17:33:28.105611] [WARN ] [MAIN ] BEPI: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:33:28.109256] [INFO ] [MAIN ] BEPI: Wiping existing primary data before full refresh. [2025-10-15T17:33:28.114218] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2024-12. [2025-10-15T17:33:28.114101] [INFO ] [LOCAL ] BEPI: Starting deletion of primary data. [2025-10-15T17:33:28.115907] [DEBUG] [LOCAL ] BEPI: Deleted primary data file. [2025-10-15T17:33:28.115967] [INFO ] [MAIN ] BEPI: Starting full primary refresh. [2025-10-15T17:33:28.501040] [INFO ] [REMOTE ] BEPI: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:33:28.907388] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-10-15T17:33:28.913955] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-01. [2025-10-15T17:33:29.713983] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2024-12. [2025-10-15T17:33:30.217172] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-06 (2.69 seconds). [2025-10-15T17:33:30.280457] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-15T17:33:30.369750] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-10-15T17:33:30.514063] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-07. [2025-10-15T17:33:31.314048] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-02. [2025-10-15T17:33:31.740129] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-15T17:33:31.875918] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-15T17:33:32.114096] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-07. [2025-10-15T17:33:32.914072] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-01. [2025-10-15T17:33:33.350934] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-10-15T17:33:33.654996] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-15T17:33:33.714032] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-02. [2025-10-15T17:33:34.168997] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-15T17:33:34.514014] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-03. [2025-10-15T17:33:34.934948] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-10-15T17:33:35.314016] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-08. [2025-10-15T17:33:36.114029] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-08. [2025-10-15T17:33:36.771935] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-15T17:33:36.914042] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-03. [2025-10-15T17:33:37.433699] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-10-15T17:33:37.603323] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-15T17:33:37.714027] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-04. [2025-10-15T17:33:38.337137] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-10-15T17:33:38.514012] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-09. [2025-10-15T17:33:39.314043] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-04. [2025-10-15T17:33:39.913696] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-10-15T17:33:40.114019] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-05. [2025-10-15T17:33:40.361095] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-15T17:33:40.783613] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-15T17:33:40.914066] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-05. [2025-10-15T17:33:41.481077] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-15T17:33:41.714058] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-06. [2025-10-15T17:33:42.300014] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-15T17:33:42.514014] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-06. [2025-10-15T17:33:42.935817] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-10-15T17:33:43.314043] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-10. [2025-10-15T17:33:44.114010] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-07. [2025-10-15T17:33:44.667417] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-10-15T17:33:44.914034] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-07. [2025-10-15T17:33:45.063826] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-15T17:33:45.070125] [INFO ] [REMOTE ] BEPC: Full fetch complete (68910 records). [2025-10-15T17:33:45.070282] [DEBUG] [VALIDATOR ] BEPC: Validating primary data. [2025-10-15T17:33:45.461323] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-10-15T17:33:45.485922] [DEBUG] [VALIDATOR ] BEPC: All expected trading days are present. [2025-10-15T17:33:45.486007] [DEBUG] [VALIDATOR ] BEPC: Primary data validation passed. [2025-10-15T17:33:45.486894] [INFO ] [MAIN ] BEPC: Fetched primary data is valid. [2025-10-15T17:33:45.489234] [DEBUG] [LOCAL ] BEPC: Saving primary data. [2025-10-15T17:33:45.491683] [DEBUG] [LOCAL ] BEPC: Trimmed 68910 records to 46488 (keeping 200 days of data) [2025-10-15T17:33:45.714793] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-09. [2025-10-15T17:33:45.792131] [DEBUG] [LOCAL ] BEPC: Primary data saved (46488 records). [2025-10-15T17:33:45.792320] [INFO ] [MAIN ] BEPC: Full history saved. [2025-10-15T17:33:45.793558] [INFO ] [MAIN ] Update Progress: 248/2369 symbols completed. BEPC took 38.6s. Estimated remaining: 4h 48m 7s. Rate: 7.4 symbols/min [2025-10-15T17:33:45.987414] [INFO ] [MAIN ] BEPJ: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:33:45.995467] [DEBUG] [LOCAL ] BEPJ: Loaded 3116 existing records from primary storage. [2025-10-15T17:33:45.995825] [INFO ] [MAIN ] BEPJ: Loaded 3116 existing records. [2025-10-15T17:33:46.177358] [WARN ] [MAIN ] BEPJ: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:33:46.177706] [INFO ] [MAIN ] BEPJ: Wiping existing primary data before full refresh. [2025-10-15T17:33:46.177768] [INFO ] [LOCAL ] BEPJ: Starting deletion of primary data. [2025-10-15T17:33:46.177979] [DEBUG] [LOCAL ] BEPJ: Deleted primary data file. [2025-10-15T17:33:46.178051] [INFO ] [MAIN ] BEPJ: Starting full primary refresh. [2025-10-15T17:33:46.519155] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-08. [2025-10-15T17:33:46.558862] [INFO ] [REMOTE ] BEPJ: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:33:47.003928] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-10-15T17:33:47.296412] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-15T17:33:47.313963] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-10. [2025-10-15T17:33:48.114022] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-08. [2025-10-15T17:33:48.642342] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-15T17:33:48.648471] [INFO ] [REMOTE ] BEP: Full fetch complete (59183 records). [2025-10-15T17:33:48.648616] [DEBUG] [VALIDATOR ] BEP: Validating primary data. [2025-10-15T17:33:48.761477] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-10-15T17:33:48.919258] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-09. [2025-10-15T17:33:49.076455] [DEBUG] [VALIDATOR ] BEP: All expected trading days are present. [2025-10-15T17:33:49.076827] [DEBUG] [VALIDATOR ] BEP: Primary data validation passed. [2025-10-15T17:33:49.077712] [INFO ] [MAIN ] BEP: Fetched primary data is valid. [2025-10-15T17:33:49.077777] [DEBUG] [LOCAL ] BEP: Saving primary data. [2025-10-15T17:33:49.079310] [DEBUG] [LOCAL ] BEP: Trimmed 59183 records to 38951 (keeping 200 days of data) [2025-10-15T17:33:49.326919] [DEBUG] [LOCAL ] BEP: Primary data saved (38951 records). [2025-10-15T17:33:49.327112] [INFO ] [MAIN ] BEP: Full history saved. [2025-10-15T17:33:49.327622] [INFO ] [MAIN ] Update Progress: 249/2369 symbols completed. BEP took 48.5s. Estimated remaining: 4h 47m 19s. Rate: 7.4 symbols/min [2025-10-15T17:33:49.503610] [INFO ] [MAIN ] BFAM: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:33:49.550627] [DEBUG] [LOCAL ] BFAM: Loaded 33752 existing records from primary storage. [2025-10-15T17:33:49.551744] [INFO ] [MAIN ] BFAM: Loaded 33752 existing records. [2025-10-15T17:33:49.552043] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-15T17:33:49.717580] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-09. [2025-10-15T17:33:49.742220] [WARN ] [MAIN ] BFAM: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:33:49.742733] [INFO ] [MAIN ] BFAM: Wiping existing primary data before full refresh. [2025-10-15T17:33:49.742794] [INFO ] [LOCAL ] BFAM: Starting deletion of primary data. [2025-10-15T17:33:49.743398] [DEBUG] [LOCAL ] BFAM: Deleted primary data file. [2025-10-15T17:33:49.743471] [INFO ] [MAIN ] BFAM: Starting full primary refresh. [2025-10-15T17:33:50.123608] [INFO ] [REMOTE ] BFAM: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:33:50.186632] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-10-15T17:33:50.514053] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-10. [2025-10-15T17:33:51.200004] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-15T17:33:51.201130] [INFO ] [REMOTE ] BEPH: Full fetch complete (7570 records). [2025-10-15T17:33:51.201198] [DEBUG] [VALIDATOR ] BEPH: Validating primary data. [2025-10-15T17:33:51.201581] [FATAL] [VALIDATOR ] BEPH: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T17:33:51.201686] [FATAL] [MAIN ] BEPH: Fetched primary data is invalid. Refusing to save it. [2025-10-15T17:33:51.201736] [WARN ] [MAIN ] BEPH: Deleting existing primary and derivative data due to validation failure. [2025-10-15T17:33:51.201874] [INFO ] [LOCAL ] BEPH: Starting deletion of primary data. [2025-10-15T17:33:51.201941] [DEBUG] [LOCAL ] BEPH: No primary data file found to delete. [2025-10-15T17:33:51.201975] [INFO ] [LOCAL ] BEPH: Starting deletion of derivative data. [2025-10-15T17:33:51.202155] [DEBUG] [LOCAL ] BEPH: Deleted derivative data file. [2025-10-15T17:33:51.202239] [INFO ] [MAIN ] Update Progress: 250/2369 symbols completed. BEPH took 24.4s. Estimated remaining: 4h 46m 18s. Rate: 7.4 symbols/min [2025-10-15T17:33:51.319238] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2024-12. [2025-10-15T17:33:51.370884] [INFO ] [MAIN ] BFH: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:33:51.371108] [DEBUG] [LOCAL ] BFH: No existing data file found in primary storage. [2025-10-15T17:33:51.371145] [WARN ] [MAIN ] BFH: No existing data found, performing full refresh instead. [2025-10-15T17:33:51.371259] [INFO ] [MAIN ] BFH: Wiping existing primary data before full refresh. [2025-10-15T17:33:51.371302] [INFO ] [LOCAL ] BFH: Starting deletion of primary data. [2025-10-15T17:33:51.371342] [DEBUG] [LOCAL ] BFH: No primary data file found to delete. [2025-10-15T17:33:51.371374] [INFO ] [MAIN ] BFH: Starting full primary refresh. [2025-10-15T17:33:51.735203] [INFO ] [REMOTE ] BFH: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:33:51.934793] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-10-15T17:33:52.114031] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-01. [2025-10-15T17:33:52.480694] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-01 (0.37 seconds). [2025-10-15T17:33:52.914040] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-10. [2025-10-15T17:33:53.526326] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-15T17:33:53.527518] [INFO ] [REMOTE ] BEPI: Full fetch complete (4772 records). [2025-10-15T17:33:53.527623] [DEBUG] [VALIDATOR ] BEPI: Validating primary data. [2025-10-15T17:33:53.723298] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2024-12. [2025-10-15T17:33:53.903900] [DEBUG] [VALIDATOR ] BEPI: All expected trading days are present. [2025-10-15T17:33:53.903995] [DEBUG] [VALIDATOR ] BEPI: Primary data validation passed. [2025-10-15T17:33:53.904203] [INFO ] [MAIN ] BEPI: Fetched primary data is valid. [2025-10-15T17:33:53.904244] [DEBUG] [LOCAL ] BEPI: Saving primary data. [2025-10-15T17:33:53.904689] [DEBUG] [LOCAL ] BEPI: Trimmed 4772 records to 3616 (keeping 200 days of data) [2025-10-15T17:33:53.928631] [DEBUG] [LOCAL ] BEPI: Primary data saved (3616 records). [2025-10-15T17:33:53.928826] [INFO ] [MAIN ] BEPI: Full history saved. [2025-10-15T17:33:53.928938] [INFO ] [MAIN ] Update Progress: 251/2369 symbols completed. BEPI took 26.8s. Estimated remaining: 4h 45m 25s. Rate: 7.4 symbols/min [2025-10-15T17:33:54.108434] [INFO ] [MAIN ] BFK: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:33:54.108671] [DEBUG] [LOCAL ] BFK: No existing data file found in primary storage. [2025-10-15T17:33:54.108727] [WARN ] [MAIN ] BFK: No existing data found, performing full refresh instead. [2025-10-15T17:33:54.108850] [INFO ] [MAIN ] BFK: Wiping existing primary data before full refresh. [2025-10-15T17:33:54.108892] [INFO ] [LOCAL ] BFK: Starting deletion of primary data. [2025-10-15T17:33:54.108959] [DEBUG] [LOCAL ] BFK: No primary data file found to delete. [2025-10-15T17:33:54.109005] [INFO ] [MAIN ] BFK: Starting full primary refresh. [2025-10-15T17:33:54.477425] [INFO ] [REMOTE ] BFK: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:33:54.514006] [INFO ] [REMOTE ] BFK: Fetching primary data for 2024-12. [2025-10-15T17:33:55.251319] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-15T17:33:55.314040] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-01. [2025-10-15T17:33:55.535606] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-15T17:33:56.114054] [INFO ] [REMOTE ] BFH: Fetching primary data for 2024-12. [2025-10-15T17:33:56.614096] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-15T17:33:56.914004] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-02. [2025-10-15T17:33:57.713996] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-02. [2025-10-15T17:33:58.019461] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-10-15T17:33:58.185210] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-15T17:33:58.189081] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-15T17:33:58.514060] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-01. [2025-10-15T17:33:59.313996] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-03. [2025-10-15T17:33:59.366021] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-15T17:34:00.114025] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-02. [2025-10-15T17:34:00.314331] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-15T17:34:00.914024] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-03. [2025-10-15T17:34:00.936759] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-15T17:34:01.453109] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-10-15T17:34:01.714023] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-04. [2025-10-15T17:34:02.152220] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-10-15T17:34:02.514024] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-01. [2025-10-15T17:34:03.314084] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-04. [2025-10-15T17:34:04.044953] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-15T17:34:04.114022] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-03. [2025-10-15T17:34:04.773287] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-15T17:34:04.914048] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-05. [2025-10-15T17:34:05.039022] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-15T17:34:05.290928] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-10-15T17:34:05.714028] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-06. [2025-10-15T17:34:06.170709] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-10-15T17:34:06.514022] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-02. [2025-10-15T17:34:07.314036] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-05. [2025-10-15T17:34:07.927229] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-15T17:34:08.114069] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-03. [2025-10-15T17:34:08.469634] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-15T17:34:08.914049] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-07. [2025-10-15T17:34:09.420948] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-10-15T17:34:09.714040] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-08. [2025-10-15T17:34:09.852051] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-15T17:34:10.071121] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-08 (0.36 seconds). [2025-10-15T17:34:10.514032] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-09. [2025-10-15T17:34:10.850719] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-09 (0.34 seconds). [2025-10-15T17:34:11.314071] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-10. [2025-10-15T17:34:11.885809] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-15T17:34:11.887086] [INFO ] [REMOTE ] BEPJ: Full fetch complete (4452 records). [2025-10-15T17:34:11.887181] [DEBUG] [VALIDATOR ] BEPJ: Validating primary data. [2025-10-15T17:34:12.125553] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-06. [2025-10-15T17:34:12.364030] [DEBUG] [VALIDATOR ] BEPJ: All expected trading days are present. [2025-10-15T17:34:12.364147] [DEBUG] [VALIDATOR ] BEPJ: Primary data validation passed. [2025-10-15T17:34:12.364376] [INFO ] [MAIN ] BEPJ: Fetched primary data is valid. [2025-10-15T17:34:12.364452] [DEBUG] [LOCAL ] BEPJ: Saving primary data. [2025-10-15T17:34:12.364960] [DEBUG] [LOCAL ] BEPJ: Trimmed 4452 records to 3112 (keeping 200 days of data) [2025-10-15T17:34:12.387253] [DEBUG] [LOCAL ] BEPJ: Primary data saved (3112 records). [2025-10-15T17:34:12.387396] [INFO ] [MAIN ] BEPJ: Full history saved. [2025-10-15T17:34:12.387581] [INFO ] [MAIN ] Update Progress: 252/2369 symbols completed. BEPJ took 26.6s. Estimated remaining: 4h 46m 44s. Rate: 7.4 symbols/min [2025-10-15T17:34:12.564388] [INFO ] [MAIN ] BFLY: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:34:12.564598] [DEBUG] [LOCAL ] BFLY: No existing data file found in primary storage. [2025-10-15T17:34:12.564636] [WARN ] [MAIN ] BFLY: No existing data found, performing full refresh instead. [2025-10-15T17:34:12.564781] [INFO ] [MAIN ] BFLY: Wiping existing primary data before full refresh. [2025-10-15T17:34:12.564823] [INFO ] [LOCAL ] BFLY: Starting deletion of primary data. [2025-10-15T17:34:12.564864] [DEBUG] [LOCAL ] BFLY: No primary data file found to delete. [2025-10-15T17:34:12.564897] [INFO ] [MAIN ] BFLY: Starting full primary refresh. [2025-10-15T17:34:12.919200] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-04. [2025-10-15T17:34:12.989638] [INFO ] [REMOTE ] BFLY: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:34:13.472252] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-15T17:34:13.714012] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-07. [2025-10-15T17:34:14.054400] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-15T17:34:14.514064] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2024-12. [2025-10-15T17:34:15.109860] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-15T17:34:15.314098] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-08. [2025-10-15T17:34:16.114024] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-04. [2025-10-15T17:34:16.348791] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-15T17:34:16.503706] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-15T17:34:16.914086] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-09. [2025-10-15T17:34:17.595130] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-15T17:34:17.714077] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-05. [2025-10-15T17:34:17.943345] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-15T17:34:18.373233] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-15T17:34:18.514077] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-05. [2025-10-15T17:34:19.314018] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-06. [2025-10-15T17:34:20.114128] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-01. [2025-10-15T17:34:20.144468] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-15T17:34:20.255235] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-15T17:34:20.914015] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-06. [2025-10-15T17:34:21.714029] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-10. [2025-10-15T17:34:21.920996] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-15T17:34:22.268811] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-15T17:34:22.514046] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-07. [2025-10-15T17:34:23.054791] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-15T17:34:23.059504] [INFO ] [REMOTE ] BFAM: Full fetch complete (46975 records). [2025-10-15T17:34:23.059636] [DEBUG] [VALIDATOR ] BFAM: Validating primary data. [2025-10-15T17:34:23.060607] [FATAL] [VALIDATOR ] BFAM: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T17:34:23.060732] [FATAL] [MAIN ] BFAM: Fetched primary data is invalid. Refusing to save it. [2025-10-15T17:34:23.060801] [WARN ] [MAIN ] BFAM: Deleting existing primary and derivative data due to validation failure. [2025-10-15T17:34:23.060855] [INFO ] [LOCAL ] BFAM: Starting deletion of primary data. [2025-10-15T17:34:23.060925] [DEBUG] [LOCAL ] BFAM: No primary data file found to delete. [2025-10-15T17:34:23.060968] [INFO ] [LOCAL ] BFAM: Starting deletion of derivative data. [2025-10-15T17:34:23.061175] [DEBUG] [LOCAL ] BFAM: Deleted derivative data file. [2025-10-15T17:34:23.061279] [INFO ] [MAIN ] Update Progress: 253/2369 symbols completed. BFAM took 33.7s. Estimated remaining: 4h 46m 57s. Rate: 7.4 symbols/min [2025-10-15T17:34:23.244310] [INFO ] [MAIN ] BFS: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:34:23.258065] [DEBUG] [LOCAL ] BFS: Loaded 9545 existing records from primary storage. [2025-10-15T17:34:23.258346] [INFO ] [MAIN ] BFS: Loaded 9545 existing records. [2025-10-15T17:34:23.322193] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-02. [2025-10-15T17:34:23.451096] [WARN ] [MAIN ] BFS: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:34:23.451377] [INFO ] [MAIN ] BFS: Wiping existing primary data before full refresh. [2025-10-15T17:34:23.451435] [INFO ] [LOCAL ] BFS: Starting deletion of primary data. [2025-10-15T17:34:23.451698] [DEBUG] [LOCAL ] BFS: Deleted primary data file. [2025-10-15T17:34:23.451778] [INFO ] [MAIN ] BFS: Starting full primary refresh. [2025-10-15T17:34:23.853611] [INFO ] [REMOTE ] BFS: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:34:23.881867] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-15T17:34:24.114013] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-07. [2025-10-15T17:34:24.859037] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-15T17:34:24.880554] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-15T17:34:24.914084] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-03. [2025-10-15T17:34:25.714025] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-08. [2025-10-15T17:34:26.460882] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-15T17:34:26.514020] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-09. [2025-10-15T17:34:26.640909] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-15T17:34:27.258195] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-15T17:34:27.314044] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-08. [2025-10-15T17:34:28.114035] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-10. [2025-10-15T17:34:28.698976] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-15T17:34:28.717751] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-15T17:34:28.719995] [INFO ] [REMOTE ] BFK: Full fetch complete (18968 records). [2025-10-15T17:34:28.720076] [DEBUG] [VALIDATOR ] BFK: Validating primary data. [2025-10-15T17:34:28.923134] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-04. [2025-10-15T17:34:29.109946] [DEBUG] [VALIDATOR ] BFK: All expected trading days are present. [2025-10-15T17:34:29.110041] [DEBUG] [VALIDATOR ] BFK: Primary data validation passed. [2025-10-15T17:34:29.110569] [INFO ] [MAIN ] BFK: Fetched primary data is valid. [2025-10-15T17:34:29.110679] [DEBUG] [LOCAL ] BFK: Saving primary data. [2025-10-15T17:34:29.111444] [DEBUG] [LOCAL ] BFK: Trimmed 18968 records to 13505 (keeping 200 days of data) [2025-10-15T17:34:29.197846] [DEBUG] [LOCAL ] BFK: Primary data saved (13505 records). [2025-10-15T17:34:29.198028] [INFO ] [MAIN ] BFK: Full history saved. [2025-10-15T17:34:29.198117] [INFO ] [MAIN ] Update Progress: 254/2369 symbols completed. BFK took 35.3s. Estimated remaining: 4h 46m 32s. Rate: 7.4 symbols/min [2025-10-15T17:34:29.384724] [INFO ] [MAIN ] BFZ: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:34:29.402182] [DEBUG] [LOCAL ] BFZ: Loaded 11900 existing records from primary storage. [2025-10-15T17:34:29.402525] [INFO ] [MAIN ] BFZ: Loaded 11900 existing records. [2025-10-15T17:34:29.594907] [WARN ] [MAIN ] BFZ: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:34:29.595189] [INFO ] [MAIN ] BFZ: Wiping existing primary data before full refresh. [2025-10-15T17:34:29.595247] [INFO ] [LOCAL ] BFZ: Starting deletion of primary data. [2025-10-15T17:34:29.595492] [DEBUG] [LOCAL ] BFZ: Deleted primary data file. [2025-10-15T17:34:29.595552] [INFO ] [MAIN ] BFZ: Starting full primary refresh. [2025-10-15T17:34:29.719161] [INFO ] [REMOTE ] BFS: Fetching primary data for 2024-12. [2025-10-15T17:34:29.980064] [INFO ] [REMOTE ] BFZ: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:34:30.442087] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-10-15T17:34:30.513982] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-01. [2025-10-15T17:34:30.797632] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-15T17:34:31.062203] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-15T17:34:31.314020] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-05. [2025-10-15T17:34:32.114045] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-02. [2025-10-15T17:34:32.917427] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-09. [2025-10-15T17:34:32.923177] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-15T17:34:32.924531] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-15T17:34:33.714031] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2024-12. [2025-10-15T17:34:34.514034] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-06. [2025-10-15T17:34:34.555039] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-15T17:34:34.757198] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-10-15T17:34:35.314036] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-01. [2025-10-15T17:34:36.117512] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-15T17:34:36.116094] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-03. [2025-10-15T17:34:36.145195] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-15T17:34:36.657705] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-10-15T17:34:36.913981] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-04. [2025-10-15T17:34:37.694087] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-15T17:34:37.713979] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-05. [2025-10-15T17:34:38.351272] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-15T17:34:38.514038] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-07. [2025-10-15T17:34:39.314014] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-06. [2025-10-15T17:34:39.945905] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-15T17:34:40.113999] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-07. [2025-10-15T17:34:40.758715] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-07 (2.24 seconds). [2025-10-15T17:34:40.915011] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-10. [2025-10-15T17:34:40.919022] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-15T17:34:41.714019] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-08. [2025-10-15T17:34:42.244332] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-15T17:34:42.250228] [INFO ] [REMOTE ] BFH: Full fetch complete (60072 records). [2025-10-15T17:34:42.250417] [DEBUG] [VALIDATOR ] BFH: Validating primary data. [2025-10-15T17:34:42.520457] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-02. [2025-10-15T17:34:42.660449] [DEBUG] [VALIDATOR ] BFH: All expected trading days are present. [2025-10-15T17:34:42.660557] [DEBUG] [VALIDATOR ] BFH: Primary data validation passed. [2025-10-15T17:34:42.661490] [INFO ] [MAIN ] BFH: Fetched primary data is valid. [2025-10-15T17:34:42.661555] [DEBUG] [LOCAL ] BFH: Saving primary data. [2025-10-15T17:34:42.663422] [DEBUG] [LOCAL ] BFH: Trimmed 60072 records to 41564 (keeping 200 days of data) [2025-10-15T17:34:42.924623] [DEBUG] [LOCAL ] BFH: Primary data saved (41564 records). [2025-10-15T17:34:42.924823] [INFO ] [MAIN ] BFH: Full history saved. [2025-10-15T17:34:42.924912] [INFO ] [MAIN ] Update Progress: 255/2369 symbols completed. BFH took 51.7s. Estimated remaining: 4h 47m 10s. Rate: 7.4 symbols/min [2025-10-15T17:34:43.100208] [INFO ] [MAIN ] BG: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:34:43.153746] [DEBUG] [LOCAL ] BG: Loaded 50480 existing records from primary storage. [2025-10-15T17:34:43.154144] [INFO ] [MAIN ] BG: Loaded 50480 existing records. [2025-10-15T17:34:43.316729] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-08. [2025-10-15T17:34:43.350991] [WARN ] [MAIN ] BG: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:34:43.352019] [INFO ] [MAIN ] BG: Wiping existing primary data before full refresh. [2025-10-15T17:34:43.352342] [INFO ] [LOCAL ] BG: Starting deletion of primary data. [2025-10-15T17:34:43.353899] [DEBUG] [LOCAL ] BG: Deleted primary data file. [2025-10-15T17:34:43.354118] [INFO ] [MAIN ] BG: Starting full primary refresh. [2025-10-15T17:34:43.532236] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-15T17:34:43.529139] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-15T17:34:43.831993] [INFO ] [REMOTE ] BG: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:34:44.114023] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-09. [2025-10-15T17:34:44.213770] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-15T17:34:44.914055] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-09. [2025-10-15T17:34:45.714045] [INFO ] [REMOTE ] BG: Fetching primary data for 2024-12. [2025-10-15T17:34:45.764277] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-15T17:34:45.992491] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-15T17:34:46.514014] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-10. [2025-10-15T17:34:47.219629] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-15T17:34:47.221797] [INFO ] [REMOTE ] BFS: Full fetch complete (13008 records). [2025-10-15T17:34:47.221885] [DEBUG] [VALIDATOR ] BFS: Validating primary data. [2025-10-15T17:34:47.319202] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-03. [2025-10-15T17:34:47.630746] [DEBUG] [VALIDATOR ] BFS: All expected trading days are present. [2025-10-15T17:34:47.630861] [DEBUG] [VALIDATOR ] BFS: Primary data validation passed. [2025-10-15T17:34:47.631260] [INFO ] [MAIN ] BFS: Fetched primary data is valid. [2025-10-15T17:34:47.631335] [DEBUG] [LOCAL ] BFS: Saving primary data. [2025-10-15T17:34:47.632164] [DEBUG] [LOCAL ] BFS: Trimmed 13008 records to 9589 (keeping 200 days of data) [2025-10-15T17:34:47.714340] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2024-12 (2.00 seconds). [2025-10-15T17:34:47.740105] [DEBUG] [LOCAL ] BFS: Primary data saved (9589 records). [2025-10-15T17:34:47.740255] [INFO ] [MAIN ] BFS: Full history saved. [2025-10-15T17:34:47.740346] [INFO ] [MAIN ] Update Progress: 256/2369 symbols completed. BFS took 24.7s. Estimated remaining: 4h 46m 35s. Rate: 7.4 symbols/min [2025-10-15T17:34:47.909775] [INFO ] [MAIN ] BGB: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:34:47.930751] [DEBUG] [LOCAL ] BGB: Loaded 17991 existing records from primary storage. [2025-10-15T17:34:47.931047] [INFO ] [MAIN ] BGB: Loaded 17991 existing records. [2025-10-15T17:34:48.117841] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-10. [2025-10-15T17:34:48.111663] [WARN ] [MAIN ] BGB: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:34:48.120288] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-15T17:34:48.121426] [INFO ] [MAIN ] BGB: Wiping existing primary data before full refresh. [2025-10-15T17:34:48.124943] [INFO ] [LOCAL ] BGB: Starting deletion of primary data. [2025-10-15T17:34:48.125668] [DEBUG] [LOCAL ] BGB: Deleted primary data file. [2025-10-15T17:34:48.125738] [INFO ] [MAIN ] BGB: Starting full primary refresh. [2025-10-15T17:34:48.498565] [INFO ] [REMOTE ] BGB: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:34:48.914042] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-01. [2025-10-15T17:34:49.714038] [INFO ] [REMOTE ] BGB: Fetching primary data for 2024-12. [2025-10-15T17:34:50.157989] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-10 (2.04 seconds). [2025-10-15T17:34:50.167621] [INFO ] [REMOTE ] BFLY: Full fetch complete (75504 records). [2025-10-15T17:34:50.167842] [DEBUG] [VALIDATOR ] BFLY: Validating primary data. [2025-10-15T17:34:50.516801] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-04. [2025-10-15T17:34:50.611758] [DEBUG] [VALIDATOR ] BFLY: All expected trading days are present. [2025-10-15T17:34:50.612383] [DEBUG] [VALIDATOR ] BFLY: Primary data validation passed. [2025-10-15T17:34:50.613523] [INFO ] [MAIN ] BFLY: Fetched primary data is valid. [2025-10-15T17:34:50.613633] [DEBUG] [LOCAL ] BFLY: Saving primary data. [2025-10-15T17:34:50.648925] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-15T17:34:50.659922] [DEBUG] [LOCAL ] BFLY: Trimmed 75504 records to 51836 (keeping 200 days of data) [2025-10-15T17:34:50.763709] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-15T17:34:50.997857] [DEBUG] [LOCAL ] BFLY: Primary data saved (51836 records). [2025-10-15T17:34:50.998038] [INFO ] [MAIN ] BFLY: Full history saved. [2025-10-15T17:34:50.998120] [INFO ] [MAIN ] Update Progress: 257/2369 symbols completed. BFLY took 38.6s. Estimated remaining: 4h 45m 46s. Rate: 7.4 symbols/min [2025-10-15T17:34:51.171159] [INFO ] [MAIN ] BGH: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:34:51.190815] [DEBUG] [LOCAL ] BGH: Loaded 17259 existing records from primary storage. [2025-10-15T17:34:51.191120] [INFO ] [MAIN ] BGH: Loaded 17259 existing records. [2025-10-15T17:34:51.314909] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-02. [2025-10-15T17:34:51.348446] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-15T17:34:51.398090] [WARN ] [MAIN ] BGH: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:34:51.398501] [INFO ] [MAIN ] BGH: Wiping existing primary data before full refresh. [2025-10-15T17:34:51.398555] [INFO ] [LOCAL ] BGH: Starting deletion of primary data. [2025-10-15T17:34:51.398829] [DEBUG] [LOCAL ] BGH: Deleted primary data file. [2025-10-15T17:34:51.398888] [INFO ] [MAIN ] BGH: Starting full primary refresh. [2025-10-15T17:34:51.756777] [INFO ] [REMOTE ] BGH: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:34:52.113984] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-01. [2025-10-15T17:34:52.856126] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-15T17:34:52.903796] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-15T17:34:52.913948] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-03. [2025-10-15T17:34:53.714016] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-05. [2025-10-15T17:34:54.340957] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-15T17:34:54.513968] [INFO ] [REMOTE ] BGH: Fetching primary data for 2024-12. [2025-10-15T17:34:54.704284] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-15T17:34:55.313971] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-02. [2025-10-15T17:34:55.495124] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-10-15T17:34:56.114034] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-06. [2025-10-15T17:34:56.211907] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-15T17:34:56.763821] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-15T17:34:56.914052] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-04. [2025-10-15T17:34:57.714121] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-03. [2025-10-15T17:34:58.514043] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-01. [2025-10-15T17:34:58.655914] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-15T17:34:58.803759] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-15T17:34:59.096578] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-15T17:34:59.313982] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-04. [2025-10-15T17:35:00.113968] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-05. [2025-10-15T17:35:00.315942] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-15T17:35:00.914051] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-02. [2025-10-15T17:35:01.565797] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-15T17:35:01.714124] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-03. [2025-10-15T17:35:01.864199] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-15T17:35:02.513985] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-05. [2025-10-15T17:35:02.579022] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-15T17:35:03.314062] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-06. [2025-10-15T17:35:03.639587] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-15T17:35:04.113997] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-06. [2025-10-15T17:35:04.914027] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-07. [2025-10-15T17:35:05.012311] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-15T17:35:05.043304] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-15T17:35:05.664618] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-15T17:35:05.713975] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-08. [2025-10-15T17:35:06.514058] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-04. [2025-10-15T17:35:06.672761] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-15T17:35:07.313978] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-07. [2025-10-15T17:35:07.451709] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-15T17:35:08.114067] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-05. [2025-10-15T17:35:08.910889] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-15T17:35:08.915266] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-07. [2025-10-15T17:35:09.239540] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-15T17:35:09.659626] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-15T17:35:09.713976] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-08. [2025-10-15T17:35:10.514018] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-08. [2025-10-15T17:35:10.646208] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-15T17:35:11.314018] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-09. [2025-10-15T17:35:12.084712] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-15T17:35:12.084017] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-15T17:35:12.113977] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-10. [2025-10-15T17:35:12.914011] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-06. [2025-10-15T17:35:12.968218] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-15T17:35:12.970123] [INFO ] [REMOTE ] BFZ: Full fetch complete (17432 records). [2025-10-15T17:35:12.970227] [DEBUG] [VALIDATOR ] BFZ: Validating primary data. [2025-10-15T17:35:13.343492] [DEBUG] [VALIDATOR ] BFZ: All expected trading days are present. [2025-10-15T17:35:13.343571] [DEBUG] [VALIDATOR ] BFZ: Primary data validation passed. [2025-10-15T17:35:13.343994] [INFO ] [MAIN ] BFZ: Fetched primary data is valid. [2025-10-15T17:35:13.344055] [DEBUG] [LOCAL ] BFZ: Saving primary data. [2025-10-15T17:35:13.344559] [DEBUG] [LOCAL ] BFZ: Trimmed 17432 records to 11947 (keeping 200 days of data) [2025-10-15T17:35:13.415667] [DEBUG] [LOCAL ] BFZ: Primary data saved (11947 records). [2025-10-15T17:35:13.415835] [INFO ] [MAIN ] BFZ: Full history saved. [2025-10-15T17:35:13.415922] [INFO ] [MAIN ] Update Progress: 258/2369 symbols completed. BFZ took 44.2s. Estimated remaining: 4h 47m 35s. Rate: 7.3 symbols/min [2025-10-15T17:35:13.585952] [INFO ] [MAIN ] BGR: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:35:13.601519] [DEBUG] [LOCAL ] BGR: Loaded 13590 existing records from primary storage. [2025-10-15T17:35:13.601772] [INFO ] [MAIN ] BGR: Loaded 13590 existing records. [2025-10-15T17:35:13.714954] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-09. [2025-10-15T17:35:13.789484] [WARN ] [MAIN ] BGR: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:35:13.796878] [INFO ] [MAIN ] BGR: Wiping existing primary data before full refresh. [2025-10-15T17:35:13.797019] [INFO ] [LOCAL ] BGR: Starting deletion of primary data. [2025-10-15T17:35:13.798420] [DEBUG] [LOCAL ] BGR: Deleted primary data file. [2025-10-15T17:35:13.798350] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-15T17:35:13.798634] [INFO ] [MAIN ] BGR: Starting full primary refresh. [2025-10-15T17:35:14.156498] [INFO ] [REMOTE ] BGR: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:35:14.514065] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-07. [2025-10-15T17:35:15.167490] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-15T17:35:15.313987] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-09. [2025-10-15T17:35:15.351737] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-15T17:35:16.113980] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-08. [2025-10-15T17:35:16.272378] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-15T17:35:16.739430] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-15T17:35:16.914016] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-09. [2025-10-15T17:35:17.692267] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-15T17:35:17.713971] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-10. [2025-10-15T17:35:18.513998] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-10. [2025-10-15T17:35:18.694612] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-15T17:35:18.697459] [INFO ] [REMOTE ] BGH: Full fetch complete (22849 records). [2025-10-15T17:35:18.697577] [DEBUG] [VALIDATOR ] BGH: Validating primary data. [2025-10-15T17:35:19.075568] [DEBUG] [VALIDATOR ] BGH: All expected trading days are present. [2025-10-15T17:35:19.075673] [DEBUG] [VALIDATOR ] BGH: Primary data validation passed. [2025-10-15T17:35:19.076159] [INFO ] [MAIN ] BGH: Fetched primary data is valid. [2025-10-15T17:35:19.076205] [DEBUG] [LOCAL ] BGH: Saving primary data. [2025-10-15T17:35:19.076811] [DEBUG] [LOCAL ] BGH: Trimmed 22849 records to 17264 (keeping 200 days of data) [2025-10-15T17:35:19.177931] [DEBUG] [LOCAL ] BGH: Primary data saved (17264 records). [2025-10-15T17:35:19.178073] [INFO ] [MAIN ] BGH: Full history saved. [2025-10-15T17:35:19.178171] [INFO ] [MAIN ] Update Progress: 259/2369 symbols completed. BGH took 28.2s. Estimated remaining: 4h 47m 7s. Rate: 7.3 symbols/min [2025-10-15T17:35:19.315195] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-10. [2025-10-15T17:35:19.349867] [INFO ] [MAIN ] BGS: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:35:19.398937] [DEBUG] [LOCAL ] BGS: Loaded 50514 existing records from primary storage. [2025-10-15T17:35:19.399270] [INFO ] [MAIN ] BGS: Loaded 50514 existing records. [2025-10-15T17:35:19.584672] [WARN ] [MAIN ] BGS: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:35:19.591570] [INFO ] [MAIN ] BGS: Wiping existing primary data before full refresh. [2025-10-15T17:35:19.591512] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-15T17:35:19.591696] [INFO ] [LOCAL ] BGS: Starting deletion of primary data. [2025-10-15T17:35:19.594710] [INFO ] [REMOTE ] BGB: Full fetch complete (26875 records). [2025-10-15T17:35:19.594782] [DEBUG] [VALIDATOR ] BGB: Validating primary data. [2025-10-15T17:35:19.594875] [DEBUG] [LOCAL ] BGS: Deleted primary data file. [2025-10-15T17:35:19.594991] [INFO ] [MAIN ] BGS: Starting full primary refresh. [2025-10-15T17:35:20.118333] [INFO ] [REMOTE ] BGR: Fetching primary data for 2024-12. [2025-10-15T17:35:20.311423] [INFO ] [REMOTE ] BGS: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:35:20.340067] [DEBUG] [VALIDATOR ] BGB: All expected trading days are present. [2025-10-15T17:35:20.340154] [DEBUG] [VALIDATOR ] BGB: Primary data validation passed. [2025-10-15T17:35:20.340667] [INFO ] [MAIN ] BGB: Fetched primary data is valid. [2025-10-15T17:35:20.340733] [DEBUG] [LOCAL ] BGB: Saving primary data. [2025-10-15T17:35:20.341430] [DEBUG] [LOCAL ] BGB: Trimmed 26875 records to 17952 (keeping 200 days of data) [2025-10-15T17:35:20.447660] [DEBUG] [LOCAL ] BGB: Primary data saved (17952 records). [2025-10-15T17:35:20.447826] [INFO ] [MAIN ] BGB: Full history saved. [2025-10-15T17:35:20.447907] [INFO ] [MAIN ] Update Progress: 260/2369 symbols completed. BGB took 32.7s. Estimated remaining: 4h 46m 3s. Rate: 7.4 symbols/min [2025-10-15T17:35:20.616430] [INFO ] [MAIN ] BGSF: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:35:20.625572] [DEBUG] [LOCAL ] BGSF: Loaded 7899 existing records from primary storage. [2025-10-15T17:35:20.625809] [INFO ] [MAIN ] BGSF: Loaded 7899 existing records. [2025-10-15T17:35:20.812006] [WARN ] [MAIN ] BGSF: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:35:20.812185] [INFO ] [MAIN ] BGSF: Wiping existing primary data before full refresh. [2025-10-15T17:35:20.812235] [INFO ] [LOCAL ] BGSF: Starting deletion of primary data. [2025-10-15T17:35:20.812407] [DEBUG] [LOCAL ] BGSF: Deleted primary data file. [2025-10-15T17:35:20.812465] [INFO ] [MAIN ] BGSF: Starting full primary refresh. [2025-10-15T17:35:20.919133] [INFO ] [REMOTE ] BGS: Fetching primary data for 2024-12. [2025-10-15T17:35:21.173793] [INFO ] [REMOTE ] BGSF: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:35:21.275381] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-15T17:35:21.372247] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-10 (2.06 seconds). [2025-10-15T17:35:21.378483] [INFO ] [REMOTE ] BG: Full fetch complete (72958 records). [2025-10-15T17:35:21.378676] [DEBUG] [VALIDATOR ] BG: Validating primary data. [2025-10-15T17:35:21.719377] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-01. [2025-10-15T17:35:21.772434] [DEBUG] [VALIDATOR ] BG: All expected trading days are present. [2025-10-15T17:35:21.772521] [DEBUG] [VALIDATOR ] BG: Primary data validation passed. [2025-10-15T17:35:21.773466] [INFO ] [MAIN ] BG: Fetched primary data is valid. [2025-10-15T17:35:21.773529] [DEBUG] [LOCAL ] BG: Saving primary data. [2025-10-15T17:35:21.775199] [DEBUG] [LOCAL ] BG: Trimmed 72958 records to 50524 (keeping 200 days of data) [2025-10-15T17:35:22.085509] [DEBUG] [LOCAL ] BG: Primary data saved (50524 records). [2025-10-15T17:35:22.085688] [INFO ] [MAIN ] BG: Full history saved. [2025-10-15T17:35:22.085784] [INFO ] [MAIN ] Update Progress: 261/2369 symbols completed. BG took 39.2s. Estimated remaining: 4h 45m 3s. Rate: 7.4 symbols/min [2025-10-15T17:35:22.253112] [INFO ] [MAIN ] BGT: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:35:22.271496] [DEBUG] [LOCAL ] BGT: Loaded 16483 existing records from primary storage. [2025-10-15T17:35:22.271747] [INFO ] [MAIN ] BGT: Loaded 16483 existing records. [2025-10-15T17:35:22.455057] [WARN ] [MAIN ] BGT: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:35:22.455421] [INFO ] [MAIN ] BGT: Wiping existing primary data before full refresh. [2025-10-15T17:35:22.455524] [INFO ] [LOCAL ] BGT: Starting deletion of primary data. [2025-10-15T17:35:22.455998] [DEBUG] [LOCAL ] BGT: Deleted primary data file. [2025-10-15T17:35:22.456081] [INFO ] [MAIN ] BGT: Starting full primary refresh. [2025-10-15T17:35:22.520049] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2024-12. [2025-10-15T17:35:22.613787] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-15T17:35:22.784943] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-10-15T17:35:22.910134] [INFO ] [REMOTE ] BGT: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:35:23.249482] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-10-15T17:35:23.314014] [INFO ] [REMOTE ] BGT: Fetching primary data for 2024-12. [2025-10-15T17:35:24.114023] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-01. [2025-10-15T17:35:24.164245] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-15T17:35:24.914009] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-02. [2025-10-15T17:35:25.608362] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-15T17:35:25.713973] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-02. [2025-10-15T17:35:25.845027] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-15T17:35:26.514018] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-03. [2025-10-15T17:35:27.149195] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-15T17:35:27.269782] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-15T17:35:27.313970] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-04. [2025-10-15T17:35:28.034534] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-15T17:35:28.114052] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-01. [2025-10-15T17:35:28.659117] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-15T17:35:28.914047] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-02. [2025-10-15T17:35:29.407483] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-15T17:35:29.714089] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-03. [2025-10-15T17:35:30.514063] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-03. [2025-10-15T17:35:31.104716] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-15T17:35:31.151965] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-15T17:35:31.314027] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-04. [2025-10-15T17:35:31.723707] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-04 (0.41 seconds). [2025-10-15T17:35:32.114024] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-05. [2025-10-15T17:35:32.559551] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-10-15T17:35:32.914028] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-01. [2025-10-15T17:35:33.714044] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-06. [2025-10-15T17:35:33.897167] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-15T17:35:34.349592] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-15T17:35:34.514001] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-04. [2025-10-15T17:35:35.314006] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-07. [2025-10-15T17:35:36.114026] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-05. [2025-10-15T17:35:36.132537] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-15T17:35:36.181971] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-15T17:35:36.914036] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-05. [2025-10-15T17:35:37.189786] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-15T17:35:37.714020] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-06. [2025-10-15T17:35:38.521170] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-02. [2025-10-15T17:35:38.545499] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-15T17:35:38.614716] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-15T17:35:39.314008] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-08. [2025-10-15T17:35:39.596632] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-15T17:35:39.622629] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-08 (0.31 seconds). [2025-10-15T17:35:40.113987] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-03. [2025-10-15T17:35:40.914002] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-06. [2025-10-15T17:35:40.930767] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-15T17:35:41.714048] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-07. [2025-10-15T17:35:42.380498] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-15T17:35:42.397736] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-10-15T17:35:42.513965] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-07. [2025-10-15T17:35:43.314065] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-08. [2025-10-15T17:35:43.877206] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-15T17:35:44.113974] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-04. [2025-10-15T17:35:44.275243] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-15T17:35:44.913987] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-09. [2025-10-15T17:35:45.015551] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-15T17:35:45.713970] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-08. [2025-10-15T17:35:45.865347] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-15T17:35:46.514051] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-05. [2025-10-15T17:35:47.178380] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-15T17:35:47.314050] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-09. [2025-10-15T17:35:47.479550] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-15T17:35:48.114022] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-09. [2025-10-15T17:35:48.501754] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-15T17:35:48.914059] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-10. [2025-10-15T17:35:49.714051] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-10. [2025-10-15T17:35:49.886626] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-15T17:35:50.114188] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-15T17:35:50.116550] [INFO ] [REMOTE ] BGSF: Full fetch complete (9515 records). [2025-10-15T17:35:50.116621] [DEBUG] [VALIDATOR ] BGSF: Validating primary data. [2025-10-15T17:35:50.484914] [DEBUG] [VALIDATOR ] BGSF: All expected trading days are present. [2025-10-15T17:35:50.485169] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-15T17:35:50.485373] [DEBUG] [VALIDATOR ] BGSF: Primary data validation passed. [2025-10-15T17:35:50.487841] [INFO ] [MAIN ] BGSF: Fetched primary data is valid. [2025-10-15T17:35:50.488005] [INFO ] [REMOTE ] BGR: Full fetch complete (20072 records). [2025-10-15T17:35:50.488082] [DEBUG] [LOCAL ] BGSF: Saving primary data. [2025-10-15T17:35:50.488386] [DEBUG] [VALIDATOR ] BGR: Validating primary data. [2025-10-15T17:35:50.489185] [DEBUG] [LOCAL ] BGSF: Trimmed 9515 records to 7984 (keeping 200 days of data) [2025-10-15T17:35:50.514866] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-06. [2025-10-15T17:35:50.621991] [DEBUG] [LOCAL ] BGSF: Primary data saved (7984 records). [2025-10-15T17:35:50.634093] [INFO ] [MAIN ] BGSF: Full history saved. [2025-10-15T17:35:50.641532] [INFO ] [MAIN ] Update Progress: 262/2369 symbols completed. BGSF took 30.2s. Estimated remaining: 4h 47m 39s. Rate: 7.3 symbols/min [2025-10-15T17:35:51.017203] [INFO ] [MAIN ] BGX: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:35:51.139826] [DEBUG] [LOCAL ] BGX: Loaded 11165 existing records from primary storage. [2025-10-15T17:35:51.140292] [DEBUG] [VALIDATOR ] BGR: All expected trading days are present. [2025-10-15T17:35:51.140543] [INFO ] [MAIN ] BGX: Loaded 11165 existing records. [2025-10-15T17:35:51.140672] [DEBUG] [VALIDATOR ] BGR: Primary data validation passed. [2025-10-15T17:35:51.171939] [INFO ] [MAIN ] BGR: Fetched primary data is valid. [2025-10-15T17:35:51.183288] [DEBUG] [LOCAL ] BGR: Saving primary data. [2025-10-15T17:35:51.238225] [DEBUG] [LOCAL ] BGR: Trimmed 20072 records to 13605 (keeping 200 days of data) [2025-10-15T17:35:51.320420] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-10. [2025-10-15T17:35:51.389343] [WARN ] [MAIN ] BGX: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:35:51.415412] [INFO ] [MAIN ] BGX: Wiping existing primary data before full refresh. [2025-10-15T17:35:51.416791] [DEBUG] [LOCAL ] BGR: Primary data saved (13605 records). [2025-10-15T17:35:51.415584] [INFO ] [LOCAL ] BGX: Starting deletion of primary data. [2025-10-15T17:35:51.417008] [INFO ] [MAIN ] BGR: Full history saved. [2025-10-15T17:35:51.417397] [INFO ] [MAIN ] Update Progress: 263/2369 symbols completed. BGR took 38.0s. Estimated remaining: 4h 46m 31s. Rate: 7.4 symbols/min [2025-10-15T17:35:51.417599] [DEBUG] [LOCAL ] BGX: Deleted primary data file. [2025-10-15T17:35:51.417795] [INFO ] [MAIN ] BGX: Starting full primary refresh. [2025-10-15T17:35:51.782965] [INFO ] [MAIN ] BGY: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:35:51.883712] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-15T17:35:51.978287] [DEBUG] [LOCAL ] BGY: Loaded 21940 existing records from primary storage. [2025-10-15T17:35:51.997634] [INFO ] [MAIN ] BGY: Loaded 21940 existing records. [2025-10-15T17:35:51.997510] [INFO ] [REMOTE ] BGX: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:35:52.119153] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-07. [2025-10-15T17:35:52.196694] [WARN ] [MAIN ] BGY: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:35:52.196905] [INFO ] [MAIN ] BGY: Wiping existing primary data before full refresh. [2025-10-15T17:35:52.196957] [INFO ] [LOCAL ] BGY: Starting deletion of primary data. [2025-10-15T17:35:52.197347] [DEBUG] [LOCAL ] BGY: Deleted primary data file. [2025-10-15T17:35:52.197404] [INFO ] [MAIN ] BGY: Starting full primary refresh. [2025-10-15T17:35:52.562416] [INFO ] [REMOTE ] BGY: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:35:52.866525] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-15T17:35:52.873606] [INFO ] [REMOTE ] BGS: Full fetch complete (72657 records). [2025-10-15T17:35:52.873782] [DEBUG] [VALIDATOR ] BGS: Validating primary data. [2025-10-15T17:35:52.919172] [INFO ] [REMOTE ] BGY: Fetching primary data for 2024-12. [2025-10-15T17:35:53.285527] [DEBUG] [VALIDATOR ] BGS: All expected trading days are present. [2025-10-15T17:35:53.285665] [DEBUG] [VALIDATOR ] BGS: Primary data validation passed. [2025-10-15T17:35:53.286639] [INFO ] [MAIN ] BGS: Fetched primary data is valid. [2025-10-15T17:35:53.286745] [DEBUG] [LOCAL ] BGS: Saving primary data. [2025-10-15T17:35:53.301903] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-15T17:35:53.307990] [DEBUG] [LOCAL ] BGS: Trimmed 72657 records to 50534 (keeping 200 days of data) [2025-10-15T17:35:53.599154] [DEBUG] [LOCAL ] BGS: Primary data saved (50534 records). [2025-10-15T17:35:53.599311] [INFO ] [MAIN ] BGS: Full history saved. [2025-10-15T17:35:53.600323] [INFO ] [MAIN ] Update Progress: 264/2369 symbols completed. BGS took 34.4s. Estimated remaining: 4h 45m 36s. Rate: 7.4 symbols/min [2025-10-15T17:35:53.719251] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-08. [2025-10-15T17:35:53.768258] [INFO ] [MAIN ] BH: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:35:53.786544] [DEBUG] [LOCAL ] BH: Loaded 16212 existing records from primary storage. [2025-10-15T17:35:53.786847] [INFO ] [MAIN ] BH: Loaded 16212 existing records. [2025-10-15T17:35:53.963114] [WARN ] [MAIN ] BH: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:35:53.963624] [INFO ] [MAIN ] BH: Wiping existing primary data before full refresh. [2025-10-15T17:35:53.963887] [INFO ] [LOCAL ] BH: Starting deletion of primary data. [2025-10-15T17:35:53.964184] [DEBUG] [LOCAL ] BH: Deleted primary data file. [2025-10-15T17:35:53.964244] [INFO ] [MAIN ] BH: Starting full primary refresh. [2025-10-15T17:35:54.105052] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-15T17:35:54.342450] [INFO ] [REMOTE ] BH: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:35:54.513974] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-01. [2025-10-15T17:35:54.672695] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-15T17:35:55.314057] [INFO ] [REMOTE ] BH: Fetching primary data for 2024-12. [2025-10-15T17:35:55.525859] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-15T17:35:56.026433] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-10-15T17:35:56.113950] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-01. [2025-10-15T17:35:56.853199] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-15T17:35:56.914014] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-02. [2025-10-15T17:35:57.388692] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-15T17:35:57.713998] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-02. [2025-10-15T17:35:58.514038] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-09. [2025-10-15T17:35:58.571160] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-15T17:35:59.314075] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-03. [2025-10-15T17:35:59.441947] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-15T17:36:00.114053] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-10. [2025-10-15T17:36:00.150511] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-15T17:36:00.914075] [INFO ] [REMOTE ] BGX: Fetching primary data for 2024-12. [2025-10-15T17:36:01.109094] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-15T17:36:01.112880] [INFO ] [REMOTE ] BGT: Full fetch complete (24166 records). [2025-10-15T17:36:01.113068] [DEBUG] [VALIDATOR ] BGT: Validating primary data. [2025-10-15T17:36:01.639848] [DEBUG] [VALIDATOR ] BGT: All expected trading days are present. [2025-10-15T17:36:01.640048] [DEBUG] [VALIDATOR ] BGT: Primary data validation passed. [2025-10-15T17:36:01.640784] [INFO ] [MAIN ] BGT: Fetched primary data is valid. [2025-10-15T17:36:01.640944] [DEBUG] [LOCAL ] BGT: Saving primary data. [2025-10-15T17:36:01.653932] [DEBUG] [LOCAL ] BGT: Trimmed 24166 records to 16412 (keeping 200 days of data) [2025-10-15T17:36:01.653413] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-10-15T17:36:01.714094] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-01. [2025-10-15T17:36:01.775265] [DEBUG] [LOCAL ] BGT: Primary data saved (16412 records). [2025-10-15T17:36:01.775494] [INFO ] [MAIN ] BGT: Full history saved. [2025-10-15T17:36:01.775675] [INFO ] [MAIN ] Update Progress: 265/2369 symbols completed. BGT took 39.7s. Estimated remaining: 4h 45m 28s. Rate: 7.4 symbols/min [2025-10-15T17:36:01.991598] [INFO ] [MAIN ] BHC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:36:02.041704] [DEBUG] [LOCAL ] BHC: Loaded 46658 existing records from primary storage. [2025-10-15T17:36:02.042316] [INFO ] [MAIN ] BHC: Loaded 46658 existing records. [2025-10-15T17:36:02.256046] [WARN ] [MAIN ] BHC: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:36:02.256301] [INFO ] [MAIN ] BHC: Wiping existing primary data before full refresh. [2025-10-15T17:36:02.256391] [INFO ] [LOCAL ] BHC: Starting deletion of primary data. [2025-10-15T17:36:02.256814] [DEBUG] [LOCAL ] BHC: Deleted primary data file. [2025-10-15T17:36:02.256870] [INFO ] [MAIN ] BHC: Starting full primary refresh. [2025-10-15T17:36:02.494384] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-15T17:36:02.519311] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-03. [2025-10-15T17:36:02.682504] [INFO ] [REMOTE ] BHC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:36:03.314021] [INFO ] [REMOTE ] BHC: Fetching primary data for 2024-12. [2025-10-15T17:36:03.591536] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-15T17:36:04.113996] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-04. [2025-10-15T17:36:04.480192] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-15T17:36:04.913994] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-01. [2025-10-15T17:36:05.372991] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-15T17:36:05.714009] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-02. [2025-10-15T17:36:06.321166] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-15T17:36:06.459002] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-15T17:36:06.513953] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-04. [2025-10-15T17:36:07.195198] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-10-15T17:36:07.314004] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-03. [2025-10-15T17:36:08.074958] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-15T17:36:08.114001] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-05. [2025-10-15T17:36:08.913998] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-02. [2025-10-15T17:36:08.952678] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-15T17:36:09.714018] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-05. [2025-10-15T17:36:10.433337] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-15T17:36:10.514010] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-03. [2025-10-15T17:36:10.557915] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-15T17:36:11.313999] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-06. [2025-10-15T17:36:12.114522] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-06. [2025-10-15T17:36:12.118900] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-15T17:36:12.169386] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-15T17:36:12.914097] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-04. [2025-10-15T17:36:13.160267] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-15T17:36:13.713989] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-07. [2025-10-15T17:36:13.785122] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-15T17:36:14.513966] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-04. [2025-10-15T17:36:14.653475] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-15T17:36:15.313977] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-05. [2025-10-15T17:36:16.084439] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-15T17:36:16.113955] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-06. [2025-10-15T17:36:16.222831] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-15T17:36:16.755942] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-15T17:36:16.913998] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-07. [2025-10-15T17:36:17.713978] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-05. [2025-10-15T17:36:17.795689] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-15T17:36:18.514054] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-07. [2025-10-15T17:36:19.208988] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-15T17:36:19.257553] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-15T17:36:19.313998] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-06. [2025-10-15T17:36:20.114002] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-08. [2025-10-15T17:36:20.818600] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-15T17:36:20.913983] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-07. [2025-10-15T17:36:20.983572] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-15T17:36:21.714047] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-08. [2025-10-15T17:36:22.358755] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-15T17:36:22.469536] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-15T17:36:22.513955] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-09. [2025-10-15T17:36:23.313975] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-08. [2025-10-15T17:36:23.367603] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-15T17:36:24.114052] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-08. [2025-10-15T17:36:24.913969] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-09. [2025-10-15T17:36:24.989172] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-15T17:36:25.025629] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-15T17:36:25.620165] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-15T17:36:25.713991] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-09. [2025-10-15T17:36:26.463609] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-15T17:36:26.513964] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-10. [2025-10-15T17:36:27.313986] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-10. [2025-10-15T17:36:27.414960] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-15T17:36:27.418456] [INFO ] [REMOTE ] BGY: Full fetch complete (33116 records). [2025-10-15T17:36:27.418835] [DEBUG] [VALIDATOR ] BGY: Validating primary data. [2025-10-15T17:36:27.837437] [DEBUG] [VALIDATOR ] BGY: All expected trading days are present. [2025-10-15T17:36:27.837553] [DEBUG] [VALIDATOR ] BGY: Primary data validation passed. [2025-10-15T17:36:27.838129] [INFO ] [MAIN ] BGY: Fetched primary data is valid. [2025-10-15T17:36:27.838192] [DEBUG] [LOCAL ] BGY: Saving primary data. [2025-10-15T17:36:27.839048] [DEBUG] [LOCAL ] BGY: Trimmed 33116 records to 21983 (keeping 200 days of data) [2025-10-15T17:36:27.964415] [DEBUG] [LOCAL ] BGY: Primary data saved (21983 records). [2025-10-15T17:36:27.964592] [INFO ] [MAIN ] BGY: Full history saved. [2025-10-15T17:36:27.964747] [INFO ] [MAIN ] Update Progress: 266/2369 symbols completed. BGY took 36.5s. Estimated remaining: 4h 47m 42s. Rate: 7.3 symbols/min [2025-10-15T17:36:28.114489] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-10. [2025-10-15T17:36:28.140224] [INFO ] [MAIN ] BHE: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:36:28.148335] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-15T17:36:28.150920] [INFO ] [REMOTE ] BH: Full fetch complete (19517 records). [2025-10-15T17:36:28.151079] [DEBUG] [VALIDATOR ] BH: Validating primary data. [2025-10-15T17:36:28.341048] [DEBUG] [LOCAL ] BHE: Loaded 23832 existing records from primary storage. [2025-10-15T17:36:28.383431] [INFO ] [MAIN ] BHE: Loaded 23832 existing records. [2025-10-15T17:36:28.695585] [DEBUG] [VALIDATOR ] BH: All expected trading days are present. [2025-10-15T17:36:28.708561] [DEBUG] [VALIDATOR ] BH: Primary data validation passed. [2025-10-15T17:36:28.716298] [INFO ] [MAIN ] BH: Fetched primary data is valid. [2025-10-15T17:36:28.716755] [DEBUG] [LOCAL ] BH: Saving primary data. [2025-10-15T17:36:28.737604] [WARN ] [MAIN ] BHE: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:36:28.738368] [INFO ] [MAIN ] BHE: Wiping existing primary data before full refresh. [2025-10-15T17:36:28.738204] [DEBUG] [LOCAL ] BH: Trimmed 19517 records to 16248 (keeping 200 days of data) [2025-10-15T17:36:28.738475] [INFO ] [LOCAL ] BHE: Starting deletion of primary data. [2025-10-15T17:36:28.738919] [DEBUG] [LOCAL ] BHE: Deleted primary data file. [2025-10-15T17:36:28.739200] [INFO ] [MAIN ] BHE: Starting full primary refresh. [2025-10-15T17:36:28.920705] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-09. [2025-10-15T17:36:29.000592] [DEBUG] [LOCAL ] BH: Primary data saved (16248 records). [2025-10-15T17:36:29.025350] [INFO ] [MAIN ] BH: Full history saved. [2025-10-15T17:36:29.039859] [INFO ] [MAIN ] Update Progress: 267/2369 symbols completed. BH took 35.4s. Estimated remaining: 4h 46m 38s. Rate: 7.3 symbols/min [2025-10-15T17:36:29.122050] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-15T17:36:29.229997] [INFO ] [REMOTE ] BGX: Full fetch complete (16592 records). [2025-10-15T17:36:29.242130] [DEBUG] [VALIDATOR ] BGX: Validating primary data. [2025-10-15T17:36:29.465300] [INFO ] [REMOTE ] BHE: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:36:29.538841] [INFO ] [MAIN ] BHK: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:36:29.719203] [INFO ] [REMOTE ] BHE: Fetching primary data for 2024-12. [2025-10-15T17:36:29.765168] [DEBUG] [LOCAL ] BHK: Loaded 23624 existing records from primary storage. [2025-10-15T17:36:29.765718] [INFO ] [MAIN ] BHK: Loaded 23624 existing records. [2025-10-15T17:36:30.003535] [DEBUG] [VALIDATOR ] BGX: All expected trading days are present. [2025-10-15T17:36:30.008820] [DEBUG] [VALIDATOR ] BGX: Primary data validation passed. [2025-10-15T17:36:30.015221] [INFO ] [MAIN ] BGX: Fetched primary data is valid. [2025-10-15T17:36:30.015316] [DEBUG] [LOCAL ] BGX: Saving primary data. [2025-10-15T17:36:30.047109] [DEBUG] [LOCAL ] BGX: Trimmed 16592 records to 11151 (keeping 200 days of data) [2025-10-15T17:36:30.046946] [WARN ] [MAIN ] BHK: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:36:30.047506] [INFO ] [MAIN ] BHK: Wiping existing primary data before full refresh. [2025-10-15T17:36:30.047973] [INFO ] [LOCAL ] BHK: Starting deletion of primary data. [2025-10-15T17:36:30.048600] [DEBUG] [LOCAL ] BHK: Deleted primary data file. [2025-10-15T17:36:30.048721] [INFO ] [MAIN ] BHK: Starting full primary refresh. [2025-10-15T17:36:30.235029] [DEBUG] [LOCAL ] BGX: Primary data saved (11151 records). [2025-10-15T17:36:30.269171] [INFO ] [MAIN ] BGX: Full history saved. [2025-10-15T17:36:30.275150] [INFO ] [MAIN ] Update Progress: 268/2369 symbols completed. BGX took 39.6s. Estimated remaining: 4h 45m 35s. Rate: 7.4 symbols/min [2025-10-15T17:36:30.663327] [INFO ] [MAIN ] BHP: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:36:30.707628] [INFO ] [REMOTE ] BHK: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:36:30.709186] [INFO ] [REMOTE ] BHK: Fetching primary data for 2024-12. [2025-10-15T17:36:30.739330] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-15T17:36:30.802072] [DEBUG] [LOCAL ] BHP: Loaded 53373 existing records from primary storage. [2025-10-15T17:36:30.802536] [INFO ] [MAIN ] BHP: Loaded 53373 existing records. [2025-10-15T17:36:30.997705] [WARN ] [MAIN ] BHP: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:36:31.012247] [INFO ] [MAIN ] BHP: Wiping existing primary data before full refresh. [2025-10-15T17:36:31.013610] [INFO ] [LOCAL ] BHP: Starting deletion of primary data. [2025-10-15T17:36:31.013503] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-15T17:36:31.018465] [DEBUG] [LOCAL ] BHP: Deleted primary data file. [2025-10-15T17:36:31.019218] [INFO ] [MAIN ] BHP: Starting full primary refresh. [2025-10-15T17:36:31.318541] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-01. [2025-10-15T17:36:31.411608] [INFO ] [REMOTE ] BHP: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:36:31.721830] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-10-15T17:36:32.114064] [INFO ] [REMOTE ] BHP: Fetching primary data for 2024-12. [2025-10-15T17:36:32.238921] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-15T17:36:32.914028] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-02. [2025-10-15T17:36:33.714056] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-10. [2025-10-15T17:36:33.889049] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-15T17:36:33.918865] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-15T17:36:34.514030] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-01. [2025-10-15T17:36:35.252745] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-15T17:36:35.258468] [INFO ] [REMOTE ] BHC: Full fetch complete (67415 records). [2025-10-15T17:36:35.258581] [DEBUG] [VALIDATOR ] BHC: Validating primary data. [2025-10-15T17:36:35.320828] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-01. [2025-10-15T17:36:35.638088] [DEBUG] [VALIDATOR ] BHC: All expected trading days are present. [2025-10-15T17:36:35.638178] [DEBUG] [VALIDATOR ] BHC: Primary data validation passed. [2025-10-15T17:36:35.639002] [INFO ] [MAIN ] BHC: Fetched primary data is valid. [2025-10-15T17:36:35.639064] [DEBUG] [LOCAL ] BHC: Saving primary data. [2025-10-15T17:36:35.640594] [DEBUG] [LOCAL ] BHC: Trimmed 67415 records to 46689 (keeping 200 days of data) [2025-10-15T17:36:35.909433] [DEBUG] [LOCAL ] BHC: Primary data saved (46689 records). [2025-10-15T17:36:35.909613] [INFO ] [MAIN ] BHC: Full history saved. [2025-10-15T17:36:35.909756] [INFO ] [MAIN ] Update Progress: 269/2369 symbols completed. BHC took 34.1s. Estimated remaining: 4h 45m 7s. Rate: 7.4 symbols/min [2025-10-15T17:36:36.108496] [INFO ] [MAIN ] BHR: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:36:36.115160] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-03. [2025-10-15T17:36:36.121709] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-15T17:36:36.150171] [DEBUG] [LOCAL ] BHR: Loaded 22078 existing records from primary storage. [2025-10-15T17:36:36.150523] [INFO ] [MAIN ] BHR: Loaded 22078 existing records. [2025-10-15T17:36:36.332933] [WARN ] [MAIN ] BHR: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:36:36.333507] [INFO ] [MAIN ] BHR: Wiping existing primary data before full refresh. [2025-10-15T17:36:36.333568] [INFO ] [LOCAL ] BHR: Starting deletion of primary data. [2025-10-15T17:36:36.344912] [DEBUG] [LOCAL ] BHR: Deleted primary data file. [2025-10-15T17:36:36.345015] [INFO ] [MAIN ] BHR: Starting full primary refresh. [2025-10-15T17:36:36.446837] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-10-15T17:36:36.741340] [INFO ] [REMOTE ] BHR: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:36:36.914070] [INFO ] [REMOTE ] BHR: Fetching primary data for 2024-12. [2025-10-15T17:36:37.438246] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-15T17:36:37.714053] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-02. [2025-10-15T17:36:38.067470] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-15T17:36:38.514008] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-04. [2025-10-15T17:36:39.251897] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-15T17:36:39.314000] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-03. [2025-10-15T17:36:39.557510] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-15T17:36:40.114030] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-02. [2025-10-15T17:36:40.913984] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-05. [2025-10-15T17:36:40.987879] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-15T17:36:41.336676] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-10-15T17:36:41.713966] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-04. [2025-10-15T17:36:41.859826] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-15T17:36:42.513999] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-06. [2025-10-15T17:36:43.314019] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-03. [2025-10-15T17:36:43.351681] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-15T17:36:43.375673] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-15T17:36:44.114051] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-05. [2025-10-15T17:36:44.331914] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-15T17:36:44.914083] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-07. [2025-10-15T17:36:45.714023] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-01. [2025-10-15T17:36:45.934588] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-15T17:36:45.993907] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-15T17:36:46.513962] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-06. [2025-10-15T17:36:46.577971] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-15T17:36:47.314022] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-04. [2025-10-15T17:36:48.114027] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-08. [2025-10-15T17:36:48.218309] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-15T17:36:48.216816] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-15T17:36:48.914023] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-07. [2025-10-15T17:36:49.015507] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-15T17:36:49.714104] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-02. [2025-10-15T17:36:50.481869] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-15T17:36:50.513972] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-03. [2025-10-15T17:36:50.992247] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-10-15T17:36:51.313984] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-05. [2025-10-15T17:36:51.396971] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-15T17:36:52.114018] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-04. [2025-10-15T17:36:52.468184] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-15T17:36:52.913989] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-09. [2025-10-15T17:36:53.066611] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-15T17:36:53.713972] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-06. [2025-10-15T17:36:53.775252] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-15T17:36:54.513977] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-08. [2025-10-15T17:36:54.790233] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-15T17:36:55.314082] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-05. [2025-10-15T17:36:56.113997] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-07. [2025-10-15T17:36:56.347891] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-15T17:36:56.481851] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-15T17:36:56.923836] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-09. [2025-10-15T17:36:56.929055] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-15T17:36:57.714050] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-06. [2025-10-15T17:36:58.513985] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-08. [2025-10-15T17:36:58.566539] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-15T17:36:58.946931] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-10-15T17:36:59.295511] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-15T17:36:59.313948] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-09. [2025-10-15T17:37:00.114065] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-07. [2025-10-15T17:37:00.333540] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-15T17:37:00.914066] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-10. [2025-10-15T17:37:01.217569] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-15T17:37:01.714001] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-10. [2025-10-15T17:37:02.514083] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-10. [2025-10-15T17:37:02.802212] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-15T17:37:02.805391] [INFO ] [REMOTE ] BHE: Full fetch complete (36279 records). [2025-10-15T17:37:02.805497] [DEBUG] [VALIDATOR ] BHE: Validating primary data. [2025-10-15T17:37:02.979315] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-10 (2.07 seconds). [2025-10-15T17:37:03.003503] [INFO ] [REMOTE ] BHP: Full fetch complete (77439 records). [2025-10-15T17:37:03.015634] [DEBUG] [VALIDATOR ] BHP: Validating primary data. [2025-10-15T17:37:03.328445] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-08. [2025-10-15T17:37:03.480043] [DEBUG] [VALIDATOR ] BHE: All expected trading days are present. [2025-10-15T17:37:03.510124] [DEBUG] [VALIDATOR ] BHE: Primary data validation passed. [2025-10-15T17:37:03.528037] [INFO ] [MAIN ] BHE: Fetched primary data is valid. [2025-10-15T17:37:03.546297] [DEBUG] [LOCAL ] BHE: Saving primary data. [2025-10-15T17:37:03.576224] [DEBUG] [LOCAL ] BHE: Trimmed 36279 records to 23842 (keeping 200 days of data) [2025-10-15T17:37:03.739294] [DEBUG] [VALIDATOR ] BHP: All expected trading days are present. [2025-10-15T17:37:03.739516] [DEBUG] [VALIDATOR ] BHP: Primary data validation passed. [2025-10-15T17:37:03.742508] [INFO ] [MAIN ] BHP: Fetched primary data is valid. [2025-10-15T17:37:03.748705] [DEBUG] [LOCAL ] BHP: Saving primary data. [2025-10-15T17:37:03.799864] [DEBUG] [LOCAL ] BHP: Trimmed 77439 records to 53372 (keeping 200 days of data) [2025-10-15T17:37:03.806187] [DEBUG] [LOCAL ] BHE: Primary data saved (23842 records). [2025-10-15T17:37:03.806532] [INFO ] [MAIN ] BHE: Full history saved. [2025-10-15T17:37:03.807070] [INFO ] [MAIN ] Update Progress: 270/2369 symbols completed. BHE took 35.8s. Estimated remaining: 4h 47m 33s. Rate: 7.3 symbols/min [2025-10-15T17:37:03.985301] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-15T17:37:04.025512] [INFO ] [REMOTE ] BHK: Full fetch complete (30732 records). [2025-10-15T17:37:04.027886] [DEBUG] [VALIDATOR ] BHK: Validating primary data. [2025-10-15T17:37:04.195939] [INFO ] [MAIN ] BHV: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:37:04.229495] [DEBUG] [LOCAL ] BHV: No existing data file found in primary storage. [2025-10-15T17:37:04.233543] [WARN ] [MAIN ] BHV: No existing data found, performing full refresh instead. [2025-10-15T17:37:04.235704] [INFO ] [MAIN ] BHV: Wiping existing primary data before full refresh. [2025-10-15T17:37:04.236975] [INFO ] [LOCAL ] BHV: Starting deletion of primary data. [2025-10-15T17:37:04.238339] [DEBUG] [LOCAL ] BHV: No primary data file found to delete. [2025-10-15T17:37:04.239023] [INFO ] [MAIN ] BHV: Starting full primary refresh. [2025-10-15T17:37:04.802994] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-15T17:37:04.844351] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-09. [2025-10-15T17:37:05.037266] [DEBUG] [VALIDATOR ] BHK: All expected trading days are present. [2025-10-15T17:37:05.036724] [INFO ] [REMOTE ] BHV: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:37:05.037472] [DEBUG] [VALIDATOR ] BHK: Primary data validation passed. [2025-10-15T17:37:05.037784] [INFO ] [REMOTE ] BHV: Fetching primary data for 2024-12. [2025-10-15T17:37:05.040900] [INFO ] [MAIN ] BHK: Fetched primary data is valid. [2025-10-15T17:37:05.041598] [DEBUG] [LOCAL ] BHK: Saving primary data. [2025-10-15T17:37:05.046527] [DEBUG] [LOCAL ] BHK: Trimmed 30732 records to 23743 (keeping 200 days of data) [2025-10-15T17:37:05.207795] [DEBUG] [LOCAL ] BHK: Primary data saved (23743 records). [2025-10-15T17:37:05.209325] [INFO ] [MAIN ] BHK: Full history saved. [2025-10-15T17:37:05.209737] [INFO ] [MAIN ] Update Progress: 271/2369 symbols completed. BHK took 36.1s. Estimated remaining: 4h 46m 32s. Rate: 7.3 symbols/min [2025-10-15T17:37:05.469227] [INFO ] [MAIN ] BHVN: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:37:05.479296] [DEBUG] [LOCAL ] BHP: Primary data saved (53372 records). [2025-10-15T17:37:05.479517] [INFO ] [MAIN ] BHP: Full history saved. [2025-10-15T17:37:05.479618] [INFO ] [MAIN ] Update Progress: 272/2369 symbols completed. BHP took 35.2s. Estimated remaining: 4h 45m 23s. Rate: 7.3 symbols/min [2025-10-15T17:37:05.548570] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2024-12 (0.51 seconds). [2025-10-15T17:37:05.681162] [INFO ] [MAIN ] BILL: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:37:05.702612] [DEBUG] [LOCAL ] BHVN: Loaded 50511 existing records from primary storage. [2025-10-15T17:37:05.703108] [INFO ] [MAIN ] BHVN: Loaded 50511 existing records. [2025-10-15T17:37:05.723826] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-01. [2025-10-15T17:37:05.904940] [WARN ] [MAIN ] BHVN: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:37:05.906458] [INFO ] [MAIN ] BHVN: Wiping existing primary data before full refresh. [2025-10-15T17:37:05.906547] [INFO ] [LOCAL ] BHVN: Starting deletion of primary data. [2025-10-15T17:37:05.924805] [DEBUG] [LOCAL ] BHVN: Deleted primary data file. [2025-10-15T17:37:05.924975] [INFO ] [MAIN ] BHVN: Starting full primary refresh. [2025-10-15T17:37:05.947788] [DEBUG] [LOCAL ] BILL: Loaded 52469 existing records from primary storage. [2025-10-15T17:37:05.981820] [INFO ] [MAIN ] BILL: Loaded 52469 existing records. [2025-10-15T17:37:06.120527] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-15T17:37:06.193399] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-10-15T17:37:06.524706] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-10. [2025-10-15T17:37:06.535083] [WARN ] [MAIN ] BILL: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:37:06.540419] [INFO ] [MAIN ] BILL: Wiping existing primary data before full refresh. [2025-10-15T17:37:06.546478] [INFO ] [LOCAL ] BILL: Starting deletion of primary data. [2025-10-15T17:37:06.561989] [DEBUG] [LOCAL ] BILL: Deleted primary data file. [2025-10-15T17:37:06.586118] [INFO ] [MAIN ] BILL: Starting full primary refresh. [2025-10-15T17:37:06.642935] [INFO ] [REMOTE ] BHVN: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:37:06.957569] [INFO ] [REMOTE ] BILL: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:37:07.314035] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-02. [2025-10-15T17:37:07.655352] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-10-15T17:37:07.824291] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-15T17:37:07.827856] [INFO ] [REMOTE ] BHR: Full fetch complete (31383 records). [2025-10-15T17:37:07.827937] [DEBUG] [VALIDATOR ] BHR: Validating primary data. [2025-10-15T17:37:08.119153] [INFO ] [REMOTE ] BILL: Fetching primary data for 2024-12. [2025-10-15T17:37:08.190507] [DEBUG] [VALIDATOR ] BHR: All expected trading days are present. [2025-10-15T17:37:08.190576] [DEBUG] [VALIDATOR ] BHR: Primary data validation passed. [2025-10-15T17:37:08.191099] [INFO ] [MAIN ] BHR: Fetched primary data is valid. [2025-10-15T17:37:08.191162] [DEBUG] [LOCAL ] BHR: Saving primary data. [2025-10-15T17:37:08.192045] [DEBUG] [LOCAL ] BHR: Trimmed 31383 records to 22093 (keeping 200 days of data) [2025-10-15T17:37:08.315992] [DEBUG] [LOCAL ] BHR: Primary data saved (22093 records). [2025-10-15T17:37:08.316131] [INFO ] [MAIN ] BHR: Full history saved. [2025-10-15T17:37:08.316212] [INFO ] [MAIN ] Update Progress: 273/2369 symbols completed. BHR took 32.4s. Estimated remaining: 4h 44m 33s. Rate: 7.4 symbols/min [2025-10-15T17:37:08.480247] [INFO ] [MAIN ] BIO: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:37:08.503525] [DEBUG] [LOCAL ] BIO: Loaded 24138 existing records from primary storage. [2025-10-15T17:37:08.503809] [INFO ] [MAIN ] BIO: Loaded 24138 existing records. [2025-10-15T17:37:08.675985] [WARN ] [MAIN ] BIO: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:37:08.676200] [INFO ] [MAIN ] BIO: Wiping existing primary data before full refresh. [2025-10-15T17:37:08.676246] [INFO ] [LOCAL ] BIO: Starting deletion of primary data. [2025-10-15T17:37:08.676464] [DEBUG] [LOCAL ] BIO: Deleted primary data file. [2025-10-15T17:37:08.676501] [INFO ] [MAIN ] BIO: Starting full primary refresh. [2025-10-15T17:37:08.923930] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2024-12. [2025-10-15T17:37:09.038757] [INFO ] [REMOTE ] BIO: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:37:09.714007] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-03. [2025-10-15T17:37:09.815259] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-15T17:37:09.955689] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-03 (0.24 seconds). [2025-10-15T17:37:10.495145] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-15T17:37:10.514020] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-01. [2025-10-15T17:37:11.314091] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-01. [2025-10-15T17:37:12.109580] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-15T17:37:12.118581] [INFO ] [REMOTE ] BIO: Fetching primary data for 2024-12. [2025-10-15T17:37:12.721041] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-15T17:37:12.914011] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-02. [2025-10-15T17:37:13.299847] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-15T17:37:13.714060] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-01. [2025-10-15T17:37:14.416659] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-15T17:37:14.514077] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-04. [2025-10-15T17:37:14.552598] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-15T17:37:14.885106] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-04 (0.37 seconds). [2025-10-15T17:37:15.314016] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-05. [2025-10-15T17:37:15.801265] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-15T17:37:16.114049] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-02. [2025-10-15T17:37:16.914011] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-06. [2025-10-15T17:37:17.228636] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-06 (0.31 seconds). [2025-10-15T17:37:17.716489] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-07. [2025-10-15T17:37:17.719679] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-15T17:37:18.034994] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-07 (0.32 seconds). [2025-10-15T17:37:18.514055] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-03. [2025-10-15T17:37:19.314068] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-08. [2025-10-15T17:37:19.614221] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-08 (0.30 seconds). [2025-10-15T17:37:19.902675] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-15T17:37:20.114027] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-03. [2025-10-15T17:37:20.914055] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-09. [2025-10-15T17:37:21.347072] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-10-15T17:37:21.713978] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-04. [2025-10-15T17:37:21.843930] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-15T17:37:22.514055] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-10. [2025-10-15T17:37:22.976764] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-15T17:37:22.977715] [INFO ] [REMOTE ] BHV: Full fetch complete (1386 records). [2025-10-15T17:37:22.977788] [DEBUG] [VALIDATOR ] BHV: Validating primary data. [2025-10-15T17:37:23.170632] [WARN ] [VALIDATOR ] BHV: Validation failed - insufficient historical data. Have 195 unique days, need 200 days [2025-10-15T17:37:23.170946] [FATAL] [MAIN ] BHV: Fetched primary data is invalid. Refusing to save it. [2025-10-15T17:37:23.171027] [WARN ] [MAIN ] BHV: Deleting existing primary and derivative data due to validation failure. [2025-10-15T17:37:23.171123] [INFO ] [LOCAL ] BHV: Starting deletion of primary data. [2025-10-15T17:37:23.171292] [DEBUG] [LOCAL ] BHV: No primary data file found to delete. [2025-10-15T17:37:23.171354] [INFO ] [LOCAL ] BHV: Starting deletion of derivative data. [2025-10-15T17:37:23.171441] [DEBUG] [LOCAL ] BHV: No derivative data file found to delete. [2025-10-15T17:37:23.171540] [INFO ] [MAIN ] Update Progress: 274/2369 symbols completed. BHV took 19.4s. Estimated remaining: 4h 45m 17s. Rate: 7.3 symbols/min [2025-10-15T17:37:23.323616] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-02. [2025-10-15T17:37:23.360710] [INFO ] [MAIN ] BIP: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:37:23.404959] [DEBUG] [LOCAL ] BIP: Loaded 39214 existing records from primary storage. [2025-10-15T17:37:23.405383] [INFO ] [MAIN ] BIP: Loaded 39214 existing records. [2025-10-15T17:37:23.601369] [WARN ] [MAIN ] BIP: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:37:23.602025] [INFO ] [MAIN ] BIP: Wiping existing primary data before full refresh. [2025-10-15T17:37:23.602139] [INFO ] [LOCAL ] BIP: Starting deletion of primary data. [2025-10-15T17:37:23.613311] [DEBUG] [LOCAL ] BIP: Deleted primary data file. [2025-10-15T17:37:23.621626] [INFO ] [MAIN ] BIP: Starting full primary refresh. [2025-10-15T17:37:23.680545] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-15T17:37:24.021556] [INFO ] [REMOTE ] BIP: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:37:24.114072] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-04. [2025-10-15T17:37:24.815549] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-15T17:37:24.914003] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-03. [2025-10-15T17:37:25.713980] [INFO ] [REMOTE ] BIP: Fetching primary data for 2024-12. [2025-10-15T17:37:25.798787] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-15T17:37:26.186713] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-15T17:37:26.514067] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-04. [2025-10-15T17:37:27.314505] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-05. [2025-10-15T17:37:27.320018] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-15T17:37:27.524592] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-15T17:37:28.114000] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-01. [2025-10-15T17:37:28.810572] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-15T17:37:28.913973] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-06. [2025-10-15T17:37:29.463913] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-15T17:37:29.714008] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-05. [2025-10-15T17:37:30.363706] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-15T17:37:30.514036] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-07. [2025-10-15T17:37:31.305584] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-15T17:37:31.316155] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-02. [2025-10-15T17:37:32.114016] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-06. [2025-10-15T17:37:32.347172] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-15T17:37:32.553328] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-15T17:37:32.914013] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-05. [2025-10-15T17:37:33.587293] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-15T17:37:33.713970] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-07. [2025-10-15T17:37:33.770912] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-15T17:37:34.514042] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-08. [2025-10-15T17:37:35.314035] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-06. [2025-10-15T17:37:35.700085] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-15T17:37:36.114079] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-08. [2025-10-15T17:37:36.353292] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-15T17:37:36.510630] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-15T17:37:36.914026] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-09. [2025-10-15T17:37:37.566081] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-15T17:37:37.714010] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-09. [2025-10-15T17:37:38.439394] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-15T17:37:38.513989] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-10. [2025-10-15T17:37:39.313999] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-03. [2025-10-15T17:37:40.113991] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-07. [2025-10-15T17:37:40.288799] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-09 (2.57 seconds). [2025-10-15T17:37:40.503098] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-10 (1.99 seconds). [2025-10-15T17:37:40.510502] [INFO ] [REMOTE ] BILL: Full fetch complete (76063 records). [2025-10-15T17:37:40.510679] [DEBUG] [VALIDATOR ] BILL: Validating primary data. [2025-10-15T17:37:40.930163] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-10. [2025-10-15T17:37:40.958789] [DEBUG] [VALIDATOR ] BILL: All expected trading days are present. [2025-10-15T17:37:40.958911] [DEBUG] [VALIDATOR ] BILL: Primary data validation passed. [2025-10-15T17:37:40.960115] [INFO ] [MAIN ] BILL: Fetched primary data is valid. [2025-10-15T17:37:40.960455] [DEBUG] [LOCAL ] BILL: Saving primary data. [2025-10-15T17:37:40.962508] [DEBUG] [LOCAL ] BILL: Trimmed 76063 records to 52497 (keeping 200 days of data) [2025-10-15T17:37:41.090150] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-15T17:37:41.261909] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-15T17:37:41.365888] [DEBUG] [LOCAL ] BILL: Primary data saved (52497 records). [2025-10-15T17:37:41.366065] [INFO ] [MAIN ] BILL: Full history saved. [2025-10-15T17:37:41.366188] [INFO ] [MAIN ] Update Progress: 275/2369 symbols completed. BILL took 35.9s. Estimated remaining: 4h 46m 25s. Rate: 7.3 symbols/min [2025-10-15T17:37:41.557143] [INFO ] [MAIN ] BIPC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:37:41.597281] [DEBUG] [LOCAL ] BIPC: Loaded 41199 existing records from primary storage. [2025-10-15T17:37:41.597625] [INFO ] [MAIN ] BIPC: Loaded 41199 existing records. [2025-10-15T17:37:41.719136] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-08. [2025-10-15T17:37:41.799227] [WARN ] [MAIN ] BIPC: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:37:41.799465] [INFO ] [MAIN ] BIPC: Wiping existing primary data before full refresh. [2025-10-15T17:37:41.799514] [INFO ] [LOCAL ] BIPC: Starting deletion of primary data. [2025-10-15T17:37:41.799906] [DEBUG] [LOCAL ] BIPC: Deleted primary data file. [2025-10-15T17:37:41.799965] [INFO ] [MAIN ] BIPC: Starting full primary refresh. [2025-10-15T17:37:42.184627] [INFO ] [REMOTE ] BIPC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:37:42.514024] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2024-12. [2025-10-15T17:37:42.702131] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-15T17:37:42.939924] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-10 (2.01 seconds). [2025-10-15T17:37:42.946233] [INFO ] [REMOTE ] BHVN: Full fetch complete (70486 records). [2025-10-15T17:37:42.946380] [DEBUG] [VALIDATOR ] BHVN: Validating primary data. [2025-10-15T17:37:43.316732] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-04. [2025-10-15T17:37:43.341294] [DEBUG] [VALIDATOR ] BHVN: All expected trading days are present. [2025-10-15T17:37:43.341433] [DEBUG] [VALIDATOR ] BHVN: Primary data validation passed. [2025-10-15T17:37:43.342512] [INFO ] [MAIN ] BHVN: Fetched primary data is valid. [2025-10-15T17:37:43.342610] [DEBUG] [LOCAL ] BHVN: Saving primary data. [2025-10-15T17:37:43.344344] [DEBUG] [LOCAL ] BHVN: Trimmed 70486 records to 50605 (keeping 200 days of data) [2025-10-15T17:37:43.640749] [DEBUG] [LOCAL ] BHVN: Primary data saved (50605 records). [2025-10-15T17:37:43.641027] [INFO ] [MAIN ] BHVN: Full history saved. [2025-10-15T17:37:43.641915] [INFO ] [MAIN ] Update Progress: 276/2369 symbols completed. BHVN took 38.4s. Estimated remaining: 4h 45m 32s. Rate: 7.3 symbols/min [2025-10-15T17:37:43.813840] [INFO ] [MAIN ] BIPH: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:37:43.820166] [DEBUG] [LOCAL ] BIPH: Loaded 2528 existing records from primary storage. [2025-10-15T17:37:43.820387] [INFO ] [MAIN ] BIPH: Loaded 2528 existing records. [2025-10-15T17:37:44.020244] [WARN ] [MAIN ] BIPH: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:37:44.020635] [INFO ] [MAIN ] BIPH: Wiping existing primary data before full refresh. [2025-10-15T17:37:44.020739] [INFO ] [LOCAL ] BIPH: Starting deletion of primary data. [2025-10-15T17:37:44.020918] [DEBUG] [LOCAL ] BIPH: Deleted primary data file. [2025-10-15T17:37:44.020969] [INFO ] [MAIN ] BIPH: Starting full primary refresh. [2025-10-15T17:37:44.121357] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-09. [2025-10-15T17:37:44.385976] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-10-15T17:37:44.461171] [INFO ] [REMOTE ] BIPH: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:37:44.730577] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-15T17:37:44.913974] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2024-12. [2025-10-15T17:37:45.150726] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-15T17:37:45.710280] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-10-15T17:37:45.713948] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-01. [2025-10-15T17:37:46.170164] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-10-15T17:37:46.514102] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-01. [2025-10-15T17:37:47.314029] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-05. [2025-10-15T17:37:47.710612] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-15T17:37:48.114024] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-02. [2025-10-15T17:37:48.536746] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-10-15T17:37:48.654824] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-15T17:37:48.913998] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-03. [2025-10-15T17:37:49.360269] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-10-15T17:37:49.714020] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-02. [2025-10-15T17:37:50.514038] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-06. [2025-10-15T17:37:50.799201] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-15T17:37:51.314068] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-03. [2025-10-15T17:37:51.919444] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-15T17:37:52.114033] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-04. [2025-10-15T17:37:52.576768] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-10-15T17:37:52.864174] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-15T17:37:52.913971] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-04. [2025-10-15T17:37:53.714027] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-07. [2025-10-15T17:37:54.514012] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-10. [2025-10-15T17:37:54.593898] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-15T17:37:54.867931] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-15T17:37:55.314080] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-05. [2025-10-15T17:37:55.608767] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-15T17:37:55.611280] [INFO ] [REMOTE ] BIO: Full fetch complete (34141 records). [2025-10-15T17:37:55.611354] [DEBUG] [VALIDATOR ] BIO: Validating primary data. [2025-10-15T17:37:55.900135] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-15T17:37:55.991256] [DEBUG] [VALIDATOR ] BIO: All expected trading days are present. [2025-10-15T17:37:55.991379] [DEBUG] [VALIDATOR ] BIO: Primary data validation passed. [2025-10-15T17:37:55.992087] [INFO ] [MAIN ] BIO: Fetched primary data is valid. [2025-10-15T17:37:55.992153] [DEBUG] [LOCAL ] BIO: Saving primary data. [2025-10-15T17:37:55.993153] [DEBUG] [LOCAL ] BIO: Trimmed 34141 records to 24027 (keeping 200 days of data) [2025-10-15T17:37:56.114194] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-06. [2025-10-15T17:37:56.149310] [DEBUG] [LOCAL ] BIO: Primary data saved (24027 records). [2025-10-15T17:37:56.149526] [INFO ] [MAIN ] BIO: Full history saved. [2025-10-15T17:37:56.149683] [INFO ] [MAIN ] Update Progress: 277/2369 symbols completed. BIO took 47.8s. Estimated remaining: 4h 45m 56s. Rate: 7.3 symbols/min [2025-10-15T17:37:56.560559] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-15T17:37:56.914045] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-07. [2025-10-15T17:37:57.217073] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-07 (0.30 seconds). [2025-10-15T17:37:57.714028] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-08. [2025-10-15T17:37:58.514059] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-05. [2025-10-15T17:37:59.162530] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-15T17:37:59.313996] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-09. [2025-10-15T17:37:59.665499] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-15T17:38:00.114028] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-06. [2025-10-15T17:38:00.694330] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-15T17:38:00.914007] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-08. [2025-10-15T17:38:01.305730] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-08 (0.39 seconds). [2025-10-15T17:38:01.504398] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-15T17:38:01.714086] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-10. [2025-10-15T17:38:02.513996] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-09. [2025-10-15T17:38:02.868691] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-09 (0.35 seconds). [2025-10-15T17:38:03.314083] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-10. [2025-10-15T17:38:03.387071] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-15T17:38:03.392868] [INFO ] [REMOTE ] BIP: Full fetch complete (57363 records). [2025-10-15T17:38:03.393069] [DEBUG] [VALIDATOR ] BIP: Validating primary data. [2025-10-15T17:38:03.814267] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-15T17:38:03.860926] [INFO ] [REMOTE ] BIPH: Full fetch complete (4092 records). [2025-10-15T17:38:03.885109] [DEBUG] [VALIDATOR ] BIPH: Validating primary data. [2025-10-15T17:38:03.931560] [DEBUG] [VALIDATOR ] BIP: All expected trading days are present. [2025-10-15T17:38:03.947393] [DEBUG] [VALIDATOR ] BIP: Primary data validation passed. [2025-10-15T17:38:03.976097] [INFO ] [MAIN ] BIP: Fetched primary data is valid. [2025-10-15T17:38:03.999441] [DEBUG] [LOCAL ] BIP: Saving primary data. [2025-10-15T17:38:04.073896] [DEBUG] [LOCAL ] BIP: Trimmed 57363 records to 39192 (keeping 200 days of data) [2025-10-15T17:38:04.117751] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-07. [2025-10-15T17:38:04.553148] [DEBUG] [VALIDATOR ] BIPH: All expected trading days are present. [2025-10-15T17:38:04.553740] [DEBUG] [VALIDATOR ] BIPH: Primary data validation passed. [2025-10-15T17:38:04.554057] [INFO ] [MAIN ] BIPH: Fetched primary data is valid. [2025-10-15T17:38:04.554152] [DEBUG] [LOCAL ] BIPH: Saving primary data. [2025-10-15T17:38:04.557193] [DEBUG] [LOCAL ] BIPH: Trimmed 4092 records to 2518 (keeping 200 days of data) [2025-10-15T17:38:04.717454] [DEBUG] [LOCAL ] BIPH: Primary data saved (2518 records). [2025-10-15T17:38:04.721005] [INFO ] [MAIN ] BIPH: Full history saved. [2025-10-15T17:38:04.721175] [INFO ] [MAIN ] Update Progress: 278/2369 symbols completed. BIPH took 21.1s. Estimated remaining: 4h 45m 51s. Rate: 7.3 symbols/min [2025-10-15T17:38:04.754245] [DEBUG] [LOCAL ] BIP: Primary data saved (39192 records). [2025-10-15T17:38:04.754405] [INFO ] [MAIN ] BIP: Full history saved. [2025-10-15T17:38:04.754490] [INFO ] [MAIN ] Update Progress: 279/2369 symbols completed. BIP took 41.6s. Estimated remaining: 4h 44m 41s. Rate: 7.3 symbols/min [2025-10-15T17:38:05.838625] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-15T17:38:05.848167] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-08. [2025-10-15T17:38:07.306167] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-15T17:38:07.315848] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-09. [2025-10-15T17:38:08.558873] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-15T17:38:08.568035] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-10. [2025-10-15T17:38:09.769783] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-15T17:38:09.775547] [INFO ] [REMOTE ] BIPC: Full fetch complete (60249 records). [2025-10-15T17:38:09.775745] [DEBUG] [VALIDATOR ] BIPC: Validating primary data. [2025-10-15T17:38:10.173789] [DEBUG] [VALIDATOR ] BIPC: All expected trading days are present. [2025-10-15T17:38:10.173916] [DEBUG] [VALIDATOR ] BIPC: Primary data validation passed. [2025-10-15T17:38:10.174734] [INFO ] [MAIN ] BIPC: Fetched primary data is valid. [2025-10-15T17:38:10.174796] [DEBUG] [LOCAL ] BIPC: Saving primary data. [2025-10-15T17:38:10.176157] [DEBUG] [LOCAL ] BIPC: Trimmed 60249 records to 41257 (keeping 200 days of data) [2025-10-15T17:38:10.417224] [DEBUG] [LOCAL ] BIPC: Primary data saved (41257 records). [2025-10-15T17:38:10.417357] [INFO ] [MAIN ] BIPC: Full history saved. [2025-10-15T17:38:10.417614] [INFO ] [MAIN ] Update Progress: 280/2369 symbols completed. BIPC took 29.1s. Estimated remaining: 4h 44m 14s. Rate: 7.3 symbols/min [2025-10-15T17:38:11.102192] [INFO ] [MAIN ] BIPJ: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:38:11.125703] [INFO ] [MAIN ] BIPI: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:38:11.103020] [INFO ] [MAIN ] BIT: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:38:11.124895] [INFO ] [MAIN ] BIRK: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:38:11.135188] [DEBUG] [LOCAL ] BIPJ: Loaded 3176 existing records from primary storage. [2025-10-15T17:38:11.137278] [DEBUG] [LOCAL ] BIPI: Loaded 3072 existing records from primary storage. [2025-10-15T17:38:11.137616] [INFO ] [MAIN ] BIPI: Loaded 3072 existing records. [2025-10-15T17:38:11.160947] [INFO ] [MAIN ] BIPJ: Loaded 3176 existing records. [2025-10-15T17:38:11.442039] [DEBUG] [LOCAL ] BIT: Loaded 23575 existing records from primary storage. [2025-10-15T17:38:11.531596] [INFO ] [MAIN ] BIT: Loaded 23575 existing records. [2025-10-15T17:38:11.512060] [WARN ] [MAIN ] BIPI: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:38:11.556168] [INFO ] [MAIN ] BIPI: Wiping existing primary data before full refresh. [2025-10-15T17:38:11.593976] [INFO ] [LOCAL ] BIPI: Starting deletion of primary data. [2025-10-15T17:38:11.618945] [DEBUG] [LOCAL ] BIRK: Loaded 51059 existing records from primary storage. [2025-10-15T17:38:11.588605] [WARN ] [MAIN ] BIPJ: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:38:11.619404] [INFO ] [MAIN ] BIRK: Loaded 51059 existing records. [2025-10-15T17:38:11.627793] [DEBUG] [LOCAL ] BIPI: Deleted primary data file. [2025-10-15T17:38:11.666692] [INFO ] [MAIN ] BIPJ: Wiping existing primary data before full refresh. [2025-10-15T17:38:11.675760] [INFO ] [MAIN ] BIPI: Starting full primary refresh. [2025-10-15T17:38:11.701638] [INFO ] [LOCAL ] BIPJ: Starting deletion of primary data. [2025-10-15T17:38:11.798986] [DEBUG] [LOCAL ] BIPJ: Deleted primary data file. [2025-10-15T17:38:11.910354] [WARN ] [MAIN ] BIT: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:38:11.891079] [INFO ] [MAIN ] BIPJ: Starting full primary refresh. [2025-10-15T17:38:11.993361] [INFO ] [MAIN ] BIT: Wiping existing primary data before full refresh. [2025-10-15T17:38:12.094364] [INFO ] [LOCAL ] BIT: Starting deletion of primary data. [2025-10-15T17:38:12.178187] [DEBUG] [LOCAL ] BIT: Deleted primary data file. [2025-10-15T17:38:12.226947] [WARN ] [MAIN ] BIRK: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:38:12.236390] [INFO ] [MAIN ] BIRK: Wiping existing primary data before full refresh. [2025-10-15T17:38:12.234700] [INFO ] [MAIN ] BIT: Starting full primary refresh. [2025-10-15T17:38:12.269788] [INFO ] [LOCAL ] BIRK: Starting deletion of primary data. [2025-10-15T17:38:12.297400] [DEBUG] [LOCAL ] BIRK: Deleted primary data file. [2025-10-15T17:38:12.411163] [INFO ] [MAIN ] BIRK: Starting full primary refresh. [2025-10-15T17:38:12.916154] [INFO ] [REMOTE ] BIPI: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:38:12.976387] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2024-12. [2025-10-15T17:38:13.243474] [INFO ] [REMOTE ] BIPJ: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:38:13.259285] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2024-12. [2025-10-15T17:38:13.397049] [INFO ] [REMOTE ] BIT: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:38:13.400317] [INFO ] [REMOTE ] BIT: Fetching primary data for 2024-12. [2025-10-15T17:38:13.477804] [INFO ] [REMOTE ] BIRK: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:38:13.478159] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2024-12. [2025-10-15T17:38:13.855795] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-15T17:38:13.858004] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-01. [2025-10-15T17:38:14.009320] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-10-15T17:38:14.011058] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-01. [2025-10-15T17:38:14.392852] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-10-15T17:38:14.394290] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-02. [2025-10-15T17:38:14.469244] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-10-15T17:38:14.470507] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-02. [2025-10-15T17:38:14.656231] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-15T17:38:14.661528] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-01. [2025-10-15T17:38:14.667668] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-02 (0.27 seconds). [2025-10-15T17:38:14.669036] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-03. [2025-10-15T17:38:14.834430] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-02 (0.36 seconds). [2025-10-15T17:38:15.050114] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-03 (0.38 seconds). [2025-10-15T17:38:15.177687] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-15T17:38:15.313974] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-04. [2025-10-15T17:38:15.698105] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-15T17:38:15.751046] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-10-15T17:38:16.114057] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-05. [2025-10-15T17:38:16.478237] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-05 (0.36 seconds). [2025-10-15T17:38:16.914046] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-02. [2025-10-15T17:38:17.713983] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-01. [2025-10-15T17:38:17.795441] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-15T17:38:18.513987] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-06. [2025-10-15T17:38:18.952763] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-10-15T17:38:19.310027] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-15T17:38:19.319179] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-03. [2025-10-15T17:38:19.660407] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-03 (0.34 seconds). [2025-10-15T17:38:20.114005] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-07. [2025-10-15T17:38:20.548541] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-10-15T17:38:20.914017] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-08. [2025-10-15T17:38:21.394728] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-10-15T17:38:21.714021] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-09. [2025-10-15T17:38:22.254149] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-10-15T17:38:22.514013] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-10. [2025-10-15T17:38:23.045469] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-15T17:38:23.046426] [INFO ] [REMOTE ] BIPI: Full fetch complete (4808 records). [2025-10-15T17:38:23.046498] [DEBUG] [VALIDATOR ] BIPI: Validating primary data. [2025-10-15T17:38:23.319141] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-02. [2025-10-15T17:38:23.412435] [DEBUG] [VALIDATOR ] BIPI: All expected trading days are present. [2025-10-15T17:38:23.412514] [DEBUG] [VALIDATOR ] BIPI: Primary data validation passed. [2025-10-15T17:38:23.412684] [INFO ] [MAIN ] BIPI: Fetched primary data is valid. [2025-10-15T17:38:23.412744] [DEBUG] [LOCAL ] BIPI: Saving primary data. [2025-10-15T17:38:23.413128] [DEBUG] [LOCAL ] BIPI: Trimmed 4808 records to 2999 (keeping 200 days of data) [2025-10-15T17:38:23.431327] [DEBUG] [LOCAL ] BIPI: Primary data saved (2999 records). [2025-10-15T17:38:23.431431] [INFO ] [MAIN ] BIPI: Full history saved. [2025-10-15T17:38:23.431505] [INFO ] [MAIN ] Update Progress: 281/2369 symbols completed. BIPI took 13.0s. Estimated remaining: 4h 44m 42s. Rate: 7.3 symbols/min [2025-10-15T17:38:23.597769] [INFO ] [MAIN ] BJ: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:38:23.650916] [DEBUG] [LOCAL ] BJ: Loaded 51583 existing records from primary storage. [2025-10-15T17:38:23.651259] [INFO ] [MAIN ] BJ: Loaded 51583 existing records. [2025-10-15T17:38:23.825284] [WARN ] [MAIN ] BJ: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:38:23.825540] [INFO ] [MAIN ] BJ: Wiping existing primary data before full refresh. [2025-10-15T17:38:23.825587] [INFO ] [LOCAL ] BJ: Starting deletion of primary data. [2025-10-15T17:38:23.826031] [DEBUG] [LOCAL ] BJ: Deleted primary data file. [2025-10-15T17:38:23.826090] [INFO ] [MAIN ] BJ: Starting full primary refresh. [2025-10-15T17:38:24.119096] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-03. [2025-10-15T17:38:24.196297] [INFO ] [REMOTE ] BJ: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:38:24.617169] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-15T17:38:24.913967] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-03. [2025-10-15T17:38:25.240013] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-15T17:38:25.714005] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-04. [2025-10-15T17:38:26.286441] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-15T17:38:26.507231] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-15T17:38:26.517154] [INFO ] [REMOTE ] BJ: Fetching primary data for 2024-12. [2025-10-15T17:38:27.314002] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-04. [2025-10-15T17:38:28.114003] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-05. [2025-10-15T17:38:28.165695] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-15T17:38:28.404565] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-15T17:38:28.551921] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-10-15T17:38:28.914011] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-06. [2025-10-15T17:38:29.526714] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-15T17:38:29.713979] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-04. [2025-10-15T17:38:30.514005] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-07. [2025-10-15T17:38:30.911119] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-07 (0.40 seconds). [2025-10-15T17:38:31.317025] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-05. [2025-10-15T17:38:31.322620] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-15T17:38:32.088988] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-15T17:38:32.113982] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-06. [2025-10-15T17:38:32.913986] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-01. [2025-10-15T17:38:33.044103] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-15T17:38:33.714070] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-07. [2025-10-15T17:38:34.288664] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-15T17:38:34.513980] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-05. [2025-10-15T17:38:34.829744] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-15T17:38:35.314015] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-08. [2025-10-15T17:38:35.740366] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-10-15T17:38:36.113974] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-02. [2025-10-15T17:38:36.248459] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-15T17:38:36.914008] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-08. [2025-10-15T17:38:37.714014] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-06. [2025-10-15T17:38:37.783304] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-15T17:38:37.925173] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-15T17:38:38.514004] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-03. [2025-10-15T17:38:39.084365] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-15T17:38:39.314026] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-09. [2025-10-15T17:38:40.114002] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-07. [2025-10-15T17:38:40.238595] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-15T17:38:40.299108] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-15T17:38:40.914004] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-10. [2025-10-15T17:38:41.713973] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-09. [2025-10-15T17:38:41.849113] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-15T17:38:41.956450] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-15T17:38:41.960703] [INFO ] [REMOTE ] BIT: Full fetch complete (32036 records). [2025-10-15T17:38:41.960837] [DEBUG] [VALIDATOR ] BIT: Validating primary data. [2025-10-15T17:38:42.356624] [DEBUG] [VALIDATOR ] BIT: All expected trading days are present. [2025-10-15T17:38:42.356985] [DEBUG] [VALIDATOR ] BIT: Primary data validation passed. [2025-10-15T17:38:42.357852] [INFO ] [MAIN ] BIT: Fetched primary data is valid. [2025-10-15T17:38:42.357919] [DEBUG] [LOCAL ] BIT: Saving primary data. [2025-10-15T17:38:42.358820] [DEBUG] [LOCAL ] BIT: Trimmed 32036 records to 23665 (keeping 200 days of data) [2025-10-15T17:38:42.468449] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-15T17:38:42.516342] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-10. [2025-10-15T17:38:42.525218] [DEBUG] [LOCAL ] BIT: Primary data saved (23665 records). [2025-10-15T17:38:42.525436] [INFO ] [MAIN ] BIT: Full history saved. [2025-10-15T17:38:42.525554] [INFO ] [MAIN ] Update Progress: 282/2369 symbols completed. BIT took 32.1s. Estimated remaining: 4h 45m 55s. Rate: 7.3 symbols/min [2025-10-15T17:38:42.704920] [INFO ] [MAIN ] BK: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:38:42.760119] [DEBUG] [LOCAL ] BK: Loaded 53536 existing records from primary storage. [2025-10-15T17:38:42.760536] [INFO ] [MAIN ] BK: Loaded 53536 existing records. [2025-10-15T17:38:42.953857] [WARN ] [MAIN ] BK: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:38:42.954180] [INFO ] [MAIN ] BK: Wiping existing primary data before full refresh. [2025-10-15T17:38:42.954259] [INFO ] [LOCAL ] BK: Starting deletion of primary data. [2025-10-15T17:38:42.954904] [DEBUG] [LOCAL ] BK: Deleted primary data file. [2025-10-15T17:38:42.954976] [INFO ] [MAIN ] BK: Starting full primary refresh. [2025-10-15T17:38:43.071503] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-15T17:38:43.084155] [INFO ] [REMOTE ] BIPJ: Full fetch complete (4360 records). [2025-10-15T17:38:43.089457] [DEBUG] [VALIDATOR ] BIPJ: Validating primary data. [2025-10-15T17:38:43.320922] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-08. [2025-10-15T17:38:43.701147] [INFO ] [REMOTE ] BK: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:38:43.757154] [DEBUG] [VALIDATOR ] BIPJ: All expected trading days are present. [2025-10-15T17:38:43.757252] [DEBUG] [VALIDATOR ] BIPJ: Primary data validation passed. [2025-10-15T17:38:43.757459] [INFO ] [MAIN ] BIPJ: Fetched primary data is valid. [2025-10-15T17:38:43.757567] [DEBUG] [LOCAL ] BIPJ: Saving primary data. [2025-10-15T17:38:43.758256] [DEBUG] [LOCAL ] BIPJ: Trimmed 4360 records to 3164 (keeping 200 days of data) [2025-10-15T17:38:43.778179] [DEBUG] [LOCAL ] BIPJ: Primary data saved (3164 records). [2025-10-15T17:38:43.778326] [INFO ] [MAIN ] BIPJ: Full history saved. [2025-10-15T17:38:43.778411] [INFO ] [MAIN ] Update Progress: 283/2369 symbols completed. BIPJ took 33.4s. Estimated remaining: 4h 44m 55s. Rate: 7.3 symbols/min [2025-10-15T17:38:43.949353] [INFO ] [MAIN ] BKD: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:38:43.998544] [DEBUG] [LOCAL ] BKD: Loaded 50449 existing records from primary storage. [2025-10-15T17:38:43.998894] [INFO ] [MAIN ] BKD: Loaded 50449 existing records. [2025-10-15T17:38:44.119159] [INFO ] [REMOTE ] BK: Fetching primary data for 2024-12. [2025-10-15T17:38:44.187632] [WARN ] [MAIN ] BKD: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:38:44.187992] [INFO ] [MAIN ] BKD: Wiping existing primary data before full refresh. [2025-10-15T17:38:44.188043] [INFO ] [LOCAL ] BKD: Starting deletion of primary data. [2025-10-15T17:38:44.188455] [DEBUG] [LOCAL ] BKD: Deleted primary data file. [2025-10-15T17:38:44.188521] [INFO ] [MAIN ] BKD: Starting full primary refresh. [2025-10-15T17:38:44.549199] [INFO ] [REMOTE ] BKD: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:38:44.914020] [INFO ] [REMOTE ] BKD: Fetching primary data for 2024-12. [2025-10-15T17:38:45.026606] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-15T17:38:45.714053] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-09. [2025-10-15T17:38:46.178977] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2024-12 (2.06 seconds). [2025-10-15T17:38:46.368102] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-15T17:38:46.514022] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-04. [2025-10-15T17:38:47.320363] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-01. [2025-10-15T17:38:47.352883] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-15T17:38:48.114015] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-10. [2025-10-15T17:38:48.392760] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-15T17:38:48.624434] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-15T17:38:48.914030] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-02. [2025-10-15T17:38:49.714114] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-01. [2025-10-15T17:38:49.836054] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-15T17:38:49.842788] [INFO ] [REMOTE ] BIRK: Full fetch complete (73272 records). [2025-10-15T17:38:49.842968] [DEBUG] [VALIDATOR ] BIRK: Validating primary data. [2025-10-15T17:38:50.283007] [DEBUG] [VALIDATOR ] BIRK: All expected trading days are present. [2025-10-15T17:38:50.283178] [DEBUG] [VALIDATOR ] BIRK: Primary data validation passed. [2025-10-15T17:38:50.284478] [INFO ] [MAIN ] BIRK: Fetched primary data is valid. [2025-10-15T17:38:50.284987] [DEBUG] [LOCAL ] BIRK: Saving primary data. [2025-10-15T17:38:50.286422] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-15T17:38:50.297286] [DEBUG] [LOCAL ] BIRK: Trimmed 73272 records to 51107 (keeping 200 days of data) [2025-10-15T17:38:50.514206] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-03. [2025-10-15T17:38:50.590408] [DEBUG] [LOCAL ] BIRK: Primary data saved (51107 records). [2025-10-15T17:38:50.590543] [INFO ] [MAIN ] BIRK: Full history saved. [2025-10-15T17:38:50.590624] [INFO ] [MAIN ] Update Progress: 284/2369 symbols completed. BIRK took 40.2s. Estimated remaining: 4h 44m 37s. Rate: 7.3 symbols/min [2025-10-15T17:38:50.758851] [INFO ] [MAIN ] BKE: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:38:50.791340] [DEBUG] [LOCAL ] BKE: Loaded 33992 existing records from primary storage. [2025-10-15T17:38:50.791685] [INFO ] [MAIN ] BKE: Loaded 33992 existing records. [2025-10-15T17:38:50.967269] [WARN ] [MAIN ] BKE: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:38:50.967498] [INFO ] [MAIN ] BKE: Wiping existing primary data before full refresh. [2025-10-15T17:38:50.967575] [INFO ] [LOCAL ] BKE: Starting deletion of primary data. [2025-10-15T17:38:50.967955] [DEBUG] [LOCAL ] BKE: Deleted primary data file. [2025-10-15T17:38:50.968013] [INFO ] [MAIN ] BKE: Starting full primary refresh. [2025-10-15T17:38:51.325630] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-05. [2025-10-15T17:38:51.330956] [INFO ] [REMOTE ] BKE: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:38:51.554550] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-15T17:38:51.947773] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-15T17:38:52.114011] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-04. [2025-10-15T17:38:52.919135] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-02. [2025-10-15T17:38:52.940840] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-15T17:38:53.714080] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-06. [2025-10-15T17:38:53.812800] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-15T17:38:54.513974] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-05. [2025-10-15T17:38:54.570348] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-15T17:38:55.313984] [INFO ] [REMOTE ] BKE: Fetching primary data for 2024-12. [2025-10-15T17:38:55.536282] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-15T17:38:55.943380] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-15T17:38:56.114044] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-07. [2025-10-15T17:38:56.584852] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-15T17:38:56.914023] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-03. [2025-10-15T17:38:57.714111] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-01. [2025-10-15T17:38:57.891608] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-15T17:38:58.290539] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-15T17:38:58.514084] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-04. [2025-10-15T17:38:59.109095] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-15T17:38:59.314006] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-08. [2025-10-15T17:39:00.114057] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-02. [2025-10-15T17:39:00.354619] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-15T17:39:00.914027] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-05. [2025-10-15T17:39:01.405177] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-15T17:39:01.433840] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-08 (2.12 seconds). [2025-10-15T17:39:01.714009] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-03. [2025-10-15T17:39:02.514005] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-09. [2025-10-15T17:39:02.705196] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-15T17:39:03.020584] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-15T17:39:03.314076] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-04. [2025-10-15T17:39:04.113266] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-15T17:39:04.123472] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-06. [2025-10-15T17:39:04.804324] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-15T17:39:04.914029] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-10. [2025-10-15T17:39:05.719236] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-05. [2025-10-15T17:39:05.754273] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-15T17:39:06.490259] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-15T17:39:06.496617] [INFO ] [REMOTE ] BJ: Full fetch complete (74338 records). [2025-10-15T17:39:06.496812] [DEBUG] [VALIDATOR ] BJ: Validating primary data. [2025-10-15T17:39:06.519139] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-07. [2025-10-15T17:39:06.902353] [DEBUG] [VALIDATOR ] BJ: All expected trading days are present. [2025-10-15T17:39:06.902472] [DEBUG] [VALIDATOR ] BJ: Primary data validation passed. [2025-10-15T17:39:06.903393] [INFO ] [MAIN ] BJ: Fetched primary data is valid. [2025-10-15T17:39:06.903482] [DEBUG] [LOCAL ] BJ: Saving primary data. [2025-10-15T17:39:06.905258] [DEBUG] [LOCAL ] BJ: Trimmed 74338 records to 51595 (keeping 200 days of data) [2025-10-15T17:39:07.139541] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-15T17:39:07.254478] [DEBUG] [LOCAL ] BJ: Primary data saved (51595 records). [2025-10-15T17:39:07.254662] [INFO ] [MAIN ] BJ: Full history saved. [2025-10-15T17:39:07.254831] [INFO ] [MAIN ] Update Progress: 285/2369 symbols completed. BJ took 43.8s. Estimated remaining: 4h 45m 31s. Rate: 7.3 symbols/min [2025-10-15T17:39:07.322993] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-06. [2025-10-15T17:39:07.438794] [INFO ] [MAIN ] BKH: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:39:07.474963] [DEBUG] [LOCAL ] BKH: Loaded 37028 existing records from primary storage. [2025-10-15T17:39:07.475261] [INFO ] [MAIN ] BKH: Loaded 37028 existing records. [2025-10-15T17:39:07.651346] [WARN ] [MAIN ] BKH: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:39:07.651573] [INFO ] [MAIN ] BKH: Wiping existing primary data before full refresh. [2025-10-15T17:39:07.651621] [INFO ] [LOCAL ] BKH: Starting deletion of primary data. [2025-10-15T17:39:07.651972] [DEBUG] [LOCAL ] BKH: Deleted primary data file. [2025-10-15T17:39:07.652029] [INFO ] [MAIN ] BKH: Starting full primary refresh. [2025-10-15T17:39:08.046427] [INFO ] [REMOTE ] BKH: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:39:08.114004] [INFO ] [REMOTE ] BKH: Fetching primary data for 2024-12. [2025-10-15T17:39:08.194469] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-15T17:39:08.913976] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-08. [2025-10-15T17:39:09.088843] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-15T17:39:09.639386] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-15T17:39:09.714007] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-01. [2025-10-15T17:39:10.126826] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-15T17:39:10.514010] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-06. [2025-10-15T17:39:11.015730] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-15T17:39:11.313974] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-02. [2025-10-15T17:39:11.792214] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-15T17:39:12.114007] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-07. [2025-10-15T17:39:12.647550] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-15T17:39:12.914004] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-09. [2025-10-15T17:39:13.623086] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-15T17:39:13.714047] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-08. [2025-10-15T17:39:14.523058] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-07. [2025-10-15T17:39:14.543839] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-15T17:39:15.315046] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-15T17:39:15.315226] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-03. [2025-10-15T17:39:15.791243] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-15T17:39:16.113994] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-09. [2025-10-15T17:39:16.428059] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-15T17:39:16.914077] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-04. [2025-10-15T17:39:17.714009] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-08. [2025-10-15T17:39:17.910149] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-15T17:39:18.487734] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-15T17:39:18.514012] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-05. [2025-10-15T17:39:19.317602] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-10. [2025-10-15T17:39:19.319871] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-15T17:39:20.017559] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-15T17:39:20.113961] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-06. [2025-10-15T17:39:20.913986] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-09. [2025-10-15T17:39:21.205689] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-10 (1.89 seconds). [2025-10-15T17:39:21.213563] [INFO ] [REMOTE ] BKD: Full fetch complete (72031 records). [2025-10-15T17:39:21.213832] [DEBUG] [VALIDATOR ] BKD: Validating primary data. [2025-10-15T17:39:21.625308] [DEBUG] [VALIDATOR ] BKD: All expected trading days are present. [2025-10-15T17:39:21.633782] [DEBUG] [VALIDATOR ] BKD: Primary data validation passed. [2025-10-15T17:39:21.646442] [INFO ] [MAIN ] BKD: Fetched primary data is valid. [2025-10-15T17:39:21.646604] [DEBUG] [LOCAL ] BKD: Saving primary data. [2025-10-15T17:39:21.648830] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-15T17:39:21.657502] [DEBUG] [LOCAL ] BKD: Trimmed 72031 records to 50474 (keeping 200 days of data) [2025-10-15T17:39:21.740397] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-10. [2025-10-15T17:39:21.959052] [DEBUG] [LOCAL ] BKD: Primary data saved (50474 records). [2025-10-15T17:39:21.959303] [INFO ] [MAIN ] BKD: Full history saved. [2025-10-15T17:39:21.960333] [INFO ] [MAIN ] Update Progress: 286/2369 symbols completed. BKD took 38.2s. Estimated remaining: 4h 46m 10s. Rate: 7.3 symbols/min [2025-10-15T17:39:22.137823] [INFO ] [MAIN ] BKKT: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:39:22.171588] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-15T17:39:22.215330] [DEBUG] [LOCAL ] BKKT: Loaded 36403 existing records from primary storage. [2025-10-15T17:39:22.215717] [INFO ] [MAIN ] BKKT: Loaded 36403 existing records. [2025-10-15T17:39:22.394685] [WARN ] [MAIN ] BKKT: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:39:22.394970] [INFO ] [MAIN ] BKKT: Wiping existing primary data before full refresh. [2025-10-15T17:39:22.395052] [INFO ] [LOCAL ] BKKT: Starting deletion of primary data. [2025-10-15T17:39:22.395438] [DEBUG] [LOCAL ] BKKT: Deleted primary data file. [2025-10-15T17:39:22.395495] [INFO ] [MAIN ] BKKT: Starting full primary refresh. [2025-10-15T17:39:22.519115] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-10. [2025-10-15T17:39:22.812418] [INFO ] [REMOTE ] BKKT: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:39:23.314010] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2024-12. [2025-10-15T17:39:23.613347] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-10 (1.87 seconds). [2025-10-15T17:39:23.620700] [INFO ] [REMOTE ] BK: Full fetch complete (77670 records). [2025-10-15T17:39:23.620889] [DEBUG] [VALIDATOR ] BK: Validating primary data. [2025-10-15T17:39:24.023455] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-15T17:39:24.052886] [DEBUG] [VALIDATOR ] BK: All expected trading days are present. [2025-10-15T17:39:24.053084] [DEBUG] [VALIDATOR ] BK: Primary data validation passed. [2025-10-15T17:39:24.054027] [INFO ] [MAIN ] BK: Fetched primary data is valid. [2025-10-15T17:39:24.054112] [DEBUG] [LOCAL ] BK: Saving primary data. [2025-10-15T17:39:24.054358] [INFO ] [REMOTE ] BKE: Full fetch complete (50384 records). [2025-10-15T17:39:24.054448] [DEBUG] [VALIDATOR ] BKE: Validating primary data. [2025-10-15T17:39:24.115098] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-07. [2025-10-15T17:39:24.138288] [DEBUG] [LOCAL ] BK: Trimmed 77670 records to 53543 (keeping 200 days of data) [2025-10-15T17:39:24.709356] [DEBUG] [VALIDATOR ] BKE: All expected trading days are present. [2025-10-15T17:39:24.716876] [DEBUG] [VALIDATOR ] BKE: Primary data validation passed. [2025-10-15T17:39:24.718392] [INFO ] [MAIN ] BKE: Fetched primary data is valid. [2025-10-15T17:39:24.720888] [DEBUG] [LOCAL ] BKE: Saving primary data. [2025-10-15T17:39:24.778750] [DEBUG] [LOCAL ] BKE: Trimmed 50384 records to 33979 (keeping 200 days of data) [2025-10-15T17:39:24.890888] [DEBUG] [LOCAL ] BK: Primary data saved (53543 records). [2025-10-15T17:39:24.891566] [INFO ] [MAIN ] BK: Full history saved. [2025-10-15T17:39:24.895111] [INFO ] [MAIN ] Update Progress: 287/2369 symbols completed. BK took 42.4s. Estimated remaining: 4h 45m 23s. Rate: 7.3 symbols/min [2025-10-15T17:39:25.089061] [INFO ] [MAIN ] BKN: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:39:25.157444] [DEBUG] [LOCAL ] BKN: Loaded 7362 existing records from primary storage. [2025-10-15T17:39:25.178741] [INFO ] [MAIN ] BKN: Loaded 7362 existing records. [2025-10-15T17:39:25.200601] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-10-15T17:39:25.249336] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-01. [2025-10-15T17:39:25.437494] [WARN ] [MAIN ] BKN: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:39:25.437983] [INFO ] [MAIN ] BKN: Wiping existing primary data before full refresh. [2025-10-15T17:39:25.438422] [INFO ] [LOCAL ] BKN: Starting deletion of primary data. [2025-10-15T17:39:25.439525] [DEBUG] [LOCAL ] BKN: Deleted primary data file. [2025-10-15T17:39:25.441090] [INFO ] [MAIN ] BKN: Starting full primary refresh. [2025-10-15T17:39:25.477275] [DEBUG] [LOCAL ] BKE: Primary data saved (33979 records). [2025-10-15T17:39:25.495048] [INFO ] [MAIN ] BKE: Full history saved. [2025-10-15T17:39:25.511892] [INFO ] [MAIN ] Update Progress: 288/2369 symbols completed. BKE took 34.9s. Estimated remaining: 4h 44m 20s. Rate: 7.3 symbols/min [2025-10-15T17:39:25.738145] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-15T17:39:25.853421] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-08. [2025-10-15T17:39:25.937681] [INFO ] [MAIN ] BKSY: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:39:26.035764] [INFO ] [REMOTE ] BKN: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:39:26.072121] [DEBUG] [LOCAL ] BKSY: Loaded 48676 existing records from primary storage. [2025-10-15T17:39:26.072457] [INFO ] [MAIN ] BKSY: Loaded 48676 existing records. [2025-10-15T17:39:26.259333] [WARN ] [MAIN ] BKSY: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:39:26.259676] [INFO ] [MAIN ] BKSY: Wiping existing primary data before full refresh. [2025-10-15T17:39:26.259750] [INFO ] [LOCAL ] BKSY: Starting deletion of primary data. [2025-10-15T17:39:26.260142] [DEBUG] [LOCAL ] BKSY: Deleted primary data file. [2025-10-15T17:39:26.260204] [INFO ] [MAIN ] BKSY: Starting full primary refresh. [2025-10-15T17:39:26.519820] [INFO ] [REMOTE ] BKN: Fetching primary data for 2024-12. [2025-10-15T17:39:26.696272] [INFO ] [REMOTE ] BKSY: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:39:26.855507] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-15T17:39:27.313979] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-02. [2025-10-15T17:39:27.486858] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-15T17:39:27.505516] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-10-15T17:39:28.114003] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2024-12. [2025-10-15T17:39:28.711970] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-15T17:39:28.914003] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-01. [2025-10-15T17:39:29.711395] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-15T17:39:29.714944] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-03. [2025-10-15T17:39:29.755306] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-15T17:39:30.514006] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-01. [2025-10-15T17:39:31.276025] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-15T17:39:31.314037] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-04. [2025-10-15T17:39:32.114011] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-09. [2025-10-15T17:39:32.239519] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-15T17:39:32.603694] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-15T17:39:32.914014] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-02. [2025-10-15T17:39:33.511379] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-15T17:39:33.524336] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-15T17:39:33.714071] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-02. [2025-10-15T17:39:34.514070] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-03. [2025-10-15T17:39:35.217633] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-15T17:39:35.314019] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-04. [2025-10-15T17:39:35.589889] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-10-15T17:39:35.873372] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-10-15T17:39:36.113996] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-03. [2025-10-15T17:39:36.914079] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-10. [2025-10-15T17:39:37.713982] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-05. [2025-10-15T17:39:37.972459] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-15T17:39:38.298706] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-15T17:39:38.303780] [INFO ] [REMOTE ] BKH: Full fetch complete (52690 records). [2025-10-15T17:39:38.303944] [DEBUG] [VALIDATOR ] BKH: Validating primary data. [2025-10-15T17:39:38.460362] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-15T17:39:38.519138] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-04. [2025-10-15T17:39:38.726964] [DEBUG] [VALIDATOR ] BKH: All expected trading days are present. [2025-10-15T17:39:38.727063] [DEBUG] [VALIDATOR ] BKH: Primary data validation passed. [2025-10-15T17:39:38.727847] [INFO ] [MAIN ] BKH: Fetched primary data is valid. [2025-10-15T17:39:38.727937] [DEBUG] [LOCAL ] BKH: Saving primary data. [2025-10-15T17:39:38.729976] [DEBUG] [LOCAL ] BKH: Trimmed 52690 records to 37090 (keeping 200 days of data) [2025-10-15T17:39:38.954718] [DEBUG] [LOCAL ] BKH: Primary data saved (37090 records). [2025-10-15T17:39:38.954890] [INFO ] [MAIN ] BKH: Full history saved. [2025-10-15T17:39:38.954972] [INFO ] [MAIN ] Update Progress: 289/2369 symbols completed. BKH took 31.7s. Estimated remaining: 4h 44m 49s. Rate: 7.3 symbols/min [2025-10-15T17:39:39.119710] [INFO ] [MAIN ] BKT: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:39:39.133761] [DEBUG] [LOCAL ] BKT: Loaded 12331 existing records from primary storage. [2025-10-15T17:39:39.134024] [INFO ] [MAIN ] BKT: Loaded 12331 existing records. [2025-10-15T17:39:39.312764] [WARN ] [MAIN ] BKT: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:39:39.313010] [INFO ] [MAIN ] BKT: Wiping existing primary data before full refresh. [2025-10-15T17:39:39.313056] [INFO ] [LOCAL ] BKT: Starting deletion of primary data. [2025-10-15T17:39:39.313282] [DEBUG] [LOCAL ] BKT: Deleted primary data file. [2025-10-15T17:39:39.313336] [INFO ] [MAIN ] BKT: Starting full primary refresh. [2025-10-15T17:39:39.324419] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-06. [2025-10-15T17:39:39.661321] [INFO ] [REMOTE ] BKT: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:39:40.114035] [INFO ] [REMOTE ] BKT: Fetching primary data for 2024-12. [2025-10-15T17:39:40.202442] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-15T17:39:40.300214] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-15T17:39:40.910218] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-10-15T17:39:40.913945] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-01. [2025-10-15T17:39:41.679998] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-15T17:39:41.713969] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-05. [2025-10-15T17:39:42.514025] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-05. [2025-10-15T17:39:43.314012] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-02. [2025-10-15T17:39:43.497667] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-15T17:39:43.925313] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-15T17:39:44.055315] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-15T17:39:44.113996] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-06. [2025-10-15T17:39:44.914014] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-03. [2025-10-15T17:39:45.434897] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-10-15T17:39:45.714023] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-07. [2025-10-15T17:39:46.247146] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-06 (2.13 seconds). [2025-10-15T17:39:46.284738] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-15T17:39:46.514014] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-06. [2025-10-15T17:39:47.314020] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-07. [2025-10-15T17:39:47.776019] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-15T17:39:48.114000] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-07. [2025-10-15T17:39:48.914011] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-08. [2025-10-15T17:39:49.636860] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-15T17:39:49.718528] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-09. [2025-10-15T17:39:49.747786] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-07 (2.43 seconds). [2025-10-15T17:39:49.987237] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-15T17:39:50.359478] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-15T17:39:50.514053] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-08. [2025-10-15T17:39:51.313968] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-08. [2025-10-15T17:39:51.952510] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-15T17:39:52.114016] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-09. [2025-10-15T17:39:52.914031] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-04. [2025-10-15T17:39:53.145317] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-15T17:39:53.713991] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-09. [2025-10-15T17:39:53.786062] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-15T17:39:53.961251] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-15T17:39:54.514002] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-05. [2025-10-15T17:39:55.254280] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-15T17:39:55.313948] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-10. [2025-10-15T17:39:55.666089] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-15T17:39:55.829300] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-15T17:39:55.831364] [INFO ] [REMOTE ] BKN: Full fetch complete (11410 records). [2025-10-15T17:39:55.831460] [DEBUG] [VALIDATOR ] BKN: Validating primary data. [2025-10-15T17:39:56.117104] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-10. [2025-10-15T17:39:56.199544] [DEBUG] [VALIDATOR ] BKN: All expected trading days are present. [2025-10-15T17:39:56.199636] [DEBUG] [VALIDATOR ] BKN: Primary data validation passed. [2025-10-15T17:39:56.200069] [INFO ] [MAIN ] BKN: Fetched primary data is valid. [2025-10-15T17:39:56.200125] [DEBUG] [LOCAL ] BKN: Saving primary data. [2025-10-15T17:39:56.200593] [DEBUG] [LOCAL ] BKN: Trimmed 11410 records to 7312 (keeping 200 days of data) [2025-10-15T17:39:56.246105] [DEBUG] [LOCAL ] BKN: Primary data saved (7312 records). [2025-10-15T17:39:56.246453] [INFO ] [MAIN ] BKN: Full history saved. [2025-10-15T17:39:56.246538] [INFO ] [MAIN ] Update Progress: 290/2369 symbols completed. BKN took 31.4s. Estimated remaining: 4h 45m 46s. Rate: 7.3 symbols/min [2025-10-15T17:39:56.419299] [INFO ] [MAIN ] BKU: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:39:56.458848] [DEBUG] [LOCAL ] BKU: Loaded 42065 existing records from primary storage. [2025-10-15T17:39:56.459175] [INFO ] [MAIN ] BKU: Loaded 42065 existing records. [2025-10-15T17:39:56.631187] [WARN ] [MAIN ] BKU: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:39:56.631901] [INFO ] [MAIN ] BKU: Wiping existing primary data before full refresh. [2025-10-15T17:39:56.631952] [INFO ] [LOCAL ] BKU: Starting deletion of primary data. [2025-10-15T17:39:56.632381] [DEBUG] [LOCAL ] BKU: Deleted primary data file. [2025-10-15T17:39:56.632437] [INFO ] [MAIN ] BKU: Starting full primary refresh. [2025-10-15T17:39:56.919174] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-06. [2025-10-15T17:39:57.001220] [INFO ] [REMOTE ] BKU: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:39:57.406774] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-10-15T17:39:57.714024] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-07. [2025-10-15T17:39:58.104220] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-10 (1.99 seconds). [2025-10-15T17:39:58.111204] [INFO ] [REMOTE ] BKSY: Full fetch complete (70348 records). [2025-10-15T17:39:58.111392] [DEBUG] [VALIDATOR ] BKSY: Validating primary data. [2025-10-15T17:39:58.394214] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-10-15T17:39:58.519224] [INFO ] [REMOTE ] BKU: Fetching primary data for 2024-12. [2025-10-15T17:39:58.543221] [DEBUG] [VALIDATOR ] BKSY: All expected trading days are present. [2025-10-15T17:39:58.544188] [DEBUG] [VALIDATOR ] BKSY: Primary data validation passed. [2025-10-15T17:39:58.545138] [INFO ] [MAIN ] BKSY: Fetched primary data is valid. [2025-10-15T17:39:58.545302] [DEBUG] [LOCAL ] BKSY: Saving primary data. [2025-10-15T17:39:58.546850] [DEBUG] [LOCAL ] BKSY: Trimmed 70348 records to 48700 (keeping 200 days of data) [2025-10-15T17:39:58.835947] [DEBUG] [LOCAL ] BKSY: Primary data saved (48700 records). [2025-10-15T17:39:58.836106] [INFO ] [MAIN ] BKSY: Full history saved. [2025-10-15T17:39:58.836188] [INFO ] [MAIN ] Update Progress: 291/2369 symbols completed. BKSY took 33.3s. Estimated remaining: 4h 44m 58s. Rate: 7.3 symbols/min [2025-10-15T17:39:59.012404] [INFO ] [MAIN ] BKV: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:39:59.046872] [DEBUG] [LOCAL ] BKV: Loaded 29704 existing records from primary storage. [2025-10-15T17:39:59.047245] [INFO ] [MAIN ] BKV: Loaded 29704 existing records. [2025-10-15T17:39:59.225180] [WARN ] [MAIN ] BKV: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:39:59.225486] [INFO ] [MAIN ] BKV: Wiping existing primary data before full refresh. [2025-10-15T17:39:59.225538] [INFO ] [LOCAL ] BKV: Starting deletion of primary data. [2025-10-15T17:39:59.225844] [DEBUG] [LOCAL ] BKV: Deleted primary data file. [2025-10-15T17:39:59.225903] [INFO ] [MAIN ] BKV: Starting full primary refresh. [2025-10-15T17:39:59.320310] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-10. [2025-10-15T17:39:59.584924] [INFO ] [REMOTE ] BKV: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:39:59.878904] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-15T17:40:00.114026] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-01. [2025-10-15T17:40:00.913994] [INFO ] [REMOTE ] BKV: Fetching primary data for 2024-12. [2025-10-15T17:40:01.441308] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-10 (2.12 seconds). [2025-10-15T17:40:01.448440] [INFO ] [REMOTE ] BKKT: Full fetch complete (51339 records). [2025-10-15T17:40:01.448597] [DEBUG] [VALIDATOR ] BKKT: Validating primary data. [2025-10-15T17:40:01.723044] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-08. [2025-10-15T17:40:01.830905] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-15T17:40:01.923558] [DEBUG] [VALIDATOR ] BKKT: All expected trading days are present. [2025-10-15T17:40:01.923684] [DEBUG] [VALIDATOR ] BKKT: Primary data validation passed. [2025-10-15T17:40:01.924437] [INFO ] [MAIN ] BKKT: Fetched primary data is valid. [2025-10-15T17:40:01.924485] [DEBUG] [LOCAL ] BKKT: Saving primary data. [2025-10-15T17:40:01.927019] [DEBUG] [LOCAL ] BKKT: Trimmed 51339 records to 36603 (keeping 200 days of data) [2025-10-15T17:40:02.152504] [DEBUG] [LOCAL ] BKKT: Primary data saved (36603 records). [2025-10-15T17:40:02.152716] [INFO ] [MAIN ] BKKT: Full history saved. [2025-10-15T17:40:02.152814] [INFO ] [MAIN ] Update Progress: 292/2369 symbols completed. BKKT took 40.2s. Estimated remaining: 4h 44m 14s. Rate: 7.3 symbols/min [2025-10-15T17:40:02.334994] [INFO ] [MAIN ] BLCO: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:40:02.358557] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-15T17:40:02.399670] [DEBUG] [LOCAL ] BLCO: Loaded 35353 existing records from primary storage. [2025-10-15T17:40:02.400008] [INFO ] [MAIN ] BLCO: Loaded 35353 existing records. [2025-10-15T17:40:02.517337] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-01. [2025-10-15T17:40:02.532202] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-15T17:40:02.609395] [WARN ] [MAIN ] BLCO: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:40:02.609661] [INFO ] [MAIN ] BLCO: Wiping existing primary data before full refresh. [2025-10-15T17:40:02.609727] [INFO ] [LOCAL ] BLCO: Starting deletion of primary data. [2025-10-15T17:40:02.610068] [DEBUG] [LOCAL ] BLCO: Deleted primary data file. [2025-10-15T17:40:02.610109] [INFO ] [MAIN ] BLCO: Starting full primary refresh. [2025-10-15T17:40:03.051491] [INFO ] [REMOTE ] BLCO: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:40:03.314043] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-02. [2025-10-15T17:40:03.568188] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-15T17:40:04.114000] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-09. [2025-10-15T17:40:04.714888] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-15T17:40:04.913978] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2024-12. [2025-10-15T17:40:05.292460] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-15T17:40:05.714016] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-03. [2025-10-15T17:40:06.237190] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-15T17:40:06.514017] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-01. [2025-10-15T17:40:07.143129] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-15T17:40:07.314111] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-04. [2025-10-15T17:40:07.760049] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-15T17:40:08.114027] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-10. [2025-10-15T17:40:08.914009] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-02. [2025-10-15T17:40:08.952889] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-15T17:40:09.173955] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-15T17:40:09.177256] [INFO ] [REMOTE ] BKT: Full fetch complete (16292 records). [2025-10-15T17:40:09.177370] [DEBUG] [VALIDATOR ] BKT: Validating primary data. [2025-10-15T17:40:09.561071] [DEBUG] [VALIDATOR ] BKT: All expected trading days are present. [2025-10-15T17:40:09.561172] [DEBUG] [VALIDATOR ] BKT: Primary data validation passed. [2025-10-15T17:40:09.561580] [INFO ] [MAIN ] BKT: Fetched primary data is valid. [2025-10-15T17:40:09.561626] [DEBUG] [LOCAL ] BKT: Saving primary data. [2025-10-15T17:40:09.562228] [DEBUG] [LOCAL ] BKT: Trimmed 16292 records to 12457 (keeping 200 days of data) [2025-10-15T17:40:09.637857] [DEBUG] [LOCAL ] BKT: Primary data saved (12457 records). [2025-10-15T17:40:09.638018] [INFO ] [MAIN ] BKT: Full history saved. [2025-10-15T17:40:09.638103] [INFO ] [MAIN ] Update Progress: 293/2369 symbols completed. BKT took 30.7s. Estimated remaining: 4h 44m 1s. Rate: 7.3 symbols/min [2025-10-15T17:40:09.719207] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-05. [2025-10-15T17:40:09.825228] [INFO ] [MAIN ] BLD: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:40:09.853365] [DEBUG] [LOCAL ] BLD: Loaded 27592 existing records from primary storage. [2025-10-15T17:40:09.853706] [INFO ] [MAIN ] BLD: Loaded 27592 existing records. [2025-10-15T17:40:10.044162] [WARN ] [MAIN ] BLD: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:40:10.044691] [INFO ] [MAIN ] BLD: Wiping existing primary data before full refresh. [2025-10-15T17:40:10.044767] [INFO ] [LOCAL ] BLD: Starting deletion of primary data. [2025-10-15T17:40:10.052960] [DEBUG] [LOCAL ] BLD: Deleted primary data file. [2025-10-15T17:40:10.066222] [INFO ] [MAIN ] BLD: Starting full primary refresh. [2025-10-15T17:40:10.131358] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-15T17:40:10.446016] [INFO ] [REMOTE ] BLD: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:40:10.514020] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-02. [2025-10-15T17:40:11.314044] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-03. [2025-10-15T17:40:11.402238] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-15T17:40:11.487233] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-15T17:40:12.114044] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-06. [2025-10-15T17:40:12.499527] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-15T17:40:12.914000] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-04. [2025-10-15T17:40:13.349086] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-15T17:40:13.714012] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-07. [2025-10-15T17:40:13.985598] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-15T17:40:14.514011] [INFO ] [REMOTE ] BLD: Fetching primary data for 2024-12. [2025-10-15T17:40:15.273609] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-15T17:40:15.313998] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-05. [2025-10-15T17:40:15.874596] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-15T17:40:16.113996] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-08. [2025-10-15T17:40:16.659967] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-15T17:40:16.913999] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-01. [2025-10-15T17:40:17.371258] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-15T17:40:17.714024] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-09. [2025-10-15T17:40:18.134484] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-15T17:40:18.514012] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-03. [2025-10-15T17:40:19.115919] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-15T17:40:19.313992] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-06. [2025-10-15T17:40:20.113996] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-10. [2025-10-15T17:40:20.317110] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-15T17:40:20.455994] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-15T17:40:20.914009] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-04. [2025-10-15T17:40:21.714011] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-07. [2025-10-15T17:40:21.793288] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-15T17:40:21.799190] [INFO ] [REMOTE ] BKU: Full fetch complete (60687 records). [2025-10-15T17:40:21.799323] [DEBUG] [VALIDATOR ] BKU: Validating primary data. [2025-10-15T17:40:22.180075] [DEBUG] [VALIDATOR ] BKU: All expected trading days are present. [2025-10-15T17:40:22.180161] [DEBUG] [VALIDATOR ] BKU: Primary data validation passed. [2025-10-15T17:40:22.180941] [INFO ] [MAIN ] BKU: Fetched primary data is valid. [2025-10-15T17:40:22.181007] [DEBUG] [LOCAL ] BKU: Saving primary data. [2025-10-15T17:40:22.182350] [DEBUG] [LOCAL ] BKU: Trimmed 60687 records to 42161 (keeping 200 days of data) [2025-10-15T17:40:22.460995] [DEBUG] [LOCAL ] BKU: Primary data saved (42161 records). [2025-10-15T17:40:22.461770] [INFO ] [MAIN ] BKU: Full history saved. [2025-10-15T17:40:22.463563] [INFO ] [MAIN ] Update Progress: 294/2369 symbols completed. BKU took 26.2s. Estimated remaining: 4h 44m 25s. Rate: 7.3 symbols/min [2025-10-15T17:40:22.463193] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-15T17:40:22.526270] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-02. [2025-10-15T17:40:22.645527] [INFO ] [MAIN ] BLDR: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:40:22.697459] [DEBUG] [LOCAL ] BLDR: Loaded 51879 existing records from primary storage. [2025-10-15T17:40:22.697860] [INFO ] [MAIN ] BLDR: Loaded 51879 existing records. [2025-10-15T17:40:22.877615] [WARN ] [MAIN ] BLDR: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:40:22.878057] [INFO ] [MAIN ] BLDR: Wiping existing primary data before full refresh. [2025-10-15T17:40:22.878135] [INFO ] [LOCAL ] BLDR: Starting deletion of primary data. [2025-10-15T17:40:22.887014] [DEBUG] [LOCAL ] BLDR: Deleted primary data file. [2025-10-15T17:40:22.887146] [INFO ] [MAIN ] BLDR: Starting full primary refresh. [2025-10-15T17:40:22.985693] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-15T17:40:23.282599] [INFO ] [REMOTE ] BLDR: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:40:23.313971] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2024-12. [2025-10-15T17:40:23.792698] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-15T17:40:24.113990] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-03. [2025-10-15T17:40:24.913987] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-05. [2025-10-15T17:40:24.971592] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-15T17:40:25.123291] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-15T17:40:25.714008] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-01. [2025-10-15T17:40:26.025685] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-15T17:40:26.513998] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-06. [2025-10-15T17:40:27.313997] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-08. [2025-10-15T17:40:27.374164] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-15T17:40:27.849921] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-15T17:40:28.114032] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-04. [2025-10-15T17:40:28.304558] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-15T17:40:28.914066] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-07. [2025-10-15T17:40:29.416132] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-15T17:40:29.714033] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-02. [2025-10-15T17:40:30.312626] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-15T17:40:30.514032] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-09. [2025-10-15T17:40:31.189491] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-15T17:40:31.314001] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-05. [2025-10-15T17:40:31.604275] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-15T17:40:32.114026] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-08. [2025-10-15T17:40:32.515831] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-15T17:40:32.914009] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-03. [2025-10-15T17:40:33.456303] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-15T17:40:33.713982] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-09. [2025-10-15T17:40:34.452277] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-15T17:40:34.513953] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-06. [2025-10-15T17:40:34.667216] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-15T17:40:35.314009] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-04. [2025-10-15T17:40:35.898680] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-15T17:40:36.114009] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-10. [2025-10-15T17:40:36.914017] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-10. [2025-10-15T17:40:37.076146] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-15T17:40:37.080305] [INFO ] [REMOTE ] BLCO: Full fetch complete (52337 records). [2025-10-15T17:40:37.080446] [DEBUG] [VALIDATOR ] BLCO: Validating primary data. [2025-10-15T17:40:37.451349] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-04 (2.14 seconds). [2025-10-15T17:40:37.502817] [DEBUG] [VALIDATOR ] BLCO: All expected trading days are present. [2025-10-15T17:40:37.502895] [DEBUG] [VALIDATOR ] BLCO: Primary data validation passed. [2025-10-15T17:40:37.503679] [INFO ] [MAIN ] BLCO: Fetched primary data is valid. [2025-10-15T17:40:37.503744] [DEBUG] [LOCAL ] BLCO: Saving primary data. [2025-10-15T17:40:37.504914] [DEBUG] [LOCAL ] BLCO: Trimmed 52337 records to 35230 (keeping 200 days of data) [2025-10-15T17:40:37.699558] [DEBUG] [LOCAL ] BLCO: Primary data saved (35230 records). [2025-10-15T17:40:37.699732] [INFO ] [MAIN ] BLCO: Full history saved. [2025-10-15T17:40:37.699821] [INFO ] [MAIN ] Update Progress: 295/2369 symbols completed. BLCO took 35.5s. Estimated remaining: 4h 45m 6s. Rate: 7.3 symbols/min [2025-10-15T17:40:37.720431] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-07. [2025-10-15T17:40:37.869598] [INFO ] [MAIN ] BLE: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:40:37.884008] [DEBUG] [LOCAL ] BLE: Loaded 13853 existing records from primary storage. [2025-10-15T17:40:37.884237] [INFO ] [MAIN ] BLE: Loaded 13853 existing records. [2025-10-15T17:40:38.061976] [WARN ] [MAIN ] BLE: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:40:38.062172] [INFO ] [MAIN ] BLE: Wiping existing primary data before full refresh. [2025-10-15T17:40:38.062219] [INFO ] [LOCAL ] BLE: Starting deletion of primary data. [2025-10-15T17:40:38.062431] [DEBUG] [LOCAL ] BLE: Deleted primary data file. [2025-10-15T17:40:38.062468] [INFO ] [MAIN ] BLE: Starting full primary refresh. [2025-10-15T17:40:38.189172] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-15T17:40:38.233820] [INFO ] [REMOTE ] BKV: Full fetch complete (44886 records). [2025-10-15T17:40:38.242089] [DEBUG] [VALIDATOR ] BKV: Validating primary data. [2025-10-15T17:40:38.532582] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-05. [2025-10-15T17:40:38.634665] [INFO ] [REMOTE ] BLE: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:40:38.852950] [DEBUG] [VALIDATOR ] BKV: All expected trading days are present. [2025-10-15T17:40:38.853248] [DEBUG] [VALIDATOR ] BKV: Primary data validation passed. [2025-10-15T17:40:38.853978] [INFO ] [MAIN ] BKV: Fetched primary data is valid. [2025-10-15T17:40:38.854088] [DEBUG] [LOCAL ] BKV: Saving primary data. [2025-10-15T17:40:38.862284] [DEBUG] [LOCAL ] BKV: Trimmed 44886 records to 29596 (keeping 200 days of data) [2025-10-15T17:40:38.875812] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-15T17:40:39.047989] [DEBUG] [LOCAL ] BKV: Primary data saved (29596 records). [2025-10-15T17:40:39.048137] [INFO ] [MAIN ] BKV: Full history saved. [2025-10-15T17:40:39.048222] [INFO ] [MAIN ] Update Progress: 296/2369 symbols completed. BKV took 40.2s. Estimated remaining: 4h 44m 10s. Rate: 7.3 symbols/min [2025-10-15T17:40:39.216633] [INFO ] [MAIN ] BLK: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:40:39.252787] [DEBUG] [LOCAL ] BLK: Loaded 34255 existing records from primary storage. [2025-10-15T17:40:39.253088] [INFO ] [MAIN ] BLK: Loaded 34255 existing records. [2025-10-15T17:40:39.319171] [INFO ] [REMOTE ] BLE: Fetching primary data for 2024-12. [2025-10-15T17:40:39.430016] [WARN ] [MAIN ] BLK: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:40:39.430301] [INFO ] [MAIN ] BLK: Wiping existing primary data before full refresh. [2025-10-15T17:40:39.430368] [INFO ] [LOCAL ] BLK: Starting deletion of primary data. [2025-10-15T17:40:39.430806] [DEBUG] [LOCAL ] BLK: Deleted primary data file. [2025-10-15T17:40:39.430864] [INFO ] [MAIN ] BLK: Starting full primary refresh. [2025-10-15T17:40:39.789321] [INFO ] [REMOTE ] BLK: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:40:40.113968] [INFO ] [REMOTE ] BLK: Fetching primary data for 2024-12. [2025-10-15T17:40:40.233969] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-15T17:40:40.373708] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-15T17:40:40.913992] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-06. [2025-10-15T17:40:41.717451] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-01. [2025-10-15T17:40:41.720313] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-15T17:40:42.513977] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-08. [2025-10-15T17:40:42.688935] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-15T17:40:42.726703] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-15T17:40:43.314035] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-02. [2025-10-15T17:40:43.852223] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-15T17:40:44.047988] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-15T17:40:44.113999] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-03. [2025-10-15T17:40:44.779543] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-15T17:40:44.913956] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-04. [2025-10-15T17:40:45.713976] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-01. [2025-10-15T17:40:45.844918] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-15T17:40:46.514019] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-07. [2025-10-15T17:40:47.319094] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-05. [2025-10-15T17:40:47.331793] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-15T17:40:47.843588] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-10-15T17:40:48.096432] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-15T17:40:48.113950] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-08. [2025-10-15T17:40:48.914016] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-06. [2025-10-15T17:40:49.697337] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-15T17:40:49.721863] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-09. [2025-10-15T17:40:49.725236] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-15T17:40:50.514141] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-09. [2025-10-15T17:40:51.314026] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-02. [2025-10-15T17:40:51.572313] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-15T17:40:51.630777] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-15T17:40:52.114016] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-10. [2025-10-15T17:40:52.914012] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-10. [2025-10-15T17:40:52.956823] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-15T17:40:53.714026] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-03. [2025-10-15T17:40:54.012767] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-15T17:40:54.016149] [INFO ] [REMOTE ] BLD: Full fetch complete (39970 records). [2025-10-15T17:40:54.016242] [DEBUG] [VALIDATOR ] BLD: Validating primary data. [2025-10-15T17:40:54.146878] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-10 (2.03 seconds). [2025-10-15T17:40:54.193956] [INFO ] [REMOTE ] BLDR: Full fetch complete (74715 records). [2025-10-15T17:40:54.231844] [DEBUG] [VALIDATOR ] BLDR: Validating primary data. [2025-10-15T17:40:54.520272] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-07. [2025-10-15T17:40:54.569540] [DEBUG] [VALIDATOR ] BLD: All expected trading days are present. [2025-10-15T17:40:54.580896] [DEBUG] [VALIDATOR ] BLD: Primary data validation passed. [2025-10-15T17:40:54.587101] [INFO ] [MAIN ] BLD: Fetched primary data is valid. [2025-10-15T17:40:54.592344] [DEBUG] [LOCAL ] BLD: Saving primary data. [2025-10-15T17:40:54.637226] [DEBUG] [LOCAL ] BLD: Trimmed 39970 records to 27482 (keeping 200 days of data) [2025-10-15T17:40:55.001114] [DEBUG] [VALIDATOR ] BLDR: All expected trading days are present. [2025-10-15T17:40:55.002741] [DEBUG] [VALIDATOR ] BLDR: Primary data validation passed. [2025-10-15T17:40:55.004778] [INFO ] [MAIN ] BLDR: Fetched primary data is valid. [2025-10-15T17:40:55.004866] [DEBUG] [LOCAL ] BLDR: Saving primary data. [2025-10-15T17:40:55.038921] [DEBUG] [LOCAL ] BLDR: Trimmed 74715 records to 51906 (keeping 200 days of data) [2025-10-15T17:40:55.117296] [DEBUG] [LOCAL ] BLD: Primary data saved (27482 records). [2025-10-15T17:40:55.150564] [INFO ] [MAIN ] BLD: Full history saved. [2025-10-15T17:40:55.151183] [INFO ] [MAIN ] Update Progress: 297/2369 symbols completed. BLD took 45.5s. Estimated remaining: 4h 44m 57s. Rate: 7.3 symbols/min [2025-10-15T17:40:55.466050] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-15T17:40:55.467761] [INFO ] [MAIN ] BLND: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:40:55.511562] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-08. [2025-10-15T17:40:55.625137] [DEBUG] [LOCAL ] BLDR: Primary data saved (51906 records). [2025-10-15T17:40:55.626151] [INFO ] [MAIN ] BLDR: Full history saved. [2025-10-15T17:40:55.626711] [INFO ] [MAIN ] Update Progress: 298/2369 symbols completed. BLDR took 33.2s. Estimated remaining: 4h 43m 54s. Rate: 7.3 symbols/min [2025-10-15T17:40:55.723959] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-10-15T17:40:55.873142] [INFO ] [MAIN ] BLSH: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:40:55.874873] [DEBUG] [LOCAL ] BLSH: No existing data file found in primary storage. [2025-10-15T17:40:55.874627] [DEBUG] [LOCAL ] BLND: Loaded 49272 existing records from primary storage. [2025-10-15T17:40:55.875009] [WARN ] [MAIN ] BLSH: No existing data found, performing full refresh instead. [2025-10-15T17:40:55.875370] [INFO ] [MAIN ] BLND: Loaded 49272 existing records. [2025-10-15T17:40:55.875521] [INFO ] [MAIN ] BLSH: Wiping existing primary data before full refresh. [2025-10-15T17:40:55.922167] [INFO ] [LOCAL ] BLSH: Starting deletion of primary data. [2025-10-15T17:40:55.949159] [DEBUG] [LOCAL ] BLSH: No primary data file found to delete. [2025-10-15T17:40:55.955085] [INFO ] [MAIN ] BLSH: Starting full primary refresh. [2025-10-15T17:40:56.114748] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-04. [2025-10-15T17:40:56.254528] [WARN ] [MAIN ] BLND: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:40:56.281969] [INFO ] [MAIN ] BLND: Wiping existing primary data before full refresh. [2025-10-15T17:40:56.282331] [INFO ] [LOCAL ] BLND: Starting deletion of primary data. [2025-10-15T17:40:56.329815] [DEBUG] [LOCAL ] BLND: Deleted primary data file. [2025-10-15T17:40:56.341783] [INFO ] [MAIN ] BLND: Starting full primary refresh. [2025-10-15T17:40:56.342700] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-15T17:40:56.637883] [INFO ] [REMOTE ] BLSH: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:40:56.905155] [INFO ] [REMOTE ] BLND: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:40:56.914028] [INFO ] [REMOTE ] BLSH: Fetching primary data for 2024-12. [2025-10-15T17:40:57.115894] [DEBUG] [REMOTE ] BLSH: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-15T17:40:57.116240] [WARN ] [REMOTE ] BLSH: No data returned for month 2024-12 [2025-10-15T17:40:57.116336] [FATAL] [REMOTE ] BLSH: API call failed - aborting fetch to avoid wasting further API calls [2025-10-15T17:40:57.116381] [FATAL] [MAIN ] BLSH: Failed to fetch primary data. [2025-10-15T17:40:57.116414] [WARN ] [MAIN ] BLSH: Deleting existing primary and derivative data due to fetch failure. [2025-10-15T17:40:57.116450] [INFO ] [LOCAL ] BLSH: Starting deletion of primary data. [2025-10-15T17:40:57.116508] [DEBUG] [LOCAL ] BLSH: No primary data file found to delete. [2025-10-15T17:40:57.116548] [INFO ] [LOCAL ] BLSH: Starting deletion of derivative data. [2025-10-15T17:40:57.116585] [DEBUG] [LOCAL ] BLSH: No derivative data file found to delete. [2025-10-15T17:40:57.116631] [INFO ] [MAIN ] Update Progress: 299/2369 symbols completed. BLSH took 1.5s. Estimated remaining: 4h 42m 59s. Rate: 7.3 symbols/min [2025-10-15T17:40:57.292707] [INFO ] [MAIN ] BLW: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:40:57.309391] [DEBUG] [LOCAL ] BLW: Loaded 13213 existing records from primary storage. [2025-10-15T17:40:57.309679] [INFO ] [MAIN ] BLW: Loaded 13213 existing records. [2025-10-15T17:40:57.482882] [WARN ] [MAIN ] BLW: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:40:57.483100] [INFO ] [MAIN ] BLW: Wiping existing primary data before full refresh. [2025-10-15T17:40:57.483145] [INFO ] [LOCAL ] BLW: Starting deletion of primary data. [2025-10-15T17:40:57.483401] [DEBUG] [LOCAL ] BLW: Deleted primary data file. [2025-10-15T17:40:57.483465] [INFO ] [MAIN ] BLW: Starting full primary refresh. [2025-10-15T17:40:57.719218] [INFO ] [REMOTE ] BLND: Fetching primary data for 2024-12. [2025-10-15T17:40:57.831456] [INFO ] [REMOTE ] BLW: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:40:58.156865] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-15T17:40:58.514025] [INFO ] [REMOTE ] BLW: Fetching primary data for 2024-12. [2025-10-15T17:40:59.236791] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-10-15T17:40:59.313957] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-01. [2025-10-15T17:40:59.820596] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2024-12 (2.10 seconds). [2025-10-15T17:40:59.962773] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-15T17:41:00.114069] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-01. [2025-10-15T17:41:00.914042] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-02. [2025-10-15T17:41:01.642638] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-15T17:41:01.711693] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-15T17:41:01.719847] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-03. [2025-10-15T17:41:02.305358] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-15T17:41:02.514046] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-02. [2025-10-15T17:41:03.314009] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-05. [2025-10-15T17:41:04.006896] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-15T17:41:04.113996] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-03. [2025-10-15T17:41:04.913993] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-04. [2025-10-15T17:41:05.361878] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-10-15T17:41:05.493861] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-15T17:41:05.515868] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-10-15T17:41:05.714029] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-06. [2025-10-15T17:41:06.513990] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-04. [2025-10-15T17:41:07.198135] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-15T17:41:07.313995] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-05. [2025-10-15T17:41:07.827439] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-15T17:41:07.923581] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-15T17:41:08.114085] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-09. [2025-10-15T17:41:08.779772] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-15T17:41:08.914045] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-06. [2025-10-15T17:41:09.714030] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-10. [2025-10-15T17:41:09.858530] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-15T17:41:10.365914] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-15T17:41:10.367868] [INFO ] [REMOTE ] BLE: Full fetch complete (19837 records). [2025-10-15T17:41:10.367947] [DEBUG] [VALIDATOR ] BLE: Validating primary data. [2025-10-15T17:41:10.519171] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-07. [2025-10-15T17:41:10.734254] [DEBUG] [VALIDATOR ] BLE: All expected trading days are present. [2025-10-15T17:41:10.734336] [DEBUG] [VALIDATOR ] BLE: Primary data validation passed. [2025-10-15T17:41:10.734797] [INFO ] [MAIN ] BLE: Fetched primary data is valid. [2025-10-15T17:41:10.734859] [DEBUG] [LOCAL ] BLE: Saving primary data. [2025-10-15T17:41:10.735442] [DEBUG] [LOCAL ] BLE: Trimmed 19837 records to 13810 (keeping 200 days of data) [2025-10-15T17:41:10.815573] [DEBUG] [LOCAL ] BLE: Primary data saved (13810 records). [2025-10-15T17:41:10.815749] [INFO ] [MAIN ] BLE: Full history saved. [2025-10-15T17:41:10.815874] [INFO ] [MAIN ] Update Progress: 300/2369 symbols completed. BLE took 33.1s. Estimated remaining: 4h 43m 29s. Rate: 7.3 symbols/min [2025-10-15T17:41:10.980891] [INFO ] [MAIN ] BLX: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:41:10.981084] [DEBUG] [LOCAL ] BLX: No existing data file found in primary storage. [2025-10-15T17:41:10.981120] [WARN ] [MAIN ] BLX: No existing data found, performing full refresh instead. [2025-10-15T17:41:10.981233] [INFO ] [MAIN ] BLX: Wiping existing primary data before full refresh. [2025-10-15T17:41:10.981273] [INFO ] [LOCAL ] BLX: Starting deletion of primary data. [2025-10-15T17:41:10.981313] [DEBUG] [LOCAL ] BLX: No primary data file found to delete. [2025-10-15T17:41:10.981344] [INFO ] [MAIN ] BLX: Starting full primary refresh. [2025-10-15T17:41:11.330519] [INFO ] [REMOTE ] BLX: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:41:11.321473] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-07. [2025-10-15T17:41:12.113976] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-05. [2025-10-15T17:41:12.157407] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-15T17:41:12.424247] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-15T17:41:12.914010] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-08. [2025-10-15T17:41:13.713980] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-08. [2025-10-15T17:41:13.852186] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-15T17:41:13.953142] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-15T17:41:14.408690] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-15T17:41:14.513990] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-09. [2025-10-15T17:41:15.313988] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-09. [2025-10-15T17:41:15.433937] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-15T17:41:16.114007] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-10. [2025-10-15T17:41:16.914031] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-06. [2025-10-15T17:41:16.991349] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-15T17:41:17.006186] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-15T17:41:17.008686] [INFO ] [REMOTE ] BLW: Full fetch complete (19297 records). [2025-10-15T17:41:17.008799] [DEBUG] [VALIDATOR ] BLW: Validating primary data. [2025-10-15T17:41:17.394852] [DEBUG] [VALIDATOR ] BLW: All expected trading days are present. [2025-10-15T17:41:17.394974] [DEBUG] [VALIDATOR ] BLW: Primary data validation passed. [2025-10-15T17:41:17.395531] [INFO ] [MAIN ] BLW: Fetched primary data is valid. [2025-10-15T17:41:17.395593] [DEBUG] [LOCAL ] BLW: Saving primary data. [2025-10-15T17:41:17.396186] [DEBUG] [LOCAL ] BLW: Trimmed 19297 records to 13190 (keeping 200 days of data) [2025-10-15T17:41:17.476310] [DEBUG] [LOCAL ] BLW: Primary data saved (13190 records). [2025-10-15T17:41:17.476473] [INFO ] [MAIN ] BLW: Full history saved. [2025-10-15T17:41:17.476554] [INFO ] [MAIN ] Update Progress: 301/2369 symbols completed. BLW took 20.4s. Estimated remaining: 4h 43m 10s. Rate: 7.3 symbols/min [2025-10-15T17:41:17.641487] [INFO ] [MAIN ] BMA: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:41:17.677135] [DEBUG] [LOCAL ] BMA: Loaded 36025 existing records from primary storage. [2025-10-15T17:41:17.677444] [INFO ] [MAIN ] BMA: Loaded 36025 existing records. [2025-10-15T17:41:17.722758] [INFO ] [REMOTE ] BLX: Fetching primary data for 2024-12. [2025-10-15T17:41:17.871585] [WARN ] [MAIN ] BMA: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:41:17.871946] [INFO ] [MAIN ] BMA: Wiping existing primary data before full refresh. [2025-10-15T17:41:17.872005] [INFO ] [LOCAL ] BMA: Starting deletion of primary data. [2025-10-15T17:41:17.872519] [DEBUG] [LOCAL ] BMA: Deleted primary data file. [2025-10-15T17:41:17.872580] [INFO ] [MAIN ] BMA: Starting full primary refresh. [2025-10-15T17:41:18.266337] [INFO ] [REMOTE ] BMA: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:41:18.294868] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-15T17:41:18.513991] [INFO ] [REMOTE ] BMA: Fetching primary data for 2024-12. [2025-10-15T17:41:18.851052] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-15T17:41:19.314061] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-01. [2025-10-15T17:41:20.020831] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-15T17:41:20.113984] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-01. [2025-10-15T17:41:20.155047] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-15T17:41:20.914049] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-10. [2025-10-15T17:41:21.372848] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-15T17:41:21.714006] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-07. [2025-10-15T17:41:22.319465] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-15T17:41:22.324029] [INFO ] [REMOTE ] BLK: Full fetch complete (52840 records). [2025-10-15T17:41:22.324150] [DEBUG] [VALIDATOR ] BLK: Validating primary data. [2025-10-15T17:41:22.520040] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-02. [2025-10-15T17:41:22.696624] [DEBUG] [VALIDATOR ] BLK: All expected trading days are present. [2025-10-15T17:41:22.696735] [DEBUG] [VALIDATOR ] BLK: Primary data validation passed. [2025-10-15T17:41:22.697417] [INFO ] [MAIN ] BLK: Fetched primary data is valid. [2025-10-15T17:41:22.697457] [DEBUG] [LOCAL ] BLK: Saving primary data. [2025-10-15T17:41:22.698525] [DEBUG] [LOCAL ] BLK: Trimmed 52840 records to 34301 (keeping 200 days of data) [2025-10-15T17:41:22.923908] [DEBUG] [LOCAL ] BLK: Primary data saved (34301 records). [2025-10-15T17:41:22.924060] [INFO ] [MAIN ] BLK: Full history saved. [2025-10-15T17:41:22.924152] [INFO ] [MAIN ] Update Progress: 302/2369 symbols completed. BLK took 43.9s. Estimated remaining: 4h 42m 43s. Rate: 7.3 symbols/min [2025-10-15T17:41:23.102624] [INFO ] [MAIN ] BME: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:41:23.137985] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-15T17:41:23.154264] [DEBUG] [LOCAL ] BME: Loaded 11234 existing records from primary storage. [2025-10-15T17:41:23.154717] [INFO ] [MAIN ] BME: Loaded 11234 existing records. [2025-10-15T17:41:23.239719] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-15T17:41:23.319408] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-02. [2025-10-15T17:41:23.363052] [WARN ] [MAIN ] BME: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:41:23.363495] [INFO ] [MAIN ] BME: Wiping existing primary data before full refresh. [2025-10-15T17:41:23.363545] [INFO ] [LOCAL ] BME: Starting deletion of primary data. [2025-10-15T17:41:23.363777] [DEBUG] [LOCAL ] BME: Deleted primary data file. [2025-10-15T17:41:23.363835] [INFO ] [MAIN ] BME: Starting full primary refresh. [2025-10-15T17:41:23.722774] [INFO ] [REMOTE ] BME: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:41:24.113993] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-08. [2025-10-15T17:41:24.521536] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-15T17:41:24.913998] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-03. [2025-10-15T17:41:25.723721] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-03. [2025-10-15T17:41:25.749479] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-15T17:41:25.773572] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-15T17:41:26.514029] [INFO ] [REMOTE ] BME: Fetching primary data for 2024-12. [2025-10-15T17:41:27.119125] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-15T17:41:27.314038] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-09. [2025-10-15T17:41:27.397875] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-15T17:41:28.114019] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-01. [2025-10-15T17:41:28.914024] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-04. [2025-10-15T17:41:28.935003] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-15T17:41:29.047932] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-15T17:41:29.714017] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-10. [2025-10-15T17:41:29.819271] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-15T17:41:30.513996] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-04. [2025-10-15T17:41:31.051440] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-15T17:41:31.058056] [INFO ] [REMOTE ] BLND: Full fetch complete (72323 records). [2025-10-15T17:41:31.058316] [DEBUG] [VALIDATOR ] BLND: Validating primary data. [2025-10-15T17:41:31.319108] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-05. [2025-10-15T17:41:31.475958] [DEBUG] [VALIDATOR ] BLND: All expected trading days are present. [2025-10-15T17:41:31.476061] [DEBUG] [VALIDATOR ] BLND: Primary data validation passed. [2025-10-15T17:41:31.476946] [INFO ] [MAIN ] BLND: Fetched primary data is valid. [2025-10-15T17:41:31.477017] [DEBUG] [LOCAL ] BLND: Saving primary data. [2025-10-15T17:41:31.478772] [DEBUG] [LOCAL ] BLND: Trimmed 72323 records to 49281 (keeping 200 days of data) [2025-10-15T17:41:31.764681] [DEBUG] [LOCAL ] BLND: Primary data saved (49281 records). [2025-10-15T17:41:31.764857] [INFO ] [MAIN ] BLND: Full history saved. [2025-10-15T17:41:31.764948] [INFO ] [MAIN ] Update Progress: 303/2369 symbols completed. BLND took 36.6s. Estimated remaining: 4h 42m 39s. Rate: 7.3 symbols/min [2025-10-15T17:41:31.942809] [INFO ] [MAIN ] BMEZ: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:41:31.969699] [DEBUG] [LOCAL ] BMEZ: Loaded 26013 existing records from primary storage. [2025-10-15T17:41:31.969973] [INFO ] [MAIN ] BMEZ: Loaded 26013 existing records. [2025-10-15T17:41:32.128708] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-15T17:41:32.127338] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-02. [2025-10-15T17:41:32.182867] [WARN ] [MAIN ] BMEZ: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:41:32.183378] [INFO ] [MAIN ] BMEZ: Wiping existing primary data before full refresh. [2025-10-15T17:41:32.183444] [INFO ] [LOCAL ] BMEZ: Starting deletion of primary data. [2025-10-15T17:41:32.183809] [DEBUG] [LOCAL ] BMEZ: Deleted primary data file. [2025-10-15T17:41:32.183866] [INFO ] [MAIN ] BMEZ: Starting full primary refresh. [2025-10-15T17:41:32.484710] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-15T17:41:32.580815] [INFO ] [REMOTE ] BMEZ: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:41:32.913992] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2024-12. [2025-10-15T17:41:33.001409] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-15T17:41:33.714116] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-06. [2025-10-15T17:41:34.181856] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-15T17:41:34.514058] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-01. [2025-10-15T17:41:34.549190] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-15T17:41:35.314105] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-03. [2025-10-15T17:41:35.572123] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-15T17:41:36.080468] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-15T17:41:36.114030] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-02. [2025-10-15T17:41:36.914030] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-07. [2025-10-15T17:41:37.154453] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-15T17:41:37.519719] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-15T17:41:37.714038] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-08. [2025-10-15T17:41:38.514042] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-04. [2025-10-15T17:41:38.675413] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-15T17:41:39.201854] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-15T17:41:39.314024] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-05. [2025-10-15T17:41:40.113995] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-03. [2025-10-15T17:41:40.156159] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-15T17:41:40.914030] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-06. [2025-10-15T17:41:41.355366] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-15T17:41:41.468300] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-10-15T17:41:41.714048] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-09. [2025-10-15T17:41:42.491084] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-15T17:41:42.513983] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-04. [2025-10-15T17:41:43.314066] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-10. [2025-10-15T17:41:43.505079] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-15T17:41:44.073792] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-15T17:41:44.076084] [INFO ] [REMOTE ] BLX: Full fetch complete (22450 records). [2025-10-15T17:41:44.076158] [DEBUG] [VALIDATOR ] BLX: Validating primary data. [2025-10-15T17:41:44.119135] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-07. [2025-10-15T17:41:44.458846] [DEBUG] [VALIDATOR ] BLX: All expected trading days are present. [2025-10-15T17:41:44.458962] [DEBUG] [VALIDATOR ] BLX: Primary data validation passed. [2025-10-15T17:41:44.459690] [INFO ] [MAIN ] BLX: Fetched primary data is valid. [2025-10-15T17:41:44.459757] [DEBUG] [LOCAL ] BLX: Saving primary data. [2025-10-15T17:41:44.460872] [DEBUG] [LOCAL ] BLX: Trimmed 22450 records to 15583 (keeping 200 days of data) [2025-10-15T17:41:44.571257] [DEBUG] [LOCAL ] BLX: Primary data saved (15583 records). [2025-10-15T17:41:44.571461] [INFO ] [MAIN ] BLX: Full history saved. [2025-10-15T17:41:44.571555] [INFO ] [MAIN ] Update Progress: 304/2369 symbols completed. BLX took 33.8s. Estimated remaining: 4h 43m 2s. Rate: 7.3 symbols/min [2025-10-15T17:41:44.815593] [INFO ] [MAIN ] BMI: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:41:44.844064] [DEBUG] [LOCAL ] BMI: Loaded 24471 existing records from primary storage. [2025-10-15T17:41:44.844406] [INFO ] [MAIN ] BMI: Loaded 24471 existing records. [2025-10-15T17:41:44.924328] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-05. [2025-10-15T17:41:45.049512] [WARN ] [MAIN ] BMI: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:41:45.057817] [INFO ] [MAIN ] BMI: Wiping existing primary data before full refresh. [2025-10-15T17:41:45.058738] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-15T17:41:45.061690] [INFO ] [LOCAL ] BMI: Starting deletion of primary data. [2025-10-15T17:41:45.062333] [DEBUG] [LOCAL ] BMI: Deleted primary data file. [2025-10-15T17:41:45.062386] [INFO ] [MAIN ] BMI: Starting full primary refresh. [2025-10-15T17:41:45.436099] [INFO ] [REMOTE ] BMI: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:41:45.714091] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-05. [2025-10-15T17:41:46.156934] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-15T17:41:46.514028] [INFO ] [REMOTE ] BMI: Fetching primary data for 2024-12. [2025-10-15T17:41:46.896426] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-15T17:41:47.314009] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-06. [2025-10-15T17:41:47.606165] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-15T17:41:48.113998] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-06. [2025-10-15T17:41:48.566353] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-15T17:41:48.914054] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-08. [2025-10-15T17:41:49.440974] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-15T17:41:49.623840] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-15T17:41:49.714034] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-01. [2025-10-15T17:41:50.512087] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-15T17:41:50.516201] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-07. [2025-10-15T17:41:51.314034] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-02. [2025-10-15T17:41:51.841277] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-15T17:41:52.114076] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-07. [2025-10-15T17:41:52.332791] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-15T17:41:52.913988] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-09. [2025-10-15T17:41:53.333790] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-15T17:41:53.714022] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-03. [2025-10-15T17:41:53.750152] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-15T17:41:54.514075] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-08. [2025-10-15T17:41:54.665738] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-15T17:41:55.314089] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-04. [2025-10-15T17:41:55.895020] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-15T17:41:56.114090] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-08. [2025-10-15T17:41:56.658872] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-15T17:41:56.914044] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-10. [2025-10-15T17:41:57.303846] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-15T17:41:57.650779] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-15T17:41:57.652866] [INFO ] [REMOTE ] BME: Full fetch complete (15950 records). [2025-10-15T17:41:57.652952] [DEBUG] [VALIDATOR ] BME: Validating primary data. [2025-10-15T17:41:57.720895] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-09. [2025-10-15T17:41:58.023282] [DEBUG] [VALIDATOR ] BME: All expected trading days are present. [2025-10-15T17:41:58.023368] [DEBUG] [VALIDATOR ] BME: Primary data validation passed. [2025-10-15T17:41:58.023775] [INFO ] [MAIN ] BME: Fetched primary data is valid. [2025-10-15T17:41:58.023837] [DEBUG] [LOCAL ] BME: Saving primary data. [2025-10-15T17:41:58.024363] [DEBUG] [LOCAL ] BME: Trimmed 15950 records to 11286 (keeping 200 days of data) [2025-10-15T17:41:58.092487] [DEBUG] [LOCAL ] BME: Primary data saved (11286 records). [2025-10-15T17:41:58.092661] [INFO ] [MAIN ] BME: Full history saved. [2025-10-15T17:41:58.092764] [INFO ] [MAIN ] Update Progress: 305/2369 symbols completed. BME took 35.2s. Estimated remaining: 4h 43m 30s. Rate: 7.3 symbols/min [2025-10-15T17:41:58.268059] [INFO ] [MAIN ] BMN: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:41:58.273481] [DEBUG] [LOCAL ] BMN: Loaded 2585 existing records from primary storage. [2025-10-15T17:41:58.273737] [INFO ] [MAIN ] BMN: Loaded 2585 existing records. [2025-10-15T17:41:58.452314] [WARN ] [MAIN ] BMN: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:41:58.452601] [INFO ] [MAIN ] BMN: Wiping existing primary data before full refresh. [2025-10-15T17:41:58.452700] [INFO ] [LOCAL ] BMN: Starting deletion of primary data. [2025-10-15T17:41:58.452850] [DEBUG] [LOCAL ] BMN: Deleted primary data file. [2025-10-15T17:41:58.452888] [INFO ] [MAIN ] BMN: Starting full primary refresh. [2025-10-15T17:41:58.519149] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-09. [2025-10-15T17:41:58.844183] [INFO ] [REMOTE ] BMN: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:41:59.055834] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-15T17:41:59.314066] [INFO ] [REMOTE ] BMN: Fetching primary data for 2024-12. [2025-10-15T17:41:59.903972] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-10-15T17:42:00.117327] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-10. [2025-10-15T17:42:00.121952] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-15T17:42:00.914025] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-05. [2025-10-15T17:42:01.115898] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-15T17:42:01.121727] [INFO ] [REMOTE ] BMEZ: Full fetch complete (40275 records). [2025-10-15T17:42:01.121951] [DEBUG] [VALIDATOR ] BMEZ: Validating primary data. [2025-10-15T17:42:01.538540] [DEBUG] [VALIDATOR ] BMEZ: All expected trading days are present. [2025-10-15T17:42:01.538700] [DEBUG] [VALIDATOR ] BMEZ: Primary data validation passed. [2025-10-15T17:42:01.539599] [INFO ] [MAIN ] BMEZ: Fetched primary data is valid. [2025-10-15T17:42:01.539669] [DEBUG] [LOCAL ] BMEZ: Saving primary data. [2025-10-15T17:42:01.540996] [DEBUG] [LOCAL ] BMEZ: Trimmed 40275 records to 25911 (keeping 200 days of data) [2025-10-15T17:42:01.701126] [DEBUG] [LOCAL ] BMEZ: Primary data saved (25911 records). [2025-10-15T17:42:01.701299] [INFO ] [MAIN ] BMEZ: Full history saved. [2025-10-15T17:42:01.701408] [INFO ] [MAIN ] Update Progress: 306/2369 symbols completed. BMEZ took 29.9s. Estimated remaining: 4h 42m 50s. Rate: 7.3 symbols/min [2025-10-15T17:42:01.722417] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-01. [2025-10-15T17:42:01.879637] [INFO ] [MAIN ] BMO: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:42:01.920928] [DEBUG] [LOCAL ] BMO: Loaded 41163 existing records from primary storage. [2025-10-15T17:42:01.921325] [INFO ] [MAIN ] BMO: Loaded 41163 existing records. [2025-10-15T17:42:02.103166] [WARN ] [MAIN ] BMO: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:42:02.103780] [INFO ] [MAIN ] BMO: Wiping existing primary data before full refresh. [2025-10-15T17:42:02.103870] [INFO ] [LOCAL ] BMO: Starting deletion of primary data. [2025-10-15T17:42:02.109696] [DEBUG] [LOCAL ] BMO: Deleted primary data file. [2025-10-15T17:42:02.117021] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-15T17:42:02.116528] [INFO ] [MAIN ] BMO: Starting full primary refresh. [2025-10-15T17:42:02.229742] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-10-15T17:42:02.515489] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-06. [2025-10-15T17:42:02.519272] [INFO ] [REMOTE ] BMO: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:42:03.314025] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-02. [2025-10-15T17:42:03.514300] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-15T17:42:04.033691] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-15T17:42:04.114018] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-07. [2025-10-15T17:42:04.914024] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-10. [2025-10-15T17:42:05.191732] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-15T17:42:05.713987] [INFO ] [REMOTE ] BMO: Fetching primary data for 2024-12. [2025-10-15T17:42:06.513981] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-08. [2025-10-15T17:42:06.624206] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-15T17:42:06.629446] [INFO ] [REMOTE ] BMA: Full fetch complete (51918 records). [2025-10-15T17:42:06.629553] [DEBUG] [VALIDATOR ] BMA: Validating primary data. [2025-10-15T17:42:07.007895] [DEBUG] [VALIDATOR ] BMA: All expected trading days are present. [2025-10-15T17:42:07.008034] [DEBUG] [VALIDATOR ] BMA: Primary data validation passed. [2025-10-15T17:42:07.009691] [INFO ] [MAIN ] BMA: Fetched primary data is valid. [2025-10-15T17:42:07.009755] [DEBUG] [LOCAL ] BMA: Saving primary data. [2025-10-15T17:42:07.010891] [DEBUG] [LOCAL ] BMA: Trimmed 51918 records to 36165 (keeping 200 days of data) [2025-10-15T17:42:07.234009] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-15T17:42:07.269613] [DEBUG] [LOCAL ] BMA: Primary data saved (36165 records). [2025-10-15T17:42:07.269795] [INFO ] [MAIN ] BMA: Full history saved. [2025-10-15T17:42:07.270063] [INFO ] [MAIN ] Update Progress: 307/2369 symbols completed. BMA took 49.8s. Estimated remaining: 4h 42m 24s. Rate: 7.3 symbols/min [2025-10-15T17:42:07.316131] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-03. [2025-10-15T17:42:07.447234] [INFO ] [MAIN ] BMY: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:42:07.447635] [DEBUG] [LOCAL ] BMY: No existing data file found in primary storage. [2025-10-15T17:42:07.447721] [WARN ] [MAIN ] BMY: No existing data found, performing full refresh instead. [2025-10-15T17:42:07.447853] [INFO ] [MAIN ] BMY: Wiping existing primary data before full refresh. [2025-10-15T17:42:07.447895] [INFO ] [LOCAL ] BMY: Starting deletion of primary data. [2025-10-15T17:42:07.447936] [DEBUG] [LOCAL ] BMY: No primary data file found to delete. [2025-10-15T17:42:07.447966] [INFO ] [MAIN ] BMY: Starting full primary refresh. [2025-10-15T17:42:07.767259] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-15T17:42:07.830739] [INFO ] [REMOTE ] BMY: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:42:07.830951] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-10-15T17:42:08.114036] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-09. [2025-10-15T17:42:08.914012] [INFO ] [REMOTE ] BMY: Fetching primary data for 2024-12. [2025-10-15T17:42:09.230942] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-15T17:42:09.713993] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-10. [2025-10-15T17:42:10.514005] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-04. [2025-10-15T17:42:10.837487] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-15T17:42:10.841987] [INFO ] [REMOTE ] BMI: Full fetch complete (33376 records). [2025-10-15T17:42:10.842146] [DEBUG] [VALIDATOR ] BMI: Validating primary data. [2025-10-15T17:42:11.073785] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-10-15T17:42:11.204969] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2024-12 (2.29 seconds). [2025-10-15T17:42:11.298623] [DEBUG] [VALIDATOR ] BMI: All expected trading days are present. [2025-10-15T17:42:11.298766] [DEBUG] [VALIDATOR ] BMI: Primary data validation passed. [2025-10-15T17:42:11.299590] [INFO ] [MAIN ] BMI: Fetched primary data is valid. [2025-10-15T17:42:11.299636] [DEBUG] [LOCAL ] BMI: Saving primary data. [2025-10-15T17:42:11.300772] [DEBUG] [LOCAL ] BMI: Trimmed 33376 records to 24500 (keeping 200 days of data) [2025-10-15T17:42:11.358053] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-01. [2025-10-15T17:42:11.476095] [DEBUG] [LOCAL ] BMI: Primary data saved (24500 records). [2025-10-15T17:42:11.476276] [INFO ] [MAIN ] BMI: Full history saved. [2025-10-15T17:42:11.476376] [INFO ] [MAIN ] Update Progress: 308/2369 symbols completed. BMI took 26.9s. Estimated remaining: 4h 41m 49s. Rate: 7.3 symbols/min [2025-10-15T17:42:11.655999] [INFO ] [MAIN ] BN: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:42:11.716282] [DEBUG] [LOCAL ] BN: Loaded 52993 existing records from primary storage. [2025-10-15T17:42:11.716712] [INFO ] [MAIN ] BN: Loaded 52993 existing records. [2025-10-15T17:42:11.909371] [WARN ] [MAIN ] BN: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:42:11.909625] [INFO ] [MAIN ] BN: Wiping existing primary data before full refresh. [2025-10-15T17:42:11.909710] [INFO ] [LOCAL ] BN: Starting deletion of primary data. [2025-10-15T17:42:11.910350] [DEBUG] [LOCAL ] BN: Deleted primary data file. [2025-10-15T17:42:11.910393] [INFO ] [MAIN ] BN: Starting full primary refresh. [2025-10-15T17:42:12.125851] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-01. [2025-10-15T17:42:12.284289] [INFO ] [REMOTE ] BN: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:42:12.615009] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-15T17:42:12.914029] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-02. [2025-10-15T17:42:13.714070] [INFO ] [REMOTE ] BN: Fetching primary data for 2024-12. [2025-10-15T17:42:13.999052] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-15T17:42:14.290177] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-15T17:42:14.514063] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-05. [2025-10-15T17:42:14.937197] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-10-15T17:42:15.314021] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-06. [2025-10-15T17:42:15.487613] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-15T17:42:15.805218] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-10-15T17:42:16.113999] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-03. [2025-10-15T17:42:16.914006] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-07. [2025-10-15T17:42:17.268452] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-10-15T17:42:17.501765] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-15T17:42:17.714003] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-08. [2025-10-15T17:42:18.025748] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-08 (0.31 seconds). [2025-10-15T17:42:18.514079] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-09. [2025-10-15T17:42:18.882864] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-09 (0.37 seconds). [2025-10-15T17:42:19.313987] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-02. [2025-10-15T17:42:20.113996] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-04. [2025-10-15T17:42:20.914198] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-10. [2025-10-15T17:42:20.920720] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-15T17:42:21.456442] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-15T17:42:21.457319] [INFO ] [REMOTE ] BMN: Full fetch complete (3724 records). [2025-10-15T17:42:21.457389] [DEBUG] [VALIDATOR ] BMN: Validating primary data. [2025-10-15T17:42:21.718275] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-03. [2025-10-15T17:42:21.838312] [DEBUG] [VALIDATOR ] BMN: All expected trading days are present. [2025-10-15T17:42:21.847595] [DEBUG] [VALIDATOR ] BMN: Primary data validation passed. [2025-10-15T17:42:21.862904] [INFO ] [MAIN ] BMN: Fetched primary data is valid. [2025-10-15T17:42:21.863049] [DEBUG] [LOCAL ] BMN: Saving primary data. [2025-10-15T17:42:21.864174] [DEBUG] [LOCAL ] BMN: Trimmed 3724 records to 2596 (keeping 200 days of data) [2025-10-15T17:42:21.865806] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-15T17:42:21.891905] [DEBUG] [LOCAL ] BMN: Primary data saved (2596 records). [2025-10-15T17:42:21.892014] [INFO ] [MAIN ] BMN: Full history saved. [2025-10-15T17:42:21.892097] [INFO ] [MAIN ] Update Progress: 309/2369 symbols completed. BMN took 23.8s. Estimated remaining: 4h 41m 56s. Rate: 7.3 symbols/min [2025-10-15T17:42:22.074348] [INFO ] [MAIN ] BNED: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:42:22.104322] [DEBUG] [LOCAL ] BNED: Loaded 28733 existing records from primary storage. [2025-10-15T17:42:22.104706] [INFO ] [MAIN ] BNED: Loaded 28733 existing records. [2025-10-15T17:42:22.311076] [WARN ] [MAIN ] BNED: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:42:22.311399] [INFO ] [MAIN ] BNED: Wiping existing primary data before full refresh. [2025-10-15T17:42:22.311472] [INFO ] [LOCAL ] BNED: Starting deletion of primary data. [2025-10-15T17:42:22.311994] [DEBUG] [LOCAL ] BNED: Deleted primary data file. [2025-10-15T17:42:22.312244] [INFO ] [MAIN ] BNED: Starting full primary refresh. [2025-10-15T17:42:22.519223] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-05. [2025-10-15T17:42:22.670090] [INFO ] [REMOTE ] BNED: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:42:23.314031] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-01. [2025-10-15T17:42:23.511325] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-15T17:42:23.927852] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-15T17:42:24.114034] [INFO ] [REMOTE ] BNED: Fetching primary data for 2024-12. [2025-10-15T17:42:24.914020] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-06. [2025-10-15T17:42:25.029329] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-15T17:42:25.714013] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-04. [2025-10-15T17:42:25.779588] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-15T17:42:26.032432] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-15T17:42:26.514046] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-02. [2025-10-15T17:42:27.314013] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-01. [2025-10-15T17:42:27.971790] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-04 (2.26 seconds). [2025-10-15T17:42:28.114057] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-05. [2025-10-15T17:42:28.284714] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-15T17:42:28.447114] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-15T17:42:28.914056] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-07. [2025-10-15T17:42:29.713986] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-02. [2025-10-15T17:42:29.895281] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-15T17:42:30.513966] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-06. [2025-10-15T17:42:30.547492] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-15T17:42:30.846821] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-15T17:42:31.314080] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-08. [2025-10-15T17:42:32.113981] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-03. [2025-10-15T17:42:32.530994] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-10-15T17:42:32.840207] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-15T17:42:32.913954] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-09. [2025-10-15T17:42:33.565779] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-15T17:42:33.714008] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-07. [2025-10-15T17:42:34.496936] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-15T17:42:34.513951] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-04. [2025-10-15T17:42:35.313967] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-10. [2025-10-15T17:42:35.573398] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-15T17:42:35.716618] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-15T17:42:36.114002] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-03. [2025-10-15T17:42:36.840631] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-15T17:42:36.845613] [INFO ] [REMOTE ] BMO: Full fetch complete (59852 records). [2025-10-15T17:42:36.845751] [DEBUG] [VALIDATOR ] BMO: Validating primary data. [2025-10-15T17:42:36.920638] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-05. [2025-10-15T17:42:37.231915] [DEBUG] [VALIDATOR ] BMO: All expected trading days are present. [2025-10-15T17:42:37.232004] [DEBUG] [VALIDATOR ] BMO: Primary data validation passed. [2025-10-15T17:42:37.232746] [INFO ] [MAIN ] BMO: Fetched primary data is valid. [2025-10-15T17:42:37.232811] [DEBUG] [LOCAL ] BMO: Saving primary data. [2025-10-15T17:42:37.234219] [DEBUG] [LOCAL ] BMO: Trimmed 59852 records to 41237 (keeping 200 days of data) [2025-10-15T17:42:37.484197] [DEBUG] [LOCAL ] BMO: Primary data saved (41237 records). [2025-10-15T17:42:37.484347] [INFO ] [MAIN ] BMO: Full history saved. [2025-10-15T17:42:37.484431] [INFO ] [MAIN ] Update Progress: 310/2369 symbols completed. BMO took 35.8s. Estimated remaining: 4h 42m 37s. Rate: 7.3 symbols/min [2025-10-15T17:42:37.687409] [INFO ] [MAIN ] BNH: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:42:37.699314] [DEBUG] [LOCAL ] BNH: Loaded 5072 existing records from primary storage. [2025-10-15T17:42:37.699551] [INFO ] [MAIN ] BNH: Loaded 5072 existing records. [2025-10-15T17:42:37.720813] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-08. [2025-10-15T17:42:37.895617] [WARN ] [MAIN ] BNH: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:42:37.896269] [INFO ] [MAIN ] BNH: Wiping existing primary data before full refresh. [2025-10-15T17:42:37.896426] [INFO ] [LOCAL ] BNH: Starting deletion of primary data. [2025-10-15T17:42:37.896617] [DEBUG] [LOCAL ] BNH: Deleted primary data file. [2025-10-15T17:42:37.896708] [INFO ] [MAIN ] BNH: Starting full primary refresh. [2025-10-15T17:42:38.092344] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-10-15T17:42:38.334706] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-15T17:42:38.340283] [INFO ] [REMOTE ] BNH: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:42:38.514010] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-06. [2025-10-15T17:42:39.314039] [INFO ] [REMOTE ] BNH: Fetching primary data for 2024-12. [2025-10-15T17:42:39.728194] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-15T17:42:39.953785] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-10-15T17:42:39.953581] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-08 (2.23 seconds). [2025-10-15T17:42:40.113987] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-07. [2025-10-15T17:42:40.914054] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-04. [2025-10-15T17:42:41.208996] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-15T17:42:41.714010] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-08. [2025-10-15T17:42:42.513986] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-01. [2025-10-15T17:42:42.745051] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-15T17:42:42.924497] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-15T17:42:42.940745] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-10-15T17:42:43.314064] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-05. [2025-10-15T17:42:44.114010] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-09. [2025-10-15T17:42:44.913995] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-09. [2025-10-15T17:42:45.320170] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-10-15T17:42:45.714004] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-02. [2025-10-15T17:42:45.978572] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-15T17:42:46.143093] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-15T17:42:46.514020] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-06. [2025-10-15T17:42:46.775037] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-15T17:42:47.314050] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-03. [2025-10-15T17:42:47.900784] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-15T17:42:48.113964] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-04. [2025-10-15T17:42:48.155371] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-15T17:42:48.813746] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-10-15T17:42:48.914081] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-07. [2025-10-15T17:42:49.714018] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-10. [2025-10-15T17:42:50.306819] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-15T17:42:50.317122] [INFO ] [REMOTE ] BMY: Full fetch complete (77937 records). [2025-10-15T17:42:50.317398] [DEBUG] [VALIDATOR ] BMY: Validating primary data. [2025-10-15T17:42:50.536070] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-05. [2025-10-15T17:42:50.780019] [DEBUG] [VALIDATOR ] BMY: All expected trading days are present. [2025-10-15T17:42:50.780340] [DEBUG] [VALIDATOR ] BMY: Primary data validation passed. [2025-10-15T17:42:50.783702] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-15T17:42:50.781807] [INFO ] [MAIN ] BMY: Fetched primary data is valid. [2025-10-15T17:42:50.794557] [DEBUG] [LOCAL ] BMY: Saving primary data. [2025-10-15T17:42:50.796688] [DEBUG] [LOCAL ] BMY: Trimmed 77937 records to 53757 (keeping 200 days of data) [2025-10-15T17:42:51.121886] [DEBUG] [LOCAL ] BMY: Primary data saved (53757 records). [2025-10-15T17:42:51.122039] [INFO ] [MAIN ] BMY: Full history saved. [2025-10-15T17:42:51.122114] [INFO ] [MAIN ] Update Progress: 311/2369 symbols completed. BMY took 43.9s. Estimated remaining: 4h 43m 4s. Rate: 7.3 symbols/min [2025-10-15T17:42:51.302604] [INFO ] [MAIN ] BNJ: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:42:51.308272] [DEBUG] [LOCAL ] BNJ: Loaded 2629 existing records from primary storage. [2025-10-15T17:42:51.308461] [INFO ] [MAIN ] BNJ: Loaded 2629 existing records. [2025-10-15T17:42:51.320068] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-08. [2025-10-15T17:42:51.444485] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-15T17:42:51.537872] [WARN ] [MAIN ] BNJ: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:42:51.538186] [INFO ] [MAIN ] BNJ: Wiping existing primary data before full refresh. [2025-10-15T17:42:51.538241] [INFO ] [LOCAL ] BNJ: Starting deletion of primary data. [2025-10-15T17:42:51.538481] [DEBUG] [LOCAL ] BNJ: Deleted primary data file. [2025-10-15T17:42:51.538541] [INFO ] [MAIN ] BNJ: Starting full primary refresh. [2025-10-15T17:42:51.924734] [INFO ] [REMOTE ] BNJ: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:42:52.114017] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-06. [2025-10-15T17:42:52.510523] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-10-15T17:42:52.766417] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-15T17:42:52.913971] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-09. [2025-10-15T17:42:53.714016] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-07. [2025-10-15T17:42:54.277178] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-15T17:42:54.513971] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2024-12. [2025-10-15T17:42:54.922771] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-10-15T17:42:55.314028] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-10. [2025-10-15T17:42:55.539198] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-15T17:42:56.114028] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-08. [2025-10-15T17:42:56.651621] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-15T17:42:56.654550] [INFO ] [REMOTE ] BNED: Full fetch complete (42620 records). [2025-10-15T17:42:56.654633] [DEBUG] [VALIDATOR ] BNED: Validating primary data. [2025-10-15T17:42:56.762787] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-10-15T17:42:56.919111] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-01. [2025-10-15T17:42:57.044131] [DEBUG] [VALIDATOR ] BNED: All expected trading days are present. [2025-10-15T17:42:57.044215] [DEBUG] [VALIDATOR ] BNED: Primary data validation passed. [2025-10-15T17:42:57.044840] [INFO ] [MAIN ] BNED: Fetched primary data is valid. [2025-10-15T17:42:57.044901] [DEBUG] [LOCAL ] BNED: Saving primary data. [2025-10-15T17:42:57.045796] [DEBUG] [LOCAL ] BNED: Trimmed 42620 records to 28621 (keeping 200 days of data) [2025-10-15T17:42:57.208046] [DEBUG] [LOCAL ] BNED: Primary data saved (28621 records). [2025-10-15T17:42:57.208189] [INFO ] [MAIN ] BNED: Full history saved. [2025-10-15T17:42:57.208273] [INFO ] [MAIN ] Update Progress: 312/2369 symbols completed. BNED took 35.3s. Estimated remaining: 4h 42m 42s. Rate: 7.3 symbols/min [2025-10-15T17:42:57.359016] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-10-15T17:42:57.383821] [INFO ] [MAIN ] BNL: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:42:57.427449] [DEBUG] [LOCAL ] BNL: Loaded 47213 existing records from primary storage. [2025-10-15T17:42:57.427814] [INFO ] [MAIN ] BNL: Loaded 47213 existing records. [2025-10-15T17:42:57.602010] [WARN ] [MAIN ] BNL: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:42:57.602288] [INFO ] [MAIN ] BNL: Wiping existing primary data before full refresh. [2025-10-15T17:42:57.602338] [INFO ] [LOCAL ] BNL: Starting deletion of primary data. [2025-10-15T17:42:57.602605] [DEBUG] [LOCAL ] BNL: Deleted primary data file. [2025-10-15T17:42:57.602694] [INFO ] [MAIN ] BNL: Starting full primary refresh. [2025-10-15T17:42:57.719291] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-10. [2025-10-15T17:42:57.968986] [INFO ] [REMOTE ] BNL: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:42:58.514027] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-02. [2025-10-15T17:42:58.883181] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-02 (0.37 seconds). [2025-10-15T17:42:59.314005] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-09. [2025-10-15T17:42:59.470321] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-15T17:42:59.477444] [INFO ] [REMOTE ] BN: Full fetch complete (76941 records). [2025-10-15T17:42:59.477626] [DEBUG] [VALIDATOR ] BN: Validating primary data. [2025-10-15T17:42:59.901558] [DEBUG] [VALIDATOR ] BN: All expected trading days are present. [2025-10-15T17:42:59.902177] [DEBUG] [VALIDATOR ] BN: Primary data validation passed. [2025-10-15T17:42:59.902072] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-15T17:42:59.903953] [INFO ] [MAIN ] BN: Fetched primary data is valid. [2025-10-15T17:42:59.906542] [DEBUG] [LOCAL ] BN: Saving primary data. [2025-10-15T17:42:59.909316] [DEBUG] [LOCAL ] BN: Trimmed 76941 records to 52988 (keeping 200 days of data) [2025-10-15T17:43:00.136945] [INFO ] [REMOTE ] BNL: Fetching primary data for 2024-12. [2025-10-15T17:43:00.258943] [DEBUG] [LOCAL ] BN: Primary data saved (52988 records). [2025-10-15T17:43:00.259114] [INFO ] [MAIN ] BN: Full history saved. [2025-10-15T17:43:00.260182] [INFO ] [MAIN ] Update Progress: 313/2369 symbols completed. BN took 48.8s. Estimated remaining: 4h 41m 59s. Rate: 7.3 symbols/min [2025-10-15T17:43:00.444975] [INFO ] [MAIN ] BNS: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:43:00.497982] [DEBUG] [LOCAL ] BNS: Loaded 51485 existing records from primary storage. [2025-10-15T17:43:00.498391] [INFO ] [MAIN ] BNS: Loaded 51485 existing records. [2025-10-15T17:43:00.700206] [WARN ] [MAIN ] BNS: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:43:00.700476] [INFO ] [MAIN ] BNS: Wiping existing primary data before full refresh. [2025-10-15T17:43:00.700537] [INFO ] [LOCAL ] BNS: Starting deletion of primary data. [2025-10-15T17:43:00.700996] [DEBUG] [LOCAL ] BNS: Deleted primary data file. [2025-10-15T17:43:00.701059] [INFO ] [MAIN ] BNS: Starting full primary refresh. [2025-10-15T17:43:00.923301] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-10. [2025-10-15T17:43:01.081621] [INFO ] [REMOTE ] BNS: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:43:01.713969] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-03. [2025-10-15T17:43:01.764311] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-15T17:43:01.783401] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-15T17:43:01.784582] [INFO ] [REMOTE ] BNH: Full fetch complete (6893 records). [2025-10-15T17:43:01.784680] [DEBUG] [VALIDATOR ] BNH: Validating primary data. [2025-10-15T17:43:01.785066] [FATAL] [VALIDATOR ] BNH: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T17:43:01.785149] [FATAL] [MAIN ] BNH: Fetched primary data is invalid. Refusing to save it. [2025-10-15T17:43:01.785193] [WARN ] [MAIN ] BNH: Deleting existing primary and derivative data due to validation failure. [2025-10-15T17:43:01.785280] [INFO ] [LOCAL ] BNH: Starting deletion of primary data. [2025-10-15T17:43:01.785345] [DEBUG] [LOCAL ] BNH: No primary data file found to delete. [2025-10-15T17:43:01.785381] [INFO ] [LOCAL ] BNH: Starting deletion of derivative data. [2025-10-15T17:43:01.785606] [DEBUG] [LOCAL ] BNH: Deleted derivative data file. [2025-10-15T17:43:01.785719] [INFO ] [MAIN ] Update Progress: 314/2369 symbols completed. BNH took 24.3s. Estimated remaining: 4h 41m 7s. Rate: 7.3 symbols/min [2025-10-15T17:43:01.950329] [INFO ] [MAIN ] BNT: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:43:01.956029] [DEBUG] [LOCAL ] BNT: Loaded 3459 existing records from primary storage. [2025-10-15T17:43:01.956243] [INFO ] [MAIN ] BNT: Loaded 3459 existing records. [2025-10-15T17:43:02.139621] [WARN ] [MAIN ] BNT: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:43:02.140147] [INFO ] [MAIN ] BNT: Wiping existing primary data before full refresh. [2025-10-15T17:43:02.144621] [INFO ] [LOCAL ] BNT: Starting deletion of primary data. [2025-10-15T17:43:02.144902] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-10-15T17:43:02.146827] [DEBUG] [LOCAL ] BNT: Deleted primary data file. [2025-10-15T17:43:02.146915] [INFO ] [MAIN ] BNT: Starting full primary refresh. [2025-10-15T17:43:02.514381] [INFO ] [REMOTE ] BNT: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:43:02.514531] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-04. [2025-10-15T17:43:03.047180] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-10-15T17:43:03.314013] [INFO ] [REMOTE ] BNS: Fetching primary data for 2024-12. [2025-10-15T17:43:04.114058] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-01. [2025-10-15T17:43:04.914009] [INFO ] [REMOTE ] BNT: Fetching primary data for 2024-12. [2025-10-15T17:43:05.055101] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-15T17:43:05.343587] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-15T17:43:05.411715] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2024-12 (0.50 seconds). [2025-10-15T17:43:05.714012] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-01. [2025-10-15T17:43:06.128223] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-01 (0.41 seconds). [2025-10-15T17:43:06.514050] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-02. [2025-10-15T17:43:06.951738] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-15T17:43:07.314071] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-01. [2025-10-15T17:43:08.113991] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-03. [2025-10-15T17:43:08.752231] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-15T17:43:08.913984] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-04. [2025-10-15T17:43:09.095211] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-15T17:43:09.576035] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-15T17:43:09.714005] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-05. [2025-10-15T17:43:10.252628] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-10-15T17:43:10.513994] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-02. [2025-10-15T17:43:11.313997] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-02. [2025-10-15T17:43:11.781591] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-15T17:43:12.113977] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-03. [2025-10-15T17:43:12.924390] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-05. [2025-10-15T17:43:12.944735] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-15T17:43:13.515072] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-15T17:43:13.521066] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-15T17:43:13.714027] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-03. [2025-10-15T17:43:14.514021] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-04. [2025-10-15T17:43:15.314023] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-06. [2025-10-15T17:43:15.623873] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-15T17:43:16.095583] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-15T17:43:16.119936] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-07. [2025-10-15T17:43:16.132363] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-15T17:43:16.535109] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-10-15T17:43:16.913988] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-05. [2025-10-15T17:43:17.713991] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-08. [2025-10-15T17:43:18.081311] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-08 (0.37 seconds). [2025-10-15T17:43:18.467526] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-15T17:43:18.513976] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-06. [2025-10-15T17:43:19.314143] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-06. [2025-10-15T17:43:20.029792] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-15T17:43:20.059689] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-15T17:43:20.114013] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-07. [2025-10-15T17:43:20.914001] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-07. [2025-10-15T17:43:21.403175] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-10-15T17:43:21.491542] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-15T17:43:21.714027] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-09. [2025-10-15T17:43:22.294088] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-15T17:43:22.514050] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-10. [2025-10-15T17:43:22.990188] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-15T17:43:22.991281] [INFO ] [REMOTE ] BNT: Full fetch complete (4674 records). [2025-10-15T17:43:22.991365] [DEBUG] [VALIDATOR ] BNT: Validating primary data. [2025-10-15T17:43:23.319202] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-04. [2025-10-15T17:43:23.350448] [DEBUG] [VALIDATOR ] BNT: All expected trading days are present. [2025-10-15T17:43:23.350535] [DEBUG] [VALIDATOR ] BNT: Primary data validation passed. [2025-10-15T17:43:23.350703] [INFO ] [MAIN ] BNT: Fetched primary data is valid. [2025-10-15T17:43:23.350765] [DEBUG] [LOCAL ] BNT: Saving primary data. [2025-10-15T17:43:23.351140] [DEBUG] [LOCAL ] BNT: Trimmed 4674 records to 3485 (keeping 200 days of data) [2025-10-15T17:43:23.376543] [DEBUG] [LOCAL ] BNT: Primary data saved (3485 records). [2025-10-15T17:43:23.376743] [INFO ] [MAIN ] BNT: Full history saved. [2025-10-15T17:43:23.376908] [INFO ] [MAIN ] Update Progress: 315/2369 symbols completed. BNT took 21.6s. Estimated remaining: 4h 42m 26s. Rate: 7.3 symbols/min [2025-10-15T17:43:23.547027] [INFO ] [MAIN ] BNY: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:43:23.556626] [DEBUG] [LOCAL ] BNY: Loaded 7171 existing records from primary storage. [2025-10-15T17:43:23.556903] [INFO ] [MAIN ] BNY: Loaded 7171 existing records. [2025-10-15T17:43:23.733073] [WARN ] [MAIN ] BNY: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:43:23.733296] [INFO ] [MAIN ] BNY: Wiping existing primary data before full refresh. [2025-10-15T17:43:23.733345] [INFO ] [LOCAL ] BNY: Starting deletion of primary data. [2025-10-15T17:43:23.733522] [DEBUG] [LOCAL ] BNY: Deleted primary data file. [2025-10-15T17:43:23.733561] [INFO ] [MAIN ] BNY: Starting full primary refresh. [2025-10-15T17:43:24.091133] [INFO ] [REMOTE ] BNY: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:43:24.113999] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-08. [2025-10-15T17:43:24.914059] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-08. [2025-10-15T17:43:25.220261] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-15T17:43:25.306391] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-08 (0.39 seconds). [2025-10-15T17:43:25.599960] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-15T17:43:25.714048] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-05. [2025-10-15T17:43:26.514059] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-09. [2025-10-15T17:43:27.313968] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-09. [2025-10-15T17:43:27.590420] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-15T17:43:27.872982] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-10-15T17:43:28.019740] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-15T17:43:28.113976] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-10. [2025-10-15T17:43:28.913968] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-06. [2025-10-15T17:43:29.714059] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-10. [2025-10-15T17:43:29.835445] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-15T17:43:29.841893] [INFO ] [REMOTE ] BNL: Full fetch complete (67273 records). [2025-10-15T17:43:29.842081] [DEBUG] [VALIDATOR ] BNL: Validating primary data. [2025-10-15T17:43:30.255141] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-15T17:43:30.255609] [DEBUG] [VALIDATOR ] BNL: All expected trading days are present. [2025-10-15T17:43:30.256803] [INFO ] [REMOTE ] BNJ: Full fetch complete (4141 records). [2025-10-15T17:43:30.257050] [DEBUG] [VALIDATOR ] BNL: Primary data validation passed. [2025-10-15T17:43:30.257223] [DEBUG] [VALIDATOR ] BNJ: Validating primary data. [2025-10-15T17:43:30.269860] [INFO ] [MAIN ] BNL: Fetched primary data is valid. [2025-10-15T17:43:30.291393] [DEBUG] [LOCAL ] BNL: Saving primary data. [2025-10-15T17:43:30.370402] [DEBUG] [LOCAL ] BNL: Trimmed 67273 records to 47279 (keeping 200 days of data) [2025-10-15T17:43:30.519014] [INFO ] [REMOTE ] BNY: Fetching primary data for 2024-12. [2025-10-15T17:43:30.773894] [DEBUG] [VALIDATOR ] BNJ: All expected trading days are present. [2025-10-15T17:43:30.784067] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-10-15T17:43:30.794422] [DEBUG] [VALIDATOR ] BNJ: Primary data validation passed. [2025-10-15T17:43:30.795528] [INFO ] [MAIN ] BNJ: Fetched primary data is valid. [2025-10-15T17:43:30.796963] [DEBUG] [LOCAL ] BNJ: Saving primary data. [2025-10-15T17:43:30.799512] [DEBUG] [LOCAL ] BNJ: Trimmed 4141 records to 2607 (keeping 200 days of data) [2025-10-15T17:43:30.819035] [DEBUG] [LOCAL ] BNJ: Primary data saved (2607 records). [2025-10-15T17:43:30.820195] [INFO ] [MAIN ] BNJ: Full history saved. [2025-10-15T17:43:30.820838] [INFO ] [MAIN ] Update Progress: 316/2369 symbols completed. BNJ took 39.7s. Estimated remaining: 4h 42m 13s. Rate: 7.3 symbols/min [2025-10-15T17:43:31.103748] [INFO ] [MAIN ] BOC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:43:31.177088] [DEBUG] [LOCAL ] BOC: Loaded 18632 existing records from primary storage. [2025-10-15T17:43:31.183229] [DEBUG] [LOCAL ] BNL: Primary data saved (47279 records). [2025-10-15T17:43:31.183169] [INFO ] [MAIN ] BOC: Loaded 18632 existing records. [2025-10-15T17:43:31.183349] [INFO ] [MAIN ] BNL: Full history saved. [2025-10-15T17:43:31.246570] [INFO ] [MAIN ] Update Progress: 317/2369 symbols completed. BNL took 34.0s. Estimated remaining: 4h 41m 14s. Rate: 7.3 symbols/min [2025-10-15T17:43:31.321764] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-07. [2025-10-15T17:43:31.363131] [WARN ] [MAIN ] BOC: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:43:31.363318] [INFO ] [MAIN ] BOC: Wiping existing primary data before full refresh. [2025-10-15T17:43:31.363366] [INFO ] [LOCAL ] BOC: Starting deletion of primary data. [2025-10-15T17:43:31.363618] [DEBUG] [LOCAL ] BOC: Deleted primary data file. [2025-10-15T17:43:31.363700] [INFO ] [MAIN ] BOC: Starting full primary refresh. [2025-10-15T17:43:31.661364] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-15T17:43:31.740042] [INFO ] [REMOTE ] BOC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:43:32.114000] [INFO ] [REMOTE ] BOC: Fetching primary data for 2024-12. [2025-10-15T17:43:32.923615] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-01. [2025-10-15T17:43:32.925287] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-10-15T17:43:33.094133] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-15T17:43:33.539769] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-15T17:43:33.714026] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-08. [2025-10-15T17:43:34.514044] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-01. [2025-10-15T17:43:35.314079] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-02. [2025-10-15T17:43:35.397992] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-15T17:43:35.450536] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-15T17:43:35.688889] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-02 (0.37 seconds). [2025-10-15T17:43:36.114024] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-09. [2025-10-15T17:43:36.914049] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-02. [2025-10-15T17:43:37.714048] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-03. [2025-10-15T17:43:37.781388] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-15T17:43:37.950001] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-15T17:43:38.360105] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-15T17:43:38.514021] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-03. [2025-10-15T17:43:39.250833] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-15T17:43:39.314070] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-04. [2025-10-15T17:43:39.925789] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-15T17:43:40.114158] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-04. [2025-10-15T17:43:40.914096] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-05. [2025-10-15T17:43:41.191681] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-15T17:43:41.606714] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-15T17:43:41.714008] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-06. [2025-10-15T17:43:42.322908] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-15T17:43:42.514007] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-10. [2025-10-15T17:43:43.314083] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-05. [2025-10-15T17:43:44.113992] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-07. [2025-10-15T17:43:44.209983] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-15T17:43:44.216995] [INFO ] [REMOTE ] BNS: Full fetch complete (74616 records). [2025-10-15T17:43:44.217159] [DEBUG] [VALIDATOR ] BNS: Validating primary data. [2025-10-15T17:43:44.421346] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-15T17:43:44.651849] [DEBUG] [VALIDATOR ] BNS: All expected trading days are present. [2025-10-15T17:43:44.651958] [DEBUG] [VALIDATOR ] BNS: Primary data validation passed. [2025-10-15T17:43:44.652946] [INFO ] [MAIN ] BNS: Fetched primary data is valid. [2025-10-15T17:43:44.653012] [DEBUG] [LOCAL ] BNS: Saving primary data. [2025-10-15T17:43:44.654855] [DEBUG] [LOCAL ] BNS: Trimmed 74616 records to 51484 (keeping 200 days of data) [2025-10-15T17:43:44.893733] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-15T17:43:44.914100] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-08. [2025-10-15T17:43:45.007996] [DEBUG] [LOCAL ] BNS: Primary data saved (51484 records). [2025-10-15T17:43:45.008184] [INFO ] [MAIN ] BNS: Full history saved. [2025-10-15T17:43:45.009149] [INFO ] [MAIN ] Update Progress: 318/2369 symbols completed. BNS took 44.7s. Estimated remaining: 4h 41m 41s. Rate: 7.3 symbols/min [2025-10-15T17:43:45.469019] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-15T17:43:45.714050] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-06. [2025-10-15T17:43:46.514060] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-09. [2025-10-15T17:43:46.542326] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-15T17:43:47.026799] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-10-15T17:43:47.314062] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-07. [2025-10-15T17:43:48.114043] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-10. [2025-10-15T17:43:48.313925] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-15T17:43:48.853056] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-15T17:43:48.855007] [INFO ] [REMOTE ] BNY: Full fetch complete (10384 records). [2025-10-15T17:43:48.855083] [DEBUG] [VALIDATOR ] BNY: Validating primary data. [2025-10-15T17:43:48.928702] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-08. [2025-10-15T17:43:49.242012] [DEBUG] [VALIDATOR ] BNY: All expected trading days are present. [2025-10-15T17:43:49.242116] [DEBUG] [VALIDATOR ] BNY: Primary data validation passed. [2025-10-15T17:43:49.242631] [INFO ] [MAIN ] BNY: Fetched primary data is valid. [2025-10-15T17:43:49.242728] [DEBUG] [LOCAL ] BNY: Saving primary data. [2025-10-15T17:43:49.243308] [DEBUG] [LOCAL ] BNY: Trimmed 10384 records to 7182 (keeping 200 days of data) [2025-10-15T17:43:49.291581] [DEBUG] [LOCAL ] BNY: Primary data saved (7182 records). [2025-10-15T17:43:49.291776] [INFO ] [MAIN ] BNY: Full history saved. [2025-10-15T17:43:49.291886] [INFO ] [MAIN ] Update Progress: 319/2369 symbols completed. BNY took 25.9s. Estimated remaining: 4h 41m 8s. Rate: 7.3 symbols/min [2025-10-15T17:43:49.986018] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-15T17:43:49.991529] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-09. [2025-10-15T17:43:50.946331] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-15T17:43:50.950514] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-10. [2025-10-15T17:43:51.998190] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-15T17:43:52.002720] [INFO ] [REMOTE ] BOC: Full fetch complete (25942 records). [2025-10-15T17:43:52.002966] [DEBUG] [VALIDATOR ] BOC: Validating primary data. [2025-10-15T17:43:52.421329] [DEBUG] [VALIDATOR ] BOC: All expected trading days are present. [2025-10-15T17:43:52.421425] [DEBUG] [VALIDATOR ] BOC: Primary data validation passed. [2025-10-15T17:43:52.422114] [INFO ] [MAIN ] BOC: Fetched primary data is valid. [2025-10-15T17:43:52.422177] [DEBUG] [LOCAL ] BOC: Saving primary data. [2025-10-15T17:43:52.423043] [DEBUG] [LOCAL ] BOC: Trimmed 25942 records to 18587 (keeping 200 days of data) [2025-10-15T17:43:52.538542] [DEBUG] [LOCAL ] BOC: Primary data saved (18587 records). [2025-10-15T17:43:52.538786] [INFO ] [MAIN ] BOC: Full history saved. [2025-10-15T17:43:52.538902] [INFO ] [MAIN ] Update Progress: 320/2369 symbols completed. BOC took 21.7s. Estimated remaining: 4h 40m 27s. Rate: 7.3 symbols/min [2025-10-15T17:43:53.241569] [INFO ] [MAIN ] BOOT: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:43:53.228871] [INFO ] [MAIN ] BOH: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:43:53.338386] [INFO ] [MAIN ] BOND: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:43:53.377119] [INFO ] [MAIN ] BOE: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:43:53.452466] [DEBUG] [LOCAL ] BOOT: Loaded 39842 existing records from primary storage. [2025-10-15T17:43:53.453866] [DEBUG] [LOCAL ] BOE: Loaded 18298 existing records from primary storage. [2025-10-15T17:43:53.453124] [DEBUG] [LOCAL ] BOH: Loaded 30552 existing records from primary storage. [2025-10-15T17:43:53.464897] [INFO ] [MAIN ] BOH: Loaded 30552 existing records. [2025-10-15T17:43:53.465204] [INFO ] [MAIN ] BOOT: Loaded 39842 existing records. [2025-10-15T17:43:53.465409] [INFO ] [MAIN ] BOE: Loaded 18298 existing records. [2025-10-15T17:43:53.483557] [DEBUG] [LOCAL ] BOND: Loaded 32377 existing records from primary storage. [2025-10-15T17:43:53.617909] [INFO ] [MAIN ] BOND: Loaded 32377 existing records. [2025-10-15T17:43:54.162960] [WARN ] [MAIN ] BOOT: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:43:54.166264] [WARN ] [MAIN ] BOH: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:43:54.205246] [INFO ] [MAIN ] BOH: Wiping existing primary data before full refresh. [2025-10-15T17:43:54.199811] [INFO ] [MAIN ] BOOT: Wiping existing primary data before full refresh. [2025-10-15T17:43:54.215517] [INFO ] [LOCAL ] BOH: Starting deletion of primary data. [2025-10-15T17:43:54.241342] [INFO ] [LOCAL ] BOOT: Starting deletion of primary data. [2025-10-15T17:43:54.276577] [DEBUG] [LOCAL ] BOH: Deleted primary data file. [2025-10-15T17:43:54.285051] [WARN ] [MAIN ] BOE: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:43:54.296457] [DEBUG] [LOCAL ] BOOT: Deleted primary data file. [2025-10-15T17:43:54.297704] [INFO ] [MAIN ] BOH: Starting full primary refresh. [2025-10-15T17:43:54.329361] [INFO ] [MAIN ] BOE: Wiping existing primary data before full refresh. [2025-10-15T17:43:54.319616] [INFO ] [MAIN ] BOOT: Starting full primary refresh. [2025-10-15T17:43:54.329836] [INFO ] [LOCAL ] BOE: Starting deletion of primary data. [2025-10-15T17:43:54.329221] [WARN ] [MAIN ] BOND: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:43:54.424729] [DEBUG] [LOCAL ] BOE: Deleted primary data file. [2025-10-15T17:43:54.457020] [INFO ] [MAIN ] BOND: Wiping existing primary data before full refresh. [2025-10-15T17:43:54.457166] [INFO ] [LOCAL ] BOND: Starting deletion of primary data. [2025-10-15T17:43:54.450218] [INFO ] [MAIN ] BOE: Starting full primary refresh. [2025-10-15T17:43:54.463088] [DEBUG] [LOCAL ] BOND: Deleted primary data file. [2025-10-15T17:43:54.544910] [INFO ] [MAIN ] BOND: Starting full primary refresh. [2025-10-15T17:43:55.728407] [INFO ] [REMOTE ] BOH: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:43:55.865734] [INFO ] [REMOTE ] BOH: Fetching primary data for 2024-12. [2025-10-15T17:43:55.874700] [INFO ] [REMOTE ] BOE: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:43:55.871460] [INFO ] [REMOTE ] BOOT: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:43:55.881639] [INFO ] [REMOTE ] BOE: Fetching primary data for 2024-12. [2025-10-15T17:43:55.882707] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2024-12. [2025-10-15T17:43:55.971047] [INFO ] [REMOTE ] BOND: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:43:55.971671] [INFO ] [REMOTE ] BOND: Fetching primary data for 2024-12. [2025-10-15T17:43:56.846031] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-10-15T17:43:56.851359] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-01. [2025-10-15T17:43:57.006919] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-15T17:43:57.012858] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-01. [2025-10-15T17:43:57.385115] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-15T17:43:57.393464] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-01. [2025-10-15T17:43:57.495119] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-15T17:43:57.503723] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-01. [2025-10-15T17:43:57.832067] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-15T17:43:57.836779] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-02. [2025-10-15T17:43:58.057536] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-15T17:43:58.435485] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-15T17:43:58.460876] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-15T17:43:58.514005] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-02. [2025-10-15T17:43:58.713465] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-15T17:43:59.313978] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-03. [2025-10-15T17:43:59.364713] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-15T17:44:00.114040] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-03. [2025-10-15T17:44:00.127249] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-15T17:44:00.914002] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-04. [2025-10-15T17:44:01.695438] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-15T17:44:01.713956] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-04. [2025-10-15T17:44:01.856888] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-15T17:44:02.514018] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-02. [2025-10-15T17:44:03.149222] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-15T17:44:03.313998] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-05. [2025-10-15T17:44:03.738621] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-15T17:44:04.113999] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-05. [2025-10-15T17:44:04.461172] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-15T17:44:04.844821] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-15T17:44:04.914000] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-06. [2025-10-15T17:44:05.574827] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-15T17:44:05.713998] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-07. [2025-10-15T17:44:06.514009] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-06. [2025-10-15T17:44:06.692339] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-15T17:44:07.314033] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-08. [2025-10-15T17:44:07.586553] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-15T17:44:07.963146] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-10-15T17:44:08.114041] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-09. [2025-10-15T17:44:08.913972] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-03. [2025-10-15T17:44:08.989255] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-15T17:44:09.714029] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-10. [2025-10-15T17:44:10.514017] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-02. [2025-10-15T17:44:10.584984] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-15T17:44:10.763287] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-15T17:44:10.766388] [INFO ] [REMOTE ] BOE: Full fetch complete (26785 records). [2025-10-15T17:44:10.766481] [DEBUG] [VALIDATOR ] BOE: Validating primary data. [2025-10-15T17:44:11.141055] [DEBUG] [VALIDATOR ] BOE: All expected trading days are present. [2025-10-15T17:44:11.141137] [DEBUG] [VALIDATOR ] BOE: Primary data validation passed. [2025-10-15T17:44:11.141670] [INFO ] [MAIN ] BOE: Fetched primary data is valid. [2025-10-15T17:44:11.141734] [DEBUG] [LOCAL ] BOE: Saving primary data. [2025-10-15T17:44:11.142366] [DEBUG] [LOCAL ] BOE: Trimmed 26785 records to 18229 (keeping 200 days of data) [2025-10-15T17:44:11.255004] [DEBUG] [LOCAL ] BOE: Primary data saved (18229 records). [2025-10-15T17:44:11.255169] [INFO ] [MAIN ] BOE: Full history saved. [2025-10-15T17:44:11.255257] [INFO ] [MAIN ] Update Progress: 321/2369 symbols completed. BOE took 18.7s. Estimated remaining: 4h 41m 26s. Rate: 7.3 symbols/min [2025-10-15T17:44:11.319125] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-07. [2025-10-15T17:44:11.426266] [INFO ] [MAIN ] BORR: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:44:11.493037] [DEBUG] [LOCAL ] BORR: Loaded 51146 existing records from primary storage. [2025-10-15T17:44:11.493436] [INFO ] [MAIN ] BORR: Loaded 51146 existing records. [2025-10-15T17:44:11.668962] [WARN ] [MAIN ] BORR: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:44:11.669205] [INFO ] [MAIN ] BORR: Wiping existing primary data before full refresh. [2025-10-15T17:44:11.669252] [INFO ] [LOCAL ] BORR: Starting deletion of primary data. [2025-10-15T17:44:11.670095] [DEBUG] [LOCAL ] BORR: Deleted primary data file. [2025-10-15T17:44:11.670155] [INFO ] [MAIN ] BORR: Starting full primary refresh. [2025-10-15T17:44:12.012950] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-15T17:44:12.071818] [INFO ] [REMOTE ] BORR: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:44:12.113967] [INFO ] [REMOTE ] BORR: Fetching primary data for 2024-12. [2025-10-15T17:44:12.457415] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-15T17:44:12.914043] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-03. [2025-10-15T17:44:13.658327] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-15T17:44:13.713970] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-01. [2025-10-15T17:44:13.819260] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-15T17:44:14.514051] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-04. [2025-10-15T17:44:15.313978] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-04. [2025-10-15T17:44:15.482244] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-15T17:44:15.606109] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-15T17:44:16.114001] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-02. [2025-10-15T17:44:16.633817] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-15T17:44:16.914028] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-05. [2025-10-15T17:44:17.713992] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-08. [2025-10-15T17:44:17.776132] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-15T17:44:18.411070] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-15T17:44:18.514034] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-03. [2025-10-15T17:44:19.107067] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-15T17:44:19.314062] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-05. [2025-10-15T17:44:20.020922] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-15T17:44:20.113962] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-04. [2025-10-15T17:44:20.596269] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-15T17:44:20.914039] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-09. [2025-10-15T17:44:21.664473] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-15T17:44:21.713977] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-05. [2025-10-15T17:44:22.191340] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-15T17:44:22.514002] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-06. [2025-10-15T17:44:23.313971] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-06. [2025-10-15T17:44:23.443017] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-15T17:44:23.568349] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-15T17:44:24.114021] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-10. [2025-10-15T17:44:24.817054] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-15T17:44:24.913955] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-07. [2025-10-15T17:44:25.483512] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-15T17:44:25.489483] [INFO ] [REMOTE ] BOH: Full fetch complete (45129 records). [2025-10-15T17:44:25.489686] [DEBUG] [VALIDATOR ] BOH: Validating primary data. [2025-10-15T17:44:25.719131] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-07. [2025-10-15T17:44:25.875542] [DEBUG] [VALIDATOR ] BOH: All expected trading days are present. [2025-10-15T17:44:25.875619] [DEBUG] [VALIDATOR ] BOH: Primary data validation passed. [2025-10-15T17:44:25.876292] [INFO ] [MAIN ] BOH: Fetched primary data is valid. [2025-10-15T17:44:25.876350] [DEBUG] [LOCAL ] BOH: Saving primary data. [2025-10-15T17:44:25.877305] [DEBUG] [LOCAL ] BOH: Trimmed 45129 records to 30544 (keeping 200 days of data) [2025-10-15T17:44:26.064586] [DEBUG] [LOCAL ] BOH: Primary data saved (30544 records). [2025-10-15T17:44:26.064759] [INFO ] [MAIN ] BOH: Full history saved. [2025-10-15T17:44:26.064849] [INFO ] [MAIN ] Update Progress: 322/2369 symbols completed. BOH took 33.5s. Estimated remaining: 4h 41m 60s. Rate: 7.3 symbols/min [2025-10-15T17:44:26.242093] [INFO ] [MAIN ] BOW: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:44:26.268526] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-15T17:44:26.297252] [DEBUG] [LOCAL ] BOW: Loaded 23426 existing records from primary storage. [2025-10-15T17:44:26.297686] [INFO ] [MAIN ] BOW: Loaded 23426 existing records. [2025-10-15T17:44:26.472607] [WARN ] [MAIN ] BOW: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:44:26.472863] [INFO ] [MAIN ] BOW: Wiping existing primary data before full refresh. [2025-10-15T17:44:26.472912] [INFO ] [LOCAL ] BOW: Starting deletion of primary data. [2025-10-15T17:44:26.473181] [DEBUG] [LOCAL ] BOW: Deleted primary data file. [2025-10-15T17:44:26.473220] [INFO ] [MAIN ] BOW: Starting full primary refresh. [2025-10-15T17:44:26.519162] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-06. [2025-10-15T17:44:26.831897] [INFO ] [REMOTE ] BOW: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:44:26.870853] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-15T17:44:27.314079] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-08. [2025-10-15T17:44:28.113970] [INFO ] [REMOTE ] BOW: Fetching primary data for 2024-12. [2025-10-15T17:44:28.145683] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-15T17:44:28.324975] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-15T17:44:28.914039] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-09. [2025-10-15T17:44:29.396042] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-15T17:44:29.714031] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-01. [2025-10-15T17:44:30.176279] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-15T17:44:30.387938] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-15T17:44:30.514011] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-02. [2025-10-15T17:44:31.313996] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-07. [2025-10-15T17:44:31.355470] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-15T17:44:32.114052] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-08. [2025-10-15T17:44:32.914028] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-10. [2025-10-15T17:44:33.168664] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-15T17:44:33.234220] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-15T17:44:33.713978] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-03. [2025-10-15T17:44:34.159593] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-15T17:44:34.164115] [INFO ] [REMOTE ] BOOT: Full fetch complete (60086 records). [2025-10-15T17:44:34.164241] [DEBUG] [VALIDATOR ] BOOT: Validating primary data. [2025-10-15T17:44:34.523414] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-08. [2025-10-15T17:44:34.562487] [DEBUG] [VALIDATOR ] BOOT: All expected trading days are present. [2025-10-15T17:44:34.562624] [DEBUG] [VALIDATOR ] BOOT: Primary data validation passed. [2025-10-15T17:44:34.563627] [INFO ] [MAIN ] BOOT: Fetched primary data is valid. [2025-10-15T17:44:34.563727] [DEBUG] [LOCAL ] BOOT: Saving primary data. [2025-10-15T17:44:34.565343] [DEBUG] [LOCAL ] BOOT: Trimmed 60086 records to 39827 (keeping 200 days of data) [2025-10-15T17:44:34.808092] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-15T17:44:34.846288] [DEBUG] [LOCAL ] BOOT: Primary data saved (39827 records). [2025-10-15T17:44:34.846469] [INFO ] [MAIN ] BOOT: Full history saved. [2025-10-15T17:44:34.846927] [INFO ] [MAIN ] Update Progress: 323/2369 symbols completed. BOOT took 42.3s. Estimated remaining: 4h 41m 55s. Rate: 7.3 symbols/min [2025-10-15T17:44:35.020826] [INFO ] [MAIN ] BOX: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:44:35.021016] [DEBUG] [LOCAL ] BOX: No existing data file found in primary storage. [2025-10-15T17:44:35.021053] [WARN ] [MAIN ] BOX: No existing data found, performing full refresh instead. [2025-10-15T17:44:35.021163] [INFO ] [MAIN ] BOX: Wiping existing primary data before full refresh. [2025-10-15T17:44:35.021208] [INFO ] [LOCAL ] BOX: Starting deletion of primary data. [2025-10-15T17:44:35.021264] [DEBUG] [LOCAL ] BOX: No primary data file found to delete. [2025-10-15T17:44:35.021299] [INFO ] [MAIN ] BOX: Starting full primary refresh. [2025-10-15T17:44:35.319141] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-04. [2025-10-15T17:44:35.391154] [INFO ] [REMOTE ] BOX: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:44:36.082780] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-15T17:44:36.113984] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-09. [2025-10-15T17:44:36.476681] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-15T17:44:36.914022] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-05. [2025-10-15T17:44:37.713975] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-09. [2025-10-15T17:44:37.759677] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-15T17:44:37.796544] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-15T17:44:38.514021] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-06. [2025-10-15T17:44:38.783350] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-15T17:44:39.313974] [INFO ] [REMOTE ] BOX: Fetching primary data for 2024-12. [2025-10-15T17:44:39.402920] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-15T17:44:40.114008] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-07. [2025-10-15T17:44:40.913980] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-10. [2025-10-15T17:44:41.068610] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-15T17:44:41.149941] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-15T17:44:41.714181] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-10. [2025-10-15T17:44:42.047389] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-15T17:44:42.051704] [INFO ] [REMOTE ] BOND: Full fetch complete (46594 records). [2025-10-15T17:44:42.051800] [DEBUG] [VALIDATOR ] BOND: Validating primary data. [2025-10-15T17:44:42.438109] [DEBUG] [VALIDATOR ] BOND: All expected trading days are present. [2025-10-15T17:44:42.438194] [DEBUG] [VALIDATOR ] BOND: Primary data validation passed. [2025-10-15T17:44:42.438919] [INFO ] [MAIN ] BOND: Fetched primary data is valid. [2025-10-15T17:44:42.438987] [DEBUG] [LOCAL ] BOND: Saving primary data. [2025-10-15T17:44:42.440109] [DEBUG] [LOCAL ] BOND: Trimmed 46594 records to 32426 (keeping 200 days of data) [2025-10-15T17:44:42.534271] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-01. [2025-10-15T17:44:42.648148] [DEBUG] [LOCAL ] BOND: Primary data saved (32426 records). [2025-10-15T17:44:42.648306] [INFO ] [MAIN ] BOND: Full history saved. [2025-10-15T17:44:42.648413] [INFO ] [MAIN ] Update Progress: 324/2369 symbols completed. BOND took 50.1s. Estimated remaining: 4h 41m 44s. Rate: 7.3 symbols/min [2025-10-15T17:44:42.825306] [INFO ] [MAIN ] BP: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:44:42.884355] [DEBUG] [LOCAL ] BP: Loaded 53708 existing records from primary storage. [2025-10-15T17:44:42.884774] [INFO ] [MAIN ] BP: Loaded 53708 existing records. [2025-10-15T17:44:43.080456] [WARN ] [MAIN ] BP: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:44:43.080752] [INFO ] [MAIN ] BP: Wiping existing primary data before full refresh. [2025-10-15T17:44:43.080809] [INFO ] [LOCAL ] BP: Starting deletion of primary data. [2025-10-15T17:44:43.081988] [DEBUG] [LOCAL ] BP: Deleted primary data file. [2025-10-15T17:44:43.082051] [INFO ] [MAIN ] BP: Starting full primary refresh. [2025-10-15T17:44:43.323142] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-08. [2025-10-15T17:44:43.476445] [INFO ] [REMOTE ] BP: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:44:43.746679] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-10 (2.03 seconds). [2025-10-15T17:44:43.752317] [INFO ] [REMOTE ] BORR: Full fetch complete (74299 records). [2025-10-15T17:44:43.752451] [DEBUG] [VALIDATOR ] BORR: Validating primary data. [2025-10-15T17:44:43.753125] [FATAL] [VALIDATOR ] BORR: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T17:44:43.753210] [FATAL] [MAIN ] BORR: Fetched primary data is invalid. Refusing to save it. [2025-10-15T17:44:43.753252] [WARN ] [MAIN ] BORR: Deleting existing primary and derivative data due to validation failure. [2025-10-15T17:44:43.753292] [INFO ] [LOCAL ] BORR: Starting deletion of primary data. [2025-10-15T17:44:43.753348] [DEBUG] [LOCAL ] BORR: No primary data file found to delete. [2025-10-15T17:44:43.753382] [INFO ] [LOCAL ] BORR: Starting deletion of derivative data. [2025-10-15T17:44:43.753563] [DEBUG] [LOCAL ] BORR: Deleted derivative data file. [2025-10-15T17:44:43.753677] [INFO ] [MAIN ] Update Progress: 325/2369 symbols completed. BORR took 32.5s. Estimated remaining: 4h 40m 50s. Rate: 7.3 symbols/min [2025-10-15T17:44:43.935408] [INFO ] [MAIN ] BR: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:44:43.971157] [DEBUG] [LOCAL ] BR: Loaded 34787 existing records from primary storage. [2025-10-15T17:44:43.971451] [INFO ] [MAIN ] BR: Loaded 34787 existing records. [2025-10-15T17:44:44.127959] [INFO ] [REMOTE ] BP: Fetching primary data for 2024-12. [2025-10-15T17:44:44.171289] [WARN ] [MAIN ] BR: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:44:44.171953] [INFO ] [MAIN ] BR: Wiping existing primary data before full refresh. [2025-10-15T17:44:44.172021] [INFO ] [LOCAL ] BR: Starting deletion of primary data. [2025-10-15T17:44:44.182752] [DEBUG] [LOCAL ] BR: Deleted primary data file. [2025-10-15T17:44:44.206898] [INFO ] [MAIN ] BR: Starting full primary refresh. [2025-10-15T17:44:44.260480] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-15T17:44:44.401559] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-15T17:44:44.614985] [INFO ] [REMOTE ] BR: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:44:44.914008] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-09. [2025-10-15T17:44:45.714011] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-02. [2025-10-15T17:44:45.746233] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-15T17:44:46.305444] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2024-12 (2.18 seconds). [2025-10-15T17:44:46.514010] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-01. [2025-10-15T17:44:47.056932] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-15T17:44:47.314007] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-03. [2025-10-15T17:44:48.114064] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-10. [2025-10-15T17:44:48.557973] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-01 (2.04 seconds). [2025-10-15T17:44:48.650885] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-15T17:44:48.914044] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-04. [2025-10-15T17:44:49.367987] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-15T17:44:49.372492] [INFO ] [REMOTE ] BOW: Full fetch complete (32121 records). [2025-10-15T17:44:49.372620] [DEBUG] [VALIDATOR ] BOW: Validating primary data. [2025-10-15T17:44:49.722913] [INFO ] [REMOTE ] BR: Fetching primary data for 2024-12. [2025-10-15T17:44:49.910799] [DEBUG] [VALIDATOR ] BOW: All expected trading days are present. [2025-10-15T17:44:49.910935] [DEBUG] [VALIDATOR ] BOW: Primary data validation passed. [2025-10-15T17:44:49.911883] [INFO ] [MAIN ] BOW: Fetched primary data is valid. [2025-10-15T17:44:49.911957] [DEBUG] [LOCAL ] BOW: Saving primary data. [2025-10-15T17:44:49.913311] [DEBUG] [LOCAL ] BOW: Trimmed 32121 records to 23268 (keeping 200 days of data) [2025-10-15T17:44:50.114422] [DEBUG] [LOCAL ] BOW: Primary data saved (23268 records). [2025-10-15T17:44:50.114691] [INFO ] [MAIN ] BOW: Full history saved. [2025-10-15T17:44:50.114949] [INFO ] [MAIN ] Update Progress: 326/2369 symbols completed. BOW took 24.0s. Estimated remaining: 4h 40m 30s. Rate: 7.3 symbols/min [2025-10-15T17:44:50.330877] [INFO ] [MAIN ] BRBR: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:44:50.331127] [DEBUG] [LOCAL ] BRBR: No existing data file found in primary storage. [2025-10-15T17:44:50.331169] [WARN ] [MAIN ] BRBR: No existing data found, performing full refresh instead. [2025-10-15T17:44:50.331349] [INFO ] [MAIN ] BRBR: Wiping existing primary data before full refresh. [2025-10-15T17:44:50.331391] [INFO ] [LOCAL ] BRBR: Starting deletion of primary data. [2025-10-15T17:44:50.331434] [DEBUG] [LOCAL ] BRBR: No primary data file found to delete. [2025-10-15T17:44:50.331467] [INFO ] [MAIN ] BRBR: Starting full primary refresh. [2025-10-15T17:44:50.537613] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-02. [2025-10-15T17:44:50.752710] [INFO ] [REMOTE ] BRBR: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:44:50.786792] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-15T17:44:50.957482] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-10-15T17:44:51.314048] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-05. [2025-10-15T17:44:52.114004] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-01. [2025-10-15T17:44:52.221001] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-15T17:44:52.792901] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-15T17:44:52.913983] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-06. [2025-10-15T17:44:53.364724] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-15T17:44:53.714027] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-03. [2025-10-15T17:44:54.383378] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-15T17:44:54.514035] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2024-12. [2025-10-15T17:44:55.314017] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-07. [2025-10-15T17:44:55.534009] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-15T17:44:55.742869] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-10-15T17:44:56.114034] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-02. [2025-10-15T17:44:56.919222] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-04. [2025-10-15T17:44:56.947740] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-15T17:44:57.166726] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-15T17:44:57.714101] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-01. [2025-10-15T17:44:58.514060] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-03. [2025-10-15T17:44:59.024399] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-15T17:44:59.073237] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-04 (2.15 seconds). [2025-10-15T17:44:59.314037] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-02. [2025-10-15T17:44:59.971953] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-15T17:45:00.114057] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-05. [2025-10-15T17:45:00.582430] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-15T17:45:00.913983] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-04. [2025-10-15T17:45:01.714062] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-03. [2025-10-15T17:45:02.509963] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-05 (2.40 seconds). [2025-10-15T17:45:02.521059] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-08. [2025-10-15T17:45:03.024274] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-10-15T17:45:03.314006] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-06. [2025-10-15T17:45:03.569733] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-15T17:45:04.114011] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-04. [2025-10-15T17:45:04.715732] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-08 (2.19 seconds). [2025-10-15T17:45:04.914024] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-09. [2025-10-15T17:45:05.285270] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-10-15T17:45:05.714002] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-05. [2025-10-15T17:45:06.334543] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-04 (2.22 seconds). [2025-10-15T17:45:06.514045] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-07. [2025-10-15T17:45:06.690057] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-15T17:45:07.187979] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-15T17:45:07.314038] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-06. [2025-10-15T17:45:08.114013] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-10. [2025-10-15T17:45:08.232143] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-15T17:45:08.777444] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-07 (2.26 seconds). [2025-10-15T17:45:08.913991] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-07. [2025-10-15T17:45:09.714003] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-08. [2025-10-15T17:45:09.794954] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-15T17:45:09.801078] [INFO ] [REMOTE ] BOX: Full fetch complete (72285 records). [2025-10-15T17:45:09.801273] [DEBUG] [VALIDATOR ] BOX: Validating primary data. [2025-10-15T17:45:10.270176] [DEBUG] [VALIDATOR ] BOX: All expected trading days are present. [2025-10-15T17:45:10.270283] [DEBUG] [VALIDATOR ] BOX: Primary data validation passed. [2025-10-15T17:45:10.271168] [INFO ] [MAIN ] BOX: Fetched primary data is valid. [2025-10-15T17:45:10.271248] [DEBUG] [LOCAL ] BOX: Saving primary data. [2025-10-15T17:45:10.272865] [DEBUG] [LOCAL ] BOX: Trimmed 72285 records to 50190 (keeping 200 days of data) [2025-10-15T17:45:10.382721] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-15T17:45:10.515720] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-05. [2025-10-15T17:45:10.594039] [DEBUG] [LOCAL ] BOX: Primary data saved (50190 records). [2025-10-15T17:45:10.594165] [INFO ] [MAIN ] BOX: Full history saved. [2025-10-15T17:45:10.594269] [INFO ] [MAIN ] Update Progress: 327/2369 symbols completed. BOX took 35.7s. Estimated remaining: 4h 41m 38s. Rate: 7.3 symbols/min [2025-10-15T17:45:10.767739] [INFO ] [MAIN ] BRC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:45:10.793072] [DEBUG] [LOCAL ] BRC: Loaded 18597 existing records from primary storage. [2025-10-15T17:45:10.793381] [INFO ] [MAIN ] BRC: Loaded 18597 existing records. [2025-10-15T17:45:10.983557] [WARN ] [MAIN ] BRC: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:45:10.983804] [INFO ] [MAIN ] BRC: Wiping existing primary data before full refresh. [2025-10-15T17:45:10.983853] [INFO ] [LOCAL ] BRC: Starting deletion of primary data. [2025-10-15T17:45:10.984379] [DEBUG] [LOCAL ] BRC: Deleted primary data file. [2025-10-15T17:45:10.984437] [INFO ] [MAIN ] BRC: Starting full primary refresh. [2025-10-15T17:45:11.315843] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-08. [2025-10-15T17:45:11.337624] [INFO ] [REMOTE ] BRC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:45:11.899721] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-08 (2.19 seconds). [2025-10-15T17:45:12.117622] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-09. [2025-10-15T17:45:12.124312] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-15T17:45:12.363348] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-15T17:45:12.914061] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-06. [2025-10-15T17:45:13.714068] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-09. [2025-10-15T17:45:14.351031] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-15T17:45:14.399470] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-09 (2.28 seconds). [2025-10-15T17:45:14.514051] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-07. [2025-10-15T17:45:14.895871] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-15T17:45:15.314010] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-10. [2025-10-15T17:45:15.914624] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-15T17:45:16.113997] [INFO ] [REMOTE ] BRC: Fetching primary data for 2024-12. [2025-10-15T17:45:16.914169] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-08. [2025-10-15T17:45:16.916747] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-15T17:45:16.922731] [INFO ] [REMOTE ] BR: Full fetch complete (49863 records). [2025-10-15T17:45:16.922832] [DEBUG] [VALIDATOR ] BR: Validating primary data. [2025-10-15T17:45:17.355695] [DEBUG] [VALIDATOR ] BR: All expected trading days are present. [2025-10-15T17:45:17.355953] [DEBUG] [VALIDATOR ] BR: Primary data validation passed. [2025-10-15T17:45:17.369582] [INFO ] [MAIN ] BR: Fetched primary data is valid. [2025-10-15T17:45:17.370995] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-15T17:45:17.376450] [DEBUG] [LOCAL ] BR: Saving primary data. [2025-10-15T17:45:17.377771] [DEBUG] [LOCAL ] BR: Trimmed 49863 records to 34787 (keeping 200 days of data) [2025-10-15T17:45:17.614899] [DEBUG] [LOCAL ] BR: Primary data saved (34787 records). [2025-10-15T17:45:17.615069] [INFO ] [MAIN ] BR: Full history saved. [2025-10-15T17:45:17.615162] [INFO ] [MAIN ] Update Progress: 328/2369 symbols completed. BR took 33.9s. Estimated remaining: 4h 41m 22s. Rate: 7.3 symbols/min [2025-10-15T17:45:17.714132] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-10. [2025-10-15T17:45:17.783506] [INFO ] [MAIN ] BRCC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:45:17.783709] [DEBUG] [LOCAL ] BRCC: No existing data file found in primary storage. [2025-10-15T17:45:17.783759] [WARN ] [MAIN ] BRCC: No existing data found, performing full refresh instead. [2025-10-15T17:45:17.783865] [INFO ] [MAIN ] BRCC: Wiping existing primary data before full refresh. [2025-10-15T17:45:17.783907] [INFO ] [LOCAL ] BRCC: Starting deletion of primary data. [2025-10-15T17:45:17.783947] [DEBUG] [LOCAL ] BRCC: No primary data file found to delete. [2025-10-15T17:45:17.783978] [INFO ] [MAIN ] BRCC: Starting full primary refresh. [2025-10-15T17:45:18.127071] [INFO ] [REMOTE ] BRCC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:45:18.441854] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-15T17:45:18.513969] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-09. [2025-10-15T17:45:19.314071] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-01. [2025-10-15T17:45:19.956573] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-10 (2.24 seconds). [2025-10-15T17:45:19.962874] [INFO ] [REMOTE ] BP: Full fetch complete (77492 records). [2025-10-15T17:45:19.963068] [DEBUG] [VALIDATOR ] BP: Validating primary data. [2025-10-15T17:45:19.963919] [FATAL] [VALIDATOR ] BP: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T17:45:19.964028] [FATAL] [MAIN ] BP: Fetched primary data is invalid. Refusing to save it. [2025-10-15T17:45:19.964108] [WARN ] [MAIN ] BP: Deleting existing primary and derivative data due to validation failure. [2025-10-15T17:45:19.964190] [INFO ] [LOCAL ] BP: Starting deletion of primary data. [2025-10-15T17:45:19.964264] [DEBUG] [LOCAL ] BP: No primary data file found to delete. [2025-10-15T17:45:19.964301] [INFO ] [LOCAL ] BP: Starting deletion of derivative data. [2025-10-15T17:45:19.964468] [DEBUG] [LOCAL ] BP: Deleted derivative data file. [2025-10-15T17:45:19.964559] [INFO ] [MAIN ] Update Progress: 329/2369 symbols completed. BP took 37.3s. Estimated remaining: 4h 40m 37s. Rate: 7.3 symbols/min [2025-10-15T17:45:20.114577] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2024-12. [2025-10-15T17:45:20.149970] [INFO ] [MAIN ] BRO: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:45:20.150279] [DEBUG] [LOCAL ] BRO: No existing data file found in primary storage. [2025-10-15T17:45:20.150438] [WARN ] [MAIN ] BRO: No existing data found, performing full refresh instead. [2025-10-15T17:45:20.150774] [INFO ] [MAIN ] BRO: Wiping existing primary data before full refresh. [2025-10-15T17:45:20.150894] [INFO ] [LOCAL ] BRO: Starting deletion of primary data. [2025-10-15T17:45:20.150951] [DEBUG] [LOCAL ] BRO: No primary data file found to delete. [2025-10-15T17:45:20.150985] [INFO ] [MAIN ] BRO: Starting full primary refresh. [2025-10-15T17:45:20.479422] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-10-15T17:45:20.577678] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-15T17:45:20.581968] [INFO ] [REMOTE ] BRO: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:45:20.914002] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-02. [2025-10-15T17:45:21.560327] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-15T17:45:21.584475] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-15T17:45:21.713965] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-03. [2025-10-15T17:45:22.513993] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-10. [2025-10-15T17:45:22.869619] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-15T17:45:23.314056] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-04. [2025-10-15T17:45:24.114007] [INFO ] [REMOTE ] BRO: Fetching primary data for 2024-12. [2025-10-15T17:45:24.158366] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-15T17:45:24.165304] [INFO ] [REMOTE ] BRBR: Full fetch complete (72810 records). [2025-10-15T17:45:24.165488] [DEBUG] [VALIDATOR ] BRBR: Validating primary data. [2025-10-15T17:45:24.585394] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-15T17:45:24.585738] [DEBUG] [VALIDATOR ] BRBR: All expected trading days are present. [2025-10-15T17:45:24.591177] [DEBUG] [VALIDATOR ] BRBR: Primary data validation passed. [2025-10-15T17:45:24.592618] [INFO ] [MAIN ] BRBR: Fetched primary data is valid. [2025-10-15T17:45:24.592894] [DEBUG] [LOCAL ] BRBR: Saving primary data. [2025-10-15T17:45:24.594738] [DEBUG] [LOCAL ] BRBR: Trimmed 72810 records to 51693 (keeping 200 days of data) [2025-10-15T17:45:24.888106] [DEBUG] [LOCAL ] BRBR: Primary data saved (51693 records). [2025-10-15T17:45:24.888253] [INFO ] [MAIN ] BRBR: Full history saved. [2025-10-15T17:45:24.888324] [INFO ] [MAIN ] Update Progress: 330/2369 symbols completed. BRBR took 34.8s. Estimated remaining: 4h 40m 9s. Rate: 7.3 symbols/min [2025-10-15T17:45:24.920845] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-01. [2025-10-15T17:45:25.064699] [INFO ] [MAIN ] BROS: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:45:25.121621] [DEBUG] [LOCAL ] BROS: Loaded 53300 existing records from primary storage. [2025-10-15T17:45:25.122020] [INFO ] [MAIN ] BROS: Loaded 53300 existing records. [2025-10-15T17:45:25.317746] [WARN ] [MAIN ] BROS: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:45:25.317994] [INFO ] [MAIN ] BROS: Wiping existing primary data before full refresh. [2025-10-15T17:45:25.318043] [INFO ] [LOCAL ] BROS: Starting deletion of primary data. [2025-10-15T17:45:25.318552] [DEBUG] [LOCAL ] BROS: Deleted primary data file. [2025-10-15T17:45:25.318608] [INFO ] [MAIN ] BROS: Starting full primary refresh. [2025-10-15T17:45:25.693820] [INFO ] [REMOTE ] BROS: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:45:25.719191] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-05. [2025-10-15T17:45:25.733693] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-15T17:45:26.140194] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-15T17:45:26.410112] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-15T17:45:26.513977] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-06. [2025-10-15T17:45:27.314031] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-01. [2025-10-15T17:45:27.623235] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-15T17:45:28.114011] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-07. [2025-10-15T17:45:28.913986] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-02. [2025-10-15T17:45:29.003926] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-15T17:45:29.111449] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-15T17:45:29.714023] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-08. [2025-10-15T17:45:29.994218] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-15T17:45:30.376029] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-15T17:45:30.514015] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-09. [2025-10-15T17:45:31.313984] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-03. [2025-10-15T17:45:31.423804] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-15T17:45:32.114047] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-02. [2025-10-15T17:45:32.899379] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-15T17:45:32.913962] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-04. [2025-10-15T17:45:33.714051] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-10. [2025-10-15T17:45:33.770242] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-15T17:45:34.066430] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-15T17:45:34.487979] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-15T17:45:34.490845] [INFO ] [REMOTE ] BRC: Full fetch complete (28430 records). [2025-10-15T17:45:34.491023] [DEBUG] [VALIDATOR ] BRC: Validating primary data. [2025-10-15T17:45:34.519155] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-05. [2025-10-15T17:45:34.875658] [DEBUG] [VALIDATOR ] BRC: All expected trading days are present. [2025-10-15T17:45:34.875757] [DEBUG] [VALIDATOR ] BRC: Primary data validation passed. [2025-10-15T17:45:34.876261] [INFO ] [MAIN ] BRC: Fetched primary data is valid. [2025-10-15T17:45:34.876301] [DEBUG] [LOCAL ] BRC: Saving primary data. [2025-10-15T17:45:34.877128] [DEBUG] [LOCAL ] BRC: Trimmed 28430 records to 18601 (keeping 200 days of data) [2025-10-15T17:45:34.996737] [DEBUG] [LOCAL ] BRC: Primary data saved (18601 records). [2025-10-15T17:45:34.996944] [INFO ] [MAIN ] BRC: Full history saved. [2025-10-15T17:45:34.997075] [INFO ] [MAIN ] Update Progress: 331/2369 symbols completed. BRC took 24.4s. Estimated remaining: 4h 40m 12s. Rate: 7.3 symbols/min [2025-10-15T17:45:35.163695] [INFO ] [MAIN ] BRSL: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:45:35.163925] [DEBUG] [LOCAL ] BRSL: No existing data file found in primary storage. [2025-10-15T17:45:35.163982] [WARN ] [MAIN ] BRSL: No existing data found, performing full refresh instead. [2025-10-15T17:45:35.164099] [INFO ] [MAIN ] BRSL: Wiping existing primary data before full refresh. [2025-10-15T17:45:35.164153] [INFO ] [LOCAL ] BRSL: Starting deletion of primary data. [2025-10-15T17:45:35.164220] [DEBUG] [LOCAL ] BRSL: No primary data file found to delete. [2025-10-15T17:45:35.164254] [INFO ] [MAIN ] BRSL: Starting full primary refresh. [2025-10-15T17:45:35.334597] [INFO ] [REMOTE ] BROS: Fetching primary data for 2024-12. [2025-10-15T17:45:35.565687] [INFO ] [REMOTE ] BRSL: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:45:36.099922] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-15T17:45:36.113941] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-06. [2025-10-15T17:45:36.913974] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-03. [2025-10-15T17:45:37.145859] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-15T17:45:37.579786] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-15T17:45:37.714034] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-07. [2025-10-15T17:45:38.485676] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-15T17:45:38.514033] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-04. [2025-10-15T17:45:39.324161] [INFO ] [REMOTE ] BRSL: Fetching primary data for 2024-12. [2025-10-15T17:45:39.329350] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-15T17:45:39.580484] [DEBUG] [REMOTE ] BRSL: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-15T17:45:39.580897] [WARN ] [REMOTE ] BRSL: No data returned for month 2024-12 [2025-10-15T17:45:39.580989] [FATAL] [REMOTE ] BRSL: API call failed - aborting fetch to avoid wasting further API calls [2025-10-15T17:45:39.581035] [FATAL] [MAIN ] BRSL: Failed to fetch primary data. [2025-10-15T17:45:39.581092] [WARN ] [MAIN ] BRSL: Deleting existing primary and derivative data due to fetch failure. [2025-10-15T17:45:39.581181] [INFO ] [LOCAL ] BRSL: Starting deletion of primary data. [2025-10-15T17:45:39.581260] [DEBUG] [LOCAL ] BRSL: No primary data file found to delete. [2025-10-15T17:45:39.581296] [INFO ] [LOCAL ] BRSL: Starting deletion of derivative data. [2025-10-15T17:45:39.581336] [DEBUG] [LOCAL ] BRSL: No derivative data file found to delete. [2025-10-15T17:45:39.581380] [INFO ] [MAIN ] Update Progress: 332/2369 symbols completed. BRSL took 4.6s. Estimated remaining: 4h 39m 41s. Rate: 7.3 symbols/min [2025-10-15T17:45:39.757115] [INFO ] [MAIN ] BRSP: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:45:39.789966] [DEBUG] [LOCAL ] BRSP: Loaded 36881 existing records from primary storage. [2025-10-15T17:45:39.790253] [INFO ] [MAIN ] BRSP: Loaded 36881 existing records. [2025-10-15T17:45:39.967712] [WARN ] [MAIN ] BRSP: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:45:39.967981] [INFO ] [MAIN ] BRSP: Wiping existing primary data before full refresh. [2025-10-15T17:45:39.968119] [INFO ] [LOCAL ] BRSP: Starting deletion of primary data. [2025-10-15T17:45:39.968940] [DEBUG] [LOCAL ] BRSP: Deleted primary data file. [2025-10-15T17:45:39.968999] [INFO ] [MAIN ] BRSP: Starting full primary refresh. [2025-10-15T17:45:40.115294] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-01. [2025-10-15T17:45:40.350360] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-15T17:45:40.354769] [INFO ] [REMOTE ] BRSP: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:45:40.913998] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-08. [2025-10-15T17:45:41.714078] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-05. [2025-10-15T17:45:42.225806] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-01 (2.11 seconds). [2025-10-15T17:45:42.291977] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-15T17:45:42.514090] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-09. [2025-10-15T17:45:43.255245] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-15T17:45:43.314068] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-06. [2025-10-15T17:45:44.115201] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-02. [2025-10-15T17:45:44.115095] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-15T17:45:44.913975] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-10. [2025-10-15T17:45:45.080371] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-15T17:45:45.714076] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2024-12. [2025-10-15T17:45:45.805353] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-15T17:45:46.376284] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-15T17:45:46.381425] [INFO ] [REMOTE ] BRCC: Full fetch complete (57499 records). [2025-10-15T17:45:46.381561] [DEBUG] [VALIDATOR ] BRCC: Validating primary data. [2025-10-15T17:45:46.519204] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-07. [2025-10-15T17:45:46.793320] [DEBUG] [VALIDATOR ] BRCC: All expected trading days are present. [2025-10-15T17:45:46.793433] [DEBUG] [VALIDATOR ] BRCC: Primary data validation passed. [2025-10-15T17:45:46.794772] [INFO ] [MAIN ] BRCC: Fetched primary data is valid. [2025-10-15T17:45:46.794841] [DEBUG] [LOCAL ] BRCC: Saving primary data. [2025-10-15T17:45:46.796615] [DEBUG] [LOCAL ] BRCC: Trimmed 57499 records to 40208 (keeping 200 days of data) [2025-10-15T17:45:47.052789] [DEBUG] [LOCAL ] BRCC: Primary data saved (40208 records). [2025-10-15T17:45:47.052954] [INFO ] [MAIN ] BRCC: Full history saved. [2025-10-15T17:45:47.053043] [INFO ] [MAIN ] Update Progress: 333/2369 symbols completed. BRCC took 29.4s. Estimated remaining: 4h 39m 28s. Rate: 7.3 symbols/min [2025-10-15T17:45:47.244727] [INFO ] [MAIN ] BRT: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:45:47.253790] [DEBUG] [LOCAL ] BRT: No existing data file found in primary storage. [2025-10-15T17:45:47.259114] [WARN ] [MAIN ] BRT: No existing data found, performing full refresh instead. [2025-10-15T17:45:47.270350] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-15T17:45:47.268750] [INFO ] [MAIN ] BRT: Wiping existing primary data before full refresh. [2025-10-15T17:45:47.278806] [INFO ] [LOCAL ] BRT: Starting deletion of primary data. [2025-10-15T17:45:47.278927] [DEBUG] [LOCAL ] BRT: No primary data file found to delete. [2025-10-15T17:45:47.278978] [INFO ] [MAIN ] BRT: Starting full primary refresh. [2025-10-15T17:45:47.319192] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-03. [2025-10-15T17:45:47.676718] [INFO ] [REMOTE ] BRT: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:45:48.114058] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-01. [2025-10-15T17:45:48.395140] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-15T17:45:48.914007] [INFO ] [REMOTE ] BRT: Fetching primary data for 2024-12. [2025-10-15T17:45:49.124403] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-15T17:45:49.455242] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-03 (2.14 seconds). [2025-10-15T17:45:49.715753] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-08. [2025-10-15T17:45:49.716710] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-10-15T17:45:50.514019] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-01. [2025-10-15T17:45:51.123070] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-15T17:45:51.314021] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-02. [2025-10-15T17:45:51.393446] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-15T17:45:52.114049] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-02. [2025-10-15T17:45:52.530001] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-10-15T17:45:52.532983] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-15T17:45:52.914012] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-03. [2025-10-15T17:45:53.447283] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-10-15T17:45:53.714018] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-04. [2025-10-15T17:45:54.514044] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-04. [2025-10-15T17:45:55.148041] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-10-15T17:45:55.313969] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-09. [2025-10-15T17:45:55.510378] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-15T17:45:56.114007] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-05. [2025-10-15T17:45:56.919154] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-05. [2025-10-15T17:45:56.941161] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-15T17:45:57.415075] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-10-15T17:45:57.714013] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-10. [2025-10-15T17:45:58.161740] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-10-15T17:45:58.514018] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-06. [2025-10-15T17:45:59.314047] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-03. [2025-10-15T17:45:59.511859] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-15T17:45:59.518720] [INFO ] [REMOTE ] BRO: Full fetch complete (74788 records). [2025-10-15T17:45:59.518855] [DEBUG] [VALIDATOR ] BRO: Validating primary data. [2025-10-15T17:45:59.906424] [DEBUG] [VALIDATOR ] BRO: All expected trading days are present. [2025-10-15T17:45:59.906530] [DEBUG] [VALIDATOR ] BRO: Primary data validation passed. [2025-10-15T17:45:59.907464] [INFO ] [MAIN ] BRO: Fetched primary data is valid. [2025-10-15T17:45:59.907543] [DEBUG] [LOCAL ] BRO: Saving primary data. [2025-10-15T17:45:59.909230] [DEBUG] [LOCAL ] BRO: Trimmed 74788 records to 52061 (keeping 200 days of data) [2025-10-15T17:46:00.132321] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-06. [2025-10-15T17:46:00.241622] [DEBUG] [LOCAL ] BRO: Primary data saved (52061 records). [2025-10-15T17:46:00.241809] [INFO ] [MAIN ] BRO: Full history saved. [2025-10-15T17:46:00.241886] [INFO ] [MAIN ] Update Progress: 334/2369 symbols completed. BRO took 40.3s. Estimated remaining: 4h 39m 50s. Rate: 7.3 symbols/min [2025-10-15T17:46:00.409095] [INFO ] [MAIN ] BRW: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:46:00.428207] [DEBUG] [LOCAL ] BRW: Loaded 21043 existing records from primary storage. [2025-10-15T17:46:00.428500] [INFO ] [MAIN ] BRW: Loaded 21043 existing records. [2025-10-15T17:46:00.606316] [WARN ] [MAIN ] BRW: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:46:00.606701] [INFO ] [MAIN ] BRW: Wiping existing primary data before full refresh. [2025-10-15T17:46:00.606761] [INFO ] [LOCAL ] BRW: Starting deletion of primary data. [2025-10-15T17:46:00.607319] [DEBUG] [LOCAL ] BRW: Deleted primary data file. [2025-10-15T17:46:00.607385] [INFO ] [MAIN ] BRW: Starting full primary refresh. [2025-10-15T17:46:00.765787] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-06 (2.25 seconds). [2025-10-15T17:46:00.918766] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-07. [2025-10-15T17:46:00.975490] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-15T17:46:01.038300] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-15T17:46:01.112720] [INFO ] [REMOTE ] BRW: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:46:01.714027] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-07. [2025-10-15T17:46:02.349386] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-10-15T17:46:02.514021] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-04. [2025-10-15T17:46:02.862888] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-15T17:46:03.313988] [INFO ] [REMOTE ] BRW: Fetching primary data for 2024-12. [2025-10-15T17:46:03.977549] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-15T17:46:04.113989] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-05. [2025-10-15T17:46:04.164427] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-15T17:46:04.914036] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-01. [2025-10-15T17:46:05.261629] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-15T17:46:05.713998] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-08. [2025-10-15T17:46:06.055673] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-15T17:46:06.301733] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-15T17:46:06.513997] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-09. [2025-10-15T17:46:06.997336] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-10-15T17:46:07.314001] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-06. [2025-10-15T17:46:08.113994] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-10. [2025-10-15T17:46:08.654398] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-15T17:46:08.654572] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-15T17:46:08.663616] [INFO ] [REMOTE ] BRT: Full fetch complete (7032 records). [2025-10-15T17:46:08.664034] [DEBUG] [VALIDATOR ] BRT: Validating primary data. [2025-10-15T17:46:08.919112] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-08. [2025-10-15T17:46:09.029831] [DEBUG] [VALIDATOR ] BRT: All expected trading days are present. [2025-10-15T17:46:09.029994] [DEBUG] [VALIDATOR ] BRT: Primary data validation passed. [2025-10-15T17:46:09.030212] [INFO ] [MAIN ] BRT: Fetched primary data is valid. [2025-10-15T17:46:09.030255] [DEBUG] [LOCAL ] BRT: Saving primary data. [2025-10-15T17:46:09.030737] [DEBUG] [LOCAL ] BRT: Trimmed 7032 records to 5222 (keeping 200 days of data) [2025-10-15T17:46:09.062200] [DEBUG] [LOCAL ] BRT: Primary data saved (5222 records). [2025-10-15T17:46:09.062299] [INFO ] [MAIN ] BRT: Full history saved. [2025-10-15T17:46:09.062369] [INFO ] [MAIN ] Update Progress: 335/2369 symbols completed. BRT took 22.0s. Estimated remaining: 4h 39m 45s. Rate: 7.3 symbols/min [2025-10-15T17:46:09.233515] [INFO ] [MAIN ] BRX: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:46:09.279846] [DEBUG] [LOCAL ] BRX: Loaded 51776 existing records from primary storage. [2025-10-15T17:46:09.280225] [INFO ] [MAIN ] BRX: Loaded 51776 existing records. [2025-10-15T17:46:09.459844] [WARN ] [MAIN ] BRX: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:46:09.460130] [INFO ] [MAIN ] BRX: Wiping existing primary data before full refresh. [2025-10-15T17:46:09.460188] [INFO ] [LOCAL ] BRX: Starting deletion of primary data. [2025-10-15T17:46:09.461167] [DEBUG] [LOCAL ] BRX: Deleted primary data file. [2025-10-15T17:46:09.461227] [INFO ] [MAIN ] BRX: Starting full primary refresh. [2025-10-15T17:46:09.719172] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-07. [2025-10-15T17:46:09.819163] [INFO ] [REMOTE ] BRX: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:46:10.514019] [INFO ] [REMOTE ] BRX: Fetching primary data for 2024-12. [2025-10-15T17:46:10.948554] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-10-15T17:46:11.313988] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-02. [2025-10-15T17:46:11.398023] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-15T17:46:12.113964] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-09. [2025-10-15T17:46:12.194675] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-15T17:46:12.247352] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-15T17:46:12.914015] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-03. [2025-10-15T17:46:13.713976] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-08. [2025-10-15T17:46:13.875571] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-15T17:46:14.019212] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-15T17:46:14.514047] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-04. [2025-10-15T17:46:15.039592] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-15T17:46:15.314027] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-01. [2025-10-15T17:46:15.750737] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-15T17:46:16.114076] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-09. [2025-10-15T17:46:16.919220] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-05. [2025-10-15T17:46:16.932811] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-15T17:46:17.471117] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-15T17:46:17.560277] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-15T17:46:17.714015] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-06. [2025-10-15T17:46:18.496400] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-15T17:46:18.513987] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-07. [2025-10-15T17:46:19.314044] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-10. [2025-10-15T17:46:19.647078] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-15T17:46:20.114061] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-08. [2025-10-15T17:46:20.746608] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-15T17:46:20.752337] [INFO ] [REMOTE ] BRSP: Full fetch complete (54378 records). [2025-10-15T17:46:20.752457] [DEBUG] [VALIDATOR ] BRSP: Validating primary data. [2025-10-15T17:46:20.919009] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-10. [2025-10-15T17:46:20.988318] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-15T17:46:21.225320] [DEBUG] [VALIDATOR ] BRSP: All expected trading days are present. [2025-10-15T17:46:21.225422] [DEBUG] [VALIDATOR ] BRSP: Primary data validation passed. [2025-10-15T17:46:21.226310] [INFO ] [MAIN ] BRSP: Fetched primary data is valid. [2025-10-15T17:46:21.226378] [DEBUG] [LOCAL ] BRSP: Saving primary data. [2025-10-15T17:46:21.227748] [DEBUG] [LOCAL ] BRSP: Trimmed 54378 records to 36808 (keeping 200 days of data) [2025-10-15T17:46:21.469024] [DEBUG] [LOCAL ] BRSP: Primary data saved (36808 records). [2025-10-15T17:46:21.469183] [INFO ] [MAIN ] BRSP: Full history saved. [2025-10-15T17:46:21.469475] [INFO ] [MAIN ] Update Progress: 336/2369 symbols completed. BRSP took 41.9s. Estimated remaining: 4h 40m 2s. Rate: 7.3 symbols/min [2025-10-15T17:46:21.635277] [INFO ] [MAIN ] BSAC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:46:21.666497] [DEBUG] [LOCAL ] BSAC: Loaded 32899 existing records from primary storage. [2025-10-15T17:46:21.666831] [INFO ] [MAIN ] BSAC: Loaded 32899 existing records. [2025-10-15T17:46:21.719898] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-09. [2025-10-15T17:46:21.846707] [WARN ] [MAIN ] BSAC: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:46:21.846978] [INFO ] [MAIN ] BSAC: Wiping existing primary data before full refresh. [2025-10-15T17:46:21.847026] [INFO ] [LOCAL ] BSAC: Starting deletion of primary data. [2025-10-15T17:46:21.847726] [DEBUG] [LOCAL ] BSAC: Deleted primary data file. [2025-10-15T17:46:21.847783] [INFO ] [MAIN ] BSAC: Starting full primary refresh. [2025-10-15T17:46:22.195173] [INFO ] [REMOTE ] BSAC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:46:22.513989] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2024-12. [2025-10-15T17:46:22.826107] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-15T17:46:22.972219] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-10 (2.05 seconds). [2025-10-15T17:46:22.978694] [INFO ] [REMOTE ] BROS: Full fetch complete (77234 records). [2025-10-15T17:46:22.978833] [DEBUG] [VALIDATOR ] BROS: Validating primary data. [2025-10-15T17:46:23.319109] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-02. [2025-10-15T17:46:23.390377] [DEBUG] [VALIDATOR ] BROS: All expected trading days are present. [2025-10-15T17:46:23.390526] [DEBUG] [VALIDATOR ] BROS: Primary data validation passed. [2025-10-15T17:46:23.391483] [INFO ] [MAIN ] BROS: Fetched primary data is valid. [2025-10-15T17:46:23.391546] [DEBUG] [LOCAL ] BROS: Saving primary data. [2025-10-15T17:46:23.393127] [DEBUG] [LOCAL ] BROS: Trimmed 77234 records to 53300 (keeping 200 days of data) [2025-10-15T17:46:23.712224] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-15T17:46:23.723209] [DEBUG] [LOCAL ] BROS: Primary data saved (53300 records). [2025-10-15T17:46:23.723350] [INFO ] [MAIN ] BROS: Full history saved. [2025-10-15T17:46:23.724353] [INFO ] [MAIN ] Update Progress: 337/2369 symbols completed. BROS took 58.8s. Estimated remaining: 4h 39m 18s. Rate: 7.3 symbols/min [2025-10-15T17:46:23.890145] [INFO ] [MAIN ] BSBR: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:46:23.926811] [DEBUG] [LOCAL ] BSBR: Loaded 35663 existing records from primary storage. [2025-10-15T17:46:23.927145] [INFO ] [MAIN ] BSBR: Loaded 35663 existing records. [2025-10-15T17:46:24.103881] [WARN ] [MAIN ] BSBR: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:46:24.104115] [INFO ] [MAIN ] BSBR: Wiping existing primary data before full refresh. [2025-10-15T17:46:24.104164] [INFO ] [LOCAL ] BSBR: Starting deletion of primary data. [2025-10-15T17:46:24.104794] [DEBUG] [LOCAL ] BSBR: Deleted primary data file. [2025-10-15T17:46:24.104854] [INFO ] [MAIN ] BSBR: Starting full primary refresh. [2025-10-15T17:46:24.119169] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-01. [2025-10-15T17:46:24.470461] [INFO ] [REMOTE ] BSBR: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:46:24.801381] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-15T17:46:24.823817] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-15T17:46:24.913998] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-02. [2025-10-15T17:46:25.714003] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-03. [2025-10-15T17:46:26.097881] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-15T17:46:26.514042] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2024-12. [2025-10-15T17:46:27.192218] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-15T17:46:27.314009] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-10. [2025-10-15T17:46:27.959759] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-15T17:46:28.113973] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-01. [2025-10-15T17:46:28.331287] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-15T17:46:28.334872] [INFO ] [REMOTE ] BRW: Full fetch complete (30445 records). [2025-10-15T17:46:28.334982] [DEBUG] [VALIDATOR ] BRW: Validating primary data. [2025-10-15T17:46:28.697233] [DEBUG] [VALIDATOR ] BRW: All expected trading days are present. [2025-10-15T17:46:28.697315] [DEBUG] [VALIDATOR ] BRW: Primary data validation passed. [2025-10-15T17:46:28.697844] [INFO ] [MAIN ] BRW: Fetched primary data is valid. [2025-10-15T17:46:28.697904] [DEBUG] [LOCAL ] BRW: Saving primary data. [2025-10-15T17:46:28.698689] [DEBUG] [LOCAL ] BRW: Trimmed 30445 records to 20981 (keeping 200 days of data) [2025-10-15T17:46:28.820508] [DEBUG] [LOCAL ] BRW: Primary data saved (20981 records). [2025-10-15T17:46:28.820667] [INFO ] [MAIN ] BRW: Full history saved. [2025-10-15T17:46:28.820763] [INFO ] [MAIN ] Update Progress: 338/2369 symbols completed. BRW took 28.6s. Estimated remaining: 4h 38m 50s. Rate: 7.3 symbols/min [2025-10-15T17:46:28.918774] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-03. [2025-10-15T17:46:28.989459] [INFO ] [MAIN ] BSL: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:46:28.998370] [DEBUG] [LOCAL ] BSL: Loaded 8184 existing records from primary storage. [2025-10-15T17:46:28.998556] [INFO ] [MAIN ] BSL: Loaded 8184 existing records. [2025-10-15T17:46:29.177117] [WARN ] [MAIN ] BSL: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:46:29.177527] [INFO ] [MAIN ] BSL: Wiping existing primary data before full refresh. [2025-10-15T17:46:29.177714] [INFO ] [LOCAL ] BSL: Starting deletion of primary data. [2025-10-15T17:46:29.184927] [DEBUG] [LOCAL ] BSL: Deleted primary data file. [2025-10-15T17:46:29.196818] [INFO ] [MAIN ] BSL: Starting full primary refresh. [2025-10-15T17:46:29.230829] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-15T17:46:29.557621] [INFO ] [REMOTE ] BSL: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:46:29.714040] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-02. [2025-10-15T17:46:30.266525] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-15T17:46:30.514068] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-04. [2025-10-15T17:46:30.757601] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-15T17:46:31.314052] [INFO ] [REMOTE ] BSL: Fetching primary data for 2024-12. [2025-10-15T17:46:31.925607] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-10-15T17:46:32.042486] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-15T17:46:32.113962] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-05. [2025-10-15T17:46:32.914038] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-01. [2025-10-15T17:46:33.295197] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-15T17:46:33.678119] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-15T17:46:33.713953] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-02. [2025-10-15T17:46:34.497434] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-15T17:46:34.513945] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-03. [2025-10-15T17:46:35.314062] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-06. [2025-10-15T17:46:35.622490] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-15T17:46:36.114096] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-04. [2025-10-15T17:46:36.570557] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-15T17:46:36.914003] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-07. [2025-10-15T17:46:37.714058] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-04. [2025-10-15T17:46:37.958706] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-15T17:46:38.292902] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-15T17:46:38.343365] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-15T17:46:38.514051] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-05. [2025-10-15T17:46:39.025561] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-10-15T17:46:39.313977] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-06. [2025-10-15T17:46:39.815998] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-10-15T17:46:40.114039] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-05. [2025-10-15T17:46:40.914036] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-08. [2025-10-15T17:46:41.713978] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-03. [2025-10-15T17:46:41.804489] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-15T17:46:41.985868] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-15T17:46:42.514045] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-07. [2025-10-15T17:46:43.083331] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-15T17:46:43.261541] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-15T17:46:43.313989] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-08. [2025-10-15T17:46:43.949772] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-15T17:46:44.114015] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-09. [2025-10-15T17:46:44.914069] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-06. [2025-10-15T17:46:45.503613] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-15T17:46:45.714002] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-09. [2025-10-15T17:46:46.380339] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-15T17:46:46.519148] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-10. [2025-10-15T17:46:46.535836] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-15T17:46:47.314060] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-04. [2025-10-15T17:46:48.036933] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-15T17:46:48.040962] [INFO ] [REMOTE ] BSAC: Full fetch complete (44541 records). [2025-10-15T17:46:48.041070] [DEBUG] [VALIDATOR ] BSAC: Validating primary data. [2025-10-15T17:46:48.041701] [FATAL] [VALIDATOR ] BSAC: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T17:46:48.041790] [FATAL] [MAIN ] BSAC: Fetched primary data is invalid. Refusing to save it. [2025-10-15T17:46:48.041833] [WARN ] [MAIN ] BSAC: Deleting existing primary and derivative data due to validation failure. [2025-10-15T17:46:48.041872] [INFO ] [LOCAL ] BSAC: Starting deletion of primary data. [2025-10-15T17:46:48.041928] [DEBUG] [LOCAL ] BSAC: No primary data file found to delete. [2025-10-15T17:46:48.041966] [INFO ] [LOCAL ] BSAC: Starting deletion of derivative data. [2025-10-15T17:46:48.042168] [DEBUG] [LOCAL ] BSAC: Deleted derivative data file. [2025-10-15T17:46:48.042456] [INFO ] [MAIN ] Update Progress: 339/2369 symbols completed. BSAC took 26.6s. Estimated remaining: 4h 39m 48s. Rate: 7.3 symbols/min [2025-10-15T17:46:48.119121] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-10. [2025-10-15T17:46:48.221227] [INFO ] [MAIN ] BSM: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:46:48.255422] [DEBUG] [LOCAL ] BSM: Loaded 32337 existing records from primary storage. [2025-10-15T17:46:48.255728] [INFO ] [MAIN ] BSM: Loaded 32337 existing records. [2025-10-15T17:46:48.450903] [WARN ] [MAIN ] BSM: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:46:48.451189] [INFO ] [MAIN ] BSM: Wiping existing primary data before full refresh. [2025-10-15T17:46:48.451242] [INFO ] [LOCAL ] BSM: Starting deletion of primary data. [2025-10-15T17:46:48.451942] [DEBUG] [LOCAL ] BSM: Deleted primary data file. [2025-10-15T17:46:48.452003] [INFO ] [MAIN ] BSM: Starting full primary refresh. [2025-10-15T17:46:48.839911] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-15T17:46:48.882771] [INFO ] [REMOTE ] BSM: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:46:48.883954] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-15T17:46:48.885977] [INFO ] [REMOTE ] BSL: Full fetch complete (12856 records). [2025-10-15T17:46:48.886045] [DEBUG] [VALIDATOR ] BSL: Validating primary data. [2025-10-15T17:46:48.919075] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-05. [2025-10-15T17:46:49.259391] [DEBUG] [VALIDATOR ] BSL: All expected trading days are present. [2025-10-15T17:46:49.259474] [DEBUG] [VALIDATOR ] BSL: Primary data validation passed. [2025-10-15T17:46:49.259780] [INFO ] [MAIN ] BSL: Fetched primary data is valid. [2025-10-15T17:46:49.259843] [DEBUG] [LOCAL ] BSL: Saving primary data. [2025-10-15T17:46:49.260379] [DEBUG] [LOCAL ] BSL: Trimmed 12856 records to 8231 (keeping 200 days of data) [2025-10-15T17:46:49.310093] [DEBUG] [LOCAL ] BSL: Primary data saved (8231 records). [2025-10-15T17:46:49.310223] [INFO ] [MAIN ] BSL: Full history saved. [2025-10-15T17:46:49.310305] [INFO ] [MAIN ] Update Progress: 340/2369 symbols completed. BSL took 20.5s. Estimated remaining: 4h 38m 58s. Rate: 7.3 symbols/min [2025-10-15T17:46:49.482276] [INFO ] [MAIN ] BST: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:46:49.500518] [DEBUG] [LOCAL ] BST: Loaded 18922 existing records from primary storage. [2025-10-15T17:46:49.500774] [INFO ] [MAIN ] BST: Loaded 18922 existing records. [2025-10-15T17:46:49.684039] [WARN ] [MAIN ] BST: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:46:49.684290] [INFO ] [MAIN ] BST: Wiping existing primary data before full refresh. [2025-10-15T17:46:49.684341] [INFO ] [LOCAL ] BST: Starting deletion of primary data. [2025-10-15T17:46:49.684691] [DEBUG] [LOCAL ] BST: Deleted primary data file. [2025-10-15T17:46:49.684751] [INFO ] [MAIN ] BST: Starting full primary refresh. [2025-10-15T17:46:49.719232] [INFO ] [REMOTE ] BSM: Fetching primary data for 2024-12. [2025-10-15T17:46:50.055212] [INFO ] [REMOTE ] BST: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:46:50.164824] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-15T17:46:50.514026] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-06. [2025-10-15T17:46:51.214811] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-15T17:46:51.314072] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-07. [2025-10-15T17:46:51.890556] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-15T17:46:52.114038] [INFO ] [REMOTE ] BST: Fetching primary data for 2024-12. [2025-10-15T17:46:52.918010] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-01. [2025-10-15T17:46:52.921388] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-15T17:46:53.146950] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-15T17:46:53.713983] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-08. [2025-10-15T17:46:53.767056] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-15T17:46:54.513990] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-02. [2025-10-15T17:46:55.313991] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-07. [2025-10-15T17:46:55.385960] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-15T17:46:55.576450] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-15T17:46:56.113996] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-09. [2025-10-15T17:46:56.693110] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-15T17:46:56.913999] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-08. [2025-10-15T17:46:57.713997] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-03. [2025-10-15T17:46:57.780553] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-15T17:46:58.362297] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-15T17:46:58.514001] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-10. [2025-10-15T17:46:59.229801] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-15T17:46:59.313966] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-09. [2025-10-15T17:47:00.024469] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-15T17:47:00.031079] [INFO ] [REMOTE ] BRX: Full fetch complete (75124 records). [2025-10-15T17:47:00.031235] [DEBUG] [VALIDATOR ] BRX: Validating primary data. [2025-10-15T17:47:00.122228] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-04. [2025-10-15T17:47:00.432358] [DEBUG] [VALIDATOR ] BRX: All expected trading days are present. [2025-10-15T17:47:00.432510] [DEBUG] [VALIDATOR ] BRX: Primary data validation passed. [2025-10-15T17:47:00.433481] [INFO ] [MAIN ] BRX: Fetched primary data is valid. [2025-10-15T17:47:00.433558] [DEBUG] [LOCAL ] BRX: Saving primary data. [2025-10-15T17:47:00.460512] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-15T17:47:00.470816] [DEBUG] [LOCAL ] BRX: Trimmed 75124 records to 51797 (keeping 200 days of data) [2025-10-15T17:47:00.782755] [DEBUG] [LOCAL ] BRX: Primary data saved (51797 records). [2025-10-15T17:47:00.782894] [INFO ] [MAIN ] BRX: Full history saved. [2025-10-15T17:47:00.782971] [INFO ] [MAIN ] Update Progress: 341/2369 symbols completed. BRX took 51.7s. Estimated remaining: 4h 39m 9s. Rate: 7.3 symbols/min [2025-10-15T17:47:00.920436] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-01. [2025-10-15T17:47:00.952322] [INFO ] [MAIN ] BSTZ: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:47:00.976631] [DEBUG] [LOCAL ] BSTZ: Loaded 25010 existing records from primary storage. [2025-10-15T17:47:00.976927] [INFO ] [MAIN ] BSTZ: Loaded 25010 existing records. [2025-10-15T17:47:01.151403] [WARN ] [MAIN ] BSTZ: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:47:01.151638] [INFO ] [MAIN ] BSTZ: Wiping existing primary data before full refresh. [2025-10-15T17:47:01.151719] [INFO ] [LOCAL ] BSTZ: Starting deletion of primary data. [2025-10-15T17:47:01.152314] [DEBUG] [LOCAL ] BSTZ: Deleted primary data file. [2025-10-15T17:47:01.152371] [INFO ] [MAIN ] BSTZ: Starting full primary refresh. [2025-10-15T17:47:01.510311] [INFO ] [REMOTE ] BSTZ: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:47:01.536540] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-15T17:47:01.713970] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-10. [2025-10-15T17:47:01.926740] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-15T17:47:02.514011] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2024-12. [2025-10-15T17:47:03.127813] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-15T17:47:03.132324] [INFO ] [REMOTE ] BSBR: Full fetch complete (50903 records). [2025-10-15T17:47:03.132423] [DEBUG] [VALIDATOR ] BSBR: Validating primary data. [2025-10-15T17:47:03.319898] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-02. [2025-10-15T17:47:03.514024] [DEBUG] [VALIDATOR ] BSBR: All expected trading days are present. [2025-10-15T17:47:03.514123] [DEBUG] [VALIDATOR ] BSBR: Primary data validation passed. [2025-10-15T17:47:03.514831] [INFO ] [MAIN ] BSBR: Fetched primary data is valid. [2025-10-15T17:47:03.514893] [DEBUG] [LOCAL ] BSBR: Saving primary data. [2025-10-15T17:47:03.515954] [DEBUG] [LOCAL ] BSBR: Trimmed 50903 records to 35665 (keeping 200 days of data) [2025-10-15T17:47:03.738987] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-15T17:47:03.742033] [DEBUG] [LOCAL ] BSBR: Primary data saved (35665 records). [2025-10-15T17:47:03.748314] [INFO ] [MAIN ] BSBR: Full history saved. [2025-10-15T17:47:03.749279] [INFO ] [MAIN ] Update Progress: 342/2369 symbols completed. BSBR took 40.0s. Estimated remaining: 4h 38m 29s. Rate: 7.3 symbols/min [2025-10-15T17:47:03.923905] [INFO ] [MAIN ] BSX: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:47:03.924080] [DEBUG] [LOCAL ] BSX: No existing data file found in primary storage. [2025-10-15T17:47:03.924117] [WARN ] [MAIN ] BSX: No existing data found, performing full refresh instead. [2025-10-15T17:47:03.924227] [INFO ] [MAIN ] BSX: Wiping existing primary data before full refresh. [2025-10-15T17:47:03.924309] [INFO ] [LOCAL ] BSX: Starting deletion of primary data. [2025-10-15T17:47:03.924361] [DEBUG] [LOCAL ] BSX: No primary data file found to delete. [2025-10-15T17:47:03.924396] [INFO ] [MAIN ] BSX: Starting full primary refresh. [2025-10-15T17:47:04.118587] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-05. [2025-10-15T17:47:04.306622] [INFO ] [REMOTE ] BSX: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:47:04.606373] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-15T17:47:04.913988] [INFO ] [REMOTE ] BSX: Fetching primary data for 2024-12. [2025-10-15T17:47:05.610736] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-15T17:47:05.714003] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-03. [2025-10-15T17:47:06.513964] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-01. [2025-10-15T17:47:06.715842] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-15T17:47:06.927548] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-10-15T17:47:07.313973] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-06. [2025-10-15T17:47:07.459149] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-15T17:47:08.114035] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-04. [2025-10-15T17:47:08.565065] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-15T17:47:08.914026] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-01. [2025-10-15T17:47:08.934875] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-15T17:47:09.714067] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-07. [2025-10-15T17:47:10.513973] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-05. [2025-10-15T17:47:10.784711] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-15T17:47:10.938033] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-15T17:47:11.146455] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-15T17:47:11.314034] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-02. [2025-10-15T17:47:12.113993] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-06. [2025-10-15T17:47:12.148829] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-15T17:47:12.914023] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-08. [2025-10-15T17:47:13.168708] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-15T17:47:13.714041] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-02. [2025-10-15T17:47:14.475543] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-15T17:47:14.514047] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-09. [2025-10-15T17:47:15.313998] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-03. [2025-10-15T17:47:15.536782] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-15T17:47:15.636466] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-15T17:47:16.114056] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-03. [2025-10-15T17:47:16.821253] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-15T17:47:16.913980] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-04. [2025-10-15T17:47:17.714050] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-10. [2025-10-15T17:47:18.047935] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-15T17:47:18.268796] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-03 (2.15 seconds). [2025-10-15T17:47:18.513990] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-05. [2025-10-15T17:47:19.049468] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-15T17:47:19.053274] [INFO ] [REMOTE ] BSM: Full fetch complete (46808 records). [2025-10-15T17:47:19.053462] [DEBUG] [VALIDATOR ] BSM: Validating primary data. [2025-10-15T17:47:19.054224] [FATAL] [VALIDATOR ] BSM: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T17:47:19.054313] [FATAL] [MAIN ] BSM: Fetched primary data is invalid. Refusing to save it. [2025-10-15T17:47:19.054358] [WARN ] [MAIN ] BSM: Deleting existing primary and derivative data due to validation failure. [2025-10-15T17:47:19.054429] [INFO ] [LOCAL ] BSM: Starting deletion of primary data. [2025-10-15T17:47:19.054510] [DEBUG] [LOCAL ] BSM: No primary data file found to delete. [2025-10-15T17:47:19.054556] [INFO ] [LOCAL ] BSM: Starting deletion of derivative data. [2025-10-15T17:47:19.054897] [DEBUG] [LOCAL ] BSM: Deleted derivative data file. [2025-10-15T17:47:19.054998] [INFO ] [MAIN ] Update Progress: 343/2369 symbols completed. BSM took 31.0s. Estimated remaining: 4h 39m 3s. Rate: 7.3 symbols/min [2025-10-15T17:47:19.248533] [INFO ] [MAIN ] BTA: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:47:19.256024] [DEBUG] [LOCAL ] BTA: Loaded 5627 existing records from primary storage. [2025-10-15T17:47:19.256253] [INFO ] [MAIN ] BTA: Loaded 5627 existing records. [2025-10-15T17:47:19.323079] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-04. [2025-10-15T17:47:19.454607] [WARN ] [MAIN ] BTA: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:47:19.454982] [INFO ] [MAIN ] BTA: Wiping existing primary data before full refresh. [2025-10-15T17:47:19.455040] [INFO ] [LOCAL ] BTA: Starting deletion of primary data. [2025-10-15T17:47:19.455285] [DEBUG] [LOCAL ] BTA: Deleted primary data file. [2025-10-15T17:47:19.455337] [INFO ] [MAIN ] BTA: Starting full primary refresh. [2025-10-15T17:47:19.854707] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-15T17:47:19.875890] [INFO ] [REMOTE ] BTA: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:47:20.114019] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-06. [2025-10-15T17:47:20.913996] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-07. [2025-10-15T17:47:21.200864] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-15T17:47:21.330547] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-15T17:47:21.713968] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-05. [2025-10-15T17:47:22.079304] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-15T17:47:22.514005] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-07. [2025-10-15T17:47:23.313977] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-08. [2025-10-15T17:47:23.532757] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-15T17:47:23.642718] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-15T17:47:24.010017] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-15T17:47:24.114003] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-09. [2025-10-15T17:47:24.913970] [INFO ] [REMOTE ] BTA: Fetching primary data for 2024-12. [2025-10-15T17:47:24.964978] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-15T17:47:25.714026] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-08. [2025-10-15T17:47:25.771955] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-10-15T17:47:26.514051] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-06. [2025-10-15T17:47:26.730931] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-15T17:47:27.314031] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-10. [2025-10-15T17:47:28.114004] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-01. [2025-10-15T17:47:28.258875] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-15T17:47:28.366896] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-15T17:47:28.370072] [INFO ] [REMOTE ] BST: Full fetch complete (28524 records). [2025-10-15T17:47:28.370275] [DEBUG] [VALIDATOR ] BST: Validating primary data. [2025-10-15T17:47:28.920557] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-09. [2025-10-15T17:47:28.952187] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-15T17:47:28.954472] [DEBUG] [VALIDATOR ] BST: All expected trading days are present. [2025-10-15T17:47:28.954561] [DEBUG] [VALIDATOR ] BST: Primary data validation passed. [2025-10-15T17:47:28.955370] [INFO ] [MAIN ] BST: Fetched primary data is valid. [2025-10-15T17:47:28.955459] [DEBUG] [LOCAL ] BST: Saving primary data. [2025-10-15T17:47:28.962750] [DEBUG] [LOCAL ] BST: Trimmed 28524 records to 18867 (keeping 200 days of data) [2025-10-15T17:47:29.089929] [DEBUG] [LOCAL ] BST: Primary data saved (18867 records). [2025-10-15T17:47:29.090125] [INFO ] [MAIN ] BST: Full history saved. [2025-10-15T17:47:29.090343] [INFO ] [MAIN ] Update Progress: 344/2369 symbols completed. BST took 39.8s. Estimated remaining: 4h 39m 5s. Rate: 7.3 symbols/min [2025-10-15T17:47:29.280179] [INFO ] [MAIN ] BTCM: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:47:29.298631] [DEBUG] [LOCAL ] BTCM: Loaded 16664 existing records from primary storage. [2025-10-15T17:47:29.298938] [INFO ] [MAIN ] BTCM: Loaded 16664 existing records. [2025-10-15T17:47:29.504890] [WARN ] [MAIN ] BTCM: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:47:29.505147] [INFO ] [MAIN ] BTCM: Wiping existing primary data before full refresh. [2025-10-15T17:47:29.505218] [INFO ] [LOCAL ] BTCM: Starting deletion of primary data. [2025-10-15T17:47:29.505480] [DEBUG] [LOCAL ] BTCM: Deleted primary data file. [2025-10-15T17:47:29.505541] [INFO ] [MAIN ] BTCM: Starting full primary refresh. [2025-10-15T17:47:29.721679] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-02. [2025-10-15T17:47:29.934920] [INFO ] [REMOTE ] BTCM: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:47:30.081598] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-15T17:47:30.233755] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-10-15T17:47:30.514034] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2024-12. [2025-10-15T17:47:31.314019] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-07. [2025-10-15T17:47:31.775963] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-15T17:47:32.114038] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-03. [2025-10-15T17:47:32.601108] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-10-15T17:47:32.914069] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-04. [2025-10-15T17:47:33.295148] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-15T17:47:33.295510] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-04 (0.38 seconds). [2025-10-15T17:47:33.713982] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-08. [2025-10-15T17:47:34.514055] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-01. [2025-10-15T17:47:35.313984] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-10. [2025-10-15T17:47:35.348433] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-15T17:47:35.394622] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-15T17:47:36.114014] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-09. [2025-10-15T17:47:36.317221] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-15T17:47:36.321146] [INFO ] [REMOTE ] BSTZ: Full fetch complete (36717 records). [2025-10-15T17:47:36.321285] [DEBUG] [VALIDATOR ] BSTZ: Validating primary data. [2025-10-15T17:47:36.687141] [DEBUG] [VALIDATOR ] BSTZ: All expected trading days are present. [2025-10-15T17:47:36.687231] [DEBUG] [VALIDATOR ] BSTZ: Primary data validation passed. [2025-10-15T17:47:36.687948] [INFO ] [MAIN ] BSTZ: Fetched primary data is valid. [2025-10-15T17:47:36.688030] [DEBUG] [LOCAL ] BSTZ: Saving primary data. [2025-10-15T17:47:36.688954] [DEBUG] [LOCAL ] BSTZ: Trimmed 36717 records to 24906 (keeping 200 days of data) [2025-10-15T17:47:36.843093] [DEBUG] [LOCAL ] BSTZ: Primary data saved (24906 records). [2025-10-15T17:47:36.843280] [INFO ] [MAIN ] BSTZ: Full history saved. [2025-10-15T17:47:36.843386] [INFO ] [MAIN ] Update Progress: 345/2369 symbols completed. BSTZ took 36.1s. Estimated remaining: 4h 38m 54s. Rate: 7.3 symbols/min [2025-10-15T17:47:36.920006] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-05. [2025-10-15T17:47:37.022316] [INFO ] [MAIN ] BTE: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:47:37.022510] [DEBUG] [LOCAL ] BTE: No existing data file found in primary storage. [2025-10-15T17:47:37.022549] [WARN ] [MAIN ] BTE: No existing data found, performing full refresh instead. [2025-10-15T17:47:37.022697] [INFO ] [MAIN ] BTE: Wiping existing primary data before full refresh. [2025-10-15T17:47:37.022752] [INFO ] [LOCAL ] BTE: Starting deletion of primary data. [2025-10-15T17:47:37.022795] [DEBUG] [LOCAL ] BTE: No primary data file found to delete. [2025-10-15T17:47:37.022827] [INFO ] [MAIN ] BTE: Starting full primary refresh. [2025-10-15T17:47:37.375156] [INFO ] [REMOTE ] BTE: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:47:37.714067] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-02. [2025-10-15T17:47:37.743672] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-15T17:47:38.160688] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-10-15T17:47:38.421666] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-15T17:47:38.513997] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-06. [2025-10-15T17:47:39.157514] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-15T17:47:39.314050] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-07. [2025-10-15T17:47:39.787314] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-10-15T17:47:40.114014] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-08. [2025-10-15T17:47:40.688626] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-15T17:47:40.914007] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-03. [2025-10-15T17:47:41.553826] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-15T17:47:41.714025] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-09. [2025-10-15T17:47:42.200360] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-10-15T17:47:42.514045] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-10. [2025-10-15T17:47:43.220725] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-15T17:47:43.222134] [INFO ] [REMOTE ] BTA: Full fetch complete (9568 records). [2025-10-15T17:47:43.222204] [DEBUG] [VALIDATOR ] BTA: Validating primary data. [2025-10-15T17:47:43.319072] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-10. [2025-10-15T17:47:43.573858] [DEBUG] [VALIDATOR ] BTA: All expected trading days are present. [2025-10-15T17:47:43.573945] [DEBUG] [VALIDATOR ] BTA: Primary data validation passed. [2025-10-15T17:47:43.574171] [INFO ] [MAIN ] BTA: Fetched primary data is valid. [2025-10-15T17:47:43.574210] [DEBUG] [LOCAL ] BTA: Saving primary data. [2025-10-15T17:47:43.574607] [DEBUG] [LOCAL ] BTA: Trimmed 9568 records to 5669 (keeping 200 days of data) [2025-10-15T17:47:43.607210] [DEBUG] [LOCAL ] BTA: Primary data saved (5669 records). [2025-10-15T17:47:43.607332] [INFO ] [MAIN ] BTA: Full history saved. [2025-10-15T17:47:43.607411] [INFO ] [MAIN ] Update Progress: 346/2369 symbols completed. BTA took 24.6s. Estimated remaining: 4h 38m 37s. Rate: 7.3 symbols/min [2025-10-15T17:47:43.778486] [INFO ] [MAIN ] BTI: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:47:43.826945] [DEBUG] [LOCAL ] BTI: Loaded 53590 existing records from primary storage. [2025-10-15T17:47:43.827287] [INFO ] [MAIN ] BTI: Loaded 53590 existing records. [2025-10-15T17:47:44.004882] [WARN ] [MAIN ] BTI: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:47:44.005229] [INFO ] [MAIN ] BTI: Wiping existing primary data before full refresh. [2025-10-15T17:47:44.005382] [INFO ] [LOCAL ] BTI: Starting deletion of primary data. [2025-10-15T17:47:44.006516] [DEBUG] [LOCAL ] BTI: Deleted primary data file. [2025-10-15T17:47:44.006573] [INFO ] [MAIN ] BTI: Starting full primary refresh. [2025-10-15T17:47:44.117021] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-04. [2025-10-15T17:47:44.319539] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-15T17:47:44.355121] [INFO ] [REMOTE ] BSX: Full fetch complete (77856 records). [2025-10-15T17:47:44.365697] [DEBUG] [VALIDATOR ] BSX: Validating primary data. [2025-10-15T17:47:44.526712] [INFO ] [REMOTE ] BTI: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:47:44.818671] [DEBUG] [VALIDATOR ] BSX: All expected trading days are present. [2025-10-15T17:47:44.818790] [DEBUG] [VALIDATOR ] BSX: Primary data validation passed. [2025-10-15T17:47:44.819803] [INFO ] [MAIN ] BSX: Fetched primary data is valid. [2025-10-15T17:47:44.819869] [DEBUG] [LOCAL ] BSX: Saving primary data. [2025-10-15T17:47:44.821590] [DEBUG] [LOCAL ] BSX: Trimmed 77856 records to 53688 (keeping 200 days of data) [2025-10-15T17:47:44.936893] [INFO ] [REMOTE ] BTE: Fetching primary data for 2024-12. [2025-10-15T17:47:45.020265] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-15T17:47:45.178694] [DEBUG] [LOCAL ] BSX: Primary data saved (53688 records). [2025-10-15T17:47:45.178856] [INFO ] [MAIN ] BSX: Full history saved. [2025-10-15T17:47:45.178929] [INFO ] [MAIN ] Update Progress: 347/2369 symbols completed. BSX took 41.4s. Estimated remaining: 4h 37m 49s. Rate: 7.3 symbols/min [2025-10-15T17:47:45.350018] [INFO ] [MAIN ] BTO: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:47:45.359873] [DEBUG] [LOCAL ] BTO: Loaded 8779 existing records from primary storage. [2025-10-15T17:47:45.360103] [INFO ] [MAIN ] BTO: Loaded 8779 existing records. [2025-10-15T17:47:45.537122] [WARN ] [MAIN ] BTO: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:47:45.537351] [INFO ] [MAIN ] BTO: Wiping existing primary data before full refresh. [2025-10-15T17:47:45.537400] [INFO ] [LOCAL ] BTO: Starting deletion of primary data. [2025-10-15T17:47:45.537757] [DEBUG] [LOCAL ] BTO: Deleted primary data file. [2025-10-15T17:47:45.537816] [INFO ] [MAIN ] BTO: Starting full primary refresh. [2025-10-15T17:47:45.719952] [INFO ] [REMOTE ] BTI: Fetching primary data for 2024-12. [2025-10-15T17:47:45.903285] [INFO ] [REMOTE ] BTO: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:47:46.489813] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-15T17:47:46.513977] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-01. [2025-10-15T17:47:47.314087] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-05. [2025-10-15T17:47:47.570196] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-15T17:47:47.766382] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-15T17:47:47.986619] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-15T17:47:48.114075] [INFO ] [REMOTE ] BTO: Fetching primary data for 2024-12. [2025-10-15T17:47:48.914072] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-02. [2025-10-15T17:47:48.960116] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-15T17:47:49.714059] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-01. [2025-10-15T17:47:50.417273] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-15T17:47:50.514032] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-03. [2025-10-15T17:47:50.524619] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-15T17:47:51.314045] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-01. [2025-10-15T17:47:51.967253] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-15T17:47:52.113994] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-02. [2025-10-15T17:47:52.615078] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-10-15T17:47:52.913989] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-04. [2025-10-15T17:47:53.281513] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-10-15T17:47:53.714007] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-03. [2025-10-15T17:47:54.455150] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-15T17:47:54.472170] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-15T17:47:54.514003] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-05. [2025-10-15T17:47:55.314045] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-04. [2025-10-15T17:47:55.940720] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-15T17:47:55.962837] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-10-15T17:47:56.113989] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-02. [2025-10-15T17:47:56.914021] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-05. [2025-10-15T17:47:57.714011] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-06. [2025-10-15T17:47:57.739255] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-15T17:47:57.834185] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-15T17:47:58.514014] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-06. [2025-10-15T17:47:59.307940] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-15T17:47:59.313956] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-07. [2025-10-15T17:47:59.373855] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-15T17:48:00.054100] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-15T17:48:00.114013] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-08. [2025-10-15T17:48:00.725329] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-15T17:48:00.913981] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-03. [2025-10-15T17:48:01.714018] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-06. [2025-10-15T17:48:02.498571] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-15T17:48:02.513969] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-07. [2025-10-15T17:48:03.065931] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-03 (2.15 seconds). [2025-10-15T17:48:03.314008] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-09. [2025-10-15T17:48:04.114017] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-04. [2025-10-15T17:48:04.139097] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-15T17:48:04.322587] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-15T17:48:04.914061] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-07. [2025-10-15T17:48:05.714025] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-08. [2025-10-15T17:48:05.826403] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-15T17:48:06.386171] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-15T17:48:06.514035] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-10. [2025-10-15T17:48:07.038063] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-15T17:48:07.280154] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-15T17:48:07.281977] [INFO ] [REMOTE ] BTO: Full fetch complete (13246 records). [2025-10-15T17:48:07.282056] [DEBUG] [VALIDATOR ] BTO: Validating primary data. [2025-10-15T17:48:07.319171] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-05. [2025-10-15T17:48:07.696187] [DEBUG] [VALIDATOR ] BTO: All expected trading days are present. [2025-10-15T17:48:07.696310] [DEBUG] [VALIDATOR ] BTO: Primary data validation passed. [2025-10-15T17:48:07.696912] [INFO ] [MAIN ] BTO: Fetched primary data is valid. [2025-10-15T17:48:07.696978] [DEBUG] [LOCAL ] BTO: Saving primary data. [2025-10-15T17:48:07.697612] [DEBUG] [LOCAL ] BTO: Trimmed 13246 records to 8850 (keeping 200 days of data) [2025-10-15T17:48:07.758416] [DEBUG] [LOCAL ] BTO: Primary data saved (8850 records). [2025-10-15T17:48:07.758611] [INFO ] [MAIN ] BTO: Full history saved. [2025-10-15T17:48:07.758755] [INFO ] [MAIN ] Update Progress: 348/2369 symbols completed. BTO took 22.6s. Estimated remaining: 4h 39m 4s. Rate: 7.2 symbols/min [2025-10-15T17:48:07.930882] [INFO ] [MAIN ] BTT: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:48:07.950533] [DEBUG] [LOCAL ] BTT: Loaded 15724 existing records from primary storage. [2025-10-15T17:48:07.950856] [INFO ] [MAIN ] BTT: Loaded 15724 existing records. [2025-10-15T17:48:08.117532] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-09. [2025-10-15T17:48:08.140430] [WARN ] [MAIN ] BTT: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:48:08.140751] [INFO ] [MAIN ] BTT: Wiping existing primary data before full refresh. [2025-10-15T17:48:08.140821] [INFO ] [LOCAL ] BTT: Starting deletion of primary data. [2025-10-15T17:48:08.141258] [DEBUG] [LOCAL ] BTT: Deleted primary data file. [2025-10-15T17:48:08.141316] [INFO ] [MAIN ] BTT: Starting full primary refresh. [2025-10-15T17:48:08.540064] [INFO ] [REMOTE ] BTT: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:48:08.914071] [INFO ] [REMOTE ] BTT: Fetching primary data for 2024-12. [2025-10-15T17:48:09.538973] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-15T17:48:09.713997] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-10. [2025-10-15T17:48:09.839872] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-05 (2.52 seconds). [2025-10-15T17:48:09.866399] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-10-15T17:48:10.513987] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-01. [2025-10-15T17:48:10.717367] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-15T17:48:10.720696] [INFO ] [REMOTE ] BTCM: Full fetch complete (20126 records). [2025-10-15T17:48:10.720787] [DEBUG] [VALIDATOR ] BTCM: Validating primary data. [2025-10-15T17:48:11.097350] [DEBUG] [VALIDATOR ] BTCM: All expected trading days are present. [2025-10-15T17:48:11.097428] [DEBUG] [VALIDATOR ] BTCM: Primary data validation passed. [2025-10-15T17:48:11.097929] [INFO ] [MAIN ] BTCM: Fetched primary data is valid. [2025-10-15T17:48:11.097990] [DEBUG] [LOCAL ] BTCM: Saving primary data. [2025-10-15T17:48:11.098622] [DEBUG] [LOCAL ] BTCM: Trimmed 20126 records to 16911 (keeping 200 days of data) [2025-10-15T17:48:11.201328] [DEBUG] [LOCAL ] BTCM: Primary data saved (16911 records). [2025-10-15T17:48:11.201830] [INFO ] [MAIN ] BTCM: Full history saved. [2025-10-15T17:48:11.202004] [INFO ] [MAIN ] Update Progress: 349/2369 symbols completed. BTCM took 42.1s. Estimated remaining: 4h 38m 28s. Rate: 7.3 symbols/min [2025-10-15T17:48:11.319114] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-06. [2025-10-15T17:48:11.380620] [INFO ] [MAIN ] BTU: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:48:11.395000] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-15T17:48:11.449470] [DEBUG] [LOCAL ] BTU: Loaded 53323 existing records from primary storage. [2025-10-15T17:48:11.449847] [INFO ] [MAIN ] BTU: Loaded 53323 existing records. [2025-10-15T17:48:11.649962] [WARN ] [MAIN ] BTU: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:48:11.650241] [INFO ] [MAIN ] BTU: Wiping existing primary data before full refresh. [2025-10-15T17:48:11.650310] [INFO ] [LOCAL ] BTU: Starting deletion of primary data. [2025-10-15T17:48:11.651246] [DEBUG] [LOCAL ] BTU: Deleted primary data file. [2025-10-15T17:48:11.651303] [INFO ] [MAIN ] BTU: Starting full primary refresh. [2025-10-15T17:48:11.996862] [INFO ] [REMOTE ] BTU: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:48:12.114001] [INFO ] [REMOTE ] BTU: Fetching primary data for 2024-12. [2025-10-15T17:48:12.913987] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-02. [2025-10-15T17:48:13.240130] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-10-15T17:48:13.656057] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-15T17:48:13.719119] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-07. [2025-10-15T17:48:13.735572] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-15T17:48:14.514006] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-03. [2025-10-15T17:48:15.313972] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-01. [2025-10-15T17:48:15.437014] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-15T17:48:15.769526] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-10-15T17:48:16.114029] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-04. [2025-10-15T17:48:16.913985] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-08. [2025-10-15T17:48:17.231257] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-10-15T17:48:17.255511] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-15T17:48:17.714009] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-05. [2025-10-15T17:48:18.513972] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-08. [2025-10-15T17:48:18.649450] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-15T17:48:18.829603] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-15T17:48:19.314014] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-02. [2025-10-15T17:48:20.114061] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-09. [2025-10-15T17:48:20.780441] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-08 (2.27 seconds). [2025-10-15T17:48:20.833764] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-15T17:48:20.914034] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-03. [2025-10-15T17:48:21.492775] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-15T17:48:21.714062] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-10. [2025-10-15T17:48:22.514021] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-06. [2025-10-15T17:48:22.837272] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-15T17:48:23.313977] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-09. [2025-10-15T17:48:23.392374] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-15T17:48:23.398779] [INFO ] [REMOTE ] BTE: Full fetch complete (76378 records). [2025-10-15T17:48:23.398952] [DEBUG] [VALIDATOR ] BTE: Validating primary data. [2025-10-15T17:48:23.514273] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-15T17:48:23.798227] [DEBUG] [VALIDATOR ] BTE: All expected trading days are present. [2025-10-15T17:48:23.798330] [DEBUG] [VALIDATOR ] BTE: Primary data validation passed. [2025-10-15T17:48:23.799213] [INFO ] [MAIN ] BTE: Fetched primary data is valid. [2025-10-15T17:48:23.799276] [DEBUG] [LOCAL ] BTE: Saving primary data. [2025-10-15T17:48:23.800791] [DEBUG] [LOCAL ] BTE: Trimmed 76378 records to 52736 (keeping 200 days of data) [2025-10-15T17:48:24.116275] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-07. [2025-10-15T17:48:24.137819] [DEBUG] [LOCAL ] BTE: Primary data saved (52736 records). [2025-10-15T17:48:24.138898] [INFO ] [MAIN ] BTE: Full history saved. [2025-10-15T17:48:24.139009] [INFO ] [MAIN ] Update Progress: 350/2369 symbols completed. BTE took 47.3s. Estimated remaining: 4h 38m 47s. Rate: 7.2 symbols/min [2025-10-15T17:48:24.332547] [INFO ] [MAIN ] BTX: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:48:24.332805] [DEBUG] [LOCAL ] BTX: No existing data file found in primary storage. [2025-10-15T17:48:24.332865] [WARN ] [MAIN ] BTX: No existing data found, performing full refresh instead. [2025-10-15T17:48:24.332979] [INFO ] [MAIN ] BTX: Wiping existing primary data before full refresh. [2025-10-15T17:48:24.333022] [INFO ] [LOCAL ] BTX: Starting deletion of primary data. [2025-10-15T17:48:24.333063] [DEBUG] [LOCAL ] BTX: No primary data file found to delete. [2025-10-15T17:48:24.333094] [INFO ] [MAIN ] BTX: Starting full primary refresh. [2025-10-15T17:48:24.748089] [INFO ] [REMOTE ] BTX: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:48:24.914039] [INFO ] [REMOTE ] BTX: Fetching primary data for 2024-12. [2025-10-15T17:48:25.105257] [DEBUG] [REMOTE ] BTX: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-15T17:48:25.105590] [WARN ] [REMOTE ] BTX: No data returned for month 2024-12 [2025-10-15T17:48:25.105719] [FATAL] [REMOTE ] BTX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-15T17:48:25.105790] [FATAL] [MAIN ] BTX: Failed to fetch primary data. [2025-10-15T17:48:25.105860] [WARN ] [MAIN ] BTX: Deleting existing primary and derivative data due to fetch failure. [2025-10-15T17:48:25.105940] [INFO ] [LOCAL ] BTX: Starting deletion of primary data. [2025-10-15T17:48:25.106006] [DEBUG] [LOCAL ] BTX: No primary data file found to delete. [2025-10-15T17:48:25.106043] [INFO ] [LOCAL ] BTX: Starting deletion of derivative data. [2025-10-15T17:48:25.106083] [DEBUG] [LOCAL ] BTX: No derivative data file found to delete. [2025-10-15T17:48:25.106130] [INFO ] [MAIN ] Update Progress: 351/2369 symbols completed. BTX took 1.0s. Estimated remaining: 4h 37m 56s. Rate: 7.3 symbols/min [2025-10-15T17:48:25.245105] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-15T17:48:25.314969] [INFO ] [MAIN ] BTZ: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:48:25.361248] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-10-15T17:48:25.391635] [DEBUG] [LOCAL ] BTZ: Loaded 22641 existing records from primary storage. [2025-10-15T17:48:25.391962] [INFO ] [MAIN ] BTZ: Loaded 22641 existing records. [2025-10-15T17:48:25.576187] [WARN ] [MAIN ] BTZ: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:48:25.576427] [INFO ] [MAIN ] BTZ: Wiping existing primary data before full refresh. [2025-10-15T17:48:25.576501] [INFO ] [LOCAL ] BTZ: Starting deletion of primary data. [2025-10-15T17:48:25.576823] [DEBUG] [LOCAL ] BTZ: Deleted primary data file. [2025-10-15T17:48:25.576881] [INFO ] [MAIN ] BTZ: Starting full primary refresh. [2025-10-15T17:48:25.719978] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-04. [2025-10-15T17:48:25.944296] [INFO ] [REMOTE ] BTZ: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:48:26.513991] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-08. [2025-10-15T17:48:27.194946] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-15T17:48:27.314496] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2024-12. [2025-10-15T17:48:27.337310] [DEBUG] [REMOTE ] BTU: Error fetching primary data for 2025-04: ("Connection broken: ConnectionResetError(104, 'Connection reset by peer')", ConnectionResetError(104, 'Connection reset by peer')) [2025-10-15T17:48:27.337463] [WARN ] [REMOTE ] BTU: No data returned for month 2025-04 [2025-10-15T17:48:27.337534] [FATAL] [REMOTE ] BTU: API call failed - aborting fetch to avoid wasting further API calls [2025-10-15T17:48:27.337603] [FATAL] [MAIN ] BTU: Failed to fetch primary data. [2025-10-15T17:48:27.337695] [WARN ] [MAIN ] BTU: Deleting existing primary and derivative data due to fetch failure. [2025-10-15T17:48:27.337769] [INFO ] [LOCAL ] BTU: Starting deletion of primary data. [2025-10-15T17:48:27.337833] [DEBUG] [LOCAL ] BTU: No primary data file found to delete. [2025-10-15T17:48:27.337869] [INFO ] [LOCAL ] BTU: Starting deletion of derivative data. [2025-10-15T17:48:27.339314] [DEBUG] [LOCAL ] BTU: Deleted derivative data file. [2025-10-15T17:48:27.339453] [INFO ] [MAIN ] Update Progress: 352/2369 symbols completed. BTU took 16.1s. Estimated remaining: 4h 37m 13s. Rate: 7.3 symbols/min [2025-10-15T17:48:27.515414] [INFO ] [MAIN ] BUD: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:48:27.563053] [DEBUG] [LOCAL ] BUD: Loaded 52625 existing records from primary storage. [2025-10-15T17:48:27.563427] [INFO ] [MAIN ] BUD: Loaded 52625 existing records. [2025-10-15T17:48:27.750595] [WARN ] [MAIN ] BUD: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:48:27.750840] [INFO ] [MAIN ] BUD: Wiping existing primary data before full refresh. [2025-10-15T17:48:27.750886] [INFO ] [LOCAL ] BUD: Starting deletion of primary data. [2025-10-15T17:48:27.751998] [DEBUG] [LOCAL ] BUD: Deleted primary data file. [2025-10-15T17:48:27.752057] [INFO ] [MAIN ] BUD: Starting full primary refresh. [2025-10-15T17:48:28.119467] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-09. [2025-10-15T17:48:28.124953] [INFO ] [REMOTE ] BUD: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:48:28.397954] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-15T17:48:28.920557] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-01. [2025-10-15T17:48:28.922505] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-15T17:48:29.714068] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-10. [2025-10-15T17:48:29.846813] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-15T17:48:30.513998] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-02. [2025-10-15T17:48:30.612379] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-15T17:48:30.614334] [INFO ] [REMOTE ] BTT: Full fetch complete (22911 records). [2025-10-15T17:48:30.614407] [DEBUG] [VALIDATOR ] BTT: Validating primary data. [2025-10-15T17:48:30.991568] [DEBUG] [VALIDATOR ] BTT: All expected trading days are present. [2025-10-15T17:48:30.991707] [DEBUG] [VALIDATOR ] BTT: Primary data validation passed. [2025-10-15T17:48:30.992290] [INFO ] [MAIN ] BTT: Fetched primary data is valid. [2025-10-15T17:48:30.992333] [DEBUG] [LOCAL ] BTT: Saving primary data. [2025-10-15T17:48:30.992956] [DEBUG] [LOCAL ] BTT: Trimmed 22911 records to 15721 (keeping 200 days of data) [2025-10-15T17:48:31.086665] [DEBUG] [LOCAL ] BTT: Primary data saved (15721 records). [2025-10-15T17:48:31.086829] [INFO ] [MAIN ] BTT: Full history saved. [2025-10-15T17:48:31.086911] [INFO ] [MAIN ] Update Progress: 353/2369 symbols completed. BTT took 23.3s. Estimated remaining: 4h 36m 40s. Rate: 7.3 symbols/min [2025-10-15T17:48:31.265804] [INFO ] [MAIN ] BUI: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:48:31.282430] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-15T17:48:31.298505] [DEBUG] [LOCAL ] BUI: Loaded 11942 existing records from primary storage. [2025-10-15T17:48:31.298814] [INFO ] [MAIN ] BUI: Loaded 11942 existing records. [2025-10-15T17:48:31.319184] [INFO ] [REMOTE ] BUD: Fetching primary data for 2024-12. [2025-10-15T17:48:31.474194] [WARN ] [MAIN ] BUI: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:48:31.474430] [INFO ] [MAIN ] BUI: Wiping existing primary data before full refresh. [2025-10-15T17:48:31.474479] [INFO ] [LOCAL ] BUI: Starting deletion of primary data. [2025-10-15T17:48:31.474821] [DEBUG] [LOCAL ] BUI: Deleted primary data file. [2025-10-15T17:48:31.474881] [INFO ] [MAIN ] BUI: Starting full primary refresh. [2025-10-15T17:48:31.813824] [INFO ] [REMOTE ] BUI: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:48:32.114020] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-10. [2025-10-15T17:48:32.914067] [INFO ] [REMOTE ] BUI: Fetching primary data for 2024-12. [2025-10-15T17:48:33.401773] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2024-12 (2.08 seconds). [2025-10-15T17:48:33.714040] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-03. [2025-10-15T17:48:33.863182] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-10-15T17:48:34.061194] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-10 (1.95 seconds). [2025-10-15T17:48:34.067620] [INFO ] [REMOTE ] BTI: Full fetch complete (77636 records). [2025-10-15T17:48:34.067782] [DEBUG] [VALIDATOR ] BTI: Validating primary data. [2025-10-15T17:48:34.480843] [DEBUG] [VALIDATOR ] BTI: All expected trading days are present. [2025-10-15T17:48:34.480955] [DEBUG] [VALIDATOR ] BTI: Primary data validation passed. [2025-10-15T17:48:34.482264] [INFO ] [MAIN ] BTI: Fetched primary data is valid. [2025-10-15T17:48:34.482345] [DEBUG] [LOCAL ] BTI: Saving primary data. [2025-10-15T17:48:34.484454] [DEBUG] [LOCAL ] BTI: Trimmed 77636 records to 53596 (keeping 200 days of data) [2025-10-15T17:48:34.541360] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-01. [2025-10-15T17:48:34.843608] [DEBUG] [LOCAL ] BTI: Primary data saved (53596 records). [2025-10-15T17:48:34.852283] [INFO ] [MAIN ] BTI: Full history saved. [2025-10-15T17:48:34.858162] [INFO ] [MAIN ] Update Progress: 354/2369 symbols completed. BTI took 51.3s. Estimated remaining: 4h 36m 6s. Rate: 7.3 symbols/min [2025-10-15T17:48:34.859610] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-15T17:48:35.053942] [INFO ] [MAIN ] BUR: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:48:35.105177] [DEBUG] [LOCAL ] BUR: Loaded 45343 existing records from primary storage. [2025-10-15T17:48:35.105805] [INFO ] [MAIN ] BUR: Loaded 45343 existing records. [2025-10-15T17:48:35.295571] [WARN ] [MAIN ] BUR: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:48:35.295922] [INFO ] [MAIN ] BUR: Wiping existing primary data before full refresh. [2025-10-15T17:48:35.295977] [INFO ] [LOCAL ] BUR: Starting deletion of primary data. [2025-10-15T17:48:35.297130] [DEBUG] [LOCAL ] BUR: Deleted primary data file. [2025-10-15T17:48:35.297192] [INFO ] [MAIN ] BUR: Starting full primary refresh. [2025-10-15T17:48:35.319301] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-01. [2025-10-15T17:48:35.672878] [INFO ] [REMOTE ] BUR: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:48:36.113973] [INFO ] [REMOTE ] BUR: Fetching primary data for 2024-12. [2025-10-15T17:48:36.199297] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-15T17:48:36.566215] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-01 (2.02 seconds). [2025-10-15T17:48:36.914014] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-04. [2025-10-15T17:48:37.376461] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-15T17:48:37.714064] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-01. [2025-10-15T17:48:38.214247] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-15T17:48:38.514066] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-02. [2025-10-15T17:48:38.983739] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-15T17:48:39.115199] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-15T17:48:39.314038] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-02. [2025-10-15T17:48:40.114071] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-05. [2025-10-15T17:48:40.921207] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-02. [2025-10-15T17:48:40.926627] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-15T17:48:41.265999] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-15T17:48:41.714015] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-06. [2025-10-15T17:48:42.141181] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-15T17:48:42.472003] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-15T17:48:42.513965] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-07. [2025-10-15T17:48:43.313982] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-03. [2025-10-15T17:48:43.551517] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-15T17:48:44.033262] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-15T17:48:44.114023] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-04. [2025-10-15T17:48:44.913977] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-03. [2025-10-15T17:48:45.026795] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-15T17:48:45.714007] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-05. [2025-10-15T17:48:46.513977] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-08. [2025-10-15T17:48:46.544553] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-15T17:48:46.956087] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-10-15T17:48:47.319080] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-03. [2025-10-15T17:48:47.331087] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-15T17:48:48.114018] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-06. [2025-10-15T17:48:48.856431] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-15T17:48:48.879357] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-15T17:48:48.913960] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-07. [2025-10-15T17:48:49.713982] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-09. [2025-10-15T17:48:49.924366] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-15T17:48:50.513975] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-04. [2025-10-15T17:48:50.800853] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-15T17:48:51.314037] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-10. [2025-10-15T17:48:52.114029] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-04. [2025-10-15T17:48:52.142242] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-15T17:48:52.804959] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-15T17:48:52.808201] [INFO ] [REMOTE ] BTZ: Full fetch complete (33426 records). [2025-10-15T17:48:52.808276] [DEBUG] [VALIDATOR ] BTZ: Validating primary data. [2025-10-15T17:48:52.919131] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-05. [2025-10-15T17:48:53.184057] [DEBUG] [VALIDATOR ] BTZ: All expected trading days are present. [2025-10-15T17:48:53.184139] [DEBUG] [VALIDATOR ] BTZ: Primary data validation passed. [2025-10-15T17:48:53.184762] [INFO ] [MAIN ] BTZ: Fetched primary data is valid. [2025-10-15T17:48:53.184843] [DEBUG] [LOCAL ] BTZ: Saving primary data. [2025-10-15T17:48:53.185670] [DEBUG] [LOCAL ] BTZ: Trimmed 33426 records to 22588 (keeping 200 days of data) [2025-10-15T17:48:53.318428] [DEBUG] [LOCAL ] BTZ: Primary data saved (22588 records). [2025-10-15T17:48:53.318576] [INFO ] [MAIN ] BTZ: Full history saved. [2025-10-15T17:48:53.318678] [INFO ] [MAIN ] Update Progress: 355/2369 symbols completed. BTZ took 28.2s. Estimated remaining: 4h 36m 56s. Rate: 7.3 symbols/min [2025-10-15T17:48:53.485183] [INFO ] [MAIN ] BURL: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:48:53.527009] [DEBUG] [LOCAL ] BURL: Loaded 45744 existing records from primary storage. [2025-10-15T17:48:53.527321] [INFO ] [MAIN ] BURL: Loaded 45744 existing records. [2025-10-15T17:48:53.710947] [WARN ] [MAIN ] BURL: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:48:53.711233] [INFO ] [MAIN ] BURL: Wiping existing primary data before full refresh. [2025-10-15T17:48:53.711302] [INFO ] [LOCAL ] BURL: Starting deletion of primary data. [2025-10-15T17:48:53.711684] [DEBUG] [LOCAL ] BURL: Deleted primary data file. [2025-10-15T17:48:53.711800] [INFO ] [MAIN ] BURL: Starting full primary refresh. [2025-10-15T17:48:53.731726] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-08. [2025-10-15T17:48:54.016824] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-15T17:48:54.109238] [INFO ] [REMOTE ] BURL: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:48:54.253751] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-15T17:48:54.351332] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-15T17:48:54.514025] [INFO ] [REMOTE ] BURL: Fetching primary data for 2024-12. [2025-10-15T17:48:55.313984] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-06. [2025-10-15T17:48:56.114012] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-09. [2025-10-15T17:48:56.311116] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-15T17:48:56.779750] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-15T17:48:56.826044] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-15T17:48:56.913994] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-05. [2025-10-15T17:48:57.714006] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-10. [2025-10-15T17:48:58.513961] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-07. [2025-10-15T17:48:58.578774] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-15T17:48:58.632874] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-15T17:48:58.634865] [INFO ] [REMOTE ] BUI: Full fetch complete (16577 records). [2025-10-15T17:48:58.634935] [DEBUG] [VALIDATOR ] BUI: Validating primary data. [2025-10-15T17:48:59.018052] [DEBUG] [VALIDATOR ] BUI: All expected trading days are present. [2025-10-15T17:48:59.018134] [DEBUG] [VALIDATOR ] BUI: Primary data validation passed. [2025-10-15T17:48:59.018515] [INFO ] [MAIN ] BUI: Fetched primary data is valid. [2025-10-15T17:48:59.018575] [DEBUG] [LOCAL ] BUI: Saving primary data. [2025-10-15T17:48:59.019163] [DEBUG] [LOCAL ] BUI: Trimmed 16577 records to 11893 (keeping 200 days of data) [2025-10-15T17:48:59.090964] [DEBUG] [LOCAL ] BUI: Primary data saved (11893 records). [2025-10-15T17:48:59.091113] [INFO ] [MAIN ] BUI: Full history saved. [2025-10-15T17:48:59.091196] [INFO ] [MAIN ] Update Progress: 356/2369 symbols completed. BUI took 28.0s. Estimated remaining: 4h 36m 33s. Rate: 7.3 symbols/min [2025-10-15T17:48:59.278824] [INFO ] [MAIN ] BUXX: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:48:59.279226] [DEBUG] [LOCAL ] BUXX: No existing data file found in primary storage. [2025-10-15T17:48:59.279285] [WARN ] [MAIN ] BUXX: No existing data found, performing full refresh instead. [2025-10-15T17:48:59.279412] [INFO ] [MAIN ] BUXX: Wiping existing primary data before full refresh. [2025-10-15T17:48:59.279477] [INFO ] [LOCAL ] BUXX: Starting deletion of primary data. [2025-10-15T17:48:59.279520] [DEBUG] [LOCAL ] BUXX: No primary data file found to delete. [2025-10-15T17:48:59.279554] [INFO ] [MAIN ] BUXX: Starting full primary refresh. [2025-10-15T17:48:59.319205] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-06. [2025-10-15T17:48:59.670876] [INFO ] [REMOTE ] BUXX: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:49:00.114026] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2024-12. [2025-10-15T17:49:00.311376] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-15T17:49:00.913962] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-08. [2025-10-15T17:49:00.923533] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-10-15T17:49:01.303925] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-10-15T17:49:01.714051] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-01. [2025-10-15T17:49:02.396688] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-15T17:49:02.514000] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-01. [2025-10-15T17:49:02.601476] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-15T17:49:03.314011] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-09. [2025-10-15T17:49:04.114076] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-02. [2025-10-15T17:49:04.202497] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-15T17:49:04.901827] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-15T17:49:04.904298] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-15T17:49:04.916543] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-02. [2025-10-15T17:49:05.714090] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-03. [2025-10-15T17:49:06.250550] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-15T17:49:06.417972] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-15T17:49:06.513972] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-04. [2025-10-15T17:49:07.314012] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-10. [2025-10-15T17:49:07.387979] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-15T17:49:08.114070] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-05. [2025-10-15T17:49:08.760204] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-15T17:49:08.766423] [INFO ] [REMOTE ] BUR: Full fetch complete (64108 records). [2025-10-15T17:49:08.766624] [DEBUG] [VALIDATOR ] BUR: Validating primary data. [2025-10-15T17:49:08.922125] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-07. [2025-10-15T17:49:09.141150] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-15T17:49:09.218015] [DEBUG] [VALIDATOR ] BUR: All expected trading days are present. [2025-10-15T17:49:09.218130] [DEBUG] [VALIDATOR ] BUR: Primary data validation passed. [2025-10-15T17:49:09.219371] [INFO ] [MAIN ] BUR: Fetched primary data is valid. [2025-10-15T17:49:09.219447] [DEBUG] [LOCAL ] BUR: Saving primary data. [2025-10-15T17:49:09.221405] [DEBUG] [LOCAL ] BUR: Trimmed 64108 records to 45344 (keeping 200 days of data) [2025-10-15T17:49:09.501114] [DEBUG] [LOCAL ] BUR: Primary data saved (45344 records). [2025-10-15T17:49:09.501292] [INFO ] [MAIN ] BUR: Full history saved. [2025-10-15T17:49:09.501573] [INFO ] [MAIN ] Update Progress: 357/2369 symbols completed. BUR took 34.6s. Estimated remaining: 4h 36m 37s. Rate: 7.3 symbols/min [2025-10-15T17:49:09.714074] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-03. [2025-10-15T17:49:10.514128] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-06. [2025-10-15T17:49:11.043362] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-10-15T17:49:11.313978] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-08. [2025-10-15T17:49:11.354021] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-15T17:49:11.515581] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-15T17:49:12.114044] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-07. [2025-10-15T17:49:12.823799] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-15T17:49:12.913956] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-09. [2025-10-15T17:49:12.993902] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-15T17:49:13.714054] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-08. [2025-10-15T17:49:14.409790] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-15T17:49:14.492840] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-15T17:49:14.513970] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-10. [2025-10-15T17:49:15.314139] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-09. [2025-10-15T17:49:16.060036] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-15T17:49:16.113966] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-10. [2025-10-15T17:49:16.264752] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-15T17:49:16.271126] [INFO ] [REMOTE ] BUD: Full fetch complete (76496 records). [2025-10-15T17:49:16.271280] [DEBUG] [VALIDATOR ] BUD: Validating primary data. [2025-10-15T17:49:16.672854] [DEBUG] [VALIDATOR ] BUD: All expected trading days are present. [2025-10-15T17:49:16.672948] [DEBUG] [VALIDATOR ] BUD: Primary data validation passed. [2025-10-15T17:49:16.674266] [INFO ] [MAIN ] BUD: Fetched primary data is valid. [2025-10-15T17:49:16.674331] [DEBUG] [LOCAL ] BUD: Saving primary data. [2025-10-15T17:49:16.676010] [DEBUG] [LOCAL ] BUD: Trimmed 76496 records to 52596 (keeping 200 days of data) [2025-10-15T17:49:16.915100] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-04. [2025-10-15T17:49:16.988864] [DEBUG] [LOCAL ] BUD: Primary data saved (52596 records). [2025-10-15T17:49:16.988988] [INFO ] [MAIN ] BUD: Full history saved. [2025-10-15T17:49:16.989065] [INFO ] [MAIN ] Update Progress: 358/2369 symbols completed. BUD took 49.6s. Estimated remaining: 4h 36m 25s. Rate: 7.3 symbols/min [2025-10-15T17:49:17.014583] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-15T17:49:17.016547] [INFO ] [REMOTE ] BUXX: Full fetch complete (20454 records). [2025-10-15T17:49:17.016634] [DEBUG] [VALIDATOR ] BUXX: Validating primary data. [2025-10-15T17:49:17.017090] [FATAL] [VALIDATOR ] BUXX: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T17:49:17.017183] [FATAL] [MAIN ] BUXX: Fetched primary data is invalid. Refusing to save it. [2025-10-15T17:49:17.017227] [WARN ] [MAIN ] BUXX: Deleting existing primary and derivative data due to validation failure. [2025-10-15T17:49:17.017265] [INFO ] [LOCAL ] BUXX: Starting deletion of primary data. [2025-10-15T17:49:17.017321] [DEBUG] [LOCAL ] BUXX: No primary data file found to delete. [2025-10-15T17:49:17.017384] [INFO ] [LOCAL ] BUXX: Starting deletion of derivative data. [2025-10-15T17:49:17.017459] [DEBUG] [LOCAL ] BUXX: No derivative data file found to delete. [2025-10-15T17:49:17.017611] [INFO ] [MAIN ] Update Progress: 359/2369 symbols completed. BUXX took 17.9s. Estimated remaining: 4h 35m 31s. Rate: 7.3 symbols/min [2025-10-15T17:49:18.725085] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-15T17:49:18.735988] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-05. [2025-10-15T17:49:20.275281] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-15T17:49:20.286038] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-06. [2025-10-15T17:49:21.821602] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-15T17:49:21.831600] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-07. [2025-10-15T17:49:23.377601] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-15T17:49:23.387734] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-08. [2025-10-15T17:49:25.033459] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-15T17:49:25.043997] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-09. [2025-10-15T17:49:26.729112] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-15T17:49:26.739752] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-10. [2025-10-15T17:49:28.217061] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-15T17:49:28.222420] [INFO ] [REMOTE ] BURL: Full fetch complete (65853 records). [2025-10-15T17:49:28.222551] [DEBUG] [VALIDATOR ] BURL: Validating primary data. [2025-10-15T17:49:28.635461] [DEBUG] [VALIDATOR ] BURL: All expected trading days are present. [2025-10-15T17:49:28.635617] [DEBUG] [VALIDATOR ] BURL: Primary data validation passed. [2025-10-15T17:49:28.638096] [INFO ] [MAIN ] BURL: Fetched primary data is valid. [2025-10-15T17:49:28.638177] [DEBUG] [LOCAL ] BURL: Saving primary data. [2025-10-15T17:49:28.640268] [DEBUG] [LOCAL ] BURL: Trimmed 65853 records to 45707 (keeping 200 days of data) [2025-10-15T17:49:28.939579] [DEBUG] [LOCAL ] BURL: Primary data saved (45707 records). [2025-10-15T17:49:28.939784] [INFO ] [MAIN ] BURL: Full history saved. [2025-10-15T17:49:28.939896] [INFO ] [MAIN ] Update Progress: 360/2369 symbols completed. BURL took 35.6s. Estimated remaining: 4h 35m 43s. Rate: 7.3 symbols/min [2025-10-15T17:49:29.537331] [INFO ] [MAIN ] BVN: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:49:29.602812] [INFO ] [MAIN ] BWA: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:49:29.689943] [INFO ] [MAIN ] BW: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:49:29.716967] [INFO ] [MAIN ] BV: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:49:29.787934] [DEBUG] [LOCAL ] BVN: Loaded 44242 existing records from primary storage. [2025-10-15T17:49:29.801020] [INFO ] [MAIN ] BVN: Loaded 44242 existing records. [2025-10-15T17:49:29.942681] [DEBUG] [LOCAL ] BW: Loaded 40458 existing records from primary storage. [2025-10-15T17:49:29.941805] [DEBUG] [LOCAL ] BWA: Loaded 52150 existing records from primary storage. [2025-10-15T17:49:29.964129] [INFO ] [MAIN ] BWA: Loaded 52150 existing records. [2025-10-15T17:49:29.958592] [INFO ] [MAIN ] BW: Loaded 40458 existing records. [2025-10-15T17:49:29.958329] [DEBUG] [LOCAL ] BV: Loaded 38559 existing records from primary storage. [2025-10-15T17:49:30.026927] [INFO ] [MAIN ] BV: Loaded 38559 existing records. [2025-10-15T17:49:30.273747] [WARN ] [MAIN ] BVN: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:49:30.384806] [INFO ] [MAIN ] BVN: Wiping existing primary data before full refresh. [2025-10-15T17:49:30.433039] [INFO ] [LOCAL ] BVN: Starting deletion of primary data. [2025-10-15T17:49:30.549708] [DEBUG] [LOCAL ] BVN: Deleted primary data file. [2025-10-15T17:49:30.583480] [INFO ] [MAIN ] BVN: Starting full primary refresh. [2025-10-15T17:49:30.673170] [WARN ] [MAIN ] BWA: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:49:30.679146] [INFO ] [MAIN ] BWA: Wiping existing primary data before full refresh. [2025-10-15T17:49:30.745606] [WARN ] [MAIN ] BW: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:49:30.691607] [INFO ] [LOCAL ] BWA: Starting deletion of primary data. [2025-10-15T17:49:30.759032] [INFO ] [MAIN ] BW: Wiping existing primary data before full refresh. [2025-10-15T17:49:30.815857] [INFO ] [LOCAL ] BW: Starting deletion of primary data. [2025-10-15T17:49:30.821583] [DEBUG] [LOCAL ] BWA: Deleted primary data file. [2025-10-15T17:49:30.833547] [INFO ] [MAIN ] BWA: Starting full primary refresh. [2025-10-15T17:49:30.863584] [DEBUG] [LOCAL ] BW: Deleted primary data file. [2025-10-15T17:49:30.902310] [INFO ] [MAIN ] BW: Starting full primary refresh. [2025-10-15T17:49:30.975461] [WARN ] [MAIN ] BV: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:49:31.091574] [INFO ] [MAIN ] BV: Wiping existing primary data before full refresh. [2025-10-15T17:49:31.134052] [INFO ] [LOCAL ] BV: Starting deletion of primary data. [2025-10-15T17:49:31.220034] [DEBUG] [LOCAL ] BV: Deleted primary data file. [2025-10-15T17:49:31.431469] [INFO ] [MAIN ] BV: Starting full primary refresh. [2025-10-15T17:49:32.132071] [INFO ] [REMOTE ] BVN: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:49:32.201230] [INFO ] [REMOTE ] BVN: Fetching primary data for 2024-12. [2025-10-15T17:49:32.382863] [INFO ] [REMOTE ] BWA: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:49:32.423817] [INFO ] [REMOTE ] BWA: Fetching primary data for 2024-12. [2025-10-15T17:49:32.524220] [INFO ] [REMOTE ] BW: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:49:32.560616] [INFO ] [REMOTE ] BW: Fetching primary data for 2024-12. [2025-10-15T17:49:32.675628] [INFO ] [REMOTE ] BV: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:49:32.676027] [INFO ] [REMOTE ] BV: Fetching primary data for 2024-12. [2025-10-15T17:49:33.743042] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-15T17:49:33.752951] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-01. [2025-10-15T17:49:34.054761] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-15T17:49:34.062966] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-01. [2025-10-15T17:49:34.148570] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-15T17:49:34.157787] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-01. [2025-10-15T17:49:34.366198] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-10-15T17:49:34.378193] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-01. [2025-10-15T17:49:34.892244] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-15T17:49:34.898894] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-02. [2025-10-15T17:49:34.956158] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-15T17:49:34.964291] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-02. [2025-10-15T17:49:35.329127] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-15T17:49:35.337859] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-02. [2025-10-15T17:49:36.102571] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-15T17:49:36.113571] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-02. [2025-10-15T17:49:36.160470] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-15T17:49:36.169297] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-03. [2025-10-15T17:49:36.244296] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-15T17:49:36.253752] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-03. [2025-10-15T17:49:36.312314] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-15T17:49:36.320637] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-03. [2025-10-15T17:49:37.354424] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-15T17:49:37.365809] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-03. [2025-10-15T17:49:37.456548] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-15T17:49:37.466163] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-04. [2025-10-15T17:49:37.541937] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-15T17:49:37.551758] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-04. [2025-10-15T17:49:37.905846] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-15T17:49:37.915793] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-04. [2025-10-15T17:49:38.626737] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-15T17:49:38.635492] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-05. [2025-10-15T17:49:38.735295] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-15T17:49:38.748163] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-04. [2025-10-15T17:49:39.121341] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-15T17:49:39.314043] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-05. [2025-10-15T17:49:39.539186] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-15T17:49:39.759999] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-15T17:49:40.114030] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-05. [2025-10-15T17:49:40.184242] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-15T17:49:40.431374] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-15T17:49:40.914048] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-05. [2025-10-15T17:49:41.218392] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-15T17:49:41.714030] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-06. [2025-10-15T17:49:42.516322] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-06. [2025-10-15T17:49:42.521795] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-15T17:49:43.014770] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-15T17:49:43.314056] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-07. [2025-10-15T17:49:43.674358] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-15T17:49:44.114003] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-06. [2025-10-15T17:49:44.914011] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-07. [2025-10-15T17:49:44.941295] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-15T17:49:45.714021] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-08. [2025-10-15T17:49:45.844889] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-15T17:49:46.137516] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-15T17:49:46.514033] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-07. [2025-10-15T17:49:47.211707] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-15T17:49:47.313954] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-09. [2025-10-15T17:49:48.113966] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-06. [2025-10-15T17:49:48.371730] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-15T17:49:48.885574] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-15T17:49:48.913950] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-10. [2025-10-15T17:49:49.506843] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-15T17:49:49.713973] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-08. [2025-10-15T17:49:50.514031] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-07. [2025-10-15T17:49:50.627109] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-15T17:49:50.632931] [INFO ] [REMOTE ] BVN: Full fetch complete (63226 records). [2025-10-15T17:49:50.633039] [DEBUG] [VALIDATOR ] BVN: Validating primary data. [2025-10-15T17:49:51.017272] [DEBUG] [VALIDATOR ] BVN: All expected trading days are present. [2025-10-15T17:49:51.017528] [DEBUG] [VALIDATOR ] BVN: Primary data validation passed. [2025-10-15T17:49:51.018402] [INFO ] [MAIN ] BVN: Fetched primary data is valid. [2025-10-15T17:49:51.026100] [DEBUG] [LOCAL ] BVN: Saving primary data. [2025-10-15T17:49:51.041363] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-15T17:49:51.049686] [DEBUG] [LOCAL ] BVN: Trimmed 63226 records to 44301 (keeping 200 days of data) [2025-10-15T17:49:51.320226] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-08. [2025-10-15T17:49:51.334736] [DEBUG] [LOCAL ] BVN: Primary data saved (44301 records). [2025-10-15T17:49:51.334884] [INFO ] [MAIN ] BVN: Full history saved. [2025-10-15T17:49:51.335000] [INFO ] [MAIN ] Update Progress: 361/2369 symbols completed. BVN took 22.4s. Estimated remaining: 4h 36m 54s. Rate: 7.3 symbols/min [2025-10-15T17:49:51.505440] [INFO ] [MAIN ] BWG: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:49:51.517360] [DEBUG] [LOCAL ] BWG: Loaded 12616 existing records from primary storage. [2025-10-15T17:49:51.517551] [INFO ] [MAIN ] BWG: Loaded 12616 existing records. [2025-10-15T17:49:51.692807] [WARN ] [MAIN ] BWG: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:49:51.693098] [INFO ] [MAIN ] BWG: Wiping existing primary data before full refresh. [2025-10-15T17:49:51.693156] [INFO ] [LOCAL ] BWG: Starting deletion of primary data. [2025-10-15T17:49:51.693497] [DEBUG] [LOCAL ] BWG: Deleted primary data file. [2025-10-15T17:49:51.693554] [INFO ] [MAIN ] BWG: Starting full primary refresh. [2025-10-15T17:49:51.953630] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-15T17:49:52.089451] [INFO ] [REMOTE ] BWG: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:49:52.114018] [INFO ] [REMOTE ] BWG: Fetching primary data for 2024-12. [2025-10-15T17:49:52.765757] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-15T17:49:52.785562] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-10-15T17:49:52.913998] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-01. [2025-10-15T17:49:53.714067] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-08. [2025-10-15T17:49:53.876228] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-15T17:49:54.513998] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-09. [2025-10-15T17:49:55.237169] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-15T17:49:55.313961] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-09. [2025-10-15T17:49:55.851752] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-15T17:49:56.113993] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-10. [2025-10-15T17:49:56.900783] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-15T17:49:56.913959] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-10. [2025-10-15T17:49:57.652727] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-15T17:49:57.661576] [INFO ] [REMOTE ] BWA: Full fetch complete (75899 records). [2025-10-15T17:49:57.661851] [DEBUG] [VALIDATOR ] BWA: Validating primary data. [2025-10-15T17:49:57.721538] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-09. [2025-10-15T17:49:58.097104] [DEBUG] [VALIDATOR ] BWA: All expected trading days are present. [2025-10-15T17:49:58.097235] [DEBUG] [VALIDATOR ] BWA: Primary data validation passed. [2025-10-15T17:49:58.098919] [INFO ] [MAIN ] BWA: Fetched primary data is valid. [2025-10-15T17:49:58.098994] [DEBUG] [LOCAL ] BWA: Saving primary data. [2025-10-15T17:49:58.101246] [DEBUG] [LOCAL ] BWA: Trimmed 75899 records to 52138 (keeping 200 days of data) [2025-10-15T17:49:58.455172] [DEBUG] [LOCAL ] BWA: Primary data saved (52138 records). [2025-10-15T17:49:58.455403] [INFO ] [MAIN ] BWA: Full history saved. [2025-10-15T17:49:58.455524] [INFO ] [MAIN ] Update Progress: 362/2369 symbols completed. BWA took 29.5s. Estimated remaining: 4h 36m 39s. Rate: 7.3 symbols/min [2025-10-15T17:49:58.528283] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-02. [2025-10-15T17:49:58.640315] [INFO ] [MAIN ] BWLP: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:49:58.676254] [DEBUG] [LOCAL ] BWLP: Loaded 32295 existing records from primary storage. [2025-10-15T17:49:58.676621] [INFO ] [MAIN ] BWLP: Loaded 32295 existing records. [2025-10-15T17:49:58.877028] [WARN ] [MAIN ] BWLP: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:49:58.888176] [INFO ] [MAIN ] BWLP: Wiping existing primary data before full refresh. [2025-10-15T17:49:58.889607] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-10 (1.98 seconds). [2025-10-15T17:49:58.889776] [INFO ] [LOCAL ] BWLP: Starting deletion of primary data. [2025-10-15T17:49:58.896343] [INFO ] [REMOTE ] BW: Full fetch complete (59424 records). [2025-10-15T17:49:58.896627] [DEBUG] [VALIDATOR ] BW: Validating primary data. [2025-10-15T17:49:58.896517] [DEBUG] [LOCAL ] BWLP: Deleted primary data file. [2025-10-15T17:49:58.896854] [INFO ] [MAIN ] BWLP: Starting full primary refresh. [2025-10-15T17:49:59.252496] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-15T17:49:59.345017] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-03. [2025-10-15T17:49:59.407873] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-15T17:49:59.764735] [INFO ] [REMOTE ] BWLP: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:49:59.784469] [DEBUG] [VALIDATOR ] BW: All expected trading days are present. [2025-10-15T17:49:59.784561] [DEBUG] [VALIDATOR ] BW: Primary data validation passed. [2025-10-15T17:49:59.785373] [INFO ] [MAIN ] BW: Fetched primary data is valid. [2025-10-15T17:49:59.785435] [DEBUG] [LOCAL ] BW: Saving primary data. [2025-10-15T17:49:59.786790] [DEBUG] [LOCAL ] BW: Trimmed 59424 records to 40513 (keeping 200 days of data) [2025-10-15T17:50:00.022443] [DEBUG] [LOCAL ] BW: Primary data saved (40513 records). [2025-10-15T17:50:00.022590] [INFO ] [MAIN ] BW: Full history saved. [2025-10-15T17:50:00.022695] [INFO ] [MAIN ] Update Progress: 363/2369 symbols completed. BW took 31.1s. Estimated remaining: 4h 35m 54s. Rate: 7.3 symbols/min [2025-10-15T17:50:00.119244] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2024-12. [2025-10-15T17:50:00.194233] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-15T17:50:00.221479] [INFO ] [MAIN ] BWMX: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:50:00.233551] [DEBUG] [LOCAL ] BWMX: Loaded 7777 existing records from primary storage. [2025-10-15T17:50:00.233854] [INFO ] [MAIN ] BWMX: Loaded 7777 existing records. [2025-10-15T17:50:00.430281] [WARN ] [MAIN ] BWMX: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:50:00.430533] [INFO ] [MAIN ] BWMX: Wiping existing primary data before full refresh. [2025-10-15T17:50:00.430592] [INFO ] [LOCAL ] BWMX: Starting deletion of primary data. [2025-10-15T17:50:00.430892] [DEBUG] [LOCAL ] BWMX: Deleted primary data file. [2025-10-15T17:50:00.430979] [INFO ] [MAIN ] BWMX: Starting full primary refresh. [2025-10-15T17:50:00.794880] [INFO ] [REMOTE ] BWMX: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:50:00.914019] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-10. [2025-10-15T17:50:01.714070] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2024-12. [2025-10-15T17:50:01.968341] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-15T17:50:02.405120] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-15T17:50:02.410708] [INFO ] [REMOTE ] BV: Full fetch complete (54510 records). [2025-10-15T17:50:02.410908] [DEBUG] [VALIDATOR ] BV: Validating primary data. [2025-10-15T17:50:02.411900] [FATAL] [VALIDATOR ] BV: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T17:50:02.411993] [FATAL] [MAIN ] BV: Fetched primary data is invalid. Refusing to save it. [2025-10-15T17:50:02.412040] [WARN ] [MAIN ] BV: Deleting existing primary and derivative data due to validation failure. [2025-10-15T17:50:02.412109] [INFO ] [LOCAL ] BV: Starting deletion of primary data. [2025-10-15T17:50:02.412177] [DEBUG] [LOCAL ] BV: No primary data file found to delete. [2025-10-15T17:50:02.412216] [INFO ] [LOCAL ] BV: Starting deletion of derivative data. [2025-10-15T17:50:02.412368] [DEBUG] [LOCAL ] BV: Deleted derivative data file. [2025-10-15T17:50:02.412459] [INFO ] [MAIN ] Update Progress: 364/2369 symbols completed. BV took 33.5s. Estimated remaining: 4h 35m 13s. Rate: 7.3 symbols/min [2025-10-15T17:50:02.517070] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-01. [2025-10-15T17:50:02.624594] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-10-15T17:50:02.674676] [INFO ] [MAIN ] BWNB: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:50:02.685931] [DEBUG] [LOCAL ] BWNB: Loaded 4215 existing records from primary storage. [2025-10-15T17:50:02.686282] [INFO ] [MAIN ] BWNB: Loaded 4215 existing records. [2025-10-15T17:50:02.905103] [WARN ] [MAIN ] BWNB: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:50:02.905401] [INFO ] [MAIN ] BWNB: Wiping existing primary data before full refresh. [2025-10-15T17:50:02.905469] [INFO ] [LOCAL ] BWNB: Starting deletion of primary data. [2025-10-15T17:50:02.905739] [DEBUG] [LOCAL ] BWNB: Deleted primary data file. [2025-10-15T17:50:02.905802] [INFO ] [MAIN ] BWNB: Starting full primary refresh. [2025-10-15T17:50:03.298034] [INFO ] [REMOTE ] BWNB: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:50:03.314125] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2024-12. [2025-10-15T17:50:03.877416] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-15T17:50:04.054164] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-10-15T17:50:04.114024] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-01. [2025-10-15T17:50:04.754102] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-15T17:50:04.914073] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-01. [2025-10-15T17:50:05.369949] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-10-15T17:50:05.714095] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-02. [2025-10-15T17:50:06.294840] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-15T17:50:06.514014] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-04. [2025-10-15T17:50:07.314001] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-02. [2025-10-15T17:50:07.508863] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-15T17:50:08.114024] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-05. [2025-10-15T17:50:08.660755] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-15T17:50:08.776388] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-15T17:50:08.914086] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-06. [2025-10-15T17:50:09.528540] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-15T17:50:09.714046] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-03. [2025-10-15T17:50:10.514021] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-02. [2025-10-15T17:50:10.889086] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-15T17:50:10.902492] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-10-15T17:50:11.314033] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-04. [2025-10-15T17:50:12.114044] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-03. [2025-10-15T17:50:12.815582] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-15T17:50:12.859371] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-15T17:50:12.914109] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-05. [2025-10-15T17:50:13.714062] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-07. [2025-10-15T17:50:14.066675] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-15T17:50:14.514097] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-06. [2025-10-15T17:50:14.611635] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-15T17:50:15.314517] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-04. [2025-10-15T17:50:15.940979] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-15T17:50:16.011332] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-10-15T17:50:16.114021] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-07. [2025-10-15T17:50:16.914025] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-05. [2025-10-15T17:50:17.291478] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-15T17:50:17.331585] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-10-15T17:50:17.714002] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-08. [2025-10-15T17:50:18.513969] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-08. [2025-10-15T17:50:18.632149] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-15T17:50:19.314049] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-03. [2025-10-15T17:50:19.852483] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-15T17:50:19.887287] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-15T17:50:20.113993] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-04. [2025-10-15T17:50:20.799205] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-15T17:50:20.914032] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-06. [2025-10-15T17:50:21.411792] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-10-15T17:50:21.713997] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-05. [2025-10-15T17:50:22.251165] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-10-15T17:50:22.514013] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-09. [2025-10-15T17:50:23.313989] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-07. [2025-10-15T17:50:23.460916] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-15T17:50:23.744633] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-10-15T17:50:24.114044] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-10. [2025-10-15T17:50:24.886236] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-15T17:50:24.887973] [INFO ] [REMOTE ] BWG: Full fetch complete (17795 records). [2025-10-15T17:50:24.888058] [DEBUG] [VALIDATOR ] BWG: Validating primary data. [2025-10-15T17:50:24.921093] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-08. [2025-10-15T17:50:25.276318] [DEBUG] [VALIDATOR ] BWG: All expected trading days are present. [2025-10-15T17:50:25.276404] [DEBUG] [VALIDATOR ] BWG: Primary data validation passed. [2025-10-15T17:50:25.276866] [INFO ] [MAIN ] BWG: Fetched primary data is valid. [2025-10-15T17:50:25.276928] [DEBUG] [LOCAL ] BWG: Saving primary data. [2025-10-15T17:50:25.277492] [DEBUG] [LOCAL ] BWG: Trimmed 17795 records to 12586 (keeping 200 days of data) [2025-10-15T17:50:25.355886] [DEBUG] [LOCAL ] BWG: Primary data saved (12586 records). [2025-10-15T17:50:25.356097] [INFO ] [MAIN ] BWG: Full history saved. [2025-10-15T17:50:25.356238] [INFO ] [MAIN ] Update Progress: 365/2369 symbols completed. BWG took 34.0s. Estimated remaining: 4h 36m 26s. Rate: 7.2 symbols/min [2025-10-15T17:50:25.547093] [INFO ] [MAIN ] BWSN: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:50:25.553341] [DEBUG] [LOCAL ] BWSN: Loaded 5143 existing records from primary storage. [2025-10-15T17:50:25.553509] [INFO ] [MAIN ] BWSN: Loaded 5143 existing records. [2025-10-15T17:50:25.650102] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-15T17:50:25.715387] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-09. [2025-10-15T17:50:25.743829] [WARN ] [MAIN ] BWSN: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:50:25.744161] [INFO ] [MAIN ] BWSN: Wiping existing primary data before full refresh. [2025-10-15T17:50:25.744209] [INFO ] [LOCAL ] BWSN: Starting deletion of primary data. [2025-10-15T17:50:25.744463] [DEBUG] [LOCAL ] BWSN: Deleted primary data file. [2025-10-15T17:50:25.744522] [INFO ] [MAIN ] BWSN: Starting full primary refresh. [2025-10-15T17:50:26.107422] [INFO ] [REMOTE ] BWSN: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:50:26.514008] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-06. [2025-10-15T17:50:27.026894] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-10-15T17:50:27.292201] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-15T17:50:27.313953] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-10. [2025-10-15T17:50:28.114025] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2024-12. [2025-10-15T17:50:28.709888] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-15T17:50:28.714111] [INFO ] [REMOTE ] BWLP: Full fetch complete (48068 records). [2025-10-15T17:50:28.714208] [DEBUG] [VALIDATOR ] BWLP: Validating primary data. [2025-10-15T17:50:28.814206] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-10-15T17:50:28.919158] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-07. [2025-10-15T17:50:29.093764] [DEBUG] [VALIDATOR ] BWLP: All expected trading days are present. [2025-10-15T17:50:29.093855] [DEBUG] [VALIDATOR ] BWLP: Primary data validation passed. [2025-10-15T17:50:29.094559] [INFO ] [MAIN ] BWLP: Fetched primary data is valid. [2025-10-15T17:50:29.094599] [DEBUG] [LOCAL ] BWLP: Saving primary data. [2025-10-15T17:50:29.095614] [DEBUG] [LOCAL ] BWLP: Trimmed 48068 records to 32251 (keeping 200 days of data) [2025-10-15T17:50:29.303407] [DEBUG] [LOCAL ] BWLP: Primary data saved (32251 records). [2025-10-15T17:50:29.303581] [INFO ] [MAIN ] BWLP: Full history saved. [2025-10-15T17:50:29.303704] [INFO ] [MAIN ] Update Progress: 366/2369 symbols completed. BWLP took 30.8s. Estimated remaining: 4h 35m 54s. Rate: 7.3 symbols/min [2025-10-15T17:50:29.498547] [INFO ] [MAIN ] BWXT: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:50:29.547539] [DEBUG] [LOCAL ] BWXT: Loaded 47039 existing records from primary storage. [2025-10-15T17:50:29.547951] [INFO ] [MAIN ] BWXT: Loaded 47039 existing records. [2025-10-15T17:50:29.719162] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-09. [2025-10-15T17:50:29.753472] [WARN ] [MAIN ] BWXT: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:50:29.753928] [INFO ] [MAIN ] BWXT: Wiping existing primary data before full refresh. [2025-10-15T17:50:29.754098] [INFO ] [LOCAL ] BWXT: Starting deletion of primary data. [2025-10-15T17:50:29.755136] [DEBUG] [LOCAL ] BWXT: Deleted primary data file. [2025-10-15T17:50:29.755238] [INFO ] [MAIN ] BWXT: Starting full primary refresh. [2025-10-15T17:50:29.894087] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-15T17:50:30.146500] [INFO ] [REMOTE ] BWXT: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:50:30.440577] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-15T17:50:30.514055] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-08. [2025-10-15T17:50:31.313974] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2024-12. [2025-10-15T17:50:31.350403] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-15T17:50:32.113989] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-01. [2025-10-15T17:50:32.451133] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-01 (0.34 seconds). [2025-10-15T17:50:32.913973] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-09. [2025-10-15T17:50:33.002868] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-15T17:50:33.475690] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-10-15T17:50:33.713979] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-10. [2025-10-15T17:50:34.363618] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-15T17:50:34.365385] [INFO ] [REMOTE ] BWMX: Full fetch complete (10032 records). [2025-10-15T17:50:34.365468] [DEBUG] [VALIDATOR ] BWMX: Validating primary data. [2025-10-15T17:50:34.521682] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-10. [2025-10-15T17:50:34.737739] [DEBUG] [VALIDATOR ] BWMX: All expected trading days are present. [2025-10-15T17:50:34.737820] [DEBUG] [VALIDATOR ] BWMX: Primary data validation passed. [2025-10-15T17:50:34.738041] [INFO ] [MAIN ] BWMX: Fetched primary data is valid. [2025-10-15T17:50:34.738079] [DEBUG] [LOCAL ] BWMX: Saving primary data. [2025-10-15T17:50:34.738482] [DEBUG] [LOCAL ] BWMX: Trimmed 10032 records to 7781 (keeping 200 days of data) [2025-10-15T17:50:34.784186] [DEBUG] [LOCAL ] BWMX: Primary data saved (7781 records). [2025-10-15T17:50:34.784284] [INFO ] [MAIN ] BWMX: Full history saved. [2025-10-15T17:50:34.784355] [INFO ] [MAIN ] Update Progress: 367/2369 symbols completed. BWMX took 34.8s. Estimated remaining: 4h 35m 30s. Rate: 7.3 symbols/min [2025-10-15T17:50:34.947793] [INFO ] [MAIN ] BX: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:50:34.989985] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-15T17:50:34.990874] [INFO ] [REMOTE ] BWNB: Full fetch complete (5669 records). [2025-10-15T17:50:34.990948] [DEBUG] [VALIDATOR ] BWNB: Validating primary data. [2025-10-15T17:50:35.125324] [DEBUG] [LOCAL ] BX: Loaded 53484 existing records from primary storage. [2025-10-15T17:50:35.148547] [INFO ] [MAIN ] BX: Loaded 53484 existing records. [2025-10-15T17:50:35.319042] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-02. [2025-10-15T17:50:35.467192] [WARN ] [MAIN ] BX: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:50:35.483405] [INFO ] [MAIN ] BX: Wiping existing primary data before full refresh. [2025-10-15T17:50:35.488583] [INFO ] [LOCAL ] BX: Starting deletion of primary data. [2025-10-15T17:50:35.508110] [DEBUG] [LOCAL ] BX: Deleted primary data file. [2025-10-15T17:50:35.526977] [INFO ] [MAIN ] BX: Starting full primary refresh. [2025-10-15T17:50:35.611982] [DEBUG] [VALIDATOR ] BWNB: All expected trading days are present. [2025-10-15T17:50:35.628352] [DEBUG] [VALIDATOR ] BWNB: Primary data validation passed. [2025-10-15T17:50:35.638853] [INFO ] [MAIN ] BWNB: Fetched primary data is valid. [2025-10-15T17:50:35.646600] [DEBUG] [LOCAL ] BWNB: Saving primary data. [2025-10-15T17:50:35.649116] [DEBUG] [LOCAL ] BWNB: Trimmed 5669 records to 4206 (keeping 200 days of data) [2025-10-15T17:50:35.731910] [DEBUG] [LOCAL ] BWNB: Primary data saved (4206 records). [2025-10-15T17:50:35.733549] [INFO ] [MAIN ] BWNB: Full history saved. [2025-10-15T17:50:35.733678] [INFO ] [MAIN ] Update Progress: 368/2369 symbols completed. BWNB took 33.3s. Estimated remaining: 4h 34m 42s. Rate: 7.3 symbols/min [2025-10-15T17:50:35.831738] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-10-15T17:50:36.104315] [INFO ] [REMOTE ] BX: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:50:36.100587] [INFO ] [MAIN ] BXC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:50:36.117299] [INFO ] [REMOTE ] BX: Fetching primary data for 2024-12. [2025-10-15T17:50:36.118507] [DEBUG] [LOCAL ] BXC: Loaded 13691 existing records from primary storage. [2025-10-15T17:50:36.118699] [INFO ] [MAIN ] BXC: Loaded 13691 existing records. [2025-10-15T17:50:36.293871] [WARN ] [MAIN ] BXC: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:50:36.294016] [INFO ] [MAIN ] BXC: Wiping existing primary data before full refresh. [2025-10-15T17:50:36.294058] [INFO ] [LOCAL ] BXC: Starting deletion of primary data. [2025-10-15T17:50:36.294330] [DEBUG] [LOCAL ] BXC: Deleted primary data file. [2025-10-15T17:50:36.294369] [INFO ] [MAIN ] BXC: Starting full primary refresh. [2025-10-15T17:50:36.633690] [INFO ] [REMOTE ] BXC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:50:36.913959] [INFO ] [REMOTE ] BXC: Fetching primary data for 2024-12. [2025-10-15T17:50:37.713960] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-03. [2025-10-15T17:50:37.833901] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-10-15T17:50:38.102718] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-10-15T17:50:38.291440] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-15T17:50:38.513984] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-01. [2025-10-15T17:50:39.289624] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-15T17:50:39.313965] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-01. [2025-10-15T17:50:40.114006] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-04. [2025-10-15T17:50:40.702775] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-15T17:50:40.913968] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-05. [2025-10-15T17:50:41.162287] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-15T17:50:41.500145] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-15T17:50:41.713990] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-02. [2025-10-15T17:50:42.513997] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-02. [2025-10-15T17:50:43.066081] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-15T17:50:43.190435] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-15T17:50:43.313998] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-03. [2025-10-15T17:50:44.114006] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-06. [2025-10-15T17:50:44.126345] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-15T17:50:44.598090] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-10-15T17:50:44.914017] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-03. [2025-10-15T17:50:45.714057] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-04. [2025-10-15T17:50:46.514048] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-01. [2025-10-15T17:50:46.701019] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-15T17:50:46.723753] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-15T17:50:47.314049] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-07. [2025-10-15T17:50:47.800322] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-10-15T17:50:48.113975] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-04. [2025-10-15T17:50:48.206628] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-15T17:50:48.913980] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-02. [2025-10-15T17:50:49.713989] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-08. [2025-10-15T17:50:50.131436] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-10-15T17:50:50.388015] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-10-15T17:50:50.514048] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-05. [2025-10-15T17:50:50.690162] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-15T17:50:51.313996] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-05. [2025-10-15T17:50:52.120917] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-03. [2025-10-15T17:50:52.142376] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-15T17:50:52.162730] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-15T17:50:52.913991] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-06. [2025-10-15T17:50:53.719059] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-06. [2025-10-15T17:50:53.740547] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-15T17:50:54.469574] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-15T17:50:54.513958] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-09. [2025-10-15T17:50:54.536081] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-15T17:50:55.065598] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-15T17:50:55.314004] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-07. [2025-10-15T17:50:56.114017] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-07. [2025-10-15T17:50:56.914081] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-04. [2025-10-15T17:50:56.996012] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-15T17:50:57.358339] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-10-15T17:50:57.713995] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-10. [2025-10-15T17:50:58.336213] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-15T17:50:58.337539] [INFO ] [REMOTE ] BWSN: Full fetch complete (6358 records). [2025-10-15T17:50:58.337667] [DEBUG] [VALIDATOR ] BWSN: Validating primary data. [2025-10-15T17:50:58.521616] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-08. [2025-10-15T17:50:58.654174] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-15T17:50:58.735911] [DEBUG] [VALIDATOR ] BWSN: All expected trading days are present. [2025-10-15T17:50:58.735992] [DEBUG] [VALIDATOR ] BWSN: Primary data validation passed. [2025-10-15T17:50:58.736166] [INFO ] [MAIN ] BWSN: Fetched primary data is valid. [2025-10-15T17:50:58.736206] [DEBUG] [LOCAL ] BWSN: Saving primary data. [2025-10-15T17:50:58.736585] [DEBUG] [LOCAL ] BWSN: Trimmed 6358 records to 5154 (keeping 200 days of data) [2025-10-15T17:50:58.767117] [DEBUG] [LOCAL ] BWSN: Primary data saved (5154 records). [2025-10-15T17:50:58.767206] [INFO ] [MAIN ] BWSN: Full history saved. [2025-10-15T17:50:58.767281] [INFO ] [MAIN ] Update Progress: 369/2369 symbols completed. BWSN took 33.4s. Estimated remaining: 4h 35m 54s. Rate: 7.2 symbols/min [2025-10-15T17:50:58.941170] [INFO ] [MAIN ] BXMT: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:50:58.983330] [DEBUG] [LOCAL ] BXMT: Loaded 47304 existing records from primary storage. [2025-10-15T17:50:58.983679] [INFO ] [MAIN ] BXMT: Loaded 47304 existing records. [2025-10-15T17:50:59.162086] [WARN ] [MAIN ] BXMT: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:50:59.162287] [INFO ] [MAIN ] BXMT: Wiping existing primary data before full refresh. [2025-10-15T17:50:59.162378] [INFO ] [LOCAL ] BXMT: Starting deletion of primary data. [2025-10-15T17:50:59.163252] [DEBUG] [LOCAL ] BXMT: Deleted primary data file. [2025-10-15T17:50:59.163311] [INFO ] [MAIN ] BXMT: Starting full primary refresh. [2025-10-15T17:50:59.315884] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-05. [2025-10-15T17:50:59.532718] [INFO ] [REMOTE ] BXMT: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:50:59.533395] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-15T17:51:00.114077] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-09. [2025-10-15T17:51:00.913975] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2024-12. [2025-10-15T17:51:00.999091] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-15T17:51:01.246063] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-15T17:51:01.714214] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-06. [2025-10-15T17:51:02.500913] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-15T17:51:02.513961] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-01. [2025-10-15T17:51:03.140886] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-15T17:51:03.313997] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-07. [2025-10-15T17:51:04.114055] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-10. [2025-10-15T17:51:04.236336] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-15T17:51:04.913969] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-02. [2025-10-15T17:51:05.009930] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-15T17:51:05.013120] [INFO ] [REMOTE ] BXC: Full fetch complete (18242 records). [2025-10-15T17:51:05.013298] [DEBUG] [VALIDATOR ] BXC: Validating primary data. [2025-10-15T17:51:05.421281] [DEBUG] [VALIDATOR ] BXC: All expected trading days are present. [2025-10-15T17:51:05.421511] [DEBUG] [VALIDATOR ] BXC: Primary data validation passed. [2025-10-15T17:51:05.423839] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-10-15T17:51:05.422309] [INFO ] [MAIN ] BXC: Fetched primary data is valid. [2025-10-15T17:51:05.433502] [DEBUG] [LOCAL ] BXC: Saving primary data. [2025-10-15T17:51:05.434777] [DEBUG] [LOCAL ] BXC: Trimmed 18242 records to 13669 (keeping 200 days of data) [2025-10-15T17:51:05.513743] [DEBUG] [LOCAL ] BXC: Primary data saved (13669 records). [2025-10-15T17:51:05.513889] [INFO ] [MAIN ] BXC: Full history saved. [2025-10-15T17:51:05.513967] [INFO ] [MAIN ] Update Progress: 370/2369 symbols completed. BXC took 29.8s. Estimated remaining: 4h 35m 38s. Rate: 7.3 symbols/min [2025-10-15T17:51:05.682989] [INFO ] [MAIN ] BXMX: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:51:05.709705] [DEBUG] [LOCAL ] BXMX: Loaded 19577 existing records from primary storage. [2025-10-15T17:51:05.710286] [INFO ] [MAIN ] BXMX: Loaded 19577 existing records. [2025-10-15T17:51:05.725072] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-08. [2025-10-15T17:51:05.906386] [WARN ] [MAIN ] BXMX: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:51:05.906670] [INFO ] [MAIN ] BXMX: Wiping existing primary data before full refresh. [2025-10-15T17:51:05.906741] [INFO ] [LOCAL ] BXMX: Starting deletion of primary data. [2025-10-15T17:51:05.906920] [DEBUG] [LOCAL ] BXMX: Deleted primary data file. [2025-10-15T17:51:05.906962] [INFO ] [MAIN ] BXMX: Starting full primary refresh. [2025-10-15T17:51:06.275724] [INFO ] [REMOTE ] BXMX: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:51:06.303051] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-15T17:51:06.513999] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-08. [2025-10-15T17:51:07.313989] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-03. [2025-10-15T17:51:07.633108] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-15T17:51:08.113999] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-09. [2025-10-15T17:51:08.684056] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-08 (2.17 seconds). [2025-10-15T17:51:08.728868] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-15T17:51:08.914002] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-04. [2025-10-15T17:51:09.714011] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2024-12. [2025-10-15T17:51:10.172945] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-10-15T17:51:10.513977] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-10. [2025-10-15T17:51:10.618759] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-15T17:51:10.716198] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-10-15T17:51:11.314015] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-01. [2025-10-15T17:51:12.113964] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-05. [2025-10-15T17:51:12.205912] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-15T17:51:12.370973] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-10 (1.86 seconds). [2025-10-15T17:51:12.376843] [INFO ] [REMOTE ] BWXT: Full fetch complete (67831 records). [2025-10-15T17:51:12.376970] [DEBUG] [VALIDATOR ] BWXT: Validating primary data. [2025-10-15T17:51:12.759556] [DEBUG] [VALIDATOR ] BWXT: All expected trading days are present. [2025-10-15T17:51:12.759684] [DEBUG] [VALIDATOR ] BWXT: Primary data validation passed. [2025-10-15T17:51:12.760496] [INFO ] [MAIN ] BWXT: Fetched primary data is valid. [2025-10-15T17:51:12.760539] [DEBUG] [LOCAL ] BWXT: Saving primary data. [2025-10-15T17:51:12.761968] [DEBUG] [LOCAL ] BWXT: Trimmed 67831 records to 47121 (keeping 200 days of data) [2025-10-15T17:51:12.941709] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-09. [2025-10-15T17:51:13.065039] [DEBUG] [LOCAL ] BWXT: Primary data saved (47121 records). [2025-10-15T17:51:13.065219] [INFO ] [MAIN ] BWXT: Full history saved. [2025-10-15T17:51:13.065320] [INFO ] [MAIN ] Update Progress: 371/2369 symbols completed. BWXT took 43.8s. Estimated remaining: 4h 35m 25s. Rate: 7.3 symbols/min [2025-10-15T17:51:13.243227] [INFO ] [MAIN ] BXP: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:51:13.300739] [DEBUG] [LOCAL ] BXP: Loaded 49862 existing records from primary storage. [2025-10-15T17:51:13.301141] [INFO ] [MAIN ] BXP: Loaded 49862 existing records. [2025-10-15T17:51:13.541092] [WARN ] [MAIN ] BXP: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:51:13.541875] [INFO ] [MAIN ] BXP: Wiping existing primary data before full refresh. [2025-10-15T17:51:13.541979] [INFO ] [LOCAL ] BXP: Starting deletion of primary data. [2025-10-15T17:51:13.542538] [DEBUG] [LOCAL ] BXP: Deleted primary data file. [2025-10-15T17:51:13.542810] [INFO ] [MAIN ] BXP: Starting full primary refresh. [2025-10-15T17:51:13.689890] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-15T17:51:13.718028] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-02. [2025-10-15T17:51:13.969962] [INFO ] [REMOTE ] BXP: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:51:14.513969] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-06. [2025-10-15T17:51:14.758679] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-15T17:51:14.844879] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-15T17:51:15.314046] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-03. [2025-10-15T17:51:15.832175] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-15T17:51:16.113984] [INFO ] [REMOTE ] BXP: Fetching primary data for 2024-12. [2025-10-15T17:51:16.410399] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-15T17:51:16.914073] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-10. [2025-10-15T17:51:17.717980] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-04. [2025-10-15T17:51:17.730608] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-15T17:51:18.514012] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-01. [2025-10-15T17:51:18.691866] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-15T17:51:18.869369] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-10 (1.96 seconds). [2025-10-15T17:51:18.877670] [INFO ] [REMOTE ] BX: Full fetch complete (77573 records). [2025-10-15T17:51:18.877834] [DEBUG] [VALIDATOR ] BX: Validating primary data. [2025-10-15T17:51:19.318605] [DEBUG] [VALIDATOR ] BX: All expected trading days are present. [2025-10-15T17:51:19.318361] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-05. [2025-10-15T17:51:19.318754] [DEBUG] [VALIDATOR ] BX: Primary data validation passed. [2025-10-15T17:51:19.319774] [INFO ] [MAIN ] BX: Fetched primary data is valid. [2025-10-15T17:51:19.320690] [DEBUG] [LOCAL ] BX: Saving primary data. [2025-10-15T17:51:19.322417] [DEBUG] [LOCAL ] BX: Trimmed 77573 records to 53483 (keeping 200 days of data) [2025-10-15T17:51:19.671612] [DEBUG] [LOCAL ] BX: Primary data saved (53483 records). [2025-10-15T17:51:19.671887] [INFO ] [MAIN ] BX: Full history saved. [2025-10-15T17:51:19.673054] [INFO ] [MAIN ] Update Progress: 372/2369 symbols completed. BX took 44.9s. Estimated remaining: 4h 35m 8s. Rate: 7.3 symbols/min [2025-10-15T17:51:19.866609] [INFO ] [MAIN ] BXSL: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:51:19.913708] [DEBUG] [LOCAL ] BXSL: Loaded 48094 existing records from primary storage. [2025-10-15T17:51:19.914112] [INFO ] [MAIN ] BXSL: Loaded 48094 existing records. [2025-10-15T17:51:20.098171] [WARN ] [MAIN ] BXSL: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:51:20.098743] [INFO ] [MAIN ] BXSL: Wiping existing primary data before full refresh. [2025-10-15T17:51:20.098811] [INFO ] [LOCAL ] BXSL: Starting deletion of primary data. [2025-10-15T17:51:20.099313] [DEBUG] [LOCAL ] BXSL: Deleted primary data file. [2025-10-15T17:51:20.108414] [INFO ] [MAIN ] BXSL: Starting full primary refresh. [2025-10-15T17:51:20.121475] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-07. [2025-10-15T17:51:20.208097] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-15T17:51:20.474240] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-15T17:51:20.558191] [INFO ] [REMOTE ] BXSL: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:51:20.914019] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-02. [2025-10-15T17:51:21.548678] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-15T17:51:21.714022] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2024-12. [2025-10-15T17:51:22.086056] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-15T17:51:22.514055] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-06. [2025-10-15T17:51:23.313993] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-08. [2025-10-15T17:51:23.411296] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-15T17:51:23.662072] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-15T17:51:24.114005] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-07. [2025-10-15T17:51:24.913996] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-03. [2025-10-15T17:51:25.148027] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-15T17:51:25.200410] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-15T17:51:25.714050] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-09. [2025-10-15T17:51:26.446049] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-15T17:51:26.513974] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-08. [2025-10-15T17:51:27.272701] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-15T17:51:27.313960] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-04. [2025-10-15T17:51:27.548432] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-15T17:51:28.114063] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-01. [2025-10-15T17:51:28.914122] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-09. [2025-10-15T17:51:29.131603] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-15T17:51:29.320128] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-15T17:51:29.714030] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-05. [2025-10-15T17:51:29.917016] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-15T17:51:30.514009] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-10. [2025-10-15T17:51:31.315604] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-02. [2025-10-15T17:51:31.319043] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-15T17:51:32.115514] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-10. [2025-10-15T17:51:32.117784] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-15T17:51:32.123958] [INFO ] [REMOTE ] BXMT: Full fetch complete (69940 records). [2025-10-15T17:51:32.124079] [DEBUG] [VALIDATOR ] BXMT: Validating primary data. [2025-10-15T17:51:32.544207] [DEBUG] [VALIDATOR ] BXMT: All expected trading days are present. [2025-10-15T17:51:32.544366] [DEBUG] [VALIDATOR ] BXMT: Primary data validation passed. [2025-10-15T17:51:32.545970] [INFO ] [MAIN ] BXMT: Fetched primary data is valid. [2025-10-15T17:51:32.546079] [DEBUG] [LOCAL ] BXMT: Saving primary data. [2025-10-15T17:51:32.547984] [DEBUG] [LOCAL ] BXMT: Trimmed 69940 records to 47317 (keeping 200 days of data) [2025-10-15T17:51:32.845363] [DEBUG] [LOCAL ] BXMT: Primary data saved (47317 records). [2025-10-15T17:51:32.845935] [INFO ] [MAIN ] BXMT: Full history saved. [2025-10-15T17:51:32.846061] [INFO ] [MAIN ] Update Progress: 373/2369 symbols completed. BXMT took 34.1s. Estimated remaining: 4h 35m 26s. Rate: 7.2 symbols/min [2025-10-15T17:51:32.937432] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-06. [2025-10-15T17:51:32.937365] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-15T17:51:33.052837] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-15T17:51:33.069372] [INFO ] [MAIN ] BY: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:51:33.072011] [DEBUG] [LOCAL ] BY: No existing data file found in primary storage. [2025-10-15T17:51:33.072066] [WARN ] [MAIN ] BY: No existing data found, performing full refresh instead. [2025-10-15T17:51:33.072186] [INFO ] [REMOTE ] BXMX: Full fetch complete (28794 records). [2025-10-15T17:51:33.072328] [DEBUG] [VALIDATOR ] BXMX: Validating primary data. [2025-10-15T17:51:33.072395] [INFO ] [MAIN ] BY: Wiping existing primary data before full refresh. [2025-10-15T17:51:33.072474] [INFO ] [LOCAL ] BY: Starting deletion of primary data. [2025-10-15T17:51:33.072574] [DEBUG] [LOCAL ] BY: No primary data file found to delete. [2025-10-15T17:51:33.072787] [INFO ] [MAIN ] BY: Starting full primary refresh. [2025-10-15T17:51:33.714109] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-03. [2025-10-15T17:51:33.799401] [INFO ] [REMOTE ] BY: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:51:33.825408] [DEBUG] [VALIDATOR ] BXMX: All expected trading days are present. [2025-10-15T17:51:33.825935] [DEBUG] [VALIDATOR ] BXMX: Primary data validation passed. [2025-10-15T17:51:33.826393] [INFO ] [MAIN ] BXMX: Fetched primary data is valid. [2025-10-15T17:51:33.826434] [DEBUG] [LOCAL ] BXMX: Saving primary data. [2025-10-15T17:51:33.827109] [DEBUG] [LOCAL ] BXMX: Trimmed 28794 records to 19492 (keeping 200 days of data) [2025-10-15T17:51:33.941313] [DEBUG] [LOCAL ] BXMX: Primary data saved (19492 records). [2025-10-15T17:51:33.941454] [INFO ] [MAIN ] BXMX: Full history saved. [2025-10-15T17:51:33.941531] [INFO ] [MAIN ] Update Progress: 374/2369 symbols completed. BXMX took 28.4s. Estimated remaining: 4h 34m 40s. Rate: 7.3 symbols/min [2025-10-15T17:51:34.109377] [INFO ] [MAIN ] BYD: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:51:34.152428] [DEBUG] [LOCAL ] BYD: Loaded 44865 existing records from primary storage. [2025-10-15T17:51:34.152789] [INFO ] [MAIN ] BYD: Loaded 44865 existing records. [2025-10-15T17:51:34.326625] [WARN ] [MAIN ] BYD: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:51:34.326909] [INFO ] [MAIN ] BYD: Wiping existing primary data before full refresh. [2025-10-15T17:51:34.327021] [INFO ] [LOCAL ] BYD: Starting deletion of primary data. [2025-10-15T17:51:34.327443] [DEBUG] [LOCAL ] BYD: Deleted primary data file. [2025-10-15T17:51:34.327500] [INFO ] [MAIN ] BYD: Starting full primary refresh. [2025-10-15T17:51:34.524015] [INFO ] [REMOTE ] BY: Fetching primary data for 2024-12. [2025-10-15T17:51:34.683995] [INFO ] [REMOTE ] BYD: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:51:34.712220] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-15T17:51:35.313968] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-07. [2025-10-15T17:51:35.370709] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-15T17:51:35.498421] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-10-15T17:51:36.113999] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-04. [2025-10-15T17:51:36.656280] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-15T17:51:36.914051] [INFO ] [REMOTE ] BYD: Fetching primary data for 2024-12. [2025-10-15T17:51:37.591912] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-15T17:51:37.713998] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-05. [2025-10-15T17:51:38.523285] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-01. [2025-10-15T17:51:38.525635] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-15T17:51:39.095869] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-15T17:51:39.313980] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-08. [2025-10-15T17:51:39.497044] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-15T17:51:40.113989] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-01. [2025-10-15T17:51:40.819039] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-15T17:51:40.914013] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-09. [2025-10-15T17:51:41.698356] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-15T17:51:41.713957] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-02. [2025-10-15T17:51:42.514101] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-02. [2025-10-15T17:51:42.682966] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-15T17:51:43.245124] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-15T17:51:43.295581] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-15T17:51:43.313961] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-03. [2025-10-15T17:51:44.114000] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-06. [2025-10-15T17:51:44.842015] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-15T17:51:44.913995] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-04. [2025-10-15T17:51:45.713977] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-03. [2025-10-15T17:51:45.845067] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-15T17:51:46.437191] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-15T17:51:46.513990] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-05. [2025-10-15T17:51:46.604631] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-15T17:51:47.314019] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-04. [2025-10-15T17:51:48.098597] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-15T17:51:48.113953] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-06. [2025-10-15T17:51:48.322197] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-15T17:51:48.914010] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-07. [2025-10-15T17:51:49.714478] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-15T17:51:49.714551] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-10. [2025-10-15T17:51:50.449549] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-15T17:51:50.513997] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-08. [2025-10-15T17:51:51.301863] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-15T17:51:51.308112] [INFO ] [REMOTE ] BXP: Full fetch complete (72106 records). [2025-10-15T17:51:51.308278] [DEBUG] [VALIDATOR ] BXP: Validating primary data. [2025-10-15T17:51:51.321060] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-05. [2025-10-15T17:51:51.702581] [DEBUG] [VALIDATOR ] BXP: All expected trading days are present. [2025-10-15T17:51:51.702696] [DEBUG] [VALIDATOR ] BXP: Primary data validation passed. [2025-10-15T17:51:51.703739] [INFO ] [MAIN ] BXP: Fetched primary data is valid. [2025-10-15T17:51:51.703806] [DEBUG] [LOCAL ] BXP: Saving primary data. [2025-10-15T17:51:51.705293] [DEBUG] [LOCAL ] BXP: Trimmed 72106 records to 49889 (keeping 200 days of data) [2025-10-15T17:51:52.022912] [DEBUG] [LOCAL ] BXP: Primary data saved (49889 records). [2025-10-15T17:51:52.023183] [INFO ] [MAIN ] BXP: Full history saved. [2025-10-15T17:51:52.023370] [INFO ] [MAIN ] Update Progress: 375/2369 symbols completed. BXP took 39.0s. Estimated remaining: 4h 35m 24s. Rate: 7.2 symbols/min [2025-10-15T17:51:52.124759] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-07. [2025-10-15T17:51:52.204570] [INFO ] [MAIN ] BYM: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:51:52.238183] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-15T17:51:52.256358] [DEBUG] [LOCAL ] BYM: Loaded 11730 existing records from primary storage. [2025-10-15T17:51:52.256626] [INFO ] [MAIN ] BYM: Loaded 11730 existing records. [2025-10-15T17:51:52.439668] [WARN ] [MAIN ] BYM: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:51:52.439867] [INFO ] [MAIN ] BYM: Wiping existing primary data before full refresh. [2025-10-15T17:51:52.439913] [INFO ] [LOCAL ] BYM: Starting deletion of primary data. [2025-10-15T17:51:52.440126] [DEBUG] [LOCAL ] BYM: Deleted primary data file. [2025-10-15T17:51:52.440181] [INFO ] [MAIN ] BYM: Starting full primary refresh. [2025-10-15T17:51:52.549077] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-15T17:51:52.803614] [INFO ] [REMOTE ] BYM: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:51:52.914000] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-09. [2025-10-15T17:51:53.691948] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-15T17:51:53.713954] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-08. [2025-10-15T17:51:54.514815] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-06. [2025-10-15T17:51:54.517973] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-15T17:51:55.301314] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-15T17:51:55.313950] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-09. [2025-10-15T17:51:55.342808] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-15T17:51:56.114030] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-07. [2025-10-15T17:51:56.657285] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-15T17:51:56.914082] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-10. [2025-10-15T17:51:57.261078] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-15T17:51:57.714054] [INFO ] [REMOTE ] BYM: Fetching primary data for 2024-12. [2025-10-15T17:51:58.514028] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-10. [2025-10-15T17:51:58.597811] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-15T17:51:58.854196] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-10 (1.94 seconds). [2025-10-15T17:51:58.861848] [INFO ] [REMOTE ] BXSL: Full fetch complete (69908 records). [2025-10-15T17:51:58.862018] [DEBUG] [VALIDATOR ] BXSL: Validating primary data. [2025-10-15T17:51:59.261488] [DEBUG] [VALIDATOR ] BXSL: All expected trading days are present. [2025-10-15T17:51:59.261578] [DEBUG] [VALIDATOR ] BXSL: Primary data validation passed. [2025-10-15T17:51:59.262499] [INFO ] [MAIN ] BXSL: Fetched primary data is valid. [2025-10-15T17:51:59.262569] [DEBUG] [LOCAL ] BXSL: Saving primary data. [2025-10-15T17:51:59.264186] [DEBUG] [LOCAL ] BXSL: Trimmed 69908 records to 48119 (keeping 200 days of data) [2025-10-15T17:51:59.320871] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-01. [2025-10-15T17:51:59.574122] [DEBUG] [LOCAL ] BXSL: Primary data saved (48119 records). [2025-10-15T17:51:59.574262] [INFO ] [MAIN ] BXSL: Full history saved. [2025-10-15T17:51:59.575366] [INFO ] [MAIN ] Update Progress: 376/2369 symbols completed. BXSL took 39.9s. Estimated remaining: 4h 35m 11s. Rate: 7.2 symbols/min [2025-10-15T17:51:59.742342] [INFO ] [MAIN ] BZH: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:51:59.779100] [DEBUG] [LOCAL ] BZH: Loaded 32491 existing records from primary storage. [2025-10-15T17:51:59.779397] [INFO ] [MAIN ] BZH: Loaded 32491 existing records. [2025-10-15T17:51:59.962405] [WARN ] [MAIN ] BZH: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:51:59.962795] [INFO ] [MAIN ] BZH: Wiping existing primary data before full refresh. [2025-10-15T17:51:59.962927] [INFO ] [LOCAL ] BZH: Starting deletion of primary data. [2025-10-15T17:51:59.963216] [DEBUG] [LOCAL ] BZH: Deleted primary data file. [2025-10-15T17:51:59.963273] [INFO ] [MAIN ] BZH: Starting full primary refresh. [2025-10-15T17:52:00.090956] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-15T17:52:00.114743] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-08. [2025-10-15T17:52:00.171330] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-15T17:52:00.219383] [INFO ] [REMOTE ] BYD: Full fetch complete (65286 records). [2025-10-15T17:52:00.252682] [DEBUG] [VALIDATOR ] BYD: Validating primary data. [2025-10-15T17:52:00.515424] [INFO ] [REMOTE ] BZH: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:52:00.757922] [DEBUG] [VALIDATOR ] BYD: All expected trading days are present. [2025-10-15T17:52:00.758007] [DEBUG] [VALIDATOR ] BYD: Primary data validation passed. [2025-10-15T17:52:00.758820] [INFO ] [MAIN ] BYD: Fetched primary data is valid. [2025-10-15T17:52:00.758885] [DEBUG] [LOCAL ] BYD: Saving primary data. [2025-10-15T17:52:00.760250] [DEBUG] [LOCAL ] BYD: Trimmed 65286 records to 44894 (keeping 200 days of data) [2025-10-15T17:52:00.933713] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-02. [2025-10-15T17:52:01.031623] [DEBUG] [LOCAL ] BYD: Primary data saved (44894 records). [2025-10-15T17:52:01.031815] [INFO ] [MAIN ] BYD: Full history saved. [2025-10-15T17:52:01.032059] [INFO ] [MAIN ] Update Progress: 377/2369 symbols completed. BYD took 27.1s. Estimated remaining: 4h 34m 27s. Rate: 7.3 symbols/min [2025-10-15T17:52:01.196126] [INFO ] [MAIN ] C: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:52:01.250151] [DEBUG] [LOCAL ] C: Loaded 53740 existing records from primary storage. [2025-10-15T17:52:01.250474] [INFO ] [MAIN ] C: Loaded 53740 existing records. [2025-10-15T17:52:01.441337] [WARN ] [MAIN ] C: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:52:01.455560] [INFO ] [MAIN ] C: Wiping existing primary data before full refresh. [2025-10-15T17:52:01.455912] [INFO ] [LOCAL ] C: Starting deletion of primary data. [2025-10-15T17:52:01.456710] [DEBUG] [LOCAL ] C: Deleted primary data file. [2025-10-15T17:52:01.457268] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-15T17:52:01.457372] [INFO ] [MAIN ] C: Starting full primary refresh. [2025-10-15T17:52:01.567347] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-15T17:52:01.720282] [INFO ] [REMOTE ] BZH: Fetching primary data for 2024-12. [2025-10-15T17:52:01.890214] [INFO ] [REMOTE ] C: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:52:02.514061] [INFO ] [REMOTE ] C: Fetching primary data for 2024-12. [2025-10-15T17:52:02.874001] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-15T17:52:03.313999] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-09. [2025-10-15T17:52:04.114054] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-01. [2025-10-15T17:52:04.352870] [INFO ] [REMOTE ] C: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-15T17:52:04.379822] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-15T17:52:04.913989] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-10. [2025-10-15T17:52:04.938685] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-15T17:52:05.713959] [INFO ] [REMOTE ] C: Fetching primary data for 2025-01. [2025-10-15T17:52:05.896089] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-15T17:52:05.899243] [INFO ] [REMOTE ] BY: Full fetch complete (29731 records). [2025-10-15T17:52:05.899357] [DEBUG] [VALIDATOR ] BY: Validating primary data. [2025-10-15T17:52:06.305689] [DEBUG] [VALIDATOR ] BY: All expected trading days are present. [2025-10-15T17:52:06.305816] [DEBUG] [VALIDATOR ] BY: Primary data validation passed. [2025-10-15T17:52:06.306592] [INFO ] [MAIN ] BY: Fetched primary data is valid. [2025-10-15T17:52:06.306681] [DEBUG] [LOCAL ] BY: Saving primary data. [2025-10-15T17:52:06.307670] [DEBUG] [LOCAL ] BY: Trimmed 29731 records to 21823 (keeping 200 days of data) [2025-10-15T17:52:06.447331] [DEBUG] [LOCAL ] BY: Primary data saved (21823 records). [2025-10-15T17:52:06.447493] [INFO ] [MAIN ] BY: Full history saved. [2025-10-15T17:52:06.447575] [INFO ] [MAIN ] Update Progress: 378/2369 symbols completed. BY took 33.6s. Estimated remaining: 4h 34m 4s. Rate: 7.3 symbols/min [2025-10-15T17:52:06.519143] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-02. [2025-10-15T17:52:06.632449] [INFO ] [MAIN ] CAAP: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:52:06.654837] [DEBUG] [LOCAL ] CAAP: Loaded 19791 existing records from primary storage. [2025-10-15T17:52:06.655160] [INFO ] [MAIN ] CAAP: Loaded 19791 existing records. [2025-10-15T17:52:06.835960] [WARN ] [MAIN ] CAAP: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:52:06.836270] [INFO ] [MAIN ] CAAP: Wiping existing primary data before full refresh. [2025-10-15T17:52:06.836333] [INFO ] [LOCAL ] CAAP: Starting deletion of primary data. [2025-10-15T17:52:06.836542] [DEBUG] [LOCAL ] CAAP: Deleted primary data file. [2025-10-15T17:52:06.836582] [INFO ] [MAIN ] CAAP: Starting full primary refresh. [2025-10-15T17:52:07.229889] [INFO ] [REMOTE ] CAAP: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:52:07.313990] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-03. [2025-10-15T17:52:07.541843] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-15T17:52:07.658379] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-15T17:52:08.113970] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-03. [2025-10-15T17:52:08.244486] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-15T17:52:08.913991] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-04. [2025-10-15T17:52:09.108232] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-15T17:52:09.501893] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-15T17:52:09.713982] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-05. [2025-10-15T17:52:10.513973] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2024-12. [2025-10-15T17:52:10.526769] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-15T17:52:11.314071] [INFO ] [REMOTE ] C: Fetching primary data for 2025-02. [2025-10-15T17:52:11.509238] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-10-15T17:52:12.114011] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-06. [2025-10-15T17:52:12.710975] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-15T17:52:12.913965] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-01. [2025-10-15T17:52:13.202214] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-10-15T17:52:13.713991] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-04. [2025-10-15T17:52:13.866904] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-15T17:52:14.514050] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-07. [2025-10-15T17:52:14.957747] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-15T17:52:15.289451] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-15T17:52:15.313974] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-08. [2025-10-15T17:52:16.065814] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-15T17:52:16.114023] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-09. [2025-10-15T17:52:16.914034] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-02. [2025-10-15T17:52:16.980499] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-15T17:52:17.556199] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-15T17:52:17.714035] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-03. [2025-10-15T17:52:18.514012] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-05. [2025-10-15T17:52:18.730026] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-15T17:52:19.314138] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-10. [2025-10-15T17:52:19.610952] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-15T17:52:20.114029] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-06. [2025-10-15T17:52:20.152073] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-15T17:52:20.153838] [INFO ] [REMOTE ] BYM: Full fetch complete (17602 records). [2025-10-15T17:52:20.153908] [DEBUG] [VALIDATOR ] BYM: Validating primary data. [2025-10-15T17:52:20.511156] [DEBUG] [VALIDATOR ] BYM: All expected trading days are present. [2025-10-15T17:52:20.511235] [DEBUG] [VALIDATOR ] BYM: Primary data validation passed. [2025-10-15T17:52:20.511593] [INFO ] [MAIN ] BYM: Fetched primary data is valid. [2025-10-15T17:52:20.511631] [DEBUG] [LOCAL ] BYM: Saving primary data. [2025-10-15T17:52:20.512182] [DEBUG] [LOCAL ] BYM: Trimmed 17602 records to 11722 (keeping 200 days of data) [2025-10-15T17:52:20.581048] [DEBUG] [LOCAL ] BYM: Primary data saved (11722 records). [2025-10-15T17:52:20.581176] [INFO ] [MAIN ] BYM: Full history saved. [2025-10-15T17:52:20.581301] [INFO ] [MAIN ] Update Progress: 379/2369 symbols completed. BYM took 28.6s. Estimated remaining: 4h 34m 26s. Rate: 7.3 symbols/min [2025-10-15T17:52:20.745412] [INFO ] [MAIN ] CABO: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:52:20.763132] [DEBUG] [LOCAL ] CABO: Loaded 16823 existing records from primary storage. [2025-10-15T17:52:20.763357] [INFO ] [MAIN ] CABO: Loaded 16823 existing records. [2025-10-15T17:52:20.918613] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-04. [2025-10-15T17:52:20.940864] [WARN ] [MAIN ] CABO: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:52:20.941177] [INFO ] [MAIN ] CABO: Wiping existing primary data before full refresh. [2025-10-15T17:52:20.941231] [INFO ] [LOCAL ] CABO: Starting deletion of primary data. [2025-10-15T17:52:20.941428] [DEBUG] [LOCAL ] CABO: Deleted primary data file. [2025-10-15T17:52:20.941464] [INFO ] [MAIN ] CABO: Starting full primary refresh. [2025-10-15T17:52:21.254019] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-15T17:52:21.322059] [INFO ] [REMOTE ] CABO: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:52:21.713967] [INFO ] [REMOTE ] CABO: Fetching primary data for 2024-12. [2025-10-15T17:52:22.098939] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-15T17:52:22.464545] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-10-15T17:52:22.513957] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-01. [2025-10-15T17:52:23.083944] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-15T17:52:23.313996] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-05. [2025-10-15T17:52:24.031111] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-15T17:52:24.114017] [INFO ] [REMOTE ] C: Fetching primary data for 2025-03. [2025-10-15T17:52:24.914012] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-06. [2025-10-15T17:52:25.639342] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-15T17:52:25.713987] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-07. [2025-10-15T17:52:26.022385] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-15T17:52:26.514052] [INFO ] [REMOTE ] C: Fetching primary data for 2025-04. [2025-10-15T17:52:26.686178] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-15T17:52:27.314065] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-07. [2025-10-15T17:52:28.114070] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-08. [2025-10-15T17:52:28.690603] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-15T17:52:28.728701] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-04 (2.21 seconds). [2025-10-15T17:52:28.913984] [INFO ] [REMOTE ] C: Fetching primary data for 2025-05. [2025-10-15T17:52:29.069084] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-15T17:52:29.713990] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-02. [2025-10-15T17:52:30.514007] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-08. [2025-10-15T17:52:30.621552] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-15T17:52:31.052674] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-05 (2.14 seconds). [2025-10-15T17:52:31.314007] [INFO ] [REMOTE ] C: Fetching primary data for 2025-06. [2025-10-15T17:52:31.838566] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-15T17:52:32.113997] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-09. [2025-10-15T17:52:32.913991] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-09. [2025-10-15T17:52:32.946966] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-15T17:52:33.245008] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-15T17:52:33.714001] [INFO ] [REMOTE ] C: Fetching primary data for 2025-07. [2025-10-15T17:52:34.039065] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-15T17:52:34.514074] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-10. [2025-10-15T17:52:35.314009] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-10. [2025-10-15T17:52:35.653592] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-15T17:52:35.651853] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-15T17:52:35.669321] [INFO ] [REMOTE ] BZH: Full fetch complete (47187 records). [2025-10-15T17:52:35.669588] [DEBUG] [VALIDATOR ] BZH: Validating primary data. [2025-10-15T17:52:36.047783] [DEBUG] [VALIDATOR ] BZH: All expected trading days are present. [2025-10-15T17:52:36.047859] [DEBUG] [VALIDATOR ] BZH: Primary data validation passed. [2025-10-15T17:52:36.048524] [INFO ] [MAIN ] BZH: Fetched primary data is valid. [2025-10-15T17:52:36.048564] [DEBUG] [LOCAL ] BZH: Saving primary data. [2025-10-15T17:52:36.049574] [DEBUG] [LOCAL ] BZH: Trimmed 47187 records to 32426 (keeping 200 days of data) [2025-10-15T17:52:36.133152] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-03. [2025-10-15T17:52:36.236793] [DEBUG] [LOCAL ] BZH: Primary data saved (32426 records). [2025-10-15T17:52:36.236929] [INFO ] [MAIN ] BZH: Full history saved. [2025-10-15T17:52:36.237022] [INFO ] [MAIN ] Update Progress: 380/2369 symbols completed. BZH took 36.7s. Estimated remaining: 4h 34m 57s. Rate: 7.2 symbols/min [2025-10-15T17:52:36.405209] [INFO ] [MAIN ] CACI: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:52:36.428015] [DEBUG] [LOCAL ] CACI: Loaded 23249 existing records from primary storage. [2025-10-15T17:52:36.428269] [INFO ] [MAIN ] CACI: Loaded 23249 existing records. [2025-10-15T17:52:36.613437] [WARN ] [MAIN ] CACI: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:52:36.614288] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-15T17:52:36.614454] [INFO ] [MAIN ] CACI: Wiping existing primary data before full refresh. [2025-10-15T17:52:36.617489] [INFO ] [LOCAL ] CACI: Starting deletion of primary data. [2025-10-15T17:52:36.617613] [INFO ] [REMOTE ] CAAP: Full fetch complete (27926 records). [2025-10-15T17:52:36.617706] [DEBUG] [VALIDATOR ] CAAP: Validating primary data. [2025-10-15T17:52:36.621158] [DEBUG] [LOCAL ] CACI: Deleted primary data file. [2025-10-15T17:52:36.663794] [INFO ] [MAIN ] CACI: Starting full primary refresh. [2025-10-15T17:52:36.916995] [INFO ] [REMOTE ] C: Fetching primary data for 2025-08. [2025-10-15T17:52:37.366603] [DEBUG] [VALIDATOR ] CAAP: All expected trading days are present. [2025-10-15T17:52:37.366429] [INFO ] [REMOTE ] CACI: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:52:37.367066] [DEBUG] [VALIDATOR ] CAAP: Primary data validation passed. [2025-10-15T17:52:37.367677] [INFO ] [MAIN ] CAAP: Fetched primary data is valid. [2025-10-15T17:52:37.367756] [DEBUG] [LOCAL ] CAAP: Saving primary data. [2025-10-15T17:52:37.379375] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-15T17:52:37.378922] [DEBUG] [LOCAL ] CAAP: Trimmed 27926 records to 19831 (keeping 200 days of data) [2025-10-15T17:52:37.495799] [DEBUG] [LOCAL ] CAAP: Primary data saved (19831 records). [2025-10-15T17:52:37.495948] [INFO ] [MAIN ] CAAP: Full history saved. [2025-10-15T17:52:37.496025] [INFO ] [MAIN ] Update Progress: 381/2369 symbols completed. CAAP took 31.0s. Estimated remaining: 4h 34m 12s. Rate: 7.3 symbols/min [2025-10-15T17:52:37.660405] [INFO ] [MAIN ] CADE: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:52:37.703321] [DEBUG] [LOCAL ] CADE: Loaded 49416 existing records from primary storage. [2025-10-15T17:52:37.703671] [INFO ] [MAIN ] CADE: Loaded 49416 existing records. [2025-10-15T17:52:37.723876] [INFO ] [REMOTE ] CACI: Fetching primary data for 2024-12. [2025-10-15T17:52:37.879186] [WARN ] [MAIN ] CADE: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:52:37.879422] [INFO ] [MAIN ] CADE: Wiping existing primary data before full refresh. [2025-10-15T17:52:37.879474] [INFO ] [LOCAL ] CADE: Starting deletion of primary data. [2025-10-15T17:52:37.879775] [DEBUG] [LOCAL ] CADE: Deleted primary data file. [2025-10-15T17:52:37.879829] [INFO ] [MAIN ] CADE: Starting full primary refresh. [2025-10-15T17:52:38.227933] [INFO ] [REMOTE ] CADE: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:52:38.514017] [INFO ] [REMOTE ] CADE: Fetching primary data for 2024-12. [2025-10-15T17:52:38.900817] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-15T17:52:39.065118] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-08 (2.15 seconds). [2025-10-15T17:52:39.314053] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-01. [2025-10-15T17:52:39.967813] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-15T17:52:40.113982] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-04. [2025-10-15T17:52:40.599961] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-15T17:52:40.905496] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-15T17:52:40.913953] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-05. [2025-10-15T17:52:41.714070] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-01. [2025-10-15T17:52:42.086089] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-15T17:52:42.514019] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-02. [2025-10-15T17:52:43.060104] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-15T17:52:43.314030] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-02. [2025-10-15T17:52:44.037436] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-15T17:52:44.114019] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-03. [2025-10-15T17:52:44.789179] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-15T17:52:44.914001] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-03. [2025-10-15T17:52:45.453307] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-15T17:52:45.714043] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-04. [2025-10-15T17:52:46.504479] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-15T17:52:46.514501] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-06. [2025-10-15T17:52:46.981337] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-15T17:52:47.314039] [INFO ] [REMOTE ] C: Fetching primary data for 2025-09. [2025-10-15T17:52:47.495540] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-15T17:52:48.113977] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-05. [2025-10-15T17:52:48.914018] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-07. [2025-10-15T17:52:49.333180] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-15T17:52:49.540747] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-09 (2.23 seconds). [2025-10-15T17:52:49.713991] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-06. [2025-10-15T17:52:49.833495] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-15T17:52:50.514018] [INFO ] [REMOTE ] C: Fetching primary data for 2025-10. [2025-10-15T17:52:50.747049] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-15T17:52:51.313983] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-08. [2025-10-15T17:52:52.114028] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-07. [2025-10-15T17:52:52.263392] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-15T17:52:52.698347] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-10 (2.18 seconds). [2025-10-15T17:52:52.704847] [INFO ] [REMOTE ] C: Full fetch complete (77918 records). [2025-10-15T17:52:52.704978] [DEBUG] [VALIDATOR ] C: Validating primary data. [2025-10-15T17:52:52.916755] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-04. [2025-10-15T17:52:53.156373] [DEBUG] [VALIDATOR ] C: All expected trading days are present. [2025-10-15T17:52:53.164750] [DEBUG] [VALIDATOR ] C: Primary data validation passed. [2025-10-15T17:52:53.166832] [INFO ] [MAIN ] C: Fetched primary data is valid. [2025-10-15T17:52:53.167747] [DEBUG] [LOCAL ] C: Saving primary data. [2025-10-15T17:52:53.167456] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-15T17:52:53.175766] [DEBUG] [LOCAL ] C: Trimmed 77918 records to 53740 (keeping 200 days of data) [2025-10-15T17:52:53.531169] [DEBUG] [LOCAL ] C: Primary data saved (53740 records). [2025-10-15T17:52:53.531366] [INFO ] [MAIN ] C: Full history saved. [2025-10-15T17:52:53.531885] [INFO ] [MAIN ] Update Progress: 382/2369 symbols completed. C took 52.5s. Estimated remaining: 4h 34m 44s. Rate: 7.2 symbols/min [2025-10-15T17:52:53.721546] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-08. [2025-10-15T17:52:53.764672] [INFO ] [MAIN ] CAE: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:52:53.809778] [DEBUG] [LOCAL ] CAE: Loaded 39218 existing records from primary storage. [2025-10-15T17:52:53.810122] [INFO ] [MAIN ] CAE: Loaded 39218 existing records. [2025-10-15T17:52:53.993598] [WARN ] [MAIN ] CAE: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:52:53.993895] [INFO ] [MAIN ] CAE: Wiping existing primary data before full refresh. [2025-10-15T17:52:53.993947] [INFO ] [LOCAL ] CAE: Starting deletion of primary data. [2025-10-15T17:52:53.994421] [DEBUG] [LOCAL ] CAE: Deleted primary data file. [2025-10-15T17:52:53.994481] [INFO ] [MAIN ] CAE: Starting full primary refresh. [2025-10-15T17:52:54.374523] [INFO ] [REMOTE ] CAE: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:52:54.513962] [INFO ] [REMOTE ] CAE: Fetching primary data for 2024-12. [2025-10-15T17:52:54.686130] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-15T17:52:54.908900] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-15T17:52:55.313985] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-05. [2025-10-15T17:52:56.079280] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-15T17:52:56.114012] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-01. [2025-10-15T17:52:56.692300] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-15T17:52:56.914003] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-06. [2025-10-15T17:52:57.241628] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-15T17:52:57.714023] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-02. [2025-10-15T17:52:58.409395] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-15T17:52:58.514000] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-07. [2025-10-15T17:52:59.054498] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-15T17:52:59.314035] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-03. [2025-10-15T17:53:00.119104] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-09. [2025-10-15T17:53:00.137103] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-15T17:53:00.846545] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-15T17:53:00.864258] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-15T17:53:00.913961] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-10. [2025-10-15T17:53:01.714008] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-04. [2025-10-15T17:53:01.820573] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-15T17:53:01.822338] [INFO ] [REMOTE ] CABO: Full fetch complete (23128 records). [2025-10-15T17:53:01.822407] [DEBUG] [VALIDATOR ] CABO: Validating primary data. [2025-10-15T17:53:01.822891] [FATAL] [VALIDATOR ] CABO: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T17:53:01.822999] [FATAL] [MAIN ] CABO: Fetched primary data is invalid. Refusing to save it. [2025-10-15T17:53:01.823040] [WARN ] [MAIN ] CABO: Deleting existing primary and derivative data due to validation failure. [2025-10-15T17:53:01.823078] [INFO ] [LOCAL ] CABO: Starting deletion of primary data. [2025-10-15T17:53:01.823134] [DEBUG] [LOCAL ] CABO: No primary data file found to delete. [2025-10-15T17:53:01.823169] [INFO ] [LOCAL ] CABO: Starting deletion of derivative data. [2025-10-15T17:53:01.823352] [DEBUG] [LOCAL ] CABO: Deleted derivative data file. [2025-10-15T17:53:01.823439] [INFO ] [MAIN ] Update Progress: 383/2369 symbols completed. CABO took 41.2s. Estimated remaining: 4h 34m 35s. Rate: 7.2 symbols/min [2025-10-15T17:53:01.990802] [INFO ] [MAIN ] CAF: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:53:01.997616] [DEBUG] [LOCAL ] CAF: Loaded 3450 existing records from primary storage. [2025-10-15T17:53:01.997884] [INFO ] [MAIN ] CAF: Loaded 3450 existing records. [2025-10-15T17:53:02.179540] [WARN ] [MAIN ] CAF: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:53:02.179801] [INFO ] [MAIN ] CAF: Wiping existing primary data before full refresh. [2025-10-15T17:53:02.179853] [INFO ] [LOCAL ] CAF: Starting deletion of primary data. [2025-10-15T17:53:02.180020] [DEBUG] [LOCAL ] CAF: Deleted primary data file. [2025-10-15T17:53:02.180060] [INFO ] [MAIN ] CAF: Starting full primary refresh. [2025-10-15T17:53:02.519173] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-08. [2025-10-15T17:53:02.584189] [INFO ] [REMOTE ] CAF: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:53:03.029739] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-15T17:53:03.313987] [INFO ] [REMOTE ] CAF: Fetching primary data for 2024-12. [2025-10-15T17:53:04.078116] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-10-15T17:53:04.113967] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-01. [2025-10-15T17:53:04.169219] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-15T17:53:04.549884] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-10-15T17:53:04.914052] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-09. [2025-10-15T17:53:05.714052] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-05. [2025-10-15T17:53:06.323055] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-15T17:53:06.514029] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-10. [2025-10-15T17:53:07.313973] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-09. [2025-10-15T17:53:07.409083] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-15T17:53:07.985672] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-15T17:53:07.991954] [INFO ] [REMOTE ] CADE: Full fetch complete (70447 records). [2025-10-15T17:53:07.992067] [DEBUG] [VALIDATOR ] CADE: Validating primary data. [2025-10-15T17:53:08.119153] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-02. [2025-10-15T17:53:08.433849] [DEBUG] [VALIDATOR ] CADE: All expected trading days are present. [2025-10-15T17:53:08.434066] [DEBUG] [VALIDATOR ] CADE: Primary data validation passed. [2025-10-15T17:53:08.436020] [INFO ] [MAIN ] CADE: Fetched primary data is valid. [2025-10-15T17:53:08.436923] [DEBUG] [LOCAL ] CADE: Saving primary data. [2025-10-15T17:53:08.436814] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-15T17:53:08.443492] [DEBUG] [LOCAL ] CADE: Trimmed 70447 records to 49483 (keeping 200 days of data) [2025-10-15T17:53:08.552848] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-15T17:53:08.757475] [DEBUG] [LOCAL ] CADE: Primary data saved (49483 records). [2025-10-15T17:53:08.757687] [INFO ] [MAIN ] CADE: Full history saved. [2025-10-15T17:53:08.757796] [INFO ] [MAIN ] Update Progress: 384/2369 symbols completed. CADE took 31.3s. Estimated remaining: 4h 34m 20s. Rate: 7.2 symbols/min [2025-10-15T17:53:08.922429] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-06. [2025-10-15T17:53:08.926625] [INFO ] [MAIN ] CAG: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:53:08.979780] [DEBUG] [LOCAL ] CAG: Loaded 53665 existing records from primary storage. [2025-10-15T17:53:08.980102] [INFO ] [MAIN ] CAG: Loaded 53665 existing records. [2025-10-15T17:53:09.164893] [WARN ] [MAIN ] CAG: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:53:09.165150] [INFO ] [MAIN ] CAG: Wiping existing primary data before full refresh. [2025-10-15T17:53:09.165206] [INFO ] [LOCAL ] CAG: Starting deletion of primary data. [2025-10-15T17:53:09.165522] [DEBUG] [LOCAL ] CAG: Deleted primary data file. [2025-10-15T17:53:09.165561] [INFO ] [MAIN ] CAG: Starting full primary refresh. [2025-10-15T17:53:09.530846] [INFO ] [REMOTE ] CAG: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:53:09.714047] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-03. [2025-10-15T17:53:10.133162] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-10-15T17:53:10.500571] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-15T17:53:10.513956] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-07. [2025-10-15T17:53:11.314038] [INFO ] [REMOTE ] CAG: Fetching primary data for 2024-12. [2025-10-15T17:53:11.998227] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-15T17:53:12.114013] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-08. [2025-10-15T17:53:12.816130] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-15T17:53:12.914010] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-01. [2025-10-15T17:53:13.220770] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-15T17:53:13.713999] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-04. [2025-10-15T17:53:14.233252] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-10-15T17:53:14.513982] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-09. [2025-10-15T17:53:14.669715] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-15T17:53:15.313991] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-10. [2025-10-15T17:53:15.733065] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-15T17:53:16.114070] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-10. [2025-10-15T17:53:16.450406] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-15T17:53:16.452759] [INFO ] [REMOTE ] CACI: Full fetch complete (38272 records). [2025-10-15T17:53:16.452854] [DEBUG] [VALIDATOR ] CACI: Validating primary data. [2025-10-15T17:53:16.820900] [DEBUG] [VALIDATOR ] CACI: All expected trading days are present. [2025-10-15T17:53:16.820980] [DEBUG] [VALIDATOR ] CACI: Primary data validation passed. [2025-10-15T17:53:16.821575] [INFO ] [MAIN ] CACI: Fetched primary data is valid. [2025-10-15T17:53:16.821615] [DEBUG] [LOCAL ] CACI: Saving primary data. [2025-10-15T17:53:16.822475] [DEBUG] [LOCAL ] CACI: Trimmed 38272 records to 23152 (keeping 200 days of data) [2025-10-15T17:53:16.917429] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-02. [2025-10-15T17:53:16.965781] [DEBUG] [LOCAL ] CACI: Primary data saved (23152 records). [2025-10-15T17:53:16.965909] [INFO ] [MAIN ] CACI: Full history saved. [2025-10-15T17:53:16.965990] [INFO ] [MAIN ] Update Progress: 385/2369 symbols completed. CACI took 40.7s. Estimated remaining: 4h 34m 11s. Rate: 7.2 symbols/min [2025-10-15T17:53:17.132192] [INFO ] [MAIN ] CAH: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:53:17.188383] [DEBUG] [LOCAL ] CAH: Loaded 51482 existing records from primary storage. [2025-10-15T17:53:17.188736] [INFO ] [MAIN ] CAH: Loaded 51482 existing records. [2025-10-15T17:53:17.364187] [WARN ] [MAIN ] CAH: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:53:17.364467] [INFO ] [MAIN ] CAH: Wiping existing primary data before full refresh. [2025-10-15T17:53:17.364528] [INFO ] [LOCAL ] CAH: Starting deletion of primary data. [2025-10-15T17:53:17.365021] [DEBUG] [LOCAL ] CAH: Deleted primary data file. [2025-10-15T17:53:17.365091] [INFO ] [MAIN ] CAH: Starting full primary refresh. [2025-10-15T17:53:17.717424] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-05. [2025-10-15T17:53:17.723392] [INFO ] [REMOTE ] CAH: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:53:17.831989] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-15T17:53:17.837126] [INFO ] [REMOTE ] CAE: Full fetch complete (56387 records). [2025-10-15T17:53:17.837225] [DEBUG] [VALIDATOR ] CAE: Validating primary data. [2025-10-15T17:53:18.242775] [DEBUG] [VALIDATOR ] CAE: All expected trading days are present. [2025-10-15T17:53:18.242508] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-10-15T17:53:18.243050] [DEBUG] [VALIDATOR ] CAE: Primary data validation passed. [2025-10-15T17:53:18.246519] [INFO ] [MAIN ] CAE: Fetched primary data is valid. [2025-10-15T17:53:18.246594] [DEBUG] [LOCAL ] CAE: Saving primary data. [2025-10-15T17:53:18.248342] [DEBUG] [LOCAL ] CAE: Trimmed 56387 records to 39206 (keeping 200 days of data) [2025-10-15T17:53:18.481634] [DEBUG] [LOCAL ] CAE: Primary data saved (39206 records). [2025-10-15T17:53:18.481818] [INFO ] [MAIN ] CAE: Full history saved. [2025-10-15T17:53:18.482157] [INFO ] [MAIN ] Update Progress: 386/2369 symbols completed. CAE took 25.0s. Estimated remaining: 4h 33m 28s. Rate: 7.3 symbols/min [2025-10-15T17:53:18.519002] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-06. [2025-10-15T17:53:18.675912] [INFO ] [MAIN ] CAL: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:53:18.720448] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-15T17:53:18.765623] [DEBUG] [LOCAL ] CAL: Loaded 43003 existing records from primary storage. [2025-10-15T17:53:18.765997] [INFO ] [MAIN ] CAL: Loaded 43003 existing records. [2025-10-15T17:53:18.955159] [WARN ] [MAIN ] CAL: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:53:18.955440] [INFO ] [MAIN ] CAL: Wiping existing primary data before full refresh. [2025-10-15T17:53:18.955498] [INFO ] [LOCAL ] CAL: Starting deletion of primary data. [2025-10-15T17:53:18.955907] [DEBUG] [LOCAL ] CAL: Deleted primary data file. [2025-10-15T17:53:18.955963] [INFO ] [MAIN ] CAL: Starting full primary refresh. [2025-10-15T17:53:19.278073] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-15T17:53:19.319153] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-03. [2025-10-15T17:53:19.412855] [INFO ] [REMOTE ] CAL: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:53:20.114062] [INFO ] [REMOTE ] CAL: Fetching primary data for 2024-12. [2025-10-15T17:53:20.224977] [DEBUG] [REMOTE ] CAL: Error fetching primary data for 2024-12: 'API call returned an empty response.' [2025-10-15T17:53:20.225351] [WARN ] [REMOTE ] CAL: No data returned for month 2024-12 [2025-10-15T17:53:20.225445] [FATAL] [REMOTE ] CAL: API call failed - aborting fetch to avoid wasting further API calls [2025-10-15T17:53:20.225515] [FATAL] [MAIN ] CAL: Failed to fetch primary data. [2025-10-15T17:53:20.225580] [WARN ] [MAIN ] CAL: Deleting existing primary and derivative data due to fetch failure. [2025-10-15T17:53:20.225677] [INFO ] [LOCAL ] CAL: Starting deletion of primary data. [2025-10-15T17:53:20.225757] [DEBUG] [LOCAL ] CAL: No primary data file found to delete. [2025-10-15T17:53:20.225794] [INFO ] [LOCAL ] CAL: Starting deletion of derivative data. [2025-10-15T17:53:20.225977] [DEBUG] [LOCAL ] CAL: Deleted derivative data file. [2025-10-15T17:53:20.226237] [INFO ] [MAIN ] Update Progress: 387/2369 symbols completed. CAL took 1.7s. Estimated remaining: 4h 32m 47s. Rate: 7.3 symbols/min [2025-10-15T17:53:20.398519] [INFO ] [MAIN ] CALX: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:53:20.434096] [DEBUG] [LOCAL ] CALX: Loaded 37675 existing records from primary storage. [2025-10-15T17:53:20.434387] [INFO ] [MAIN ] CALX: Loaded 37675 existing records. [2025-10-15T17:53:20.608940] [WARN ] [MAIN ] CALX: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:53:20.609159] [INFO ] [MAIN ] CALX: Wiping existing primary data before full refresh. [2025-10-15T17:53:20.609205] [INFO ] [LOCAL ] CALX: Starting deletion of primary data. [2025-10-15T17:53:20.609452] [DEBUG] [LOCAL ] CALX: Deleted primary data file. [2025-10-15T17:53:20.609490] [INFO ] [MAIN ] CALX: Starting full primary refresh. [2025-10-15T17:53:20.927182] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-07. [2025-10-15T17:53:20.968482] [INFO ] [REMOTE ] CALX: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:53:21.202111] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-15T17:53:21.495363] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-15T17:53:21.714026] [INFO ] [REMOTE ] CALX: Fetching primary data for 2024-12. [2025-10-15T17:53:22.514000] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-04. [2025-10-15T17:53:23.291348] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-15T17:53:23.313955] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-01. [2025-10-15T17:53:24.113992] [INFO ] [REMOTE ] CAH: Fetching primary data for 2024-12. [2025-10-15T17:53:24.395752] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-15T17:53:24.617092] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-15T17:53:24.914014] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-02. [2025-10-15T17:53:25.724834] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-05. [2025-10-15T17:53:25.732279] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-15T17:53:25.781764] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-15T17:53:26.514063] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-01. [2025-10-15T17:53:27.314043] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-08. [2025-10-15T17:53:27.372323] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-15T17:53:27.730287] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-10-15T17:53:27.972410] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-15T17:53:28.114083] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-06. [2025-10-15T17:53:28.913995] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-03. [2025-10-15T17:53:29.714031] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-02. [2025-10-15T17:53:29.853563] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-15T17:53:30.005760] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-15T17:53:30.513990] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-04. [2025-10-15T17:53:31.313989] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-09. [2025-10-15T17:53:31.425581] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-15T17:53:31.579461] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-15T17:53:31.834292] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-10-15T17:53:32.114008] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-03. [2025-10-15T17:53:32.914014] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-05. [2025-10-15T17:53:33.637354] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-15T17:53:33.713955] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-04. [2025-10-15T17:53:34.518132] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-07. [2025-10-15T17:53:34.523347] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-15T17:53:35.313966] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-10. [2025-10-15T17:53:35.482825] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-15T17:53:35.853595] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-15T17:53:35.854628] [INFO ] [REMOTE ] CAF: Full fetch complete (5566 records). [2025-10-15T17:53:35.854743] [DEBUG] [VALIDATOR ] CAF: Validating primary data. [2025-10-15T17:53:36.119258] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-06. [2025-10-15T17:53:36.243106] [DEBUG] [VALIDATOR ] CAF: All expected trading days are present. [2025-10-15T17:53:36.243213] [DEBUG] [VALIDATOR ] CAF: Primary data validation passed. [2025-10-15T17:53:36.243431] [INFO ] [MAIN ] CAF: Fetched primary data is valid. [2025-10-15T17:53:36.243473] [DEBUG] [LOCAL ] CAF: Saving primary data. [2025-10-15T17:53:36.244295] [DEBUG] [LOCAL ] CAF: Trimmed 5566 records to 3465 (keeping 200 days of data) [2025-10-15T17:53:36.265179] [DEBUG] [LOCAL ] CAF: Primary data saved (3465 records). [2025-10-15T17:53:36.265253] [INFO ] [MAIN ] CAF: Full history saved. [2025-10-15T17:53:36.265340] [INFO ] [MAIN ] Update Progress: 388/2369 symbols completed. CAF took 34.4s. Estimated remaining: 4h 33m 18s. Rate: 7.2 symbols/min [2025-10-15T17:53:36.436604] [INFO ] [MAIN ] CANG: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:53:36.436886] [DEBUG] [LOCAL ] CANG: No existing data file found in primary storage. [2025-10-15T17:53:36.437086] [WARN ] [MAIN ] CANG: No existing data found, performing full refresh instead. [2025-10-15T17:53:36.437276] [INFO ] [MAIN ] CANG: Wiping existing primary data before full refresh. [2025-10-15T17:53:36.437320] [INFO ] [LOCAL ] CANG: Starting deletion of primary data. [2025-10-15T17:53:36.437363] [DEBUG] [LOCAL ] CANG: No primary data file found to delete. [2025-10-15T17:53:36.437398] [INFO ] [MAIN ] CANG: Starting full primary refresh. [2025-10-15T17:53:36.796362] [INFO ] [REMOTE ] CANG: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:53:36.829190] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-07 (2.31 seconds). [2025-10-15T17:53:36.913974] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-08. [2025-10-15T17:53:37.419941] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-15T17:53:37.713983] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-07. [2025-10-15T17:53:38.513993] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-05. [2025-10-15T17:53:38.840733] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-10-15T17:53:39.191929] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-15T17:53:39.313962] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-08. [2025-10-15T17:53:40.113999] [INFO ] [REMOTE ] CANG: Fetching primary data for 2024-12. [2025-10-15T17:53:40.450140] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-15T17:53:40.840538] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-15T17:53:40.914021] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-06. [2025-10-15T17:53:41.366250] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-15T17:53:41.713998] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-01. [2025-10-15T17:53:42.312975] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-15T17:53:42.513959] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-09. [2025-10-15T17:53:42.999084] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-15T17:53:43.314009] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-07. [2025-10-15T17:53:43.819169] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-15T17:53:44.114003] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-02. [2025-10-15T17:53:44.914021] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-10. [2025-10-15T17:53:45.093605] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-15T17:53:45.169890] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-15T17:53:45.713974] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-03. [2025-10-15T17:53:46.319322] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-15T17:53:46.323542] [INFO ] [REMOTE ] CALX: Full fetch complete (54227 records). [2025-10-15T17:53:46.323637] [DEBUG] [VALIDATOR ] CALX: Validating primary data. [2025-10-15T17:53:46.517528] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-09. [2025-10-15T17:53:46.719298] [DEBUG] [VALIDATOR ] CALX: All expected trading days are present. [2025-10-15T17:53:46.719431] [DEBUG] [VALIDATOR ] CALX: Primary data validation passed. [2025-10-15T17:53:46.720290] [INFO ] [MAIN ] CALX: Fetched primary data is valid. [2025-10-15T17:53:46.720355] [DEBUG] [LOCAL ] CALX: Saving primary data. [2025-10-15T17:53:46.721535] [DEBUG] [LOCAL ] CALX: Trimmed 54227 records to 37642 (keeping 200 days of data) [2025-10-15T17:53:46.925623] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-15T17:53:46.962734] [DEBUG] [LOCAL ] CALX: Primary data saved (37642 records). [2025-10-15T17:53:46.962909] [INFO ] [MAIN ] CALX: Full history saved. [2025-10-15T17:53:46.963169] [INFO ] [MAIN ] Update Progress: 389/2369 symbols completed. CALX took 26.7s. Estimated remaining: 4h 33m 22s. Rate: 7.2 symbols/min [2025-10-15T17:53:47.139149] [INFO ] [MAIN ] CAPL: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:53:47.148308] [DEBUG] [LOCAL ] CAPL: Loaded 5645 existing records from primary storage. [2025-10-15T17:53:47.148552] [INFO ] [MAIN ] CAPL: Loaded 5645 existing records. [2025-10-15T17:53:47.319205] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-04. [2025-10-15T17:53:47.323356] [WARN ] [MAIN ] CAPL: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:53:47.324565] [INFO ] [MAIN ] CAPL: Wiping existing primary data before full refresh. [2025-10-15T17:53:47.324629] [INFO ] [LOCAL ] CAPL: Starting deletion of primary data. [2025-10-15T17:53:47.325031] [DEBUG] [LOCAL ] CAPL: Deleted primary data file. [2025-10-15T17:53:47.325089] [INFO ] [MAIN ] CAPL: Starting full primary refresh. [2025-10-15T17:53:47.683737] [INFO ] [REMOTE ] CAPL: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:53:48.113997] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-08. [2025-10-15T17:53:48.277567] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-15T17:53:48.397997] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-15T17:53:48.914015] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-10. [2025-10-15T17:53:49.714019] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2024-12. [2025-10-15T17:53:49.992010] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-15T17:53:50.513980] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-09. [2025-10-15T17:53:50.530458] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-10-15T17:53:50.747542] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-15T17:53:50.754469] [INFO ] [REMOTE ] CAG: Full fetch complete (77822 records). [2025-10-15T17:53:50.754624] [DEBUG] [VALIDATOR ] CAG: Validating primary data. [2025-10-15T17:53:51.168139] [DEBUG] [VALIDATOR ] CAG: All expected trading days are present. [2025-10-15T17:53:51.168296] [DEBUG] [VALIDATOR ] CAG: Primary data validation passed. [2025-10-15T17:53:51.169710] [INFO ] [MAIN ] CAG: Fetched primary data is valid. [2025-10-15T17:53:51.169779] [DEBUG] [LOCAL ] CAG: Saving primary data. [2025-10-15T17:53:51.171830] [DEBUG] [LOCAL ] CAG: Trimmed 77822 records to 53665 (keeping 200 days of data) [2025-10-15T17:53:51.351697] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-05. [2025-10-15T17:53:51.519967] [DEBUG] [LOCAL ] CAG: Primary data saved (53665 records). [2025-10-15T17:53:51.520163] [INFO ] [MAIN ] CAG: Full history saved. [2025-10-15T17:53:51.520262] [INFO ] [MAIN ] Update Progress: 390/2369 symbols completed. CAG took 42.8s. Estimated remaining: 4h 32m 55s. Rate: 7.3 symbols/min [2025-10-15T17:53:51.693873] [INFO ] [MAIN ] CARR: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:53:51.745594] [DEBUG] [LOCAL ] CARR: Loaded 53602 existing records from primary storage. [2025-10-15T17:53:51.746046] [INFO ] [MAIN ] CARR: Loaded 53602 existing records. [2025-10-15T17:53:51.926880] [WARN ] [MAIN ] CARR: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:53:51.927131] [INFO ] [MAIN ] CARR: Wiping existing primary data before full refresh. [2025-10-15T17:53:51.927181] [INFO ] [LOCAL ] CARR: Starting deletion of primary data. [2025-10-15T17:53:51.927480] [DEBUG] [LOCAL ] CARR: Deleted primary data file. [2025-10-15T17:53:51.927573] [INFO ] [MAIN ] CARR: Starting full primary refresh. [2025-10-15T17:53:52.123203] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-01. [2025-10-15T17:53:52.305842] [INFO ] [REMOTE ] CARR: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:53:52.355844] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-15T17:53:52.395307] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-15T17:53:52.633463] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-10-15T17:53:52.913997] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-06. [2025-10-15T17:53:53.714026] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-10. [2025-10-15T17:53:54.079412] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-15T17:53:54.514013] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-02. [2025-10-15T17:53:54.991890] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-10-15T17:53:55.314002] [INFO ] [REMOTE ] CARR: Fetching primary data for 2024-12. [2025-10-15T17:53:55.491316] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-15T17:53:55.497450] [INFO ] [REMOTE ] CAH: Full fetch complete (74818 records). [2025-10-15T17:53:55.497582] [DEBUG] [VALIDATOR ] CAH: Validating primary data. [2025-10-15T17:53:55.893274] [DEBUG] [VALIDATOR ] CAH: All expected trading days are present. [2025-10-15T17:53:55.893355] [DEBUG] [VALIDATOR ] CAH: Primary data validation passed. [2025-10-15T17:53:55.894249] [INFO ] [MAIN ] CAH: Fetched primary data is valid. [2025-10-15T17:53:55.894312] [DEBUG] [LOCAL ] CAH: Saving primary data. [2025-10-15T17:53:55.895808] [DEBUG] [LOCAL ] CAH: Trimmed 74818 records to 51461 (keeping 200 days of data) [2025-10-15T17:53:56.114628] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-07. [2025-10-15T17:53:56.218094] [DEBUG] [LOCAL ] CAH: Primary data saved (51461 records). [2025-10-15T17:53:56.218232] [INFO ] [MAIN ] CAH: Full history saved. [2025-10-15T17:53:56.219367] [INFO ] [MAIN ] Update Progress: 391/2369 symbols completed. CAH took 39.3s. Estimated remaining: 4h 32m 29s. Rate: 7.3 symbols/min [2025-10-15T17:53:56.392016] [INFO ] [MAIN ] CARS: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:53:56.432611] [DEBUG] [LOCAL ] CARS: Loaded 39798 existing records from primary storage. [2025-10-15T17:53:56.433015] [INFO ] [MAIN ] CARS: Loaded 39798 existing records. [2025-10-15T17:53:56.617317] [WARN ] [MAIN ] CARS: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:53:56.617526] [INFO ] [MAIN ] CARS: Wiping existing primary data before full refresh. [2025-10-15T17:53:56.617573] [INFO ] [LOCAL ] CARS: Starting deletion of primary data. [2025-10-15T17:53:56.618167] [DEBUG] [LOCAL ] CARS: Deleted primary data file. [2025-10-15T17:53:56.618225] [INFO ] [MAIN ] CARS: Starting full primary refresh. [2025-10-15T17:53:56.919190] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-03. [2025-10-15T17:53:56.976519] [INFO ] [REMOTE ] CARS: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:53:57.180294] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-10-15T17:53:57.368472] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-10-15T17:53:57.394474] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-15T17:53:57.714096] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-04. [2025-10-15T17:53:58.406928] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-15T17:53:58.514037] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-01. [2025-10-15T17:53:59.314080] [INFO ] [REMOTE ] CARS: Fetching primary data for 2024-12. [2025-10-15T17:54:00.004868] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-15T17:54:00.114094] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-08. [2025-10-15T17:54:00.822802] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-15T17:54:00.914024] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-02. [2025-10-15T17:54:01.675637] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-15T17:54:01.714047] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-01. [2025-10-15T17:54:02.514045] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-09. [2025-10-15T17:54:03.027169] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-15T17:54:03.167302] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-02 (2.25 seconds). [2025-10-15T17:54:03.313966] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-03. [2025-10-15T17:54:03.942212] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-15T17:54:04.114013] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-05. [2025-10-15T17:54:04.843316] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-15T17:54:04.913970] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-10. [2025-10-15T17:54:04.947767] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-15T17:54:05.714004] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-06. [2025-10-15T17:54:06.065938] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-15T17:54:06.071270] [INFO ] [REMOTE ] CANG: Full fetch complete (39777 records). [2025-10-15T17:54:06.071434] [DEBUG] [VALIDATOR ] CANG: Validating primary data. [2025-10-15T17:54:06.337278] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-15T17:54:06.501969] [DEBUG] [VALIDATOR ] CANG: All expected trading days are present. [2025-10-15T17:54:06.502073] [DEBUG] [VALIDATOR ] CANG: Primary data validation passed. [2025-10-15T17:54:06.503692] [INFO ] [MAIN ] CANG: Fetched primary data is valid. [2025-10-15T17:54:06.503761] [DEBUG] [LOCAL ] CANG: Saving primary data. [2025-10-15T17:54:06.505298] [DEBUG] [LOCAL ] CANG: Trimmed 39777 records to 26919 (keeping 200 days of data) [2025-10-15T17:54:06.553458] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-04. [2025-10-15T17:54:06.672554] [DEBUG] [LOCAL ] CANG: Primary data saved (26919 records). [2025-10-15T17:54:06.672785] [INFO ] [MAIN ] CANG: Full history saved. [2025-10-15T17:54:06.672924] [INFO ] [MAIN ] Update Progress: 392/2369 symbols completed. CANG took 30.4s. Estimated remaining: 4h 32m 31s. Rate: 7.3 symbols/min [2025-10-15T17:54:06.860174] [INFO ] [MAIN ] CAT: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:54:06.918491] [DEBUG] [LOCAL ] CAT: Loaded 52943 existing records from primary storage. [2025-10-15T17:54:06.919041] [INFO ] [MAIN ] CAT: Loaded 52943 existing records. [2025-10-15T17:54:07.109147] [WARN ] [MAIN ] CAT: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:54:07.109539] [INFO ] [MAIN ] CAT: Wiping existing primary data before full refresh. [2025-10-15T17:54:07.109627] [INFO ] [LOCAL ] CAT: Starting deletion of primary data. [2025-10-15T17:54:07.110286] [DEBUG] [LOCAL ] CAT: Deleted primary data file. [2025-10-15T17:54:07.110358] [INFO ] [MAIN ] CAT: Starting full primary refresh. [2025-10-15T17:54:07.323076] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-02. [2025-10-15T17:54:07.541747] [INFO ] [REMOTE ] CAT: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:54:08.114041] [INFO ] [REMOTE ] CAT: Fetching primary data for 2024-12. [2025-10-15T17:54:08.524930] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-15T17:54:08.563612] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-15T17:54:08.914014] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-03. [2025-10-15T17:54:09.713963] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-07. [2025-10-15T17:54:10.227015] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-15T17:54:10.267434] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2024-12 (2.15 seconds). [2025-10-15T17:54:10.292421] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-15T17:54:10.513998] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-08. [2025-10-15T17:54:11.087046] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-15T17:54:11.313965] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-09. [2025-10-15T17:54:11.897446] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-15T17:54:12.114089] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-05. [2025-10-15T17:54:12.914048] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-04. [2025-10-15T17:54:13.715674] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-01. [2025-10-15T17:54:13.718601] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-15T17:54:14.514006] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-10. [2025-10-15T17:54:14.570854] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-15T17:54:15.313991] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-06. [2025-10-15T17:54:15.376485] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-15T17:54:15.377788] [INFO ] [REMOTE ] CAPL: Full fetch complete (8751 records). [2025-10-15T17:54:15.377854] [DEBUG] [VALIDATOR ] CAPL: Validating primary data. [2025-10-15T17:54:15.742757] [DEBUG] [VALIDATOR ] CAPL: All expected trading days are present. [2025-10-15T17:54:15.742884] [DEBUG] [VALIDATOR ] CAPL: Primary data validation passed. [2025-10-15T17:54:15.743155] [INFO ] [MAIN ] CAPL: Fetched primary data is valid. [2025-10-15T17:54:15.743282] [DEBUG] [LOCAL ] CAPL: Saving primary data. [2025-10-15T17:54:15.743717] [DEBUG] [LOCAL ] CAPL: Trimmed 8751 records to 5642 (keeping 200 days of data) [2025-10-15T17:54:15.805020] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-01 (2.09 seconds). [2025-10-15T17:54:15.818157] [DEBUG] [LOCAL ] CAPL: Primary data saved (5642 records). [2025-10-15T17:54:15.818268] [INFO ] [MAIN ] CAPL: Full history saved. [2025-10-15T17:54:15.818346] [INFO ] [MAIN ] Update Progress: 393/2369 symbols completed. CAPL took 28.9s. Estimated remaining: 4h 32m 27s. Rate: 7.3 symbols/min [2025-10-15T17:54:15.983215] [INFO ] [MAIN ] CATO: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:54:15.991670] [DEBUG] [LOCAL ] CATO: Loaded 6737 existing records from primary storage. [2025-10-15T17:54:15.991867] [INFO ] [MAIN ] CATO: Loaded 6737 existing records. [2025-10-15T17:54:16.125583] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-05. [2025-10-15T17:54:16.166932] [WARN ] [MAIN ] CATO: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:54:16.167163] [INFO ] [MAIN ] CATO: Wiping existing primary data before full refresh. [2025-10-15T17:54:16.167212] [INFO ] [LOCAL ] CATO: Starting deletion of primary data. [2025-10-15T17:54:16.167389] [DEBUG] [LOCAL ] CATO: Deleted primary data file. [2025-10-15T17:54:16.167461] [INFO ] [MAIN ] CATO: Starting full primary refresh. [2025-10-15T17:54:16.520286] [INFO ] [REMOTE ] CATO: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:54:16.744268] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-15T17:54:16.913991] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-07. [2025-10-15T17:54:17.366726] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-15T17:54:17.713999] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-06. [2025-10-15T17:54:18.514013] [INFO ] [REMOTE ] CATO: Fetching primary data for 2024-12. [2025-10-15T17:54:18.914570] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-10-15T17:54:18.952142] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-15T17:54:19.303953] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-10-15T17:54:19.313965] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-01. [2025-10-15T17:54:19.914327] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-15T17:54:20.114050] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-02. [2025-10-15T17:54:20.690982] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-15T17:54:20.913999] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-03. [2025-10-15T17:54:21.714003] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-08. [2025-10-15T17:54:21.755176] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-15T17:54:22.514013] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-04. [2025-10-15T17:54:23.286323] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-15T17:54:23.313953] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-05. [2025-10-15T17:54:23.465221] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-15T17:54:23.984350] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-15T17:54:24.113996] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-07. [2025-10-15T17:54:24.914047] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-09. [2025-10-15T17:54:25.644256] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-15T17:54:25.714065] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-08. [2025-10-15T17:54:26.186518] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-15T17:54:26.514000] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-10. [2025-10-15T17:54:26.983670] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-15T17:54:27.314021] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-09. [2025-10-15T17:54:28.113998] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-06. [2025-10-15T17:54:28.163741] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-15T17:54:28.170552] [INFO ] [REMOTE ] CARR: Full fetch complete (77772 records). [2025-10-15T17:54:28.170750] [DEBUG] [VALIDATOR ] CARR: Validating primary data. [2025-10-15T17:54:28.577468] [DEBUG] [VALIDATOR ] CARR: All expected trading days are present. [2025-10-15T17:54:28.577940] [DEBUG] [VALIDATOR ] CARR: Primary data validation passed. [2025-10-15T17:54:28.579107] [INFO ] [MAIN ] CARR: Fetched primary data is valid. [2025-10-15T17:54:28.579276] [DEBUG] [LOCAL ] CARR: Saving primary data. [2025-10-15T17:54:28.602072] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-15T17:54:28.610063] [DEBUG] [LOCAL ] CARR: Trimmed 77772 records to 53602 (keeping 200 days of data) [2025-10-15T17:54:28.711303] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-15T17:54:28.927492] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-07. [2025-10-15T17:54:28.951525] [DEBUG] [LOCAL ] CARR: Primary data saved (53602 records). [2025-10-15T17:54:28.951632] [INFO ] [MAIN ] CARR: Full history saved. [2025-10-15T17:54:28.951744] [INFO ] [MAIN ] Update Progress: 394/2369 symbols completed. CARR took 37.4s. Estimated remaining: 4h 32m 44s. Rate: 7.2 symbols/min [2025-10-15T17:54:29.116941] [INFO ] [MAIN ] CAVA: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:54:29.117098] [DEBUG] [LOCAL ] CAVA: No existing data file found in primary storage. [2025-10-15T17:54:29.117134] [WARN ] [MAIN ] CAVA: No existing data found, performing full refresh instead. [2025-10-15T17:54:29.117241] [INFO ] [MAIN ] CAVA: Wiping existing primary data before full refresh. [2025-10-15T17:54:29.117282] [INFO ] [LOCAL ] CAVA: Starting deletion of primary data. [2025-10-15T17:54:29.117323] [DEBUG] [LOCAL ] CAVA: No primary data file found to delete. [2025-10-15T17:54:29.117355] [INFO ] [MAIN ] CAVA: Starting full primary refresh. [2025-10-15T17:54:29.469259] [INFO ] [REMOTE ] CAVA: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:54:29.713990] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2024-12. [2025-10-15T17:54:29.752165] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-15T17:54:30.514013] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-10. [2025-10-15T17:54:31.313996] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-08. [2025-10-15T17:54:31.754681] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-15T17:54:31.760065] [INFO ] [REMOTE ] CARS: Full fetch complete (56246 records). [2025-10-15T17:54:31.760215] [DEBUG] [VALIDATOR ] CARS: Validating primary data. [2025-10-15T17:54:31.991343] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-15T17:54:32.115381] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-02. [2025-10-15T17:54:32.208784] [DEBUG] [VALIDATOR ] CARS: All expected trading days are present. [2025-10-15T17:54:32.208880] [DEBUG] [VALIDATOR ] CARS: Primary data validation passed. [2025-10-15T17:54:32.209599] [INFO ] [MAIN ] CARS: Fetched primary data is valid. [2025-10-15T17:54:32.209661] [DEBUG] [LOCAL ] CARS: Saving primary data. [2025-10-15T17:54:32.211103] [DEBUG] [LOCAL ] CARS: Trimmed 56246 records to 39797 (keeping 200 days of data) [2025-10-15T17:54:32.247117] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2024-12 (2.53 seconds). [2025-10-15T17:54:32.485842] [DEBUG] [LOCAL ] CARS: Primary data saved (39797 records). [2025-10-15T17:54:32.486007] [INFO ] [MAIN ] CARS: Full history saved. [2025-10-15T17:54:32.486090] [INFO ] [MAIN ] Update Progress: 395/2369 symbols completed. CARS took 36.3s. Estimated remaining: 4h 32m 12s. Rate: 7.3 symbols/min [2025-10-15T17:54:32.651269] [INFO ] [MAIN ] CB: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:54:32.701857] [DEBUG] [LOCAL ] CB: Loaded 49935 existing records from primary storage. [2025-10-15T17:54:32.702204] [INFO ] [MAIN ] CB: Loaded 49935 existing records. [2025-10-15T17:54:32.873303] [WARN ] [MAIN ] CB: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:54:32.873524] [INFO ] [MAIN ] CB: Wiping existing primary data before full refresh. [2025-10-15T17:54:32.873570] [INFO ] [LOCAL ] CB: Starting deletion of primary data. [2025-10-15T17:54:32.873788] [DEBUG] [LOCAL ] CB: Deleted primary data file. [2025-10-15T17:54:32.873844] [INFO ] [MAIN ] CB: Starting full primary refresh. [2025-10-15T17:54:32.926170] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-01. [2025-10-15T17:54:33.223031] [INFO ] [REMOTE ] CB: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:54:33.713997] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-09. [2025-10-15T17:54:34.375931] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-15T17:54:34.407505] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-02 (2.29 seconds). [2025-10-15T17:54:34.513959] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-03. [2025-10-15T17:54:34.790492] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-15T17:54:35.313999] [INFO ] [REMOTE ] CB: Fetching primary data for 2024-12. [2025-10-15T17:54:36.114002] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-02. [2025-10-15T17:54:36.533366] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-10-15T17:54:36.913977] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-04. [2025-10-15T17:54:37.186837] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-10-15T17:54:37.713979] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-10. [2025-10-15T17:54:37.832837] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-15T17:54:38.344394] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-15T17:54:38.345699] [INFO ] [REMOTE ] CATO: Full fetch complete (10963 records). [2025-10-15T17:54:38.345770] [DEBUG] [VALIDATOR ] CATO: Validating primary data. [2025-10-15T17:54:38.523336] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-03. [2025-10-15T17:54:38.703458] [DEBUG] [VALIDATOR ] CATO: All expected trading days are present. [2025-10-15T17:54:38.703588] [DEBUG] [VALIDATOR ] CATO: Primary data validation passed. [2025-10-15T17:54:38.703894] [INFO ] [MAIN ] CATO: Fetched primary data is valid. [2025-10-15T17:54:38.703955] [DEBUG] [LOCAL ] CATO: Saving primary data. [2025-10-15T17:54:38.704457] [DEBUG] [LOCAL ] CATO: Trimmed 10963 records to 6687 (keeping 200 days of data) [2025-10-15T17:54:38.741611] [DEBUG] [LOCAL ] CATO: Primary data saved (6687 records). [2025-10-15T17:54:38.741777] [INFO ] [MAIN ] CATO: Full history saved. [2025-10-15T17:54:38.741864] [INFO ] [MAIN ] Update Progress: 396/2369 symbols completed. CATO took 22.9s. Estimated remaining: 4h 31m 53s. Rate: 7.3 symbols/min [2025-10-15T17:54:38.918329] [INFO ] [MAIN ] CBAN: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:54:38.930877] [DEBUG] [LOCAL ] CBAN: Loaded 10508 existing records from primary storage. [2025-10-15T17:54:38.931094] [INFO ] [MAIN ] CBAN: Loaded 10508 existing records. [2025-10-15T17:54:39.124770] [WARN ] [MAIN ] CBAN: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:54:39.125142] [INFO ] [MAIN ] CBAN: Wiping existing primary data before full refresh. [2025-10-15T17:54:39.125233] [INFO ] [LOCAL ] CBAN: Starting deletion of primary data. [2025-10-15T17:54:39.125559] [DEBUG] [LOCAL ] CBAN: Deleted primary data file. [2025-10-15T17:54:39.125791] [INFO ] [MAIN ] CBAN: Starting full primary refresh. [2025-10-15T17:54:39.267907] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-04 (2.35 seconds). [2025-10-15T17:54:39.321560] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-05. [2025-10-15T17:54:39.546133] [INFO ] [REMOTE ] CBAN: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:54:40.114047] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2024-12. [2025-10-15T17:54:40.762617] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-03 (2.24 seconds). [2025-10-15T17:54:40.913996] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-04. [2025-10-15T17:54:41.016688] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-10-15T17:54:41.513713] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-05 (2.19 seconds). [2025-10-15T17:54:41.714007] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-06. [2025-10-15T17:54:42.513969] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-01. [2025-10-15T17:54:42.770624] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-15T17:54:43.313988] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-05. [2025-10-15T17:54:43.344987] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-15T17:54:43.556351] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-15T17:54:44.113995] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-07. [2025-10-15T17:54:44.914028] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-01. [2025-10-15T17:54:45.081627] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-15T17:54:45.713992] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-06. [2025-10-15T17:54:46.343745] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-07 (2.23 seconds). [2025-10-15T17:54:46.513964] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-08. [2025-10-15T17:54:46.764977] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-15T17:54:47.313984] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-02. [2025-10-15T17:54:47.513127] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-15T17:54:47.803620] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-15T17:54:48.113993] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-03. [2025-10-15T17:54:48.406161] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-15T17:54:48.897472] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-15T17:54:48.913972] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-04. [2025-10-15T17:54:49.713997] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-02. [2025-10-15T17:54:49.806568] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-15T17:54:50.514010] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-05. [2025-10-15T17:54:51.154759] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-15T17:54:51.277563] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-15T17:54:51.313981] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-03. [2025-10-15T17:54:52.114063] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-06. [2025-10-15T17:54:52.913988] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-07. [2025-10-15T17:54:52.934009] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-15T17:54:53.099542] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-15T17:54:53.714040] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-04. [2025-10-15T17:54:54.514036] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-07. [2025-10-15T17:54:55.140184] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-07 (2.23 seconds). [2025-10-15T17:54:55.180083] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-15T17:54:55.279346] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-15T17:54:55.313971] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-08. [2025-10-15T17:54:56.034414] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-15T17:54:56.113958] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-09. [2025-10-15T17:54:56.914014] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-08. [2025-10-15T17:54:56.956019] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-15T17:54:57.714008] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-09. [2025-10-15T17:54:58.514007] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-10. [2025-10-15T17:54:59.028242] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-08 (2.11 seconds). [2025-10-15T17:54:59.244837] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-15T17:54:59.246419] [INFO ] [REMOTE ] CBAN: Full fetch complete (16201 records). [2025-10-15T17:54:59.246488] [DEBUG] [VALIDATOR ] CBAN: Validating primary data. [2025-10-15T17:54:59.314719] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-05. [2025-10-15T17:54:59.621614] [DEBUG] [VALIDATOR ] CBAN: All expected trading days are present. [2025-10-15T17:54:59.621756] [DEBUG] [VALIDATOR ] CBAN: Primary data validation passed. [2025-10-15T17:54:59.622237] [INFO ] [MAIN ] CBAN: Fetched primary data is valid. [2025-10-15T17:54:59.622312] [DEBUG] [LOCAL ] CBAN: Saving primary data. [2025-10-15T17:54:59.623068] [DEBUG] [LOCAL ] CBAN: Trimmed 16201 records to 10503 (keeping 200 days of data) [2025-10-15T17:54:59.717412] [DEBUG] [LOCAL ] CBAN: Primary data saved (10503 records). [2025-10-15T17:54:59.717686] [INFO ] [MAIN ] CBAN: Full history saved. [2025-10-15T17:54:59.717833] [INFO ] [MAIN ] Update Progress: 397/2369 symbols completed. CBAN took 21.0s. Estimated remaining: 4h 32m 48s. Rate: 7.2 symbols/min [2025-10-15T17:54:59.721205] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-10-15T17:55:00.114051] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-10. [2025-10-15T17:55:00.914102] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-09. [2025-10-15T17:55:01.082873] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-15T17:55:01.714035] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-06. [2025-10-15T17:55:02.152090] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-10 (2.04 seconds). [2025-10-15T17:55:02.158404] [INFO ] [REMOTE ] CAT: Full fetch complete (76863 records). [2025-10-15T17:55:02.158572] [DEBUG] [VALIDATOR ] CAT: Validating primary data. [2025-10-15T17:55:02.543851] [DEBUG] [VALIDATOR ] CAT: All expected trading days are present. [2025-10-15T17:55:02.543949] [DEBUG] [VALIDATOR ] CAT: Primary data validation passed. [2025-10-15T17:55:02.544850] [INFO ] [MAIN ] CAT: Fetched primary data is valid. [2025-10-15T17:55:02.544917] [DEBUG] [LOCAL ] CAT: Saving primary data. [2025-10-15T17:55:02.546412] [DEBUG] [LOCAL ] CAT: Trimmed 76863 records to 52958 (keeping 200 days of data) [2025-10-15T17:55:02.881991] [DEBUG] [LOCAL ] CAT: Primary data saved (52958 records). [2025-10-15T17:55:02.882168] [INFO ] [MAIN ] CAT: Full history saved. [2025-10-15T17:55:02.882335] [INFO ] [MAIN ] Update Progress: 398/2369 symbols completed. CAT took 56.2s. Estimated remaining: 4h 32m 14s. Rate: 7.2 symbols/min [2025-10-15T17:55:03.055548] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-09 (2.14 seconds). [2025-10-15T17:55:03.068943] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-10. [2025-10-15T17:55:03.764748] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-10-15T17:55:03.775205] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-07. [2025-10-15T17:55:05.332900] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-10 (2.26 seconds). [2025-10-15T17:55:05.339551] [INFO ] [REMOTE ] CAVA: Full fetch complete (77455 records). [2025-10-15T17:55:05.339750] [DEBUG] [VALIDATOR ] CAVA: Validating primary data. [2025-10-15T17:55:05.881389] [DEBUG] [VALIDATOR ] CAVA: All expected trading days are present. [2025-10-15T17:55:05.881831] [DEBUG] [VALIDATOR ] CAVA: Primary data validation passed. [2025-10-15T17:55:05.884160] [INFO ] [MAIN ] CAVA: Fetched primary data is valid. [2025-10-15T17:55:05.884412] [DEBUG] [LOCAL ] CAVA: Saving primary data. [2025-10-15T17:55:05.930751] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-07 (2.16 seconds). [2025-10-15T17:55:05.948070] [DEBUG] [LOCAL ] CAVA: Trimmed 77455 records to 53567 (keeping 200 days of data) [2025-10-15T17:55:05.948976] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-08. [2025-10-15T17:55:06.378755] [DEBUG] [LOCAL ] CAVA: Primary data saved (53567 records). [2025-10-15T17:55:06.379001] [INFO ] [MAIN ] CAVA: Full history saved. [2025-10-15T17:55:06.379160] [INFO ] [MAIN ] Update Progress: 399/2369 symbols completed. CAVA took 37.4s. Estimated remaining: 4h 31m 42s. Rate: 7.3 symbols/min [2025-10-15T17:55:08.008310] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-10-15T17:55:08.020433] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-09. [2025-10-15T17:55:09.709924] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-15T17:55:09.722546] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-10. [2025-10-15T17:55:11.507627] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-15T17:55:11.514073] [INFO ] [REMOTE ] CB: Full fetch complete (72758 records). [2025-10-15T17:55:11.514232] [DEBUG] [VALIDATOR ] CB: Validating primary data. [2025-10-15T17:55:11.907820] [DEBUG] [VALIDATOR ] CB: All expected trading days are present. [2025-10-15T17:55:11.907902] [DEBUG] [VALIDATOR ] CB: Primary data validation passed. [2025-10-15T17:55:11.908782] [INFO ] [MAIN ] CB: Fetched primary data is valid. [2025-10-15T17:55:11.908847] [DEBUG] [LOCAL ] CB: Saving primary data. [2025-10-15T17:55:11.910282] [DEBUG] [LOCAL ] CB: Trimmed 72758 records to 49940 (keeping 200 days of data) [2025-10-15T17:55:12.231165] [DEBUG] [LOCAL ] CB: Primary data saved (49940 records). [2025-10-15T17:55:12.231316] [INFO ] [MAIN ] CB: Full history saved. [2025-10-15T17:55:12.232308] [INFO ] [MAIN ] Update Progress: 400/2369 symbols completed. CB took 39.7s. Estimated remaining: 4h 31m 22s. Rate: 7.3 symbols/min [2025-10-15T17:55:12.810923] [INFO ] [MAIN ] CBNA: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:55:12.965372] [INFO ] [MAIN ] CBRE: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:55:12.928983] [INFO ] [MAIN ] CBO: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:55:12.972503] [DEBUG] [LOCAL ] CBO: No existing data file found in primary storage. [2025-10-15T17:55:12.972087] [INFO ] [MAIN ] CBL: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:55:12.972764] [WARN ] [MAIN ] CBO: No existing data found, performing full refresh instead. [2025-10-15T17:55:12.973305] [INFO ] [MAIN ] CBO: Wiping existing primary data before full refresh. [2025-10-15T17:55:12.973387] [INFO ] [LOCAL ] CBO: Starting deletion of primary data. [2025-10-15T17:55:12.973487] [DEBUG] [LOCAL ] CBO: No primary data file found to delete. [2025-10-15T17:55:12.973677] [INFO ] [MAIN ] CBO: Starting full primary refresh. [2025-10-15T17:55:13.030056] [DEBUG] [LOCAL ] CBNA: Loaded 2912 existing records from primary storage. [2025-10-15T17:55:13.065864] [INFO ] [MAIN ] CBNA: Loaded 2912 existing records. [2025-10-15T17:55:13.164550] [DEBUG] [LOCAL ] CBL: Loaded 16285 existing records from primary storage. [2025-10-15T17:55:13.192287] [INFO ] [MAIN ] CBL: Loaded 16285 existing records. [2025-10-15T17:55:13.506342] [DEBUG] [LOCAL ] CBRE: Loaded 50370 existing records from primary storage. [2025-10-15T17:55:13.599354] [INFO ] [MAIN ] CBRE: Loaded 50370 existing records. [2025-10-15T17:55:13.714251] [WARN ] [MAIN ] CBNA: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:55:13.765346] [INFO ] [MAIN ] CBNA: Wiping existing primary data before full refresh. [2025-10-15T17:55:13.892684] [INFO ] [LOCAL ] CBNA: Starting deletion of primary data. [2025-10-15T17:55:13.954703] [WARN ] [MAIN ] CBL: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:55:13.964827] [INFO ] [MAIN ] CBL: Wiping existing primary data before full refresh. [2025-10-15T17:55:13.968087] [INFO ] [LOCAL ] CBL: Starting deletion of primary data. [2025-10-15T17:55:13.967848] [INFO ] [REMOTE ] CBO: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:55:13.967907] [DEBUG] [LOCAL ] CBNA: Deleted primary data file. [2025-10-15T17:55:13.969108] [INFO ] [MAIN ] CBNA: Starting full primary refresh. [2025-10-15T17:55:13.969035] [INFO ] [REMOTE ] CBO: Fetching primary data for 2024-12. [2025-10-15T17:55:13.979684] [DEBUG] [LOCAL ] CBL: Deleted primary data file. [2025-10-15T17:55:14.014584] [INFO ] [MAIN ] CBL: Starting full primary refresh. [2025-10-15T17:55:14.214568] [WARN ] [MAIN ] CBRE: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:55:14.262551] [INFO ] [MAIN ] CBRE: Wiping existing primary data before full refresh. [2025-10-15T17:55:14.295905] [INFO ] [LOCAL ] CBRE: Starting deletion of primary data. [2025-10-15T17:55:14.375832] [DEBUG] [LOCAL ] CBRE: Deleted primary data file. [2025-10-15T17:55:14.478149] [INFO ] [MAIN ] CBRE: Starting full primary refresh. [2025-10-15T17:55:14.889049] [INFO ] [REMOTE ] CBNA: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:55:14.958936] [INFO ] [REMOTE ] CBL: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:55:14.959208] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2024-12. [2025-10-15T17:55:14.969873] [INFO ] [REMOTE ] CBL: Fetching primary data for 2024-12. [2025-10-15T17:55:15.228208] [INFO ] [REMOTE ] CBRE: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:55:15.228538] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2024-12. [2025-10-15T17:55:15.915398] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-10-15T17:55:15.917120] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-01. [2025-10-15T17:55:16.137001] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-15T17:55:16.144614] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-01. [2025-10-15T17:55:16.299444] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-01 (0.38 seconds). [2025-10-15T17:55:16.301786] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-02. [2025-10-15T17:55:16.767412] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-15T17:55:16.768813] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-03. [2025-10-15T17:55:16.810023] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-15T17:55:16.821063] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-01. [2025-10-15T17:55:17.138572] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-15T17:55:17.145174] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-02. [2025-10-15T17:55:17.157509] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-03 (0.39 seconds). [2025-10-15T17:55:17.158742] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-04. [2025-10-15T17:55:17.623555] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-10-15T17:55:17.625190] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-05. [2025-10-15T17:55:17.941274] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-15T17:55:17.945427] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-03. [2025-10-15T17:55:18.084722] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-15T17:55:18.095547] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-02. [2025-10-15T17:55:18.972117] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-15T17:55:18.976598] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-04. [2025-10-15T17:55:19.564962] [DEBUG] [REMOTE ] CBO: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-15T17:55:19.565273] [WARN ] [REMOTE ] CBO: No data returned for month 2024-12 [2025-10-15T17:55:19.565376] [FATAL] [REMOTE ] CBO: API call failed - aborting fetch to avoid wasting further API calls [2025-10-15T17:55:19.565468] [FATAL] [MAIN ] CBO: Failed to fetch primary data. [2025-10-15T17:55:19.565548] [WARN ] [MAIN ] CBO: Deleting existing primary and derivative data due to fetch failure. [2025-10-15T17:55:19.565636] [INFO ] [LOCAL ] CBO: Starting deletion of primary data. [2025-10-15T17:55:19.565748] [DEBUG] [LOCAL ] CBO: No primary data file found to delete. [2025-10-15T17:55:19.565790] [INFO ] [LOCAL ] CBO: Starting deletion of derivative data. [2025-10-15T17:55:19.565833] [DEBUG] [LOCAL ] CBO: No derivative data file found to delete. [2025-10-15T17:55:19.565881] [INFO ] [MAIN ] Update Progress: 401/2369 symbols completed. CBO took 7.3s. Estimated remaining: 4h 31m 9s. Rate: 7.3 symbols/min [2025-10-15T17:55:19.771397] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-15T17:55:19.774686] [INFO ] [MAIN ] CBT: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:55:19.785034] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-03. [2025-10-15T17:55:19.815603] [DEBUG] [LOCAL ] CBT: Loaded 31069 existing records from primary storage. [2025-10-15T17:55:19.815952] [INFO ] [MAIN ] CBT: Loaded 31069 existing records. [2025-10-15T17:55:19.950223] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-05 (2.33 seconds). [2025-10-15T17:55:20.004471] [WARN ] [MAIN ] CBT: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:55:20.006382] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-06. [2025-10-15T17:55:20.007457] [INFO ] [MAIN ] CBT: Wiping existing primary data before full refresh. [2025-10-15T17:55:20.007734] [INFO ] [LOCAL ] CBT: Starting deletion of primary data. [2025-10-15T17:55:20.008082] [DEBUG] [LOCAL ] CBT: Deleted primary data file. [2025-10-15T17:55:20.008139] [INFO ] [MAIN ] CBT: Starting full primary refresh. [2025-10-15T17:55:20.315781] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-15T17:55:20.359337] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-05. [2025-10-15T17:55:20.385773] [INFO ] [REMOTE ] CBT: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:55:20.613115] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-15T17:55:20.914004] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-07. [2025-10-15T17:55:21.315078] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-15T17:55:21.355919] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-10-15T17:55:21.367070] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-15T17:55:21.714014] [INFO ] [REMOTE ] CBT: Fetching primary data for 2024-12. [2025-10-15T17:55:21.815293] [DEBUG] [REMOTE ] CBT: Error fetching primary data for 2024-12: 'API call returned an empty response.' [2025-10-15T17:55:21.815631] [WARN ] [REMOTE ] CBT: No data returned for month 2024-12 [2025-10-15T17:55:21.815737] [FATAL] [REMOTE ] CBT: API call failed - aborting fetch to avoid wasting further API calls [2025-10-15T17:55:21.815816] [FATAL] [MAIN ] CBT: Failed to fetch primary data. [2025-10-15T17:55:21.815893] [WARN ] [MAIN ] CBT: Deleting existing primary and derivative data due to fetch failure. [2025-10-15T17:55:21.816169] [INFO ] [LOCAL ] CBT: Starting deletion of primary data. [2025-10-15T17:55:21.816250] [DEBUG] [LOCAL ] CBT: No primary data file found to delete. [2025-10-15T17:55:21.816301] [INFO ] [LOCAL ] CBT: Starting deletion of derivative data. [2025-10-15T17:55:21.816490] [DEBUG] [LOCAL ] CBT: Deleted derivative data file. [2025-10-15T17:55:21.816606] [INFO ] [MAIN ] Update Progress: 402/2369 symbols completed. CBT took 2.3s. Estimated remaining: 4h 30m 32s. Rate: 7.3 symbols/min [2025-10-15T17:55:21.985180] [INFO ] [MAIN ] CBU: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:55:22.005928] [DEBUG] [LOCAL ] CBU: Loaded 22672 existing records from primary storage. [2025-10-15T17:55:22.006146] [INFO ] [MAIN ] CBU: Loaded 22672 existing records. [2025-10-15T17:55:22.177908] [WARN ] [MAIN ] CBU: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:55:22.178084] [INFO ] [MAIN ] CBU: Wiping existing primary data before full refresh. [2025-10-15T17:55:22.178163] [INFO ] [LOCAL ] CBU: Starting deletion of primary data. [2025-10-15T17:55:22.178375] [DEBUG] [LOCAL ] CBU: Deleted primary data file. [2025-10-15T17:55:22.178432] [INFO ] [MAIN ] CBU: Starting full primary refresh. [2025-10-15T17:55:22.523852] [INFO ] [REMOTE ] CBU: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:55:22.519484] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-06. [2025-10-15T17:55:23.144787] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-15T17:55:23.314000] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-04. [2025-10-15T17:55:24.114011] [INFO ] [REMOTE ] CBU: Fetching primary data for 2024-12. [2025-10-15T17:55:24.552816] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-15T17:55:24.913986] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-08. [2025-10-15T17:55:25.274034] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-15T17:55:25.341737] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-10-15T17:55:25.714012] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-09. [2025-10-15T17:55:26.229570] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-10-15T17:55:26.513998] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-07. [2025-10-15T17:55:27.313983] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-05. [2025-10-15T17:55:27.653232] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-15T17:55:28.114047] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-01. [2025-10-15T17:55:28.820108] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-15T17:55:28.914026] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-08. [2025-10-15T17:55:29.669148] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-15T17:55:29.714046] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-06. [2025-10-15T17:55:29.931668] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-15T17:55:30.513989] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-09. [2025-10-15T17:55:31.298525] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-15T17:55:31.313941] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-07. [2025-10-15T17:55:31.340556] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-15T17:55:32.113994] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-10. [2025-10-15T17:55:32.900557] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-15T17:55:32.903433] [INFO ] [REMOTE ] CBL: Full fetch complete (25204 records). [2025-10-15T17:55:32.903631] [DEBUG] [VALIDATOR ] CBL: Validating primary data. [2025-10-15T17:55:32.919094] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-02. [2025-10-15T17:55:33.124952] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-15T17:55:33.320794] [DEBUG] [VALIDATOR ] CBL: All expected trading days are present. [2025-10-15T17:55:33.320873] [DEBUG] [VALIDATOR ] CBL: Primary data validation passed. [2025-10-15T17:55:33.321490] [INFO ] [MAIN ] CBL: Fetched primary data is valid. [2025-10-15T17:55:33.321551] [DEBUG] [LOCAL ] CBL: Saving primary data. [2025-10-15T17:55:33.322164] [DEBUG] [LOCAL ] CBL: Trimmed 25204 records to 16293 (keeping 200 days of data) [2025-10-15T17:55:33.417506] [DEBUG] [LOCAL ] CBL: Primary data saved (16293 records). [2025-10-15T17:55:33.420589] [INFO ] [MAIN ] CBL: Full history saved. [2025-10-15T17:55:33.420702] [INFO ] [MAIN ] Update Progress: 403/2369 symbols completed. CBL took 21.2s. Estimated remaining: 4h 30m 40s. Rate: 7.3 symbols/min [2025-10-15T17:55:33.585356] [INFO ] [MAIN ] CBX: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:55:33.585523] [DEBUG] [LOCAL ] CBX: No existing data file found in primary storage. [2025-10-15T17:55:33.585579] [WARN ] [MAIN ] CBX: No existing data found, performing full refresh instead. [2025-10-15T17:55:33.585711] [INFO ] [MAIN ] CBX: Wiping existing primary data before full refresh. [2025-10-15T17:55:33.585776] [INFO ] [LOCAL ] CBX: Starting deletion of primary data. [2025-10-15T17:55:33.585820] [DEBUG] [LOCAL ] CBX: No primary data file found to delete. [2025-10-15T17:55:33.585854] [INFO ] [MAIN ] CBX: Starting full primary refresh. [2025-10-15T17:55:33.721880] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-08. [2025-10-15T17:55:33.937247] [INFO ] [REMOTE ] CBX: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:55:33.977724] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-15T17:55:34.513988] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-03. [2025-10-15T17:55:35.313955] [INFO ] [REMOTE ] CBX: Fetching primary data for 2024-12. [2025-10-15T17:55:35.502058] [DEBUG] [REMOTE ] CBX: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-15T17:55:35.502359] [WARN ] [REMOTE ] CBX: No data returned for month 2024-12 [2025-10-15T17:55:35.502446] [FATAL] [REMOTE ] CBX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-15T17:55:35.502491] [FATAL] [MAIN ] CBX: Failed to fetch primary data. [2025-10-15T17:55:35.502550] [WARN ] [MAIN ] CBX: Deleting existing primary and derivative data due to fetch failure. [2025-10-15T17:55:35.502619] [INFO ] [LOCAL ] CBX: Starting deletion of primary data. [2025-10-15T17:55:35.502716] [DEBUG] [LOCAL ] CBX: No primary data file found to delete. [2025-10-15T17:55:35.502761] [INFO ] [LOCAL ] CBX: Starting deletion of derivative data. [2025-10-15T17:55:35.502802] [DEBUG] [LOCAL ] CBX: No derivative data file found to delete. [2025-10-15T17:55:35.502848] [INFO ] [MAIN ] Update Progress: 404/2369 symbols completed. CBX took 2.1s. Estimated remaining: 4h 30m 1s. Rate: 7.3 symbols/min [2025-10-15T17:55:35.676358] [INFO ] [MAIN ] CBZ: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:55:35.693278] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-15T17:55:35.731952] [DEBUG] [LOCAL ] CBZ: Loaded 34151 existing records from primary storage. [2025-10-15T17:55:35.732261] [INFO ] [MAIN ] CBZ: Loaded 34151 existing records. [2025-10-15T17:55:35.911626] [WARN ] [MAIN ] CBZ: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:55:35.911863] [INFO ] [MAIN ] CBZ: Wiping existing primary data before full refresh. [2025-10-15T17:55:35.911911] [INFO ] [LOCAL ] CBZ: Starting deletion of primary data. [2025-10-15T17:55:35.912136] [DEBUG] [LOCAL ] CBZ: Deleted primary data file. [2025-10-15T17:55:35.912204] [INFO ] [MAIN ] CBZ: Starting full primary refresh. [2025-10-15T17:55:36.115709] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-04. [2025-10-15T17:55:36.142789] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-08 (2.42 seconds). [2025-10-15T17:55:36.334761] [INFO ] [REMOTE ] CBZ: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:55:36.914036] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-09. [2025-10-15T17:55:37.318230] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-15T17:55:37.713975] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-10. [2025-10-15T17:55:38.212226] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-15T17:55:38.213084] [INFO ] [REMOTE ] CBNA: Full fetch complete (4407 records). [2025-10-15T17:55:38.213151] [DEBUG] [VALIDATOR ] CBNA: Validating primary data. [2025-10-15T17:55:38.516130] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-05. [2025-10-15T17:55:38.610638] [DEBUG] [VALIDATOR ] CBNA: All expected trading days are present. [2025-10-15T17:55:38.610803] [DEBUG] [VALIDATOR ] CBNA: Primary data validation passed. [2025-10-15T17:55:38.610999] [INFO ] [MAIN ] CBNA: Fetched primary data is valid. [2025-10-15T17:55:38.611042] [DEBUG] [LOCAL ] CBNA: Saving primary data. [2025-10-15T17:55:38.611843] [DEBUG] [LOCAL ] CBNA: Trimmed 4407 records to 2920 (keeping 200 days of data) [2025-10-15T17:55:38.644671] [DEBUG] [LOCAL ] CBNA: Primary data saved (2920 records). [2025-10-15T17:55:38.656214] [INFO ] [MAIN ] CBNA: Full history saved. [2025-10-15T17:55:38.656374] [INFO ] [MAIN ] Update Progress: 405/2369 symbols completed. CBNA took 26.4s. Estimated remaining: 4h 29m 28s. Rate: 7.3 symbols/min [2025-10-15T17:55:38.727425] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-15T17:55:38.836862] [INFO ] [MAIN ] CC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:55:38.888082] [DEBUG] [LOCAL ] CC: Loaded 53008 existing records from primary storage. [2025-10-15T17:55:38.888427] [INFO ] [MAIN ] CC: Loaded 53008 existing records. [2025-10-15T17:55:39.061869] [WARN ] [MAIN ] CC: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:55:39.062085] [INFO ] [MAIN ] CC: Wiping existing primary data before full refresh. [2025-10-15T17:55:39.062131] [INFO ] [LOCAL ] CC: Starting deletion of primary data. [2025-10-15T17:55:39.062531] [DEBUG] [LOCAL ] CC: Deleted primary data file. [2025-10-15T17:55:39.062569] [INFO ] [MAIN ] CC: Starting full primary refresh. [2025-10-15T17:55:39.314159] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-10. [2025-10-15T17:55:39.419934] [INFO ] [REMOTE ] CC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:55:39.708887] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-15T17:55:40.113993] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2024-12. [2025-10-15T17:55:40.914024] [INFO ] [REMOTE ] CC: Fetching primary data for 2024-12. [2025-10-15T17:55:41.220534] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-10 (1.91 seconds). [2025-10-15T17:55:41.226751] [INFO ] [REMOTE ] CBRE: Full fetch complete (73854 records). [2025-10-15T17:55:41.226871] [DEBUG] [VALIDATOR ] CBRE: Validating primary data. [2025-10-15T17:55:41.624119] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-15T17:55:41.652769] [DEBUG] [VALIDATOR ] CBRE: All expected trading days are present. [2025-10-15T17:55:41.652835] [DEBUG] [VALIDATOR ] CBRE: Primary data validation passed. [2025-10-15T17:55:41.653703] [INFO ] [MAIN ] CBRE: Fetched primary data is valid. [2025-10-15T17:55:41.653765] [DEBUG] [LOCAL ] CBRE: Saving primary data. [2025-10-15T17:55:41.655106] [DEBUG] [LOCAL ] CBRE: Trimmed 73854 records to 50361 (keeping 200 days of data) [2025-10-15T17:55:41.715284] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-01. [2025-10-15T17:55:41.950348] [DEBUG] [LOCAL ] CBRE: Primary data saved (50361 records). [2025-10-15T17:55:41.950485] [INFO ] [MAIN ] CBRE: Full history saved. [2025-10-15T17:55:41.950563] [INFO ] [MAIN ] Update Progress: 406/2369 symbols completed. CBRE took 29.7s. Estimated remaining: 4h 28m 56s. Rate: 7.3 symbols/min [2025-10-15T17:55:42.122379] [INFO ] [MAIN ] CCI: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:55:42.175194] [DEBUG] [LOCAL ] CCI: Loaded 53124 existing records from primary storage. [2025-10-15T17:55:42.175499] [INFO ] [MAIN ] CCI: Loaded 53124 existing records. [2025-10-15T17:55:42.357018] [WARN ] [MAIN ] CCI: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:55:42.357418] [INFO ] [MAIN ] CCI: Wiping existing primary data before full refresh. [2025-10-15T17:55:42.357467] [INFO ] [LOCAL ] CCI: Starting deletion of primary data. [2025-10-15T17:55:42.357789] [DEBUG] [LOCAL ] CCI: Deleted primary data file. [2025-10-15T17:55:42.357851] [INFO ] [MAIN ] CCI: Starting full primary refresh. [2025-10-15T17:55:42.515546] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-06. [2025-10-15T17:55:42.735862] [INFO ] [REMOTE ] CCI: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:55:42.755762] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-15T17:55:42.777917] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-15T17:55:43.314023] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-02. [2025-10-15T17:55:43.610165] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-15T17:55:44.114019] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-07. [2025-10-15T17:55:44.135578] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-15T17:55:44.914033] [INFO ] [REMOTE ] CCI: Fetching primary data for 2024-12. [2025-10-15T17:55:45.332207] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-15T17:55:45.713987] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-08. [2025-10-15T17:55:46.513963] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-03. [2025-10-15T17:55:46.613374] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-15T17:55:46.647564] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-15T17:55:47.313973] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-01. [2025-10-15T17:55:47.712843] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-15T17:55:48.114025] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-09. [2025-10-15T17:55:48.799910] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-15T17:55:48.913998] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-04. [2025-10-15T17:55:49.186230] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-15T17:55:49.714080] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-01. [2025-10-15T17:55:50.400514] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-15T17:55:50.513994] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-02. [2025-10-15T17:55:51.314026] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-05. [2025-10-15T17:55:51.542457] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-15T17:55:51.977490] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-15T17:55:52.114010] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-03. [2025-10-15T17:55:52.161702] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-15T17:55:52.914044] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-02. [2025-10-15T17:55:53.714075] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-06. [2025-10-15T17:55:53.979122] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-15T17:55:54.517184] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-10. [2025-10-15T17:55:54.522464] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-15T17:55:54.935907] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-15T17:55:55.314059] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-03. [2025-10-15T17:55:55.414135] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-15T17:55:55.417343] [INFO ] [REMOTE ] CBU: Full fetch complete (32441 records). [2025-10-15T17:55:55.417436] [DEBUG] [VALIDATOR ] CBU: Validating primary data. [2025-10-15T17:55:55.783732] [DEBUG] [VALIDATOR ] CBU: All expected trading days are present. [2025-10-15T17:55:55.783812] [DEBUG] [VALIDATOR ] CBU: Primary data validation passed. [2025-10-15T17:55:55.784350] [INFO ] [MAIN ] CBU: Fetched primary data is valid. [2025-10-15T17:55:55.784389] [DEBUG] [LOCAL ] CBU: Saving primary data. [2025-10-15T17:55:55.785196] [DEBUG] [LOCAL ] CBU: Trimmed 32441 records to 22717 (keeping 200 days of data) [2025-10-15T17:55:55.921712] [DEBUG] [LOCAL ] CBU: Primary data saved (22717 records). [2025-10-15T17:55:55.921848] [INFO ] [MAIN ] CBU: Full history saved. [2025-10-15T17:55:55.921951] [INFO ] [MAIN ] Update Progress: 407/2369 symbols completed. CBU took 34.1s. Estimated remaining: 4h 29m 16s. Rate: 7.3 symbols/min [2025-10-15T17:55:56.101559] [INFO ] [MAIN ] CCIA: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:55:56.102274] [DEBUG] [LOCAL ] CCIA: No existing data file found in primary storage. [2025-10-15T17:55:56.102318] [WARN ] [MAIN ] CCIA: No existing data found, performing full refresh instead. [2025-10-15T17:55:56.102490] [INFO ] [MAIN ] CCIA: Wiping existing primary data before full refresh. [2025-10-15T17:55:56.102559] [INFO ] [LOCAL ] CCIA: Starting deletion of primary data. [2025-10-15T17:55:56.102631] [DEBUG] [LOCAL ] CCIA: No primary data file found to delete. [2025-10-15T17:55:56.102711] [INFO ] [MAIN ] CCIA: Starting full primary refresh. [2025-10-15T17:55:56.119200] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-04. [2025-10-15T17:55:56.489582] [INFO ] [REMOTE ] CCIA: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:55:56.914058] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-07. [2025-10-15T17:55:57.502976] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-03 (2.19 seconds). [2025-10-15T17:55:57.714015] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-04. [2025-10-15T17:55:58.096589] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-15T17:55:58.305735] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-15T17:55:58.514066] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-05. [2025-10-15T17:55:59.314058] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-08. [2025-10-15T17:55:59.483891] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-15T17:56:00.011154] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-15T17:56:00.114002] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-06. [2025-10-15T17:56:00.767017] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-15T17:56:00.913966] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-09. [2025-10-15T17:56:01.713988] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-05. [2025-10-15T17:56:02.011423] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-15T17:56:02.297834] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-15T17:56:02.514021] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-10. [2025-10-15T17:56:03.150727] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-15T17:56:03.313971] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-06. [2025-10-15T17:56:03.930609] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-15T17:56:03.934633] [INFO ] [REMOTE ] CBZ: Full fetch complete (45745 records). [2025-10-15T17:56:03.934775] [DEBUG] [VALIDATOR ] CBZ: Validating primary data. [2025-10-15T17:56:03.935362] [FATAL] [VALIDATOR ] CBZ: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T17:56:03.935449] [FATAL] [MAIN ] CBZ: Fetched primary data is invalid. Refusing to save it. [2025-10-15T17:56:03.935492] [WARN ] [MAIN ] CBZ: Deleting existing primary and derivative data due to validation failure. [2025-10-15T17:56:03.935530] [INFO ] [LOCAL ] CBZ: Starting deletion of primary data. [2025-10-15T17:56:03.935626] [DEBUG] [LOCAL ] CBZ: No primary data file found to delete. [2025-10-15T17:56:03.935712] [INFO ] [LOCAL ] CBZ: Starting deletion of derivative data. [2025-10-15T17:56:03.935945] [DEBUG] [LOCAL ] CBZ: Deleted derivative data file. [2025-10-15T17:56:03.936257] [INFO ] [MAIN ] Update Progress: 408/2369 symbols completed. CBZ took 28.4s. Estimated remaining: 4h 29m 7s. Rate: 7.3 symbols/min [2025-10-15T17:56:04.106273] [INFO ] [MAIN ] CCIF: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:56:04.106445] [DEBUG] [LOCAL ] CCIF: No existing data file found in primary storage. [2025-10-15T17:56:04.106483] [WARN ] [MAIN ] CCIF: No existing data found, performing full refresh instead. [2025-10-15T17:56:04.106595] [INFO ] [MAIN ] CCIF: Wiping existing primary data before full refresh. [2025-10-15T17:56:04.106637] [INFO ] [LOCAL ] CCIF: Starting deletion of primary data. [2025-10-15T17:56:04.106725] [DEBUG] [LOCAL ] CCIF: No primary data file found to delete. [2025-10-15T17:56:04.106761] [INFO ] [MAIN ] CCIF: Starting full primary refresh. [2025-10-15T17:56:04.119362] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-07. [2025-10-15T17:56:04.453251] [INFO ] [REMOTE ] CCIF: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:56:04.914005] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2024-12. [2025-10-15T17:56:04.999521] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-15T17:56:05.345822] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2024-12 (0.43 seconds). [2025-10-15T17:56:05.713967] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-01. [2025-10-15T17:56:06.147534] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-10-15T17:56:06.196420] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-10-15T17:56:06.514060] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-08. [2025-10-15T17:56:07.314062] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-07. [2025-10-15T17:56:08.114023] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-02. [2025-10-15T17:56:08.149774] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-15T17:56:08.440021] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-10-15T17:56:08.914014] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-09. [2025-10-15T17:56:09.141692] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-15T17:56:09.714073] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-03. [2025-10-15T17:56:10.060459] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-03 (0.35 seconds). [2025-10-15T17:56:10.513998] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-04. [2025-10-15T17:56:10.693565] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-15T17:56:10.851142] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-04 (0.34 seconds). [2025-10-15T17:56:11.314032] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-05. [2025-10-15T17:56:11.780710] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-15T17:56:12.114042] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-06. [2025-10-15T17:56:12.437343] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-06 (0.32 seconds). [2025-10-15T17:56:12.914000] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-07. [2025-10-15T17:56:13.273485] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-07 (0.36 seconds). [2025-10-15T17:56:13.713992] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-08. [2025-10-15T17:56:14.513985] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2024-12. [2025-10-15T17:56:15.314040] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-08. [2025-10-15T17:56:15.365260] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-15T17:56:15.790443] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-10-15T17:56:15.884409] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-08 (2.17 seconds). [2025-10-15T17:56:16.113995] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-01. [2025-10-15T17:56:16.914049] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-09. [2025-10-15T17:56:17.016971] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-15T17:56:17.265636] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-09 (0.35 seconds). [2025-10-15T17:56:17.714052] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-10. [2025-10-15T17:56:18.232044] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-15T17:56:18.233675] [INFO ] [REMOTE ] CCIA: Full fetch complete (2158 records). [2025-10-15T17:56:18.233766] [DEBUG] [VALIDATOR ] CCIA: Validating primary data. [2025-10-15T17:56:18.431528] [WARN ] [VALIDATOR ] CCIA: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-15T17:56:18.431801] [FATAL] [MAIN ] CCIA: Fetched primary data is invalid. Refusing to save it. [2025-10-15T17:56:18.431886] [WARN ] [MAIN ] CCIA: Deleting existing primary and derivative data due to validation failure. [2025-10-15T17:56:18.431948] [INFO ] [LOCAL ] CCIA: Starting deletion of primary data. [2025-10-15T17:56:18.432015] [DEBUG] [LOCAL ] CCIA: No primary data file found to delete. [2025-10-15T17:56:18.432052] [INFO ] [LOCAL ] CCIA: Starting deletion of derivative data. [2025-10-15T17:56:18.432096] [DEBUG] [LOCAL ] CCIA: No derivative data file found to delete. [2025-10-15T17:56:18.432314] [INFO ] [MAIN ] Update Progress: 409/2369 symbols completed. CCIA took 22.5s. Estimated remaining: 4h 29m 28s. Rate: 7.3 symbols/min [2025-10-15T17:56:18.519151] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-09. [2025-10-15T17:56:18.621916] [INFO ] [MAIN ] CCJ: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:56:18.680575] [DEBUG] [LOCAL ] CCJ: Loaded 53686 existing records from primary storage. [2025-10-15T17:56:18.681105] [INFO ] [MAIN ] CCJ: Loaded 53686 existing records. [2025-10-15T17:56:18.866825] [WARN ] [MAIN ] CCJ: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:56:18.867102] [INFO ] [MAIN ] CCJ: Wiping existing primary data before full refresh. [2025-10-15T17:56:18.867155] [INFO ] [LOCAL ] CCJ: Starting deletion of primary data. [2025-10-15T17:56:18.867449] [DEBUG] [LOCAL ] CCJ: Deleted primary data file. [2025-10-15T17:56:18.867489] [INFO ] [MAIN ] CCJ: Starting full primary refresh. [2025-10-15T17:56:19.243886] [INFO ] [REMOTE ] CCJ: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:56:19.314056] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2024-12. [2025-10-15T17:56:20.114013] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-02. [2025-10-15T17:56:20.570675] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-10-15T17:56:20.913959] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-10. [2025-10-15T17:56:20.913882] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-15T17:56:21.065730] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-15T17:56:21.714001] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-10. [2025-10-15T17:56:22.513974] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-03. [2025-10-15T17:56:22.688751] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-15T17:56:22.695142] [INFO ] [REMOTE ] CCI: Full fetch complete (77106 records). [2025-10-15T17:56:22.695307] [DEBUG] [VALIDATOR ] CCI: Validating primary data. [2025-10-15T17:56:23.099636] [DEBUG] [VALIDATOR ] CCI: All expected trading days are present. [2025-10-15T17:56:23.099744] [DEBUG] [VALIDATOR ] CCI: Primary data validation passed. [2025-10-15T17:56:23.100734] [INFO ] [MAIN ] CCI: Fetched primary data is valid. [2025-10-15T17:56:23.100799] [DEBUG] [LOCAL ] CCI: Saving primary data. [2025-10-15T17:56:23.102378] [DEBUG] [LOCAL ] CCI: Trimmed 77106 records to 53117 (keeping 200 days of data) [2025-10-15T17:56:23.322835] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-01. [2025-10-15T17:56:23.430128] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-15T17:56:23.457713] [DEBUG] [LOCAL ] CCI: Primary data saved (53117 records). [2025-10-15T17:56:23.457837] [INFO ] [MAIN ] CCI: Full history saved. [2025-10-15T17:56:23.459130] [INFO ] [MAIN ] Update Progress: 410/2369 symbols completed. CCI took 41.5s. Estimated remaining: 4h 29m 5s. Rate: 7.3 symbols/min [2025-10-15T17:56:23.652748] [INFO ] [MAIN ] CCK: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:56:23.665117] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-10 (1.95 seconds). [2025-10-15T17:56:23.672880] [INFO ] [REMOTE ] CC: Full fetch complete (76047 records). [2025-10-15T17:56:23.673090] [DEBUG] [VALIDATOR ] CC: Validating primary data. [2025-10-15T17:56:24.013044] [DEBUG] [LOCAL ] CCK: Loaded 46416 existing records from primary storage. [2025-10-15T17:56:24.028985] [INFO ] [MAIN ] CCK: Loaded 46416 existing records. [2025-10-15T17:56:24.126871] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-04. [2025-10-15T17:56:24.217662] [DEBUG] [VALIDATOR ] CC: All expected trading days are present. [2025-10-15T17:56:24.217820] [DEBUG] [VALIDATOR ] CC: Primary data validation passed. [2025-10-15T17:56:24.218835] [INFO ] [MAIN ] CC: Fetched primary data is valid. [2025-10-15T17:56:24.218915] [DEBUG] [LOCAL ] CC: Saving primary data. [2025-10-15T17:56:24.278034] [DEBUG] [LOCAL ] CC: Trimmed 76047 records to 53013 (keeping 200 days of data) [2025-10-15T17:56:24.297932] [WARN ] [MAIN ] CCK: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:56:24.298334] [INFO ] [MAIN ] CCK: Wiping existing primary data before full refresh. [2025-10-15T17:56:24.298393] [INFO ] [LOCAL ] CCK: Starting deletion of primary data. [2025-10-15T17:56:24.299001] [DEBUG] [LOCAL ] CCK: Deleted primary data file. [2025-10-15T17:56:24.299058] [INFO ] [MAIN ] CCK: Starting full primary refresh. [2025-10-15T17:56:24.778519] [INFO ] [REMOTE ] CCK: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:56:24.916538] [INFO ] [REMOTE ] CCK: Fetching primary data for 2024-12. [2025-10-15T17:56:24.997502] [DEBUG] [LOCAL ] CC: Primary data saved (53013 records). [2025-10-15T17:56:24.997684] [INFO ] [MAIN ] CC: Full history saved. [2025-10-15T17:56:24.997777] [INFO ] [MAIN ] Update Progress: 411/2369 symbols completed. CC took 46.3s. Estimated remaining: 4h 28m 25s. Rate: 7.3 symbols/min [2025-10-15T17:56:25.186679] [INFO ] [MAIN ] CCL: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:56:25.188075] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-15T17:56:25.224573] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-10-15T17:56:25.280725] [DEBUG] [LOCAL ] CCL: Loaded 53800 existing records from primary storage. [2025-10-15T17:56:25.281052] [INFO ] [MAIN ] CCL: Loaded 53800 existing records. [2025-10-15T17:56:25.455884] [WARN ] [MAIN ] CCL: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:56:25.456129] [INFO ] [MAIN ] CCL: Wiping existing primary data before full refresh. [2025-10-15T17:56:25.456179] [INFO ] [LOCAL ] CCL: Starting deletion of primary data. [2025-10-15T17:56:25.456507] [DEBUG] [LOCAL ] CCL: Deleted primary data file. [2025-10-15T17:56:25.456563] [INFO ] [MAIN ] CCL: Starting full primary refresh. [2025-10-15T17:56:25.719137] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-05. [2025-10-15T17:56:25.841938] [INFO ] [REMOTE ] CCL: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:56:26.365940] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-15T17:56:26.513977] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-02. [2025-10-15T17:56:26.884248] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-15T17:56:27.314048] [INFO ] [REMOTE ] CCL: Fetching primary data for 2024-12. [2025-10-15T17:56:28.113994] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-06. [2025-10-15T17:56:28.370841] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-10-15T17:56:28.857621] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-15T17:56:28.913995] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-07. [2025-10-15T17:56:29.467310] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2024-12 (2.15 seconds). [2025-10-15T17:56:29.713986] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-01. [2025-10-15T17:56:29.868535] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-15T17:56:30.514009] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-01. [2025-10-15T17:56:31.314001] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-08. [2025-10-15T17:56:31.884797] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-15T17:56:32.114080] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-03. [2025-10-15T17:56:32.287702] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-01 (2.57 seconds). [2025-10-15T17:56:32.368934] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-15T17:56:32.914012] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-02. [2025-10-15T17:56:33.714031] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-02. [2025-10-15T17:56:34.120090] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-10-15T17:56:34.507520] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-15T17:56:34.517227] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-09. [2025-10-15T17:56:35.255375] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-15T17:56:35.313959] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-10. [2025-10-15T17:56:35.774501] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-02 (2.06 seconds). [2025-10-15T17:56:36.097315] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-15T17:56:36.099344] [INFO ] [REMOTE ] CCIF: Full fetch complete (21883 records). [2025-10-15T17:56:36.099418] [DEBUG] [VALIDATOR ] CCIF: Validating primary data. [2025-10-15T17:56:36.122257] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-04. [2025-10-15T17:56:36.520408] [DEBUG] [VALIDATOR ] CCIF: All expected trading days are present. [2025-10-15T17:56:36.520526] [DEBUG] [VALIDATOR ] CCIF: Primary data validation passed. [2025-10-15T17:56:36.521192] [INFO ] [MAIN ] CCIF: Fetched primary data is valid. [2025-10-15T17:56:36.521258] [DEBUG] [LOCAL ] CCIF: Saving primary data. [2025-10-15T17:56:36.522131] [DEBUG] [LOCAL ] CCIF: Trimmed 21883 records to 15528 (keeping 200 days of data) [2025-10-15T17:56:36.614576] [DEBUG] [LOCAL ] CCIF: Primary data saved (15528 records). [2025-10-15T17:56:36.614751] [INFO ] [MAIN ] CCIF: Full history saved. [2025-10-15T17:56:36.614831] [INFO ] [MAIN ] Update Progress: 412/2369 symbols completed. CCIF took 32.7s. Estimated remaining: 4h 28m 32s. Rate: 7.3 symbols/min [2025-10-15T17:56:36.779950] [INFO ] [MAIN ] CCO: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:56:36.828286] [DEBUG] [LOCAL ] CCO: Loaded 48290 existing records from primary storage. [2025-10-15T17:56:36.828632] [INFO ] [MAIN ] CCO: Loaded 48290 existing records. [2025-10-15T17:56:36.924125] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-03. [2025-10-15T17:56:37.007070] [WARN ] [MAIN ] CCO: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:56:37.007246] [INFO ] [MAIN ] CCO: Wiping existing primary data before full refresh. [2025-10-15T17:56:37.007305] [INFO ] [LOCAL ] CCO: Starting deletion of primary data. [2025-10-15T17:56:37.007677] [DEBUG] [LOCAL ] CCO: Deleted primary data file. [2025-10-15T17:56:37.007734] [INFO ] [MAIN ] CCO: Starting full primary refresh. [2025-10-15T17:56:37.354505] [INFO ] [REMOTE ] CCO: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:56:37.713964] [INFO ] [REMOTE ] CCO: Fetching primary data for 2024-12. [2025-10-15T17:56:37.921020] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-15T17:56:38.513957] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-05. [2025-10-15T17:56:38.560484] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-15T17:56:39.234036] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-15T17:56:39.313988] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-01. [2025-10-15T17:56:40.114020] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-04. [2025-10-15T17:56:40.480761] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-15T17:56:40.914032] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-03. [2025-10-15T17:56:41.514183] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-15T17:56:41.713976] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-05. [2025-10-15T17:56:42.513988] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-02. [2025-10-15T17:56:43.258070] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-15T17:56:43.313961] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-06. [2025-10-15T17:56:43.385796] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-03 (2.47 seconds). [2025-10-15T17:56:43.472638] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-15T17:56:44.113986] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-03. [2025-10-15T17:56:44.914055] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-04. [2025-10-15T17:56:45.632780] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-15T17:56:45.713975] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-04. [2025-10-15T17:56:46.148338] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-05 (7.63 seconds). [2025-10-15T17:56:46.514063] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-06. [2025-10-15T17:56:47.163774] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-04 (2.25 seconds). [2025-10-15T17:56:47.238743] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-06 (3.92 seconds). [2025-10-15T17:56:47.287510] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-15T17:56:47.314002] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-05. [2025-10-15T17:56:48.113995] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-05. [2025-10-15T17:56:48.566099] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-10-15T17:56:48.887542] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-15T17:56:48.913946] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-06. [2025-10-15T17:56:49.714022] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-07. [2025-10-15T17:56:50.521064] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-07. [2025-10-15T17:56:50.541289] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-15T17:56:50.897910] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-05 (2.78 seconds). [2025-10-15T17:56:51.289092] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-15T17:56:51.314009] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-08. [2025-10-15T17:56:52.114016] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-06. [2025-10-15T17:56:52.814205] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-07 (2.29 seconds). [2025-10-15T17:56:52.881103] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-15T17:56:52.913993] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-08. [2025-10-15T17:56:53.714054] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-09. [2025-10-15T17:56:54.513994] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-07. [2025-10-15T17:56:55.000701] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-10-15T17:56:55.314021] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-09. [2025-10-15T17:56:55.394623] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-06 (3.28 seconds). [2025-10-15T17:56:56.058977] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-15T17:56:56.113963] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-07. [2025-10-15T17:56:56.500631] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-09 (2.79 seconds). [2025-10-15T17:56:56.914037] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-08. [2025-10-15T17:56:57.491401] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-09 (2.18 seconds). [2025-10-15T17:56:57.713990] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-10. [2025-10-15T17:56:58.514100] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-10. [2025-10-15T17:56:59.814357] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-08 (2.90 seconds). [2025-10-15T17:56:59.824893] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-09. [2025-10-15T17:57:00.078469] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-15T17:57:00.085097] [INFO ] [REMOTE ] CCK: Full fetch complete (67760 records). [2025-10-15T17:57:00.085238] [DEBUG] [VALIDATOR ] CCK: Validating primary data. [2025-10-15T17:57:00.178123] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-10 (2.46 seconds). [2025-10-15T17:57:00.222881] [INFO ] [REMOTE ] CCJ: Full fetch complete (77837 records). [2025-10-15T17:57:00.256619] [DEBUG] [VALIDATOR ] CCJ: Validating primary data. [2025-10-15T17:57:00.731134] [DEBUG] [VALIDATOR ] CCK: All expected trading days are present. [2025-10-15T17:57:00.752040] [DEBUG] [VALIDATOR ] CCK: Primary data validation passed. [2025-10-15T17:57:00.753131] [INFO ] [MAIN ] CCK: Fetched primary data is valid. [2025-10-15T17:57:00.777046] [DEBUG] [LOCAL ] CCK: Saving primary data. [2025-10-15T17:57:00.847207] [DEBUG] [LOCAL ] CCK: Trimmed 67760 records to 46451 (keeping 200 days of data) [2025-10-15T17:57:00.925227] [DEBUG] [VALIDATOR ] CCJ: All expected trading days are present. [2025-10-15T17:57:00.925418] [DEBUG] [VALIDATOR ] CCJ: Primary data validation passed. [2025-10-15T17:57:00.926186] [INFO ] [MAIN ] CCJ: Fetched primary data is valid. [2025-10-15T17:57:00.926277] [DEBUG] [LOCAL ] CCJ: Saving primary data. [2025-10-15T17:57:00.928080] [DEBUG] [LOCAL ] CCJ: Trimmed 77837 records to 53688 (keeping 200 days of data) [2025-10-15T17:57:01.488946] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-15T17:57:01.562043] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-10. [2025-10-15T17:57:01.561361] [DEBUG] [LOCAL ] CCK: Primary data saved (46451 records). [2025-10-15T17:57:01.563815] [INFO ] [MAIN ] CCK: Full history saved. [2025-10-15T17:57:01.564837] [INFO ] [MAIN ] Update Progress: 413/2369 symbols completed. CCK took 38.1s. Estimated remaining: 4h 29m 43s. Rate: 7.3 symbols/min [2025-10-15T17:57:01.811457] [INFO ] [MAIN ] CCRD: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:57:01.807911] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-07 (5.69 seconds). [2025-10-15T17:57:01.827220] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-08. [2025-10-15T17:57:01.832121] [DEBUG] [LOCAL ] CCJ: Primary data saved (53688 records). [2025-10-15T17:57:01.834711] [INFO ] [MAIN ] CCJ: Full history saved. [2025-10-15T17:57:01.834914] [INFO ] [MAIN ] Update Progress: 414/2369 symbols completed. CCJ took 43.4s. Estimated remaining: 4h 28m 57s. Rate: 7.3 symbols/min [2025-10-15T17:57:01.940208] [DEBUG] [LOCAL ] CCRD: Loaded 9483 existing records from primary storage. [2025-10-15T17:57:01.946092] [INFO ] [MAIN ] CCRD: Loaded 9483 existing records. [2025-10-15T17:57:02.116116] [INFO ] [MAIN ] CCS: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:57:02.202862] [WARN ] [MAIN ] CCRD: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:57:02.203202] [INFO ] [MAIN ] CCRD: Wiping existing primary data before full refresh. [2025-10-15T17:57:02.203294] [INFO ] [LOCAL ] CCRD: Starting deletion of primary data. [2025-10-15T17:57:02.203583] [DEBUG] [LOCAL ] CCRD: Deleted primary data file. [2025-10-15T17:57:02.203676] [INFO ] [MAIN ] CCRD: Starting full primary refresh. [2025-10-15T17:57:02.382111] [DEBUG] [LOCAL ] CCS: Loaded 30327 existing records from primary storage. [2025-10-15T17:57:02.450597] [INFO ] [MAIN ] CCS: Loaded 30327 existing records. [2025-10-15T17:57:02.799993] [WARN ] [MAIN ] CCS: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:57:02.806912] [INFO ] [MAIN ] CCS: Wiping existing primary data before full refresh. [2025-10-15T17:57:02.806732] [INFO ] [REMOTE ] CCRD: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:57:02.807110] [INFO ] [LOCAL ] CCS: Starting deletion of primary data. [2025-10-15T17:57:02.807481] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2024-12. [2025-10-15T17:57:02.807568] [DEBUG] [LOCAL ] CCS: Deleted primary data file. [2025-10-15T17:57:02.808907] [INFO ] [MAIN ] CCS: Starting full primary refresh. [2025-10-15T17:57:03.186545] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-15T17:57:03.225550] [INFO ] [REMOTE ] CCS: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:57:03.226815] [INFO ] [REMOTE ] CCS: Fetching primary data for 2024-12. [2025-10-15T17:57:03.228056] [INFO ] [REMOTE ] CCO: Full fetch complete (67086 records). [2025-10-15T17:57:03.228283] [DEBUG] [VALIDATOR ] CCO: Validating primary data. [2025-10-15T17:57:03.663568] [DEBUG] [VALIDATOR ] CCO: All expected trading days are present. [2025-10-15T17:57:03.663723] [DEBUG] [VALIDATOR ] CCO: Primary data validation passed. [2025-10-15T17:57:03.665031] [INFO ] [MAIN ] CCO: Fetched primary data is valid. [2025-10-15T17:57:03.665103] [DEBUG] [LOCAL ] CCO: Saving primary data. [2025-10-15T17:57:03.667054] [DEBUG] [LOCAL ] CCO: Trimmed 67086 records to 48392 (keeping 200 days of data) [2025-10-15T17:57:03.950849] [DEBUG] [LOCAL ] CCO: Primary data saved (48392 records). [2025-10-15T17:57:03.951050] [INFO ] [MAIN ] CCO: Full history saved. [2025-10-15T17:57:03.951327] [INFO ] [MAIN ] Update Progress: 415/2369 symbols completed. CCO took 27.3s. Estimated remaining: 4h 28m 20s. Rate: 7.3 symbols/min [2025-10-15T17:57:04.130426] [INFO ] [MAIN ] CCU: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:57:04.168225] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-08 (2.34 seconds). [2025-10-15T17:57:04.180402] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-09. [2025-10-15T17:57:04.202461] [DEBUG] [LOCAL ] CCU: Loaded 22426 existing records from primary storage. [2025-10-15T17:57:04.202889] [INFO ] [MAIN ] CCU: Loaded 22426 existing records. [2025-10-15T17:57:04.307738] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-15T17:57:04.337986] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-01. [2025-10-15T17:57:04.430383] [WARN ] [MAIN ] CCU: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:57:04.431205] [INFO ] [MAIN ] CCU: Wiping existing primary data before full refresh. [2025-10-15T17:57:04.431422] [INFO ] [LOCAL ] CCU: Starting deletion of primary data. [2025-10-15T17:57:04.437495] [DEBUG] [LOCAL ] CCU: Deleted primary data file. [2025-10-15T17:57:04.446859] [INFO ] [MAIN ] CCU: Starting full primary refresh. [2025-10-15T17:57:04.453531] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-10-15T17:57:04.847131] [INFO ] [REMOTE ] CCU: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:57:04.849167] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-10-15T17:57:04.913972] [INFO ] [REMOTE ] CCU: Fetching primary data for 2024-12. [2025-10-15T17:57:05.714025] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-01. [2025-10-15T17:57:06.450884] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-15T17:57:06.514009] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-02. [2025-10-15T17:57:06.577095] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-09 (2.40 seconds). [2025-10-15T17:57:07.014889] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-10-15T17:57:07.266685] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-15T17:57:07.314017] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-02. [2025-10-15T17:57:08.114071] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-03. [2025-10-15T17:57:08.751804] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-15T17:57:08.877182] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-15T17:57:08.914038] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-04. [2025-10-15T17:57:09.372355] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-10-15T17:57:09.714072] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-01. [2025-10-15T17:57:10.514002] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-10. [2025-10-15T17:57:10.752363] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-15T17:57:11.314091] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-05. [2025-10-15T17:57:11.876756] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-15T17:57:12.114045] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-06. [2025-10-15T17:57:12.914498] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-03. [2025-10-15T17:57:12.914411] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-10 (2.40 seconds). [2025-10-15T17:57:12.923138] [INFO ] [REMOTE ] CCL: Full fetch complete (77980 records). [2025-10-15T17:57:12.923327] [DEBUG] [VALIDATOR ] CCL: Validating primary data. [2025-10-15T17:57:13.097387] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-15T17:57:13.364264] [DEBUG] [VALIDATOR ] CCL: All expected trading days are present. [2025-10-15T17:57:13.364383] [DEBUG] [VALIDATOR ] CCL: Primary data validation passed. [2025-10-15T17:57:13.365543] [INFO ] [MAIN ] CCL: Fetched primary data is valid. [2025-10-15T17:57:13.365614] [DEBUG] [LOCAL ] CCL: Saving primary data. [2025-10-15T17:57:13.367913] [DEBUG] [LOCAL ] CCL: Trimmed 77980 records to 53800 (keeping 200 days of data) [2025-10-15T17:57:13.693976] [DEBUG] [LOCAL ] CCL: Primary data saved (53800 records). [2025-10-15T17:57:13.694125] [INFO ] [MAIN ] CCL: Full history saved. [2025-10-15T17:57:13.694206] [INFO ] [MAIN ] Update Progress: 416/2369 symbols completed. CCL took 48.7s. Estimated remaining: 4h 28m 19s. Rate: 7.3 symbols/min [2025-10-15T17:57:13.723168] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-07. [2025-10-15T17:57:13.877103] [INFO ] [MAIN ] CCZ: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:57:13.877273] [DEBUG] [LOCAL ] CCZ: No existing data file found in primary storage. [2025-10-15T17:57:13.877309] [WARN ] [MAIN ] CCZ: No existing data found, performing full refresh instead. [2025-10-15T17:57:13.877419] [INFO ] [MAIN ] CCZ: Wiping existing primary data before full refresh. [2025-10-15T17:57:13.877465] [INFO ] [LOCAL ] CCZ: Starting deletion of primary data. [2025-10-15T17:57:13.877506] [DEBUG] [LOCAL ] CCZ: No primary data file found to delete. [2025-10-15T17:57:13.877537] [INFO ] [MAIN ] CCZ: Starting full primary refresh. [2025-10-15T17:57:14.252241] [INFO ] [REMOTE ] CCZ: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:57:14.309429] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-15T17:57:14.514091] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-04. [2025-10-15T17:57:14.535049] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-15T17:57:15.314064] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-08. [2025-10-15T17:57:15.900569] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-15T17:57:16.093053] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-15T17:57:16.114022] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-05. [2025-10-15T17:57:16.914077] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-02. [2025-10-15T17:57:17.572367] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-15T17:57:17.714041] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-06. [2025-10-15T17:57:18.195885] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-15T17:57:18.514021] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-03. [2025-10-15T17:57:18.934766] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-15T17:57:19.314020] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-09. [2025-10-15T17:57:19.483445] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-15T17:57:19.923941] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-15T17:57:20.114000] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-04. [2025-10-15T17:57:20.914002] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2024-12. [2025-10-15T17:57:21.335939] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2024-12 (0.42 seconds). [2025-10-15T17:57:21.406414] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-15T17:57:21.714013] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-10. [2025-10-15T17:57:22.514010] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-05. [2025-10-15T17:57:22.643483] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-15T17:57:22.645040] [INFO ] [REMOTE ] CCRD: Full fetch complete (11904 records). [2025-10-15T17:57:22.645111] [DEBUG] [VALIDATOR ] CCRD: Validating primary data. [2025-10-15T17:57:22.995449] [DEBUG] [VALIDATOR ] CCRD: All expected trading days are present. [2025-10-15T17:57:22.995524] [DEBUG] [VALIDATOR ] CCRD: Primary data validation passed. [2025-10-15T17:57:22.995829] [INFO ] [MAIN ] CCRD: Fetched primary data is valid. [2025-10-15T17:57:22.995891] [DEBUG] [LOCAL ] CCRD: Saving primary data. [2025-10-15T17:57:22.996348] [DEBUG] [LOCAL ] CCRD: Trimmed 11904 records to 9504 (keeping 200 days of data) [2025-10-15T17:57:23.051850] [DEBUG] [LOCAL ] CCRD: Primary data saved (9504 records). [2025-10-15T17:57:23.051990] [INFO ] [MAIN ] CCRD: Full history saved. [2025-10-15T17:57:23.052073] [INFO ] [MAIN ] Update Progress: 417/2369 symbols completed. CCRD took 21.5s. Estimated remaining: 4h 28m 16s. Rate: 7.3 symbols/min [2025-10-15T17:57:23.227348] [INFO ] [MAIN ] CDE: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:57:23.286998] [DEBUG] [LOCAL ] CDE: Loaded 53643 existing records from primary storage. [2025-10-15T17:57:23.287486] [INFO ] [MAIN ] CDE: Loaded 53643 existing records. [2025-10-15T17:57:23.320374] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-01. [2025-10-15T17:57:23.486757] [WARN ] [MAIN ] CDE: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:57:23.487085] [INFO ] [MAIN ] CDE: Wiping existing primary data before full refresh. [2025-10-15T17:57:23.487177] [INFO ] [LOCAL ] CDE: Starting deletion of primary data. [2025-10-15T17:57:23.487720] [DEBUG] [LOCAL ] CDE: Deleted primary data file. [2025-10-15T17:57:23.487780] [INFO ] [MAIN ] CDE: Starting full primary refresh. [2025-10-15T17:57:23.629955] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-01 (0.31 seconds). [2025-10-15T17:57:23.687312] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-15T17:57:23.938203] [INFO ] [REMOTE ] CDE: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:57:24.113998] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-02. [2025-10-15T17:57:24.336635] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-02 (0.22 seconds). [2025-10-15T17:57:24.914005] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-03. [2025-10-15T17:57:25.152538] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-03 (0.24 seconds). [2025-10-15T17:57:25.714009] [INFO ] [REMOTE ] CDE: Fetching primary data for 2024-12. [2025-10-15T17:57:26.514026] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-07. [2025-10-15T17:57:27.313969] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-04. [2025-10-15T17:57:27.679740] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-04 (0.37 seconds). [2025-10-15T17:57:27.686308] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-10-15T17:57:27.828458] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-15T17:57:28.113998] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-08. [2025-10-15T17:57:28.914080] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-05. [2025-10-15T17:57:29.172385] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-05 (0.26 seconds). [2025-10-15T17:57:29.499610] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-15T17:57:29.714007] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-06. [2025-10-15T17:57:29.941853] [DEBUG] [REMOTE ] CCZ: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-15T17:57:29.942231] [WARN ] [REMOTE ] CCZ: No data returned for month 2025-06 [2025-10-15T17:57:29.942346] [FATAL] [REMOTE ] CCZ: API call failed - aborting fetch to avoid wasting further API calls [2025-10-15T17:57:29.942469] [FATAL] [MAIN ] CCZ: Failed to fetch primary data. [2025-10-15T17:57:29.942561] [WARN ] [MAIN ] CCZ: Deleting existing primary and derivative data due to fetch failure. [2025-10-15T17:57:29.942675] [INFO ] [LOCAL ] CCZ: Starting deletion of primary data. [2025-10-15T17:57:29.942777] [DEBUG] [LOCAL ] CCZ: No primary data file found to delete. [2025-10-15T17:57:29.942844] [INFO ] [LOCAL ] CCZ: Starting deletion of derivative data. [2025-10-15T17:57:29.942910] [DEBUG] [LOCAL ] CCZ: No derivative data file found to delete. [2025-10-15T17:57:29.942982] [INFO ] [MAIN ] Update Progress: 418/2369 symbols completed. CCZ took 16.2s. Estimated remaining: 4h 28m 1s. Rate: 7.3 symbols/min [2025-10-15T17:57:30.124565] [INFO ] [MAIN ] CDLR: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:57:30.137344] [DEBUG] [LOCAL ] CDLR: Loaded 10012 existing records from primary storage. [2025-10-15T17:57:30.137589] [INFO ] [MAIN ] CDLR: Loaded 10012 existing records. [2025-10-15T17:57:30.317141] [WARN ] [MAIN ] CDLR: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:57:30.317462] [INFO ] [MAIN ] CDLR: Wiping existing primary data before full refresh. [2025-10-15T17:57:30.317528] [INFO ] [LOCAL ] CDLR: Starting deletion of primary data. [2025-10-15T17:57:30.317799] [DEBUG] [LOCAL ] CDLR: Deleted primary data file. [2025-10-15T17:57:30.317857] [INFO ] [MAIN ] CDLR: Starting full primary refresh. [2025-10-15T17:57:30.522280] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-09. [2025-10-15T17:57:30.753277] [INFO ] [REMOTE ] CDLR: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:57:31.314003] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-01. [2025-10-15T17:57:31.878440] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-15T17:57:32.114041] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-10. [2025-10-15T17:57:32.913972] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2024-12. [2025-10-15T17:57:33.022220] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-15T17:57:33.316338] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-15T17:57:33.319935] [INFO ] [REMOTE ] CCS: Full fetch complete (44881 records). [2025-10-15T17:57:33.320014] [DEBUG] [VALIDATOR ] CCS: Validating primary data. [2025-10-15T17:57:33.671524] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-10-15T17:57:33.705522] [DEBUG] [VALIDATOR ] CCS: All expected trading days are present. [2025-10-15T17:57:33.705583] [DEBUG] [VALIDATOR ] CCS: Primary data validation passed. [2025-10-15T17:57:33.706215] [INFO ] [MAIN ] CCS: Fetched primary data is valid. [2025-10-15T17:57:33.706275] [DEBUG] [LOCAL ] CCS: Saving primary data. [2025-10-15T17:57:33.707163] [DEBUG] [LOCAL ] CCS: Trimmed 44881 records to 30343 (keeping 200 days of data) [2025-10-15T17:57:33.759194] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-01. [2025-10-15T17:57:33.890728] [DEBUG] [LOCAL ] CCS: Primary data saved (30343 records). [2025-10-15T17:57:33.890875] [INFO ] [MAIN ] CCS: Full history saved. [2025-10-15T17:57:33.890959] [INFO ] [MAIN ] Update Progress: 419/2369 symbols completed. CCS took 32.1s. Estimated remaining: 4h 27m 33s. Rate: 7.3 symbols/min [2025-10-15T17:57:34.058365] [INFO ] [MAIN ] CDP: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:57:34.095276] [DEBUG] [LOCAL ] CDP: Loaded 42524 existing records from primary storage. [2025-10-15T17:57:34.095566] [INFO ] [MAIN ] CDP: Loaded 42524 existing records. [2025-10-15T17:57:34.268506] [WARN ] [MAIN ] CDP: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:57:34.268721] [INFO ] [MAIN ] CDP: Wiping existing primary data before full refresh. [2025-10-15T17:57:34.268776] [INFO ] [LOCAL ] CDP: Starting deletion of primary data. [2025-10-15T17:57:34.269595] [DEBUG] [LOCAL ] CDP: Deleted primary data file. [2025-10-15T17:57:34.269685] [INFO ] [MAIN ] CDP: Starting full primary refresh. [2025-10-15T17:57:34.522528] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-06. [2025-10-15T17:57:34.528499] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-15T17:57:34.627590] [INFO ] [REMOTE ] CDP: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:57:35.314048] [INFO ] [REMOTE ] CDP: Fetching primary data for 2024-12. [2025-10-15T17:57:35.554154] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-15T17:57:36.114021] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-02. [2025-10-15T17:57:36.725424] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-15T17:57:36.914026] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-07. [2025-10-15T17:57:37.714045] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-02. [2025-10-15T17:57:38.039853] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-15T17:57:38.083935] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-10-15T17:57:38.234317] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-10-15T17:57:38.514036] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-03. [2025-10-15T17:57:39.314037] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-03. [2025-10-15T17:57:39.455199] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-15T17:57:40.114025] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-01. [2025-10-15T17:57:40.914033] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-08. [2025-10-15T17:57:41.263006] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-15T17:57:41.299301] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-15T17:57:41.713960] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-04. [2025-10-15T17:57:41.971497] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-15T17:57:42.514018] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-04. [2025-10-15T17:57:43.283945] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-15T17:57:43.313962] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-05. [2025-10-15T17:57:43.452941] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-15T17:57:43.836935] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-10-15T17:57:44.114019] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-02. [2025-10-15T17:57:44.914013] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-09. [2025-10-15T17:57:45.674595] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-15T17:57:45.713985] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-03. [2025-10-15T17:57:45.788799] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-15T17:57:46.514013] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-10. [2025-10-15T17:57:47.314061] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-06. [2025-10-15T17:57:47.360783] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-15T17:57:47.515898] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-15T17:57:47.518363] [INFO ] [REMOTE ] CCU: Full fetch complete (32410 records). [2025-10-15T17:57:47.518463] [DEBUG] [VALIDATOR ] CCU: Validating primary data. [2025-10-15T17:57:47.898285] [DEBUG] [VALIDATOR ] CCU: All expected trading days are present. [2025-10-15T17:57:47.898365] [DEBUG] [VALIDATOR ] CCU: Primary data validation passed. [2025-10-15T17:57:47.898999] [INFO ] [MAIN ] CCU: Fetched primary data is valid. [2025-10-15T17:57:47.899062] [DEBUG] [LOCAL ] CCU: Saving primary data. [2025-10-15T17:57:47.899795] [DEBUG] [LOCAL ] CCU: Trimmed 32410 records to 22294 (keeping 200 days of data) [2025-10-15T17:57:48.042061] [DEBUG] [LOCAL ] CCU: Primary data saved (22294 records). [2025-10-15T17:57:48.043325] [INFO ] [MAIN ] CCU: Full history saved. [2025-10-15T17:57:48.043493] [INFO ] [MAIN ] Update Progress: 420/2369 symbols completed. CCU took 44.1s. Estimated remaining: 4h 27m 52s. Rate: 7.3 symbols/min [2025-10-15T17:57:48.043208] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-15T17:57:48.119173] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-05. [2025-10-15T17:57:48.222609] [INFO ] [MAIN ] CDRE: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:57:48.245028] [DEBUG] [LOCAL ] CDRE: Loaded 24873 existing records from primary storage. [2025-10-15T17:57:48.245310] [INFO ] [MAIN ] CDRE: Loaded 24873 existing records. [2025-10-15T17:57:48.419809] [WARN ] [MAIN ] CDRE: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:57:48.420100] [INFO ] [MAIN ] CDRE: Wiping existing primary data before full refresh. [2025-10-15T17:57:48.420164] [INFO ] [LOCAL ] CDRE: Starting deletion of primary data. [2025-10-15T17:57:48.420718] [DEBUG] [LOCAL ] CDRE: Deleted primary data file. [2025-10-15T17:57:48.420778] [INFO ] [MAIN ] CDRE: Starting full primary refresh. [2025-10-15T17:57:48.791138] [INFO ] [REMOTE ] CDRE: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:57:48.914062] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-04. [2025-10-15T17:57:49.714023] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2024-12. [2025-10-15T17:57:50.451601] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-05 (2.33 seconds). [2025-10-15T17:57:50.513988] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-06. [2025-10-15T17:57:50.737381] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-15T17:57:51.048691] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-15T17:57:51.313999] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-01. [2025-10-15T17:57:52.114002] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-05. [2025-10-15T17:57:52.350231] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-15T17:57:52.448827] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-15T17:57:52.914033] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-02. [2025-10-15T17:57:53.345818] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-15T17:57:53.540923] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-15T17:57:53.713981] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-07. [2025-10-15T17:57:54.514011] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-07. [2025-10-15T17:57:54.573932] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-15T17:57:55.314007] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-08. [2025-10-15T17:57:55.971156] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-15T17:57:55.997546] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-15T17:57:56.114038] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-06. [2025-10-15T17:57:56.914016] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-03. [2025-10-15T17:57:57.330693] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-15T17:57:57.714016] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-09. [2025-10-15T17:57:58.045852] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-15T17:57:58.513972] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-04. [2025-10-15T17:57:58.581989] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-15T17:57:59.314024] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-08. [2025-10-15T17:57:59.618915] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-15T17:58:00.114056] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-05. [2025-10-15T17:58:00.914078] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-07. [2025-10-15T17:58:01.084430] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-15T17:58:01.412306] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-15T17:58:01.714063] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-09. [2025-10-15T17:58:02.408929] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-15T17:58:02.514052] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-06. [2025-10-15T17:58:03.314089] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-08. [2025-10-15T17:58:03.674848] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-10-15T17:58:03.932621] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-15T17:58:04.114050] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-10. [2025-10-15T17:58:04.692147] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-15T17:58:04.914013] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-10. [2025-10-15T17:58:05.714007] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-07. [2025-10-15T17:58:05.941233] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-15T17:58:05.943487] [INFO ] [REMOTE ] CDLR: Full fetch complete (13860 records). [2025-10-15T17:58:05.943667] [DEBUG] [VALIDATOR ] CDLR: Validating primary data. [2025-10-15T17:58:06.310634] [DEBUG] [VALIDATOR ] CDLR: All expected trading days are present. [2025-10-15T17:58:06.310946] [DEBUG] [VALIDATOR ] CDLR: Primary data validation passed. [2025-10-15T17:58:06.311600] [INFO ] [MAIN ] CDLR: Fetched primary data is valid. [2025-10-15T17:58:06.311775] [DEBUG] [LOCAL ] CDLR: Saving primary data. [2025-10-15T17:58:06.312636] [DEBUG] [LOCAL ] CDLR: Trimmed 13860 records to 10075 (keeping 200 days of data) [2025-10-15T17:58:06.374776] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-10 (2.26 seconds). [2025-10-15T17:58:06.392975] [INFO ] [REMOTE ] CDE: Full fetch complete (77771 records). [2025-10-15T17:58:06.397480] [DEBUG] [LOCAL ] CDLR: Primary data saved (10075 records). [2025-10-15T17:58:06.397965] [DEBUG] [VALIDATOR ] CDE: Validating primary data. [2025-10-15T17:58:06.397875] [INFO ] [MAIN ] CDLR: Full history saved. [2025-10-15T17:58:06.398264] [INFO ] [MAIN ] Update Progress: 421/2369 symbols completed. CDLR took 36.5s. Estimated remaining: 4h 28m 31s. Rate: 7.3 symbols/min [2025-10-15T17:58:06.524903] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-09. [2025-10-15T17:58:06.761772] [INFO ] [MAIN ] CE: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:58:06.802196] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-15T17:58:07.032205] [DEBUG] [VALIDATOR ] CDE: All expected trading days are present. [2025-10-15T17:58:07.047102] [DEBUG] [VALIDATOR ] CDE: Primary data validation passed. [2025-10-15T17:58:07.048250] [INFO ] [MAIN ] CDE: Fetched primary data is valid. [2025-10-15T17:58:07.048412] [DEBUG] [LOCAL ] CDE: Saving primary data. [2025-10-15T17:58:07.050011] [DEBUG] [LOCAL ] CDE: Trimmed 77771 records to 53643 (keeping 200 days of data) [2025-10-15T17:58:07.123917] [DEBUG] [LOCAL ] CE: Loaded 51362 existing records from primary storage. [2025-10-15T17:58:07.157833] [INFO ] [MAIN ] CE: Loaded 51362 existing records. [2025-10-15T17:58:07.320275] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-08. [2025-10-15T17:58:07.475830] [WARN ] [MAIN ] CE: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:58:07.477585] [INFO ] [MAIN ] CE: Wiping existing primary data before full refresh. [2025-10-15T17:58:07.480989] [INFO ] [LOCAL ] CE: Starting deletion of primary data. [2025-10-15T17:58:07.523183] [DEBUG] [LOCAL ] CE: Deleted primary data file. [2025-10-15T17:58:07.529686] [INFO ] [MAIN ] CE: Starting full primary refresh. [2025-10-15T17:58:07.759957] [DEBUG] [LOCAL ] CDE: Primary data saved (53643 records). [2025-10-15T17:58:07.831368] [INFO ] [MAIN ] CDE: Full history saved. [2025-10-15T17:58:07.850294] [INFO ] [MAIN ] Update Progress: 422/2369 symbols completed. CDE took 44.8s. Estimated remaining: 4h 27m 51s. Rate: 7.3 symbols/min [2025-10-15T17:58:08.079822] [INFO ] [REMOTE ] CE: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:58:08.138059] [INFO ] [MAIN ] CEE: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:58:08.118130] [INFO ] [REMOTE ] CE: Fetching primary data for 2024-12. [2025-10-15T17:58:08.146689] [DEBUG] [LOCAL ] CEE: Loaded 5395 existing records from primary storage. [2025-10-15T17:58:08.146930] [INFO ] [MAIN ] CEE: Loaded 5395 existing records. [2025-10-15T17:58:08.349408] [WARN ] [MAIN ] CEE: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:58:08.350633] [INFO ] [MAIN ] CEE: Wiping existing primary data before full refresh. [2025-10-15T17:58:08.366680] [INFO ] [LOCAL ] CEE: Starting deletion of primary data. [2025-10-15T17:58:08.379842] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-15T17:58:08.379905] [DEBUG] [LOCAL ] CEE: Deleted primary data file. [2025-10-15T17:58:08.389878] [INFO ] [MAIN ] CEE: Starting full primary refresh. [2025-10-15T17:58:08.642184] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-15T17:58:08.782078] [INFO ] [REMOTE ] CEE: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:58:08.914019] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-09. [2025-10-15T17:58:09.714027] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-10. [2025-10-15T17:58:09.924279] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-15T17:58:10.044744] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-15T17:58:10.514004] [INFO ] [REMOTE ] CEE: Fetching primary data for 2024-12. [2025-10-15T17:58:11.240287] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-15T17:58:11.241011] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-10-15T17:58:11.248202] [INFO ] [REMOTE ] CDP: Full fetch complete (61967 records). [2025-10-15T17:58:11.248323] [DEBUG] [VALIDATOR ] CDP: Validating primary data. [2025-10-15T17:58:11.319241] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-01. [2025-10-15T17:58:11.640912] [DEBUG] [VALIDATOR ] CDP: All expected trading days are present. [2025-10-15T17:58:11.640992] [DEBUG] [VALIDATOR ] CDP: Primary data validation passed. [2025-10-15T17:58:11.641864] [INFO ] [MAIN ] CDP: Fetched primary data is valid. [2025-10-15T17:58:11.641928] [DEBUG] [LOCAL ] CDP: Saving primary data. [2025-10-15T17:58:11.643246] [DEBUG] [LOCAL ] CDP: Trimmed 61967 records to 42531 (keeping 200 days of data) [2025-10-15T17:58:11.898445] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-15T17:58:11.914476] [DEBUG] [LOCAL ] CDP: Primary data saved (42531 records). [2025-10-15T17:58:11.914609] [INFO ] [MAIN ] CDP: Full history saved. [2025-10-15T17:58:11.914720] [INFO ] [MAIN ] Update Progress: 423/2369 symbols completed. CDP took 38.0s. Estimated remaining: 4h 27m 24s. Rate: 7.3 symbols/min [2025-10-15T17:58:12.081701] [INFO ] [MAIN ] CEPU: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:58:12.109622] [DEBUG] [LOCAL ] CEPU: Loaded 26472 existing records from primary storage. [2025-10-15T17:58:12.109915] [INFO ] [MAIN ] CEPU: Loaded 26472 existing records. [2025-10-15T17:58:12.120445] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-10. [2025-10-15T17:58:12.290307] [WARN ] [MAIN ] CEPU: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:58:12.290528] [INFO ] [MAIN ] CEPU: Wiping existing primary data before full refresh. [2025-10-15T17:58:12.290577] [INFO ] [LOCAL ] CEPU: Starting deletion of primary data. [2025-10-15T17:58:12.290904] [DEBUG] [LOCAL ] CEPU: Deleted primary data file. [2025-10-15T17:58:12.290957] [INFO ] [MAIN ] CEPU: Starting full primary refresh. [2025-10-15T17:58:12.646805] [INFO ] [REMOTE ] CEPU: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:58:12.914080] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2024-12. [2025-10-15T17:58:13.403107] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-15T17:58:13.407947] [INFO ] [REMOTE ] CDRE: Full fetch complete (35173 records). [2025-10-15T17:58:13.408069] [DEBUG] [VALIDATOR ] CDRE: Validating primary data. [2025-10-15T17:58:13.719122] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-02. [2025-10-15T17:58:13.797959] [DEBUG] [VALIDATOR ] CDRE: All expected trading days are present. [2025-10-15T17:58:13.798072] [DEBUG] [VALIDATOR ] CDRE: Primary data validation passed. [2025-10-15T17:58:13.798731] [INFO ] [MAIN ] CDRE: Fetched primary data is valid. [2025-10-15T17:58:13.798792] [DEBUG] [LOCAL ] CDRE: Saving primary data. [2025-10-15T17:58:13.799611] [DEBUG] [LOCAL ] CDRE: Trimmed 35173 records to 24933 (keeping 200 days of data) [2025-10-15T17:58:13.949573] [DEBUG] [LOCAL ] CDRE: Primary data saved (24933 records). [2025-10-15T17:58:13.949740] [INFO ] [MAIN ] CDRE: Full history saved. [2025-10-15T17:58:13.949872] [INFO ] [MAIN ] Update Progress: 424/2369 symbols completed. CDRE took 25.9s. Estimated remaining: 4h 26m 47s. Rate: 7.3 symbols/min [2025-10-15T17:58:14.136434] [INFO ] [MAIN ] CF: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:58:14.186385] [DEBUG] [LOCAL ] CF: Loaded 52133 existing records from primary storage. [2025-10-15T17:58:14.186749] [INFO ] [MAIN ] CF: Loaded 52133 existing records. [2025-10-15T17:58:14.373787] [WARN ] [MAIN ] CF: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:58:14.374065] [INFO ] [MAIN ] CF: Wiping existing primary data before full refresh. [2025-10-15T17:58:14.374199] [INFO ] [LOCAL ] CF: Starting deletion of primary data. [2025-10-15T17:58:14.381909] [DEBUG] [LOCAL ] CF: Deleted primary data file. [2025-10-15T17:58:14.393184] [INFO ] [MAIN ] CF: Starting full primary refresh. [2025-10-15T17:58:14.471480] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-15T17:58:14.519090] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-01. [2025-10-15T17:58:14.605592] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-15T17:58:14.782581] [INFO ] [REMOTE ] CF: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:58:15.313970] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-03. [2025-10-15T17:58:16.057149] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-15T17:58:16.113959] [INFO ] [REMOTE ] CF: Fetching primary data for 2024-12. [2025-10-15T17:58:16.230341] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-15T17:58:16.914040] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-01. [2025-10-15T17:58:17.673115] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-15T17:58:17.714022] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-02. [2025-10-15T17:58:18.231380] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-15T17:58:18.514004] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-01. [2025-10-15T17:58:19.211561] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-15T17:58:19.314006] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-03. [2025-10-15T17:58:20.114035] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-02. [2025-10-15T17:58:20.184792] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-15T17:58:20.913973] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-04. [2025-10-15T17:58:21.161588] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-15T17:58:21.627734] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-03 (2.31 seconds). [2025-10-15T17:58:21.694040] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-15T17:58:21.713942] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-05. [2025-10-15T17:58:22.323734] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-15T17:58:22.513998] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-03. [2025-10-15T17:58:23.314028] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-04. [2025-10-15T17:58:23.378016] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-15T17:58:24.113997] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-04. [2025-10-15T17:58:24.913963] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-06. [2025-10-15T17:58:25.289967] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-15T17:58:25.317121] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-15T17:58:25.531693] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-15T17:58:25.714015] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-05. [2025-10-15T17:58:26.513998] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-05. [2025-10-15T17:58:27.242307] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-15T17:58:27.313966] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-07. [2025-10-15T17:58:27.781415] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-15T17:58:27.906000] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-10-15T17:58:28.114098] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-08. [2025-10-15T17:58:28.515809] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-10-15T17:58:28.913993] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-06. [2025-10-15T17:58:29.714115] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-09. [2025-10-15T17:58:30.280047] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-15T17:58:30.512157] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-15T17:58:30.521545] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-02. [2025-10-15T17:58:31.314008] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-06. [2025-10-15T17:58:32.113979] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-10. [2025-10-15T17:58:32.216562] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-15T17:58:32.310463] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-15T17:58:32.794971] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-15T17:58:32.795957] [INFO ] [REMOTE ] CEE: Full fetch complete (10135 records). [2025-10-15T17:58:32.796027] [DEBUG] [VALIDATOR ] CEE: Validating primary data. [2025-10-15T17:58:32.919094] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-07. [2025-10-15T17:58:33.169573] [DEBUG] [VALIDATOR ] CEE: All expected trading days are present. [2025-10-15T17:58:33.169679] [DEBUG] [VALIDATOR ] CEE: Primary data validation passed. [2025-10-15T17:58:33.169929] [INFO ] [MAIN ] CEE: Fetched primary data is valid. [2025-10-15T17:58:33.169968] [DEBUG] [LOCAL ] CEE: Saving primary data. [2025-10-15T17:58:33.170402] [DEBUG] [LOCAL ] CEE: Trimmed 10135 records to 5365 (keeping 200 days of data) [2025-10-15T17:58:33.202212] [DEBUG] [LOCAL ] CEE: Primary data saved (5365 records). [2025-10-15T17:58:33.202375] [INFO ] [MAIN ] CEE: Full history saved. [2025-10-15T17:58:33.202500] [INFO ] [MAIN ] Update Progress: 425/2369 symbols completed. CEE took 25.4s. Estimated remaining: 4h 27m 29s. Rate: 7.3 symbols/min [2025-10-15T17:58:33.371577] [INFO ] [MAIN ] CFG: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:58:33.425241] [DEBUG] [LOCAL ] CFG: Loaded 53622 existing records from primary storage. [2025-10-15T17:58:33.425548] [INFO ] [MAIN ] CFG: Loaded 53622 existing records. [2025-10-15T17:58:33.603709] [WARN ] [MAIN ] CFG: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:58:33.603909] [INFO ] [MAIN ] CFG: Wiping existing primary data before full refresh. [2025-10-15T17:58:33.603957] [INFO ] [LOCAL ] CFG: Starting deletion of primary data. [2025-10-15T17:58:33.604306] [DEBUG] [LOCAL ] CFG: Deleted primary data file. [2025-10-15T17:58:33.604367] [INFO ] [MAIN ] CFG: Starting full primary refresh. [2025-10-15T17:58:33.719099] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-03. [2025-10-15T17:58:33.964053] [INFO ] [REMOTE ] CFG: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:58:34.513963] [INFO ] [REMOTE ] CFG: Fetching primary data for 2024-12. [2025-10-15T17:58:34.926177] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-10-15T17:58:35.313980] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-07. [2025-10-15T17:58:35.390524] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-15T17:58:36.114016] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-08. [2025-10-15T17:58:36.226491] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-15T17:58:36.296359] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-15T17:58:36.914007] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-08. [2025-10-15T17:58:37.714030] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-04. [2025-10-15T17:58:37.753339] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-15T17:58:37.935462] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-15T17:58:38.513983] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-09. [2025-10-15T17:58:39.313976] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-09. [2025-10-15T17:58:39.501741] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-15T17:58:39.847558] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-15T17:58:40.114006] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-05. [2025-10-15T17:58:40.841057] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-15T17:58:40.914057] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-10. [2025-10-15T17:58:41.713966] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-01. [2025-10-15T17:58:41.880593] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-15T17:58:42.471166] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-15T17:58:42.477329] [INFO ] [REMOTE ] CE: Full fetch complete (74873 records). [2025-10-15T17:58:42.477458] [DEBUG] [VALIDATOR ] CE: Validating primary data. [2025-10-15T17:58:42.519089] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-10. [2025-10-15T17:58:42.872574] [DEBUG] [VALIDATOR ] CE: All expected trading days are present. [2025-10-15T17:58:42.872709] [DEBUG] [VALIDATOR ] CE: Primary data validation passed. [2025-10-15T17:58:42.873753] [INFO ] [MAIN ] CE: Fetched primary data is valid. [2025-10-15T17:58:42.873819] [DEBUG] [LOCAL ] CE: Saving primary data. [2025-10-15T17:58:42.875531] [DEBUG] [LOCAL ] CE: Trimmed 74873 records to 51344 (keeping 200 days of data) [2025-10-15T17:58:43.192129] [DEBUG] [LOCAL ] CE: Primary data saved (51344 records). [2025-10-15T17:58:43.192377] [INFO ] [MAIN ] CE: Full history saved. [2025-10-15T17:58:43.192530] [INFO ] [MAIN ] Update Progress: 426/2369 symbols completed. CE took 36.8s. Estimated remaining: 4h 27m 29s. Rate: 7.3 symbols/min [2025-10-15T17:58:43.320591] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-06. [2025-10-15T17:58:43.371992] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-15T17:58:43.407278] [INFO ] [MAIN ] CFND: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:58:43.408261] [DEBUG] [LOCAL ] CFND: No existing data file found in primary storage. [2025-10-15T17:58:43.408317] [WARN ] [MAIN ] CFND: No existing data found, performing full refresh instead. [2025-10-15T17:58:43.408428] [INFO ] [MAIN ] CFND: Wiping existing primary data before full refresh. [2025-10-15T17:58:43.408470] [INFO ] [LOCAL ] CFND: Starting deletion of primary data. [2025-10-15T17:58:43.408514] [DEBUG] [LOCAL ] CFND: No primary data file found to delete. [2025-10-15T17:58:43.408546] [INFO ] [MAIN ] CFND: Starting full primary refresh. [2025-10-15T17:58:43.800605] [INFO ] [REMOTE ] CFND: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:58:43.901063] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-15T17:58:43.905314] [INFO ] [REMOTE ] CEPU: Full fetch complete (39893 records). [2025-10-15T17:58:43.905405] [DEBUG] [VALIDATOR ] CEPU: Validating primary data. [2025-10-15T17:58:44.121288] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-02. [2025-10-15T17:58:44.284409] [DEBUG] [VALIDATOR ] CEPU: All expected trading days are present. [2025-10-15T17:58:44.284494] [DEBUG] [VALIDATOR ] CEPU: Primary data validation passed. [2025-10-15T17:58:44.285122] [INFO ] [MAIN ] CEPU: Fetched primary data is valid. [2025-10-15T17:58:44.285187] [DEBUG] [LOCAL ] CEPU: Saving primary data. [2025-10-15T17:58:44.286556] [DEBUG] [LOCAL ] CEPU: Trimmed 39893 records to 26707 (keeping 200 days of data) [2025-10-15T17:58:44.438140] [DEBUG] [LOCAL ] CEPU: Primary data saved (26707 records). [2025-10-15T17:58:44.438274] [INFO ] [MAIN ] CEPU: Full history saved. [2025-10-15T17:58:44.438352] [INFO ] [MAIN ] Update Progress: 427/2369 symbols completed. CEPU took 32.5s. Estimated remaining: 4h 26m 49s. Rate: 7.3 symbols/min [2025-10-15T17:58:44.606138] [INFO ] [MAIN ] CFR: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:58:44.637979] [DEBUG] [LOCAL ] CFR: Loaded 32654 existing records from primary storage. [2025-10-15T17:58:44.638258] [INFO ] [MAIN ] CFR: Loaded 32654 existing records. [2025-10-15T17:58:44.821180] [WARN ] [MAIN ] CFR: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:58:44.821410] [INFO ] [MAIN ] CFR: Wiping existing primary data before full refresh. [2025-10-15T17:58:44.821459] [INFO ] [LOCAL ] CFR: Starting deletion of primary data. [2025-10-15T17:58:44.822141] [DEBUG] [LOCAL ] CFR: Deleted primary data file. [2025-10-15T17:58:44.822199] [INFO ] [MAIN ] CFR: Starting full primary refresh. [2025-10-15T17:58:44.923153] [INFO ] [REMOTE ] CFND: Fetching primary data for 2024-12. [2025-10-15T17:58:45.182025] [DEBUG] [REMOTE ] CFND: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-15T17:58:45.187857] [INFO ] [REMOTE ] CFR: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:58:45.189025] [WARN ] [REMOTE ] CFND: No data returned for month 2024-12 [2025-10-15T17:58:45.189365] [FATAL] [REMOTE ] CFND: API call failed - aborting fetch to avoid wasting further API calls [2025-10-15T17:58:45.189520] [FATAL] [MAIN ] CFND: Failed to fetch primary data. [2025-10-15T17:58:45.189674] [WARN ] [MAIN ] CFND: Deleting existing primary and derivative data due to fetch failure. [2025-10-15T17:58:45.189902] [INFO ] [LOCAL ] CFND: Starting deletion of primary data. [2025-10-15T17:58:45.190017] [DEBUG] [LOCAL ] CFND: No primary data file found to delete. [2025-10-15T17:58:45.190160] [INFO ] [LOCAL ] CFND: Starting deletion of derivative data. [2025-10-15T17:58:45.190408] [DEBUG] [LOCAL ] CFND: No derivative data file found to delete. [2025-10-15T17:58:45.190551] [INFO ] [MAIN ] Update Progress: 428/2369 symbols completed. CFND took 2.0s. Estimated remaining: 4h 26m 6s. Rate: 7.3 symbols/min [2025-10-15T17:58:45.421446] [INFO ] [MAIN ] CGAU: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:58:45.425758] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-06 (2.11 seconds). [2025-10-15T17:58:45.486198] [DEBUG] [LOCAL ] CGAU: Loaded 43482 existing records from primary storage. [2025-10-15T17:58:45.486692] [INFO ] [MAIN ] CGAU: Loaded 43482 existing records. [2025-10-15T17:58:45.692477] [WARN ] [MAIN ] CGAU: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:58:45.693021] [INFO ] [MAIN ] CGAU: Wiping existing primary data before full refresh. [2025-10-15T17:58:45.693160] [INFO ] [LOCAL ] CGAU: Starting deletion of primary data. [2025-10-15T17:58:45.693631] [DEBUG] [LOCAL ] CGAU: Deleted primary data file. [2025-10-15T17:58:45.693810] [INFO ] [MAIN ] CGAU: Starting full primary refresh. [2025-10-15T17:58:45.724496] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-07. [2025-10-15T17:58:46.052072] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-10-15T17:58:46.175392] [INFO ] [REMOTE ] CGAU: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:58:46.514035] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-03. [2025-10-15T17:58:47.314030] [INFO ] [REMOTE ] CFR: Fetching primary data for 2024-12. [2025-10-15T17:58:47.557051] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-15T17:58:48.114003] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2024-12. [2025-10-15T17:58:48.593424] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-10-15T17:58:48.682635] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-15T17:58:48.914075] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-04. [2025-10-15T17:58:49.395230] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-15T17:58:49.714036] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-01. [2025-10-15T17:58:50.514048] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-08. [2025-10-15T17:58:50.754059] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-15T17:58:50.975423] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-15T17:58:51.314019] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-05. [2025-10-15T17:58:52.113981] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-01. [2025-10-15T17:58:52.157944] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-15T17:58:52.913968] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-02. [2025-10-15T17:58:53.036940] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-15T17:58:53.380890] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-15T17:58:53.714070] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-09. [2025-10-15T17:58:54.041575] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-15T17:58:54.514120] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-06. [2025-10-15T17:58:55.314028] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-02. [2025-10-15T17:58:55.541855] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-15T17:58:56.114079] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-10. [2025-10-15T17:58:56.218501] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-15T17:58:56.607777] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-15T17:58:56.914092] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-03. [2025-10-15T17:58:57.714067] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-03. [2025-10-15T17:58:58.340412] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-15T17:58:58.405774] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-10 (2.29 seconds). [2025-10-15T17:58:58.412483] [INFO ] [REMOTE ] CF: Full fetch complete (75522 records). [2025-10-15T17:58:58.412701] [DEBUG] [VALIDATOR ] CF: Validating primary data. [2025-10-15T17:58:58.518752] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-04. [2025-10-15T17:58:58.814629] [DEBUG] [VALIDATOR ] CF: All expected trading days are present. [2025-10-15T17:58:58.814843] [DEBUG] [VALIDATOR ] CF: Primary data validation passed. [2025-10-15T17:58:58.815956] [INFO ] [MAIN ] CF: Fetched primary data is valid. [2025-10-15T17:58:58.816041] [DEBUG] [LOCAL ] CF: Saving primary data. [2025-10-15T17:58:58.817821] [DEBUG] [LOCAL ] CF: Trimmed 75522 records to 52155 (keeping 200 days of data) [2025-10-15T17:58:58.932161] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-15T17:58:59.158774] [DEBUG] [LOCAL ] CF: Primary data saved (52155 records). [2025-10-15T17:58:59.158913] [INFO ] [MAIN ] CF: Full history saved. [2025-10-15T17:58:59.159282] [INFO ] [MAIN ] Update Progress: 429/2369 symbols completed. CF took 45.2s. Estimated remaining: 4h 26m 24s. Rate: 7.3 symbols/min [2025-10-15T17:58:59.325073] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-07. [2025-10-15T17:58:59.327942] [INFO ] [MAIN ] CGV: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:58:59.333631] [DEBUG] [LOCAL ] CGV: Loaded 1397 existing records from primary storage. [2025-10-15T17:58:59.334051] [INFO ] [MAIN ] CGV: Loaded 1397 existing records. [2025-10-15T17:58:59.512347] [WARN ] [MAIN ] CGV: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:58:59.512602] [INFO ] [MAIN ] CGV: Wiping existing primary data before full refresh. [2025-10-15T17:58:59.512683] [INFO ] [LOCAL ] CGV: Starting deletion of primary data. [2025-10-15T17:58:59.512861] [DEBUG] [LOCAL ] CGV: Deleted primary data file. [2025-10-15T17:58:59.512919] [INFO ] [MAIN ] CGV: Starting full primary refresh. [2025-10-15T17:58:59.872046] [INFO ] [REMOTE ] CGV: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:59:00.093227] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-15T17:59:00.114003] [INFO ] [REMOTE ] CGV: Fetching primary data for 2024-12. [2025-10-15T17:59:00.615507] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2024-12 (0.50 seconds). [2025-10-15T17:59:00.891048] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-15T17:59:00.913971] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-08. [2025-10-15T17:59:01.714033] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-05. [2025-10-15T17:59:02.514095] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-04. [2025-10-15T17:59:02.660757] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-15T17:59:03.099682] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-15T17:59:03.314029] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-06. [2025-10-15T17:59:03.981284] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-15T17:59:04.114006] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-09. [2025-10-15T17:59:04.643148] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-15T17:59:04.914056] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-07. [2025-10-15T17:59:05.719439] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-05. [2025-10-15T17:59:05.724291] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-15T17:59:06.485376] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-15T17:59:06.513972] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-08. [2025-10-15T17:59:07.066303] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-15T17:59:07.314027] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-10. [2025-10-15T17:59:07.672201] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-15T17:59:08.114027] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-06. [2025-10-15T17:59:08.914118] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-09. [2025-10-15T17:59:09.184571] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-10 (1.87 seconds). [2025-10-15T17:59:09.191080] [INFO ] [REMOTE ] CFG: Full fetch complete (77754 records). [2025-10-15T17:59:09.191205] [DEBUG] [VALIDATOR ] CFG: Validating primary data. [2025-10-15T17:59:09.316974] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-15T17:59:09.657680] [DEBUG] [VALIDATOR ] CFG: All expected trading days are present. [2025-10-15T17:59:09.657821] [DEBUG] [VALIDATOR ] CFG: Primary data validation passed. [2025-10-15T17:59:09.659019] [INFO ] [MAIN ] CFG: Fetched primary data is valid. [2025-10-15T17:59:09.659087] [DEBUG] [LOCAL ] CFG: Saving primary data. [2025-10-15T17:59:09.661212] [DEBUG] [LOCAL ] CFG: Trimmed 77754 records to 53623 (keeping 200 days of data) [2025-10-15T17:59:09.717442] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-07. [2025-10-15T17:59:10.009185] [DEBUG] [LOCAL ] CFG: Primary data saved (53623 records). [2025-10-15T17:59:10.009385] [INFO ] [MAIN ] CFG: Full history saved. [2025-10-15T17:59:10.010361] [INFO ] [MAIN ] Update Progress: 430/2369 symbols completed. CFG took 36.8s. Estimated remaining: 4h 26m 28s. Rate: 7.3 symbols/min [2025-10-15T17:59:10.189972] [INFO ] [MAIN ] CHCT: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:59:10.220035] [DEBUG] [LOCAL ] CHCT: Loaded 24137 existing records from primary storage. [2025-10-15T17:59:10.220376] [INFO ] [MAIN ] CHCT: Loaded 24137 existing records. [2025-10-15T17:59:10.420995] [WARN ] [MAIN ] CHCT: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:59:10.421400] [INFO ] [MAIN ] CHCT: Wiping existing primary data before full refresh. [2025-10-15T17:59:10.421490] [INFO ] [LOCAL ] CHCT: Starting deletion of primary data. [2025-10-15T17:59:10.421979] [DEBUG] [LOCAL ] CHCT: Deleted primary data file. [2025-10-15T17:59:10.422050] [INFO ] [MAIN ] CHCT: Starting full primary refresh. [2025-10-15T17:59:10.519285] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-01. [2025-10-15T17:59:10.646525] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-15T17:59:10.858514] [INFO ] [REMOTE ] CHCT: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:59:10.996073] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-15T17:59:11.140071] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-15T17:59:11.314035] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-08. [2025-10-15T17:59:12.114059] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-10. [2025-10-15T17:59:12.644439] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-15T17:59:12.914049] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-02. [2025-10-15T17:59:13.208561] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-02 (0.29 seconds). [2025-10-15T17:59:13.630561] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-15T17:59:13.636622] [INFO ] [REMOTE ] CGAU: Full fetch complete (61586 records). [2025-10-15T17:59:13.636754] [DEBUG] [VALIDATOR ] CGAU: Validating primary data. [2025-10-15T17:59:13.719109] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-09. [2025-10-15T17:59:14.027056] [DEBUG] [VALIDATOR ] CGAU: All expected trading days are present. [2025-10-15T17:59:14.027135] [DEBUG] [VALIDATOR ] CGAU: Primary data validation passed. [2025-10-15T17:59:14.027926] [INFO ] [MAIN ] CGAU: Fetched primary data is valid. [2025-10-15T17:59:14.027988] [DEBUG] [LOCAL ] CGAU: Saving primary data. [2025-10-15T17:59:14.029112] [DEBUG] [LOCAL ] CGAU: Trimmed 61586 records to 43550 (keeping 200 days of data) [2025-10-15T17:59:14.304978] [DEBUG] [LOCAL ] CGAU: Primary data saved (43550 records). [2025-10-15T17:59:14.305198] [INFO ] [MAIN ] CGAU: Full history saved. [2025-10-15T17:59:14.305343] [INFO ] [MAIN ] Update Progress: 431/2369 symbols completed. CGAU took 29.1s. Estimated remaining: 4h 26m 2s. Rate: 7.3 symbols/min [2025-10-15T17:59:14.515578] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-03. [2025-10-15T17:59:14.515433] [INFO ] [MAIN ] CHD: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:59:14.576205] [DEBUG] [LOCAL ] CHD: Loaded 52310 existing records from primary storage. [2025-10-15T17:59:14.576635] [INFO ] [MAIN ] CHD: Loaded 52310 existing records. [2025-10-15T17:59:14.769996] [WARN ] [MAIN ] CHD: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:59:14.770295] [INFO ] [MAIN ] CHD: Wiping existing primary data before full refresh. [2025-10-15T17:59:14.770350] [INFO ] [LOCAL ] CHD: Starting deletion of primary data. [2025-10-15T17:59:14.770847] [DEBUG] [LOCAL ] CHD: Deleted primary data file. [2025-10-15T17:59:14.770907] [INFO ] [MAIN ] CHD: Starting full primary refresh. [2025-10-15T17:59:14.870873] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-10-15T17:59:15.182489] [INFO ] [REMOTE ] CHD: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:59:15.205693] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-15T17:59:15.314075] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-10. [2025-10-15T17:59:16.114021] [INFO ] [REMOTE ] CHD: Fetching primary data for 2024-12. [2025-10-15T17:59:16.309031] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-15T17:59:16.312965] [INFO ] [REMOTE ] CFR: Full fetch complete (48238 records). [2025-10-15T17:59:16.313058] [DEBUG] [VALIDATOR ] CFR: Validating primary data. [2025-10-15T17:59:16.692061] [DEBUG] [VALIDATOR ] CFR: All expected trading days are present. [2025-10-15T17:59:16.692140] [DEBUG] [VALIDATOR ] CFR: Primary data validation passed. [2025-10-15T17:59:16.692852] [INFO ] [MAIN ] CFR: Fetched primary data is valid. [2025-10-15T17:59:16.692914] [DEBUG] [LOCAL ] CFR: Saving primary data. [2025-10-15T17:59:16.693879] [DEBUG] [LOCAL ] CFR: Trimmed 48238 records to 32574 (keeping 200 days of data) [2025-10-15T17:59:16.901889] [DEBUG] [LOCAL ] CFR: Primary data saved (32574 records). [2025-10-15T17:59:16.902107] [INFO ] [MAIN ] CFR: Full history saved. [2025-10-15T17:59:16.902194] [INFO ] [MAIN ] Update Progress: 432/2369 symbols completed. CFR took 32.5s. Estimated remaining: 4h 25m 28s. Rate: 7.3 symbols/min [2025-10-15T17:59:16.923403] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2024-12. [2025-10-15T17:59:17.089704] [INFO ] [MAIN ] CHE: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:59:17.106008] [DEBUG] [LOCAL ] CHE: Loaded 15380 existing records from primary storage. [2025-10-15T17:59:17.106223] [INFO ] [MAIN ] CHE: Loaded 15380 existing records. [2025-10-15T17:59:17.302421] [WARN ] [MAIN ] CHE: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:59:17.302699] [INFO ] [MAIN ] CHE: Wiping existing primary data before full refresh. [2025-10-15T17:59:17.302762] [INFO ] [LOCAL ] CHE: Starting deletion of primary data. [2025-10-15T17:59:17.303007] [DEBUG] [LOCAL ] CHE: Deleted primary data file. [2025-10-15T17:59:17.303064] [INFO ] [MAIN ] CHE: Starting full primary refresh. [2025-10-15T17:59:17.678027] [INFO ] [REMOTE ] CHE: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:59:17.714023] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-04. [2025-10-15T17:59:18.014202] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-10-15T17:59:18.132073] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-10-15T17:59:18.222472] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-15T17:59:18.514010] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-01. [2025-10-15T17:59:19.313984] [INFO ] [REMOTE ] CHE: Fetching primary data for 2024-12. [2025-10-15T17:59:19.599726] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-15T17:59:20.098121] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-10-15T17:59:20.113955] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-05. [2025-10-15T17:59:20.461194] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-10-15T17:59:20.914037] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-06. [2025-10-15T17:59:21.445866] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-10-15T17:59:21.714012] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-02. [2025-10-15T17:59:22.514034] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-01. [2025-10-15T17:59:22.531295] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-15T17:59:23.314038] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-03. [2025-10-15T17:59:24.119070] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-07. [2025-10-15T17:59:24.132411] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-15T17:59:24.235989] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-15T17:59:24.711639] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-10-15T17:59:24.914044] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-02. [2025-10-15T17:59:25.714013] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-01. [2025-10-15T17:59:26.476034] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-15T17:59:26.516609] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-08. [2025-10-15T17:59:26.519290] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-15T17:59:26.909843] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-08 (0.39 seconds). [2025-10-15T17:59:27.313992] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-02. [2025-10-15T17:59:28.084015] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-15T17:59:28.113996] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-09. [2025-10-15T17:59:28.443470] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-09 (0.33 seconds). [2025-10-15T17:59:28.914009] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-03. [2025-10-15T17:59:29.715322] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-10. [2025-10-15T17:59:29.716390] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-15T17:59:30.346352] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-15T17:59:30.347203] [INFO ] [REMOTE ] CGV: Full fetch complete (2278 records). [2025-10-15T17:59:30.347273] [DEBUG] [VALIDATOR ] CGV: Validating primary data. [2025-10-15T17:59:30.523936] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-04. [2025-10-15T17:59:30.731588] [DEBUG] [VALIDATOR ] CGV: All expected trading days are present. [2025-10-15T17:59:30.731688] [DEBUG] [VALIDATOR ] CGV: Primary data validation passed. [2025-10-15T17:59:30.731799] [INFO ] [MAIN ] CGV: Fetched primary data is valid. [2025-10-15T17:59:30.731837] [DEBUG] [LOCAL ] CGV: Saving primary data. [2025-10-15T17:59:30.732151] [DEBUG] [LOCAL ] CGV: Trimmed 2278 records to 1398 (keeping 200 days of data) [2025-10-15T17:59:30.740981] [DEBUG] [LOCAL ] CGV: Primary data saved (1398 records). [2025-10-15T17:59:30.741043] [INFO ] [MAIN ] CGV: Full history saved. [2025-10-15T17:59:30.741109] [INFO ] [MAIN ] Update Progress: 433/2369 symbols completed. CGV took 31.6s. Estimated remaining: 4h 25m 45s. Rate: 7.3 symbols/min [2025-10-15T17:59:30.908330] [INFO ] [MAIN ] CHGG: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:59:30.958865] [DEBUG] [LOCAL ] CHGG: Loaded 47711 existing records from primary storage. [2025-10-15T17:59:30.959230] [INFO ] [MAIN ] CHGG: Loaded 47711 existing records. [2025-10-15T17:59:31.138434] [WARN ] [MAIN ] CHGG: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:59:31.138677] [INFO ] [MAIN ] CHGG: Wiping existing primary data before full refresh. [2025-10-15T17:59:31.138738] [INFO ] [LOCAL ] CHGG: Starting deletion of primary data. [2025-10-15T17:59:31.139121] [DEBUG] [LOCAL ] CHGG: Deleted primary data file. [2025-10-15T17:59:31.139178] [INFO ] [MAIN ] CHGG: Starting full primary refresh. [2025-10-15T17:59:31.326835] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-03. [2025-10-15T17:59:31.528734] [INFO ] [REMOTE ] CHGG: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:59:32.114024] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-04. [2025-10-15T17:59:32.914079] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2024-12. [2025-10-15T17:59:33.255390] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-04 (2.73 seconds). [2025-10-15T17:59:33.371173] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-10-15T17:59:33.508903] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-15T17:59:33.714033] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-05. [2025-10-15T17:59:34.513980] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-05. [2025-10-15T17:59:34.711605] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-15T17:59:34.781128] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-10-15T17:59:35.314038] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-06. [2025-10-15T17:59:35.421782] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-15T17:59:36.113987] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-06. [2025-10-15T17:59:36.367479] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-15T17:59:36.914027] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-04. [2025-10-15T17:59:37.021399] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-15T17:59:37.714025] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-01. [2025-10-15T17:59:38.514045] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-07. [2025-10-15T17:59:38.824990] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-15T17:59:39.191198] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-15T17:59:39.313978] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-02. [2025-10-15T17:59:39.644629] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-15T17:59:40.113994] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-08. [2025-10-15T17:59:40.848374] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-15T17:59:40.906244] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-15T17:59:40.913953] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-09. [2025-10-15T17:59:41.714026] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-03. [2025-10-15T17:59:42.012844] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-15T17:59:42.514001] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-05. [2025-10-15T17:59:43.314022] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-10. [2025-10-15T17:59:43.453716] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-15T17:59:44.114004] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-07. [2025-10-15T17:59:44.418778] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-15T17:59:44.555881] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-15T17:59:44.559599] [INFO ] [REMOTE ] CHCT: Full fetch complete (34781 records). [2025-10-15T17:59:44.559725] [DEBUG] [VALIDATOR ] CHCT: Validating primary data. [2025-10-15T17:59:44.924028] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-06. [2025-10-15T17:59:44.984688] [DEBUG] [VALIDATOR ] CHCT: All expected trading days are present. [2025-10-15T17:59:44.984970] [DEBUG] [VALIDATOR ] CHCT: Primary data validation passed. [2025-10-15T17:59:44.986018] [INFO ] [MAIN ] CHCT: Fetched primary data is valid. [2025-10-15T17:59:44.986106] [DEBUG] [LOCAL ] CHCT: Saving primary data. [2025-10-15T17:59:45.000219] [DEBUG] [LOCAL ] CHCT: Trimmed 34781 records to 24209 (keeping 200 days of data) [2025-10-15T17:59:45.001253] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-15T17:59:45.165261] [DEBUG] [LOCAL ] CHCT: Primary data saved (24209 records). [2025-10-15T17:59:45.165420] [INFO ] [MAIN ] CHCT: Full history saved. [2025-10-15T17:59:45.165512] [INFO ] [MAIN ] Update Progress: 434/2369 symbols completed. CHCT took 35.2s. Estimated remaining: 4h 26m 4s. Rate: 7.3 symbols/min [2025-10-15T17:59:45.357261] [INFO ] [MAIN ] CHH: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:59:45.397071] [DEBUG] [LOCAL ] CHH: Loaded 32451 existing records from primary storage. [2025-10-15T17:59:45.397387] [INFO ] [MAIN ] CHH: Loaded 32451 existing records. [2025-10-15T17:59:45.601941] [WARN ] [MAIN ] CHH: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:59:45.602176] [INFO ] [MAIN ] CHH: Wiping existing primary data before full refresh. [2025-10-15T17:59:45.602297] [INFO ] [LOCAL ] CHH: Starting deletion of primary data. [2025-10-15T17:59:45.602729] [DEBUG] [LOCAL ] CHH: Deleted primary data file. [2025-10-15T17:59:45.602789] [INFO ] [MAIN ] CHH: Starting full primary refresh. [2025-10-15T17:59:45.719739] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-04. [2025-10-15T17:59:46.017713] [INFO ] [REMOTE ] CHH: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:59:46.513970] [INFO ] [REMOTE ] CHH: Fetching primary data for 2024-12. [2025-10-15T17:59:46.591362] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-15T17:59:47.313986] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-08. [2025-10-15T17:59:47.517138] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-15T17:59:47.583126] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-15T17:59:47.966184] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-10-15T17:59:48.114026] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-09. [2025-10-15T17:59:48.902003] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-15T17:59:48.913961] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-10. [2025-10-15T17:59:49.713965] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-01. [2025-10-15T17:59:49.981816] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-15T17:59:49.984243] [INFO ] [REMOTE ] CHE: Full fetch complete (20318 records). [2025-10-15T17:59:49.984319] [DEBUG] [VALIDATOR ] CHE: Validating primary data. [2025-10-15T17:59:50.336167] [DEBUG] [VALIDATOR ] CHE: All expected trading days are present. [2025-10-15T17:59:50.336248] [DEBUG] [VALIDATOR ] CHE: Primary data validation passed. [2025-10-15T17:59:50.336698] [INFO ] [MAIN ] CHE: Fetched primary data is valid. [2025-10-15T17:59:50.336771] [DEBUG] [LOCAL ] CHE: Saving primary data. [2025-10-15T17:59:50.337341] [DEBUG] [LOCAL ] CHE: Trimmed 20318 records to 15315 (keeping 200 days of data) [2025-10-15T17:59:50.431043] [DEBUG] [LOCAL ] CHE: Primary data saved (15315 records). [2025-10-15T17:59:50.431204] [INFO ] [MAIN ] CHE: Full history saved. [2025-10-15T17:59:50.431293] [INFO ] [MAIN ] Update Progress: 435/2369 symbols completed. CHE took 33.5s. Estimated remaining: 4h 25m 43s. Rate: 7.3 symbols/min [2025-10-15T17:59:50.519870] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-05. [2025-10-15T17:59:50.599377] [INFO ] [MAIN ] CHMI: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T17:59:50.624499] [DEBUG] [LOCAL ] CHMI: Loaded 21630 existing records from primary storage. [2025-10-15T17:59:50.624778] [INFO ] [MAIN ] CHMI: Loaded 21630 existing records. [2025-10-15T17:59:50.805040] [WARN ] [MAIN ] CHMI: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T17:59:50.805402] [INFO ] [MAIN ] CHMI: Wiping existing primary data before full refresh. [2025-10-15T17:59:50.805497] [INFO ] [LOCAL ] CHMI: Starting deletion of primary data. [2025-10-15T17:59:50.805710] [DEBUG] [LOCAL ] CHMI: Deleted primary data file. [2025-10-15T17:59:50.805767] [INFO ] [MAIN ] CHMI: Starting full primary refresh. [2025-10-15T17:59:51.156335] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-15T17:59:51.187969] [INFO ] [REMOTE ] CHMI: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T17:59:51.313967] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2024-12. [2025-10-15T17:59:51.907680] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-15T17:59:52.113967] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-06. [2025-10-15T17:59:52.319706] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-10-15T17:59:52.914002] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-07. [2025-10-15T17:59:53.714028] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-01. [2025-10-15T17:59:54.235594] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-06 (2.12 seconds). [2025-10-15T17:59:54.513969] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-02. [2025-10-15T17:59:54.650217] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-15T17:59:54.781147] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-15T17:59:55.313971] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-07. [2025-10-15T17:59:55.617434] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-15T17:59:56.114007] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-02. [2025-10-15T17:59:56.913951] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-08. [2025-10-15T17:59:56.950175] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-15T17:59:57.065540] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-15T17:59:57.714010] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-08. [2025-10-15T17:59:58.514079] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-03. [2025-10-15T17:59:58.648262] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-15T17:59:58.909590] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-15T17:59:59.313982] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-03. [2025-10-15T17:59:59.348372] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-15T18:00:00.114017] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-09. [2025-10-15T18:00:00.882913] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-15T18:00:00.913950] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-04. [2025-10-15T18:00:01.713976] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-09. [2025-10-15T18:00:01.938926] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-15T18:00:02.266720] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-15T18:00:02.514075] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-05. [2025-10-15T18:00:03.314039] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-10. [2025-10-15T18:00:03.721399] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-15T18:00:03.835635] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-09 (2.12 seconds). [2025-10-15T18:00:04.113994] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-10. [2025-10-15T18:00:04.914070] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-06. [2025-10-15T18:00:05.143729] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-15T18:00:05.150449] [INFO ] [REMOTE ] CHGG: Full fetch complete (70363 records). [2025-10-15T18:00:05.150638] [DEBUG] [VALIDATOR ] CHGG: Validating primary data. [2025-10-15T18:00:05.570690] [DEBUG] [VALIDATOR ] CHGG: All expected trading days are present. [2025-10-15T18:00:05.570810] [DEBUG] [VALIDATOR ] CHGG: Primary data validation passed. [2025-10-15T18:00:05.571863] [INFO ] [MAIN ] CHGG: Fetched primary data is valid. [2025-10-15T18:00:05.571932] [DEBUG] [LOCAL ] CHGG: Saving primary data. [2025-10-15T18:00:05.573419] [DEBUG] [LOCAL ] CHGG: Trimmed 70363 records to 47763 (keeping 200 days of data) [2025-10-15T18:00:05.732134] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-04. [2025-10-15T18:00:05.845553] [DEBUG] [LOCAL ] CHGG: Primary data saved (47763 records). [2025-10-15T18:00:05.846008] [INFO ] [MAIN ] CHGG: Full history saved. [2025-10-15T18:00:05.846444] [INFO ] [MAIN ] Update Progress: 436/2369 symbols completed. CHGG took 35.1s. Estimated remaining: 4h 26m 6s. Rate: 7.3 symbols/min [2025-10-15T18:00:06.020896] [INFO ] [MAIN ] CHN: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:00:06.021497] [DEBUG] [LOCAL ] CHN: No existing data file found in primary storage. [2025-10-15T18:00:06.021603] [WARN ] [MAIN ] CHN: No existing data found, performing full refresh instead. [2025-10-15T18:00:06.021925] [INFO ] [MAIN ] CHN: Wiping existing primary data before full refresh. [2025-10-15T18:00:06.021992] [INFO ] [LOCAL ] CHN: Starting deletion of primary data. [2025-10-15T18:00:06.022079] [DEBUG] [LOCAL ] CHN: No primary data file found to delete. [2025-10-15T18:00:06.022149] [INFO ] [MAIN ] CHN: Starting full primary refresh. [2025-10-15T18:00:06.340965] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-15T18:00:06.388863] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-10 (2.27 seconds). [2025-10-15T18:00:06.447151] [INFO ] [REMOTE ] CHD: Full fetch complete (74743 records). [2025-10-15T18:00:06.450875] [INFO ] [REMOTE ] CHN: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:00:06.451168] [DEBUG] [VALIDATOR ] CHD: Validating primary data. [2025-10-15T18:00:06.519874] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-07. [2025-10-15T18:00:06.859467] [DEBUG] [VALIDATOR ] CHD: All expected trading days are present. [2025-10-15T18:00:06.859568] [DEBUG] [VALIDATOR ] CHD: Primary data validation passed. [2025-10-15T18:00:06.860632] [INFO ] [MAIN ] CHD: Fetched primary data is valid. [2025-10-15T18:00:06.860726] [DEBUG] [LOCAL ] CHD: Saving primary data. [2025-10-15T18:00:06.862294] [DEBUG] [LOCAL ] CHD: Trimmed 74743 records to 52319 (keeping 200 days of data) [2025-10-15T18:00:07.112443] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-15T18:00:07.212499] [DEBUG] [LOCAL ] CHD: Primary data saved (52319 records). [2025-10-15T18:00:07.212660] [INFO ] [MAIN ] CHD: Full history saved. [2025-10-15T18:00:07.212764] [INFO ] [MAIN ] Update Progress: 437/2369 symbols completed. CHD took 52.9s. Estimated remaining: 4h 25m 28s. Rate: 7.3 symbols/min [2025-10-15T18:00:07.314041] [INFO ] [REMOTE ] CHN: Fetching primary data for 2024-12. [2025-10-15T18:00:07.948126] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-15T18:00:08.116031] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-08. [2025-10-15T18:00:08.117529] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-10-15T18:00:08.914003] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-01. [2025-10-15T18:00:09.544286] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-15T18:00:09.555802] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-15T18:00:09.713995] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-09. [2025-10-15T18:00:10.514054] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-05. [2025-10-15T18:00:11.168300] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-15T18:00:11.314011] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-10. [2025-10-15T18:00:11.594169] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-15T18:00:12.114091] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-02. [2025-10-15T18:00:12.836899] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-15T18:00:12.846824] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-15T18:00:12.849387] [INFO ] [REMOTE ] CHH: Full fetch complete (47425 records). [2025-10-15T18:00:12.849540] [DEBUG] [VALIDATOR ] CHH: Validating primary data. [2025-10-15T18:00:12.922766] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-06. [2025-10-15T18:00:13.229406] [DEBUG] [VALIDATOR ] CHH: All expected trading days are present. [2025-10-15T18:00:13.229482] [DEBUG] [VALIDATOR ] CHH: Primary data validation passed. [2025-10-15T18:00:13.230174] [INFO ] [MAIN ] CHH: Fetched primary data is valid. [2025-10-15T18:00:13.230236] [DEBUG] [LOCAL ] CHH: Saving primary data. [2025-10-15T18:00:13.231179] [DEBUG] [LOCAL ] CHH: Trimmed 47425 records to 32425 (keeping 200 days of data) [2025-10-15T18:00:13.434707] [DEBUG] [LOCAL ] CHH: Primary data saved (32425 records). [2025-10-15T18:00:13.434885] [INFO ] [MAIN ] CHH: Full history saved. [2025-10-15T18:00:13.435001] [INFO ] [MAIN ] Update Progress: 438/2369 symbols completed. CHH took 28.3s. Estimated remaining: 4h 25m 11s. Rate: 7.3 symbols/min [2025-10-15T18:00:13.714030] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-03. [2025-10-15T18:00:13.852997] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-15T18:00:14.358940] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-15T18:00:14.513997] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-07. [2025-10-15T18:00:15.314030] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-04. [2025-10-15T18:00:15.622874] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-15T18:00:16.022211] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-15T18:00:16.113973] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-08. [2025-10-15T18:00:16.914039] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-05. [2025-10-15T18:00:17.192671] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-15T18:00:17.438165] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-10-15T18:00:17.714008] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-06. [2025-10-15T18:00:18.438455] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-15T18:00:18.514008] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-09. [2025-10-15T18:00:19.314075] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-07. [2025-10-15T18:00:19.612167] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-15T18:00:19.920183] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-15T18:00:20.114043] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-08. [2025-10-15T18:00:20.703878] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-15T18:00:20.914018] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-09. [2025-10-15T18:00:21.478972] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-10-15T18:00:21.714016] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-10. [2025-10-15T18:00:22.224418] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-15T18:00:22.225507] [INFO ] [REMOTE ] CHN: Full fetch complete (7429 records). [2025-10-15T18:00:22.225576] [DEBUG] [VALIDATOR ] CHN: Validating primary data. [2025-10-15T18:00:22.225970] [FATAL] [VALIDATOR ] CHN: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T18:00:22.226057] [FATAL] [MAIN ] CHN: Fetched primary data is invalid. Refusing to save it. [2025-10-15T18:00:22.226099] [WARN ] [MAIN ] CHN: Deleting existing primary and derivative data due to validation failure. [2025-10-15T18:00:22.226174] [INFO ] [LOCAL ] CHN: Starting deletion of primary data. [2025-10-15T18:00:22.226238] [DEBUG] [LOCAL ] CHN: No primary data file found to delete. [2025-10-15T18:00:22.226274] [INFO ] [LOCAL ] CHN: Starting deletion of derivative data. [2025-10-15T18:00:22.226332] [DEBUG] [LOCAL ] CHN: No derivative data file found to delete. [2025-10-15T18:00:22.226384] [INFO ] [MAIN ] Update Progress: 439/2369 symbols completed. CHN took 16.4s. Estimated remaining: 4h 25m 5s. Rate: 7.3 symbols/min [2025-10-15T18:00:22.514044] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-10. [2025-10-15T18:00:23.429570] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-15T18:00:23.432423] [INFO ] [REMOTE ] CHMI: Full fetch complete (31738 records). [2025-10-15T18:00:23.432523] [DEBUG] [VALIDATOR ] CHMI: Validating primary data. [2025-10-15T18:00:23.433130] [FATAL] [VALIDATOR ] CHMI: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T18:00:23.433215] [FATAL] [MAIN ] CHMI: Fetched primary data is invalid. Refusing to save it. [2025-10-15T18:00:23.433288] [WARN ] [MAIN ] CHMI: Deleting existing primary and derivative data due to validation failure. [2025-10-15T18:00:23.433371] [INFO ] [LOCAL ] CHMI: Starting deletion of primary data. [2025-10-15T18:00:23.433448] [DEBUG] [LOCAL ] CHMI: No primary data file found to delete. [2025-10-15T18:00:23.433497] [INFO ] [LOCAL ] CHMI: Starting deletion of derivative data. [2025-10-15T18:00:23.434009] [DEBUG] [LOCAL ] CHMI: Deleted derivative data file. [2025-10-15T18:00:23.434120] [INFO ] [MAIN ] Update Progress: 440/2369 symbols completed. CHMI took 33.0s. Estimated remaining: 4h 24m 26s. Rate: 7.3 symbols/min [2025-10-15T18:00:23.981175] [INFO ] [MAIN ] CHWY: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:00:24.151063] [INFO ] [MAIN ] CI: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:00:24.154535] [INFO ] [MAIN ] CHT: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:00:24.156451] [INFO ] [MAIN ] CHPT: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:00:24.157404] [DEBUG] [LOCAL ] CHPT: No existing data file found in primary storage. [2025-10-15T18:00:24.157472] [WARN ] [MAIN ] CHPT: No existing data found, performing full refresh instead. [2025-10-15T18:00:24.157602] [INFO ] [MAIN ] CHPT: Wiping existing primary data before full refresh. [2025-10-15T18:00:24.157694] [INFO ] [LOCAL ] CHPT: Starting deletion of primary data. [2025-10-15T18:00:24.157752] [DEBUG] [LOCAL ] CHPT: No primary data file found to delete. [2025-10-15T18:00:24.157785] [INFO ] [MAIN ] CHPT: Starting full primary refresh. [2025-10-15T18:00:24.387583] [DEBUG] [LOCAL ] CHT: Loaded 19461 existing records from primary storage. [2025-10-15T18:00:24.428177] [INFO ] [MAIN ] CHT: Loaded 19461 existing records. [2025-10-15T18:00:24.522617] [DEBUG] [LOCAL ] CHWY: Loaded 53654 existing records from primary storage. [2025-10-15T18:00:24.582538] [INFO ] [MAIN ] CHWY: Loaded 53654 existing records. [2025-10-15T18:00:24.583233] [DEBUG] [LOCAL ] CI: Loaded 49778 existing records from primary storage. [2025-10-15T18:00:24.639247] [INFO ] [MAIN ] CI: Loaded 49778 existing records. [2025-10-15T18:00:24.836080] [INFO ] [REMOTE ] CHPT: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:00:24.936522] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2024-12. [2025-10-15T18:00:24.977105] [WARN ] [MAIN ] CHT: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:00:25.024334] [INFO ] [MAIN ] CHT: Wiping existing primary data before full refresh. [2025-10-15T18:00:25.078705] [INFO ] [LOCAL ] CHT: Starting deletion of primary data. [2025-10-15T18:00:25.132349] [WARN ] [MAIN ] CHWY: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:00:25.137866] [DEBUG] [LOCAL ] CHT: Deleted primary data file. [2025-10-15T18:00:25.152475] [INFO ] [MAIN ] CHT: Starting full primary refresh. [2025-10-15T18:00:25.152687] [INFO ] [MAIN ] CHWY: Wiping existing primary data before full refresh. [2025-10-15T18:00:25.156055] [INFO ] [LOCAL ] CHWY: Starting deletion of primary data. [2025-10-15T18:00:25.174933] [DEBUG] [LOCAL ] CHWY: Deleted primary data file. [2025-10-15T18:00:25.169697] [WARN ] [MAIN ] CI: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:00:25.201498] [INFO ] [MAIN ] CI: Wiping existing primary data before full refresh. [2025-10-15T18:00:25.201784] [INFO ] [LOCAL ] CI: Starting deletion of primary data. [2025-10-15T18:00:25.201677] [INFO ] [MAIN ] CHWY: Starting full primary refresh. [2025-10-15T18:00:25.287263] [DEBUG] [LOCAL ] CI: Deleted primary data file. [2025-10-15T18:00:25.309987] [INFO ] [MAIN ] CI: Starting full primary refresh. [2025-10-15T18:00:26.144024] [INFO ] [REMOTE ] CHT: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:00:26.172982] [INFO ] [REMOTE ] CHT: Fetching primary data for 2024-12. [2025-10-15T18:00:26.267751] [INFO ] [REMOTE ] CHWY: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:00:26.284809] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2024-12. [2025-10-15T18:00:26.340352] [INFO ] [REMOTE ] CI: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:00:26.340724] [INFO ] [REMOTE ] CI: Fetching primary data for 2024-12. [2025-10-15T18:00:27.130122] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-10-15T18:00:27.134409] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-01. [2025-10-15T18:00:27.167902] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2024-12 (2.23 seconds). [2025-10-15T18:00:27.313995] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-01. [2025-10-15T18:00:27.920735] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-15T18:00:27.965486] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-15T18:00:27.986705] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-15T18:00:28.113952] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-02. [2025-10-15T18:00:28.914017] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-01. [2025-10-15T18:00:28.939950] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-15T18:00:29.272046] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-10-15T18:00:29.713988] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-03. [2025-10-15T18:00:30.513956] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-02. [2025-10-15T18:00:30.769331] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-15T18:00:30.832703] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-15T18:00:31.314035] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-01. [2025-10-15T18:00:32.113985] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-02. [2025-10-15T18:00:32.613174] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-02 (2.10 seconds). [2025-10-15T18:00:32.914494] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-04. [2025-10-15T18:00:32.914424] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-15T18:00:33.713970] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-03. [2025-10-15T18:00:33.964255] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-10-15T18:00:34.049298] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-15T18:00:34.514006] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-02. [2025-10-15T18:00:35.313979] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-05. [2025-10-15T18:00:35.522282] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-15T18:00:36.084491] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-15T18:00:36.113958] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-03. [2025-10-15T18:00:36.174320] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-15T18:00:36.914016] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-06. [2025-10-15T18:00:37.713970] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-04. [2025-10-15T18:00:38.001238] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-15T18:00:38.002197] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-15T18:00:38.514067] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-07. [2025-10-15T18:00:39.289275] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-15T18:00:39.313966] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-08. [2025-10-15T18:00:39.883807] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-04 (2.17 seconds). [2025-10-15T18:00:40.114006] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-05. [2025-10-15T18:00:40.378479] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-15T18:00:40.914008] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-04. [2025-10-15T18:00:41.714006] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-03. [2025-10-15T18:00:42.180811] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-10-15T18:00:42.514044] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-06. [2025-10-15T18:00:42.688465] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-15T18:00:43.313973] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-05. [2025-10-15T18:00:43.812226] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-03 (2.10 seconds). [2025-10-15T18:00:44.113980] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-04. [2025-10-15T18:00:44.390441] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-15T18:00:44.913998] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-07. [2025-10-15T18:00:45.157922] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-15T18:00:45.676587] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-15T18:00:45.713959] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-05. [2025-10-15T18:00:46.513994] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-06. [2025-10-15T18:00:46.801376] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-15T18:00:47.314049] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-08. [2025-10-15T18:00:47.663451] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-15T18:00:47.786389] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-10-15T18:00:48.114018] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-07. [2025-10-15T18:00:48.919113] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-06. [2025-10-15T18:00:48.931671] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-15T18:00:49.713968] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-09. [2025-10-15T18:00:50.116399] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-10-15T18:00:50.514043] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-08. [2025-10-15T18:00:50.980056] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-06 (2.06 seconds). [2025-10-15T18:00:51.041022] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-15T18:00:51.313982] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-10. [2025-10-15T18:00:52.113967] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-09. [2025-10-15T18:00:52.355258] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-15T18:00:52.914032] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-09. [2025-10-15T18:00:52.977876] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-15T18:00:52.982952] [INFO ] [REMOTE ] CHPT: Full fetch complete (71787 records). [2025-10-15T18:00:52.983114] [DEBUG] [VALIDATOR ] CHPT: Validating primary data. [2025-10-15T18:00:53.332722] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-15T18:00:53.417584] [DEBUG] [VALIDATOR ] CHPT: All expected trading days are present. [2025-10-15T18:00:53.417738] [DEBUG] [VALIDATOR ] CHPT: Primary data validation passed. [2025-10-15T18:00:53.418582] [INFO ] [MAIN ] CHPT: Fetched primary data is valid. [2025-10-15T18:00:53.418626] [DEBUG] [LOCAL ] CHPT: Saving primary data. [2025-10-15T18:00:53.420161] [DEBUG] [LOCAL ] CHPT: Trimmed 71787 records to 47661 (keeping 200 days of data) [2025-10-15T18:00:53.701702] [DEBUG] [LOCAL ] CHPT: Primary data saved (47661 records). [2025-10-15T18:00:53.701854] [INFO ] [MAIN ] CHPT: Full history saved. [2025-10-15T18:00:53.702124] [INFO ] [MAIN ] Update Progress: 441/2369 symbols completed. CHPT took 30.3s. Estimated remaining: 4h 25m 54s. Rate: 7.3 symbols/min [2025-10-15T18:00:53.724504] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-07. [2025-10-15T18:00:53.909433] [INFO ] [MAIN ] CIA: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:00:53.925843] [DEBUG] [LOCAL ] CIA: Loaded 16701 existing records from primary storage. [2025-10-15T18:00:53.926125] [INFO ] [MAIN ] CIA: Loaded 16701 existing records. [2025-10-15T18:00:54.098267] [WARN ] [MAIN ] CIA: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:00:54.098512] [INFO ] [MAIN ] CIA: Wiping existing primary data before full refresh. [2025-10-15T18:00:54.098561] [INFO ] [LOCAL ] CIA: Starting deletion of primary data. [2025-10-15T18:00:54.098785] [DEBUG] [LOCAL ] CIA: Deleted primary data file. [2025-10-15T18:00:54.098842] [INFO ] [MAIN ] CIA: Starting full primary refresh. [2025-10-15T18:00:54.463520] [INFO ] [REMOTE ] CIA: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:00:54.513966] [INFO ] [REMOTE ] CIA: Fetching primary data for 2024-12. [2025-10-15T18:00:54.657760] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-15T18:00:55.314093] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-10. [2025-10-15T18:00:55.326661] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-10-15T18:00:55.560028] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-15T18:00:56.114020] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-08. [2025-10-15T18:00:56.190500] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-15T18:00:56.196454] [INFO ] [REMOTE ] CI: Full fetch complete (72162 records). [2025-10-15T18:00:56.196569] [DEBUG] [VALIDATOR ] CI: Validating primary data. [2025-10-15T18:00:56.593748] [DEBUG] [VALIDATOR ] CI: All expected trading days are present. [2025-10-15T18:00:56.593844] [DEBUG] [VALIDATOR ] CI: Primary data validation passed. [2025-10-15T18:00:56.594805] [INFO ] [MAIN ] CI: Fetched primary data is valid. [2025-10-15T18:00:56.594870] [DEBUG] [LOCAL ] CI: Saving primary data. [2025-10-15T18:00:56.596382] [DEBUG] [LOCAL ] CI: Trimmed 72162 records to 49737 (keeping 200 days of data) [2025-10-15T18:00:56.917076] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-01. [2025-10-15T18:00:56.925290] [DEBUG] [LOCAL ] CI: Primary data saved (49737 records). [2025-10-15T18:00:56.925405] [INFO ] [MAIN ] CI: Full history saved. [2025-10-15T18:00:56.925498] [INFO ] [MAIN ] Update Progress: 442/2369 symbols completed. CI took 33.5s. Estimated remaining: 4h 25m 23s. Rate: 7.3 symbols/min [2025-10-15T18:00:57.140856] [INFO ] [MAIN ] CIB: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:00:57.177251] [DEBUG] [LOCAL ] CIB: Loaded 30546 existing records from primary storage. [2025-10-15T18:00:57.177676] [INFO ] [MAIN ] CIB: Loaded 30546 existing records. [2025-10-15T18:00:57.419914] [WARN ] [MAIN ] CIB: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:00:57.420233] [INFO ] [MAIN ] CIB: Wiping existing primary data before full refresh. [2025-10-15T18:00:57.420316] [INFO ] [LOCAL ] CIB: Starting deletion of primary data. [2025-10-15T18:00:57.420756] [DEBUG] [LOCAL ] CIB: Deleted primary data file. [2025-10-15T18:00:57.420829] [INFO ] [MAIN ] CIB: Starting full primary refresh. [2025-10-15T18:00:57.718012] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-10. [2025-10-15T18:00:57.813301] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-15T18:00:57.987593] [INFO ] [REMOTE ] CIB: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:00:58.121863] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-10-15T18:00:58.514026] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-09. [2025-10-15T18:00:58.776151] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-15T18:00:58.778890] [INFO ] [REMOTE ] CHT: Full fetch complete (27396 records). [2025-10-15T18:00:58.779009] [DEBUG] [VALIDATOR ] CHT: Validating primary data. [2025-10-15T18:00:58.779545] [FATAL] [VALIDATOR ] CHT: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T18:00:58.779631] [FATAL] [MAIN ] CHT: Fetched primary data is invalid. Refusing to save it. [2025-10-15T18:00:58.779722] [WARN ] [MAIN ] CHT: Deleting existing primary and derivative data due to validation failure. [2025-10-15T18:00:58.779803] [INFO ] [LOCAL ] CHT: Starting deletion of primary data. [2025-10-15T18:00:58.779879] [DEBUG] [LOCAL ] CHT: No primary data file found to delete. [2025-10-15T18:00:58.779914] [INFO ] [LOCAL ] CHT: Starting deletion of derivative data. [2025-10-15T18:00:58.780056] [DEBUG] [LOCAL ] CHT: Deleted derivative data file. [2025-10-15T18:00:58.780145] [INFO ] [MAIN ] Update Progress: 443/2369 symbols completed. CHT took 35.3s. Estimated remaining: 4h 24m 47s. Rate: 7.3 symbols/min [2025-10-15T18:00:58.945857] [INFO ] [MAIN ] CICB: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:00:58.946033] [DEBUG] [LOCAL ] CICB: No existing data file found in primary storage. [2025-10-15T18:00:58.946071] [WARN ] [MAIN ] CICB: No existing data found, performing full refresh instead. [2025-10-15T18:00:58.946176] [INFO ] [MAIN ] CICB: Wiping existing primary data before full refresh. [2025-10-15T18:00:58.946216] [INFO ] [LOCAL ] CICB: Starting deletion of primary data. [2025-10-15T18:00:58.946257] [DEBUG] [LOCAL ] CICB: No primary data file found to delete. [2025-10-15T18:00:58.946328] [INFO ] [MAIN ] CICB: Starting full primary refresh. [2025-10-15T18:00:59.293026] [INFO ] [REMOTE ] CICB: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:00:59.313959] [INFO ] [REMOTE ] CICB: Fetching primary data for 2024-12. [2025-10-15T18:00:59.751327] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2024-12 (0.44 seconds). [2025-10-15T18:01:00.114001] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-02. [2025-10-15T18:01:00.748172] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-09 (2.23 seconds). [2025-10-15T18:01:00.913968] [INFO ] [REMOTE ] CIB: Fetching primary data for 2024-12. [2025-10-15T18:01:01.111242] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-15T18:01:01.714034] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-01. [2025-10-15T18:01:02.106385] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-01 (0.39 seconds). [2025-10-15T18:01:02.448711] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-15T18:01:02.513993] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-10. [2025-10-15T18:01:03.314063] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-03. [2025-10-15T18:01:04.114001] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-02. [2025-10-15T18:01:04.289537] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-15T18:01:04.379980] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-02 (0.27 seconds). [2025-10-15T18:01:04.708442] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-10 (2.19 seconds). [2025-10-15T18:01:04.715250] [INFO ] [REMOTE ] CHWY: Full fetch complete (77775 records). [2025-10-15T18:01:04.715407] [DEBUG] [VALIDATOR ] CHWY: Validating primary data. [2025-10-15T18:01:04.920900] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-01. [2025-10-15T18:01:05.119729] [DEBUG] [VALIDATOR ] CHWY: All expected trading days are present. [2025-10-15T18:01:05.119823] [DEBUG] [VALIDATOR ] CHWY: Primary data validation passed. [2025-10-15T18:01:05.120813] [INFO ] [MAIN ] CHWY: Fetched primary data is valid. [2025-10-15T18:01:05.120879] [DEBUG] [LOCAL ] CHWY: Saving primary data. [2025-10-15T18:01:05.122382] [DEBUG] [LOCAL ] CHWY: Trimmed 77775 records to 53655 (keeping 200 days of data) [2025-10-15T18:01:05.432549] [DEBUG] [LOCAL ] CHWY: Primary data saved (53655 records). [2025-10-15T18:01:05.432721] [INFO ] [MAIN ] CHWY: Full history saved. [2025-10-15T18:01:05.432814] [INFO ] [MAIN ] Update Progress: 444/2369 symbols completed. CHWY took 42.0s. Estimated remaining: 4h 24m 32s. Rate: 7.3 symbols/min [2025-10-15T18:01:05.602634] [INFO ] [MAIN ] CIEN: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:01:05.650712] [DEBUG] [LOCAL ] CIEN: Loaded 52153 existing records from primary storage. [2025-10-15T18:01:05.651062] [INFO ] [MAIN ] CIEN: Loaded 52153 existing records. [2025-10-15T18:01:05.723837] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-04. [2025-10-15T18:01:05.832174] [WARN ] [MAIN ] CIEN: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:01:05.832408] [INFO ] [MAIN ] CIEN: Wiping existing primary data before full refresh. [2025-10-15T18:01:05.832471] [INFO ] [LOCAL ] CIEN: Starting deletion of primary data. [2025-10-15T18:01:05.832905] [DEBUG] [LOCAL ] CIEN: Deleted primary data file. [2025-10-15T18:01:05.832963] [INFO ] [MAIN ] CIEN: Starting full primary refresh. [2025-10-15T18:01:06.194766] [INFO ] [REMOTE ] CIEN: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:01:06.423003] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-15T18:01:06.513992] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-02. [2025-10-15T18:01:06.741574] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-15T18:01:07.313977] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-05. [2025-10-15T18:01:07.754562] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-15T18:01:08.114037] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-03. [2025-10-15T18:01:08.161676] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-15T18:01:08.914006] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-03. [2025-10-15T18:01:09.229087] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-03 (0.32 seconds). [2025-10-15T18:01:09.509935] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-15T18:01:09.714010] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-04. [2025-10-15T18:01:10.281123] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-15T18:01:10.513975] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-06. [2025-10-15T18:01:11.314015] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-04. [2025-10-15T18:01:11.612564] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-15T18:01:12.113999] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-07. [2025-10-15T18:01:12.433103] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-15T18:01:12.913972] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-05. [2025-10-15T18:01:13.170960] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-15T18:01:13.714039] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-05. [2025-10-15T18:01:13.990915] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-05 (0.28 seconds). [2025-10-15T18:01:14.261429] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-15T18:01:14.514065] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-06. [2025-10-15T18:01:15.314003] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-06. [2025-10-15T18:01:15.631629] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-15T18:01:15.726493] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-10-15T18:01:16.113992] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-07. [2025-10-15T18:01:16.455827] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-07 (0.34 seconds). [2025-10-15T18:01:16.914050] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2024-12. [2025-10-15T18:01:17.714035] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-08. [2025-10-15T18:01:18.513992] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-08. [2025-10-15T18:01:18.740716] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-15T18:01:18.772669] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-15T18:01:18.772771] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-08 (0.26 seconds). [2025-10-15T18:01:19.314016] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-07. [2025-10-15T18:01:20.114012] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-09. [2025-10-15T18:01:20.450050] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-15T18:01:20.913979] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-01. [2025-10-15T18:01:21.098860] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-15T18:01:21.714012] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-08. [2025-10-15T18:01:22.310897] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-15T18:01:22.513974] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-09. [2025-10-15T18:01:22.839255] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-15T18:01:22.960506] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-10-15T18:01:23.314008] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-09. [2025-10-15T18:01:24.113993] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-10. [2025-10-15T18:01:24.520212] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-10 (0.41 seconds). [2025-10-15T18:01:24.521133] [INFO ] [REMOTE ] CICB: Full fetch complete (1988 records). [2025-10-15T18:01:24.521212] [DEBUG] [VALIDATOR ] CICB: Validating primary data. [2025-10-15T18:01:24.712784] [WARN ] [VALIDATOR ] CICB: Validation failed - insufficient historical data. Have 196 unique days, need 200 days [2025-10-15T18:01:24.712973] [FATAL] [MAIN ] CICB: Fetched primary data is invalid. Refusing to save it. [2025-10-15T18:01:24.713181] [WARN ] [MAIN ] CICB: Deleting existing primary and derivative data due to validation failure. [2025-10-15T18:01:24.713260] [INFO ] [LOCAL ] CICB: Starting deletion of primary data. [2025-10-15T18:01:24.713341] [DEBUG] [LOCAL ] CICB: No primary data file found to delete. [2025-10-15T18:01:24.713505] [INFO ] [LOCAL ] CICB: Starting deletion of derivative data. [2025-10-15T18:01:24.713663] [DEBUG] [LOCAL ] CICB: No derivative data file found to delete. [2025-10-15T18:01:24.713751] [INFO ] [MAIN ] Update Progress: 445/2369 symbols completed. CICB took 25.9s. Estimated remaining: 4h 25m 12s. Rate: 7.3 symbols/min [2025-10-15T18:01:24.857954] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-15T18:01:24.914953] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-10. [2025-10-15T18:01:24.918765] [INFO ] [MAIN ] CIF: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:01:24.927013] [DEBUG] [LOCAL ] CIF: Loaded 4046 existing records from primary storage. [2025-10-15T18:01:24.927256] [INFO ] [MAIN ] CIF: Loaded 4046 existing records. [2025-10-15T18:01:25.101691] [WARN ] [MAIN ] CIF: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:01:25.101935] [INFO ] [MAIN ] CIF: Wiping existing primary data before full refresh. [2025-10-15T18:01:25.101983] [INFO ] [LOCAL ] CIF: Starting deletion of primary data. [2025-10-15T18:01:25.102142] [DEBUG] [LOCAL ] CIF: Deleted primary data file. [2025-10-15T18:01:25.102179] [INFO ] [MAIN ] CIF: Starting full primary refresh. [2025-10-15T18:01:25.474864] [INFO ] [REMOTE ] CIF: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:01:25.700468] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-15T18:01:25.702318] [INFO ] [REMOTE ] CIA: Full fetch complete (23410 records). [2025-10-15T18:01:25.702389] [DEBUG] [VALIDATOR ] CIA: Validating primary data. [2025-10-15T18:01:25.702903] [FATAL] [VALIDATOR ] CIA: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T18:01:25.702983] [FATAL] [MAIN ] CIA: Fetched primary data is invalid. Refusing to save it. [2025-10-15T18:01:25.703024] [WARN ] [MAIN ] CIA: Deleting existing primary and derivative data due to validation failure. [2025-10-15T18:01:25.703061] [INFO ] [LOCAL ] CIA: Starting deletion of primary data. [2025-10-15T18:01:25.703115] [DEBUG] [LOCAL ] CIA: No primary data file found to delete. [2025-10-15T18:01:25.703149] [INFO ] [LOCAL ] CIA: Starting deletion of derivative data. [2025-10-15T18:01:25.703264] [DEBUG] [LOCAL ] CIA: Deleted derivative data file. [2025-10-15T18:01:25.703327] [INFO ] [MAIN ] Update Progress: 446/2369 symbols completed. CIA took 32.0s. Estimated remaining: 4h 24m 32s. Rate: 7.3 symbols/min [2025-10-15T18:01:25.723464] [INFO ] [REMOTE ] CIF: Fetching primary data for 2024-12. [2025-10-15T18:01:25.874133] [INFO ] [MAIN ] CIG: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:01:25.944549] [DEBUG] [LOCAL ] CIG: Loaded 44270 existing records from primary storage. [2025-10-15T18:01:25.944931] [INFO ] [MAIN ] CIG: Loaded 44270 existing records. [2025-10-15T18:01:26.125801] [WARN ] [MAIN ] CIG: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:01:26.126052] [INFO ] [MAIN ] CIG: Wiping existing primary data before full refresh. [2025-10-15T18:01:26.126111] [INFO ] [LOCAL ] CIG: Starting deletion of primary data. [2025-10-15T18:01:26.126371] [DEBUG] [LOCAL ] CIG: Deleted primary data file. [2025-10-15T18:01:26.126416] [INFO ] [MAIN ] CIG: Starting full primary refresh. [2025-10-15T18:01:26.442070] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-10-15T18:01:26.506131] [INFO ] [REMOTE ] CIG: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:01:26.513947] [INFO ] [REMOTE ] CIG: Fetching primary data for 2024-12. [2025-10-15T18:01:27.314052] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-02. [2025-10-15T18:01:27.794975] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-15T18:01:28.113993] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-01. [2025-10-15T18:01:28.913997] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-01. [2025-10-15T18:01:29.007709] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-15T18:01:29.049874] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-15T18:01:29.714076] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-02. [2025-10-15T18:01:30.317288] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-15T18:01:30.444326] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-15T18:01:30.514052] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-03. [2025-10-15T18:01:31.163552] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-15T18:01:31.314004] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-10. [2025-10-15T18:01:32.114001] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-02. [2025-10-15T18:01:32.413036] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-15T18:01:32.417018] [INFO ] [REMOTE ] CIB: Full fetch complete (45018 records). [2025-10-15T18:01:32.417165] [DEBUG] [VALIDATOR ] CIB: Validating primary data. [2025-10-15T18:01:32.806965] [DEBUG] [VALIDATOR ] CIB: All expected trading days are present. [2025-10-15T18:01:32.807062] [DEBUG] [VALIDATOR ] CIB: Primary data validation passed. [2025-10-15T18:01:32.807735] [INFO ] [MAIN ] CIB: Fetched primary data is valid. [2025-10-15T18:01:32.807798] [DEBUG] [LOCAL ] CIB: Saving primary data. [2025-10-15T18:01:32.808712] [DEBUG] [LOCAL ] CIB: Trimmed 45018 records to 30426 (keeping 200 days of data) [2025-10-15T18:01:32.917275] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-03. [2025-10-15T18:01:32.985974] [DEBUG] [LOCAL ] CIB: Primary data saved (30426 records). [2025-10-15T18:01:32.986108] [INFO ] [MAIN ] CIB: Full history saved. [2025-10-15T18:01:32.986186] [INFO ] [MAIN ] Update Progress: 447/2369 symbols completed. CIB took 36.1s. Estimated remaining: 4h 24m 20s. Rate: 7.3 symbols/min [2025-10-15T18:01:33.151457] [INFO ] [MAIN ] CII: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:01:33.151699] [DEBUG] [LOCAL ] CII: No existing data file found in primary storage. [2025-10-15T18:01:33.151750] [WARN ] [MAIN ] CII: No existing data found, performing full refresh instead. [2025-10-15T18:01:33.151874] [INFO ] [MAIN ] CII: Wiping existing primary data before full refresh. [2025-10-15T18:01:33.151914] [INFO ] [LOCAL ] CII: Starting deletion of primary data. [2025-10-15T18:01:33.151956] [DEBUG] [LOCAL ] CII: No primary data file found to delete. [2025-10-15T18:01:33.152461] [INFO ] [MAIN ] CII: Starting full primary refresh. [2025-10-15T18:01:33.475747] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-15T18:01:33.539166] [INFO ] [REMOTE ] CII: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:01:33.713965] [INFO ] [REMOTE ] CII: Fetching primary data for 2024-12. [2025-10-15T18:01:34.513974] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-04. [2025-10-15T18:01:34.565530] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-15T18:01:34.648513] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-15T18:01:35.082615] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-15T18:01:35.314110] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-01. [2025-10-15T18:01:36.113969] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-04. [2025-10-15T18:01:36.191027] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-15T18:01:36.914035] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-03. [2025-10-15T18:01:37.714004] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-02. [2025-10-15T18:01:37.757098] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-15T18:01:38.284754] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-15T18:01:38.358809] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-15T18:01:38.514075] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-05. [2025-10-15T18:01:39.119009] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-15T18:01:39.314133] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-05. [2025-10-15T18:01:40.114028] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-04. [2025-10-15T18:01:40.914012] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-06. [2025-10-15T18:01:41.180591] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-15T18:01:41.346775] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-10-15T18:01:41.531504] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-15T18:01:41.714006] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-06. [2025-10-15T18:01:42.514051] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-03. [2025-10-15T18:01:43.197447] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-15T18:01:43.313972] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-04. [2025-10-15T18:01:43.498862] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-15T18:01:44.113990] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-05. [2025-10-15T18:01:44.345549] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-15T18:01:44.914036] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-07. [2025-10-15T18:01:45.427220] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-15T18:01:45.426333] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-10-15T18:01:45.714045] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-06. [2025-10-15T18:01:46.514047] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-07. [2025-10-15T18:01:47.314054] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-05. [2025-10-15T18:01:47.377541] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-15T18:01:47.832569] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-15T18:01:48.011633] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-15T18:01:48.114019] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-07. [2025-10-15T18:01:48.914005] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-08. [2025-10-15T18:01:49.418858] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-10-15T18:01:49.714029] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-06. [2025-10-15T18:01:49.916047] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-15T18:01:50.387358] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-15T18:01:50.514113] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-08. [2025-10-15T18:01:51.314016] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-09. [2025-10-15T18:01:51.827784] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-10-15T18:01:52.113989] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-10. [2025-10-15T18:01:52.195482] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-15T18:01:52.756492] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-15T18:01:52.757714] [INFO ] [REMOTE ] CIF: Full fetch complete (6580 records). [2025-10-15T18:01:52.757797] [DEBUG] [VALIDATOR ] CIF: Validating primary data. [2025-10-15T18:01:52.917475] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-09. [2025-10-15T18:01:53.127221] [DEBUG] [VALIDATOR ] CIF: All expected trading days are present. [2025-10-15T18:01:53.127322] [DEBUG] [VALIDATOR ] CIF: Primary data validation passed. [2025-10-15T18:01:53.127492] [INFO ] [MAIN ] CIF: Fetched primary data is valid. [2025-10-15T18:01:53.127533] [DEBUG] [LOCAL ] CIF: Saving primary data. [2025-10-15T18:01:53.127937] [DEBUG] [LOCAL ] CIF: Trimmed 6580 records to 4024 (keeping 200 days of data) [2025-10-15T18:01:53.151448] [DEBUG] [LOCAL ] CIF: Primary data saved (4024 records). [2025-10-15T18:01:53.151517] [INFO ] [MAIN ] CIF: Full history saved. [2025-10-15T18:01:53.151586] [INFO ] [MAIN ] Update Progress: 448/2369 symbols completed. CIF took 28.4s. Estimated remaining: 4h 25m 2s. Rate: 7.2 symbols/min [2025-10-15T18:01:53.312564] [INFO ] [MAIN ] CIM: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:01:53.349599] [DEBUG] [LOCAL ] CIM: Loaded 37747 existing records from primary storage. [2025-10-15T18:01:53.349908] [INFO ] [MAIN ] CIM: Loaded 37747 existing records. [2025-10-15T18:01:53.531988] [WARN ] [MAIN ] CIM: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:01:53.532253] [INFO ] [MAIN ] CIM: Wiping existing primary data before full refresh. [2025-10-15T18:01:53.532304] [INFO ] [LOCAL ] CIM: Starting deletion of primary data. [2025-10-15T18:01:53.532526] [DEBUG] [LOCAL ] CIM: Deleted primary data file. [2025-10-15T18:01:53.532583] [INFO ] [MAIN ] CIM: Starting full primary refresh. [2025-10-15T18:01:53.724082] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-07. [2025-10-15T18:01:53.935552] [INFO ] [REMOTE ] CIM: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:01:54.513985] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-08. [2025-10-15T18:01:54.568209] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-15T18:01:54.649589] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-15T18:01:55.314084] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-08. [2025-10-15T18:01:55.879099] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-15T18:01:56.114027] [INFO ] [REMOTE ] CIM: Fetching primary data for 2024-12. [2025-10-15T18:01:56.144040] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-15T18:01:56.914063] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-09. [2025-10-15T18:01:57.527022] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-15T18:01:57.714048] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-09. [2025-10-15T18:01:58.398740] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-15T18:01:58.513976] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-10. [2025-10-15T18:01:58.813930] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-15T18:01:59.314013] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-10. [2025-10-15T18:01:59.930464] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-15T18:01:59.936187] [INFO ] [REMOTE ] CIG: Full fetch complete (62134 records). [2025-10-15T18:01:59.936290] [DEBUG] [VALIDATOR ] CIG: Validating primary data. [2025-10-15T18:02:00.117964] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-10. [2025-10-15T18:02:00.283979] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-15T18:02:00.338828] [INFO ] [REMOTE ] CII: Full fetch complete (22913 records). [2025-10-15T18:02:00.362263] [DEBUG] [VALIDATOR ] CII: Validating primary data. [2025-10-15T18:02:00.378467] [DEBUG] [VALIDATOR ] CIG: All expected trading days are present. [2025-10-15T18:02:00.378585] [DEBUG] [VALIDATOR ] CIG: Primary data validation passed. [2025-10-15T18:02:00.379710] [INFO ] [MAIN ] CIG: Fetched primary data is valid. [2025-10-15T18:02:00.379814] [DEBUG] [LOCAL ] CIG: Saving primary data. [2025-10-15T18:02:00.482549] [DEBUG] [LOCAL ] CIG: Trimmed 62134 records to 44317 (keeping 200 days of data) [2025-10-15T18:02:00.866014] [DEBUG] [VALIDATOR ] CII: All expected trading days are present. [2025-10-15T18:02:00.870098] [DEBUG] [VALIDATOR ] CII: Primary data validation passed. [2025-10-15T18:02:00.871105] [INFO ] [MAIN ] CII: Fetched primary data is valid. [2025-10-15T18:02:00.873560] [DEBUG] [LOCAL ] CII: Saving primary data. [2025-10-15T18:02:00.874509] [DEBUG] [LOCAL ] CII: Trimmed 22913 records to 15321 (keeping 200 days of data) [2025-10-15T18:02:00.921433] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-01. [2025-10-15T18:02:01.109316] [DEBUG] [LOCAL ] CIG: Primary data saved (44317 records). [2025-10-15T18:02:01.106175] [DEBUG] [LOCAL ] CII: Primary data saved (15321 records). [2025-10-15T18:02:01.109473] [INFO ] [MAIN ] CIG: Full history saved. [2025-10-15T18:02:01.109571] [INFO ] [MAIN ] CII: Full history saved. [2025-10-15T18:02:01.109698] [INFO ] [MAIN ] Update Progress: 449/2369 symbols completed. CIG took 35.4s. Estimated remaining: 4h 24m 53s. Rate: 7.2 symbols/min [2025-10-15T18:02:01.109943] [INFO ] [MAIN ] Update Progress: 450/2369 symbols completed. CII took 28.1s. Estimated remaining: 4h 24m 9s. Rate: 7.3 symbols/min [2025-10-15T18:02:01.438443] [INFO ] [MAIN ] CIMN: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:02:01.455119] [INFO ] [MAIN ] CIMO: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:02:01.455496] [DEBUG] [LOCAL ] CIMO: No existing data file found in primary storage. [2025-10-15T18:02:01.455545] [WARN ] [MAIN ] CIMO: No existing data found, performing full refresh instead. [2025-10-15T18:02:01.455685] [INFO ] [MAIN ] CIMO: Wiping existing primary data before full refresh. [2025-10-15T18:02:01.455739] [INFO ] [LOCAL ] CIMO: Starting deletion of primary data. [2025-10-15T18:02:01.455786] [DEBUG] [LOCAL ] CIMO: No primary data file found to delete. [2025-10-15T18:02:01.455819] [INFO ] [MAIN ] CIMO: Starting full primary refresh. [2025-10-15T18:02:01.567871] [DEBUG] [LOCAL ] CIMN: Loaded 2750 existing records from primary storage. [2025-10-15T18:02:01.583538] [INFO ] [MAIN ] CIMN: Loaded 2750 existing records. [2025-10-15T18:02:02.028713] [WARN ] [MAIN ] CIMN: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:02:02.065333] [INFO ] [REMOTE ] CIMO: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:02:02.066137] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2024-12. [2025-10-15T18:02:02.067487] [INFO ] [MAIN ] CIMN: Wiping existing primary data before full refresh. [2025-10-15T18:02:02.067616] [INFO ] [LOCAL ] CIMN: Starting deletion of primary data. [2025-10-15T18:02:02.067888] [DEBUG] [LOCAL ] CIMN: Deleted primary data file. [2025-10-15T18:02:02.068123] [INFO ] [MAIN ] CIMN: Starting full primary refresh. [2025-10-15T18:02:02.156359] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-10 (2.04 seconds). [2025-10-15T18:02:02.187037] [INFO ] [REMOTE ] CIEN: Full fetch complete (75782 records). [2025-10-15T18:02:02.198304] [DEBUG] [VALIDATOR ] CIEN: Validating primary data. [2025-10-15T18:02:02.744376] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-15T18:02:02.741092] [INFO ] [REMOTE ] CIMN: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:02:02.770739] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2024-12. [2025-10-15T18:02:02.877575] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-10-15T18:02:02.953435] [DEBUG] [VALIDATOR ] CIEN: All expected trading days are present. [2025-10-15T18:02:02.953527] [DEBUG] [VALIDATOR ] CIEN: Primary data validation passed. [2025-10-15T18:02:02.954377] [INFO ] [MAIN ] CIEN: Fetched primary data is valid. [2025-10-15T18:02:02.954448] [DEBUG] [LOCAL ] CIEN: Saving primary data. [2025-10-15T18:02:02.955958] [DEBUG] [LOCAL ] CIEN: Trimmed 75782 records to 52151 (keeping 200 days of data) [2025-10-15T18:02:03.259573] [DEBUG] [LOCAL ] CIEN: Primary data saved (52151 records). [2025-10-15T18:02:03.259743] [INFO ] [MAIN ] CIEN: Full history saved. [2025-10-15T18:02:03.260064] [INFO ] [MAIN ] Update Progress: 451/2369 symbols completed. CIEN took 57.8s. Estimated remaining: 4h 23m 35s. Rate: 7.3 symbols/min [2025-10-15T18:02:03.323250] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-01. [2025-10-15T18:02:03.433551] [INFO ] [MAIN ] CIMP: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:02:03.433769] [DEBUG] [LOCAL ] CIMP: No existing data file found in primary storage. [2025-10-15T18:02:03.433861] [WARN ] [MAIN ] CIMP: No existing data found, performing full refresh instead. [2025-10-15T18:02:03.433974] [INFO ] [MAIN ] CIMP: Wiping existing primary data before full refresh. [2025-10-15T18:02:03.434017] [INFO ] [LOCAL ] CIMP: Starting deletion of primary data. [2025-10-15T18:02:03.434059] [DEBUG] [LOCAL ] CIMP: No primary data file found to delete. [2025-10-15T18:02:03.434092] [INFO ] [MAIN ] CIMP: Starting full primary refresh. [2025-10-15T18:02:03.538172] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-10-15T18:02:03.800322] [INFO ] [REMOTE ] CIMP: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:02:03.917163] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-15T18:02:04.114002] [INFO ] [REMOTE ] CIMP: Fetching primary data for 2024-12. [2025-10-15T18:02:04.350665] [DEBUG] [REMOTE ] CIMP: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-15T18:02:04.351046] [WARN ] [REMOTE ] CIMP: No data returned for month 2024-12 [2025-10-15T18:02:04.351163] [FATAL] [REMOTE ] CIMP: API call failed - aborting fetch to avoid wasting further API calls [2025-10-15T18:02:04.351216] [FATAL] [MAIN ] CIMP: Failed to fetch primary data. [2025-10-15T18:02:04.351309] [WARN ] [MAIN ] CIMP: Deleting existing primary and derivative data due to fetch failure. [2025-10-15T18:02:04.351392] [INFO ] [LOCAL ] CIMP: Starting deletion of primary data. [2025-10-15T18:02:04.351494] [DEBUG] [LOCAL ] CIMP: No primary data file found to delete. [2025-10-15T18:02:04.351789] [INFO ] [LOCAL ] CIMP: Starting deletion of derivative data. [2025-10-15T18:02:04.351862] [DEBUG] [LOCAL ] CIMP: No derivative data file found to delete. [2025-10-15T18:02:04.351938] [INFO ] [MAIN ] Update Progress: 452/2369 symbols completed. CIMP took 1.1s. Estimated remaining: 4h 22m 56s. Rate: 7.3 symbols/min [2025-10-15T18:02:04.555073] [INFO ] [MAIN ] CINT: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:02:04.575625] [DEBUG] [LOCAL ] CINT: Loaded 19941 existing records from primary storage. [2025-10-15T18:02:04.575918] [INFO ] [MAIN ] CINT: Loaded 19941 existing records. [2025-10-15T18:02:04.751374] [WARN ] [MAIN ] CINT: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:02:04.751588] [INFO ] [MAIN ] CINT: Wiping existing primary data before full refresh. [2025-10-15T18:02:04.751636] [INFO ] [LOCAL ] CINT: Starting deletion of primary data. [2025-10-15T18:02:04.751837] [DEBUG] [LOCAL ] CINT: Deleted primary data file. [2025-10-15T18:02:04.751878] [INFO ] [MAIN ] CINT: Starting full primary refresh. [2025-10-15T18:02:04.921057] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-02. [2025-10-15T18:02:05.109016] [INFO ] [REMOTE ] CINT: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:02:05.713991] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-02. [2025-10-15T18:02:06.031931] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-02 (0.32 seconds). [2025-10-15T18:02:06.375297] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-15T18:02:06.514055] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-03. [2025-10-15T18:02:06.968708] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-10-15T18:02:07.314004] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-04. [2025-10-15T18:02:07.873003] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-10-15T18:02:08.114004] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-03. [2025-10-15T18:02:08.914006] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-05. [2025-10-15T18:02:09.133717] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-15T18:02:09.200318] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-05 (0.29 seconds). [2025-10-15T18:02:09.714042] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-06. [2025-10-15T18:02:10.000476] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-06 (0.29 seconds). [2025-10-15T18:02:10.513999] [INFO ] [REMOTE ] CINT: Fetching primary data for 2024-12. [2025-10-15T18:02:11.200211] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-10-15T18:02:11.314046] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-01. [2025-10-15T18:02:12.113977] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-04. [2025-10-15T18:02:12.150868] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-15T18:02:12.913997] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-01. [2025-10-15T18:02:13.714034] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-07. [2025-10-15T18:02:13.790536] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-15T18:02:13.794620] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-15T18:02:14.249394] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-10-15T18:02:14.514017] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-02. [2025-10-15T18:02:15.064016] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-15T18:02:15.313990] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-03. [2025-10-15T18:02:15.820732] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-10-15T18:02:16.114031] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-08. [2025-10-15T18:02:16.635847] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-10-15T18:02:16.913997] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-05. [2025-10-15T18:02:17.713996] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-09. [2025-10-15T18:02:18.208306] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-10-15T18:02:18.351546] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-15T18:02:18.514059] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-10. [2025-10-15T18:02:19.021162] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-15T18:02:19.022157] [INFO ] [REMOTE ] CIMO: Full fetch complete (4861 records). [2025-10-15T18:02:19.022224] [DEBUG] [VALIDATOR ] CIMO: Validating primary data. [2025-10-15T18:02:19.022576] [FATAL] [VALIDATOR ] CIMO: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T18:02:19.022695] [FATAL] [MAIN ] CIMO: Fetched primary data is invalid. Refusing to save it. [2025-10-15T18:02:19.022750] [WARN ] [MAIN ] CIMO: Deleting existing primary and derivative data due to validation failure. [2025-10-15T18:02:19.022795] [INFO ] [LOCAL ] CIMO: Starting deletion of primary data. [2025-10-15T18:02:19.022852] [DEBUG] [LOCAL ] CIMO: No primary data file found to delete. [2025-10-15T18:02:19.022886] [INFO ] [LOCAL ] CIMO: Starting deletion of derivative data. [2025-10-15T18:02:19.022925] [DEBUG] [LOCAL ] CIMO: No derivative data file found to delete. [2025-10-15T18:02:19.022977] [INFO ] [MAIN ] Update Progress: 453/2369 symbols completed. CIMO took 17.9s. Estimated remaining: 4h 23m 15s. Rate: 7.3 symbols/min [2025-10-15T18:02:19.192736] [INFO ] [MAIN ] CIO: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:02:19.211994] [DEBUG] [LOCAL ] CIO: Loaded 20780 existing records from primary storage. [2025-10-15T18:02:19.212215] [INFO ] [MAIN ] CIO: Loaded 20780 existing records. [2025-10-15T18:02:19.319106] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-06. [2025-10-15T18:02:19.391189] [WARN ] [MAIN ] CIO: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:02:19.391419] [INFO ] [MAIN ] CIO: Wiping existing primary data before full refresh. [2025-10-15T18:02:19.391467] [INFO ] [LOCAL ] CIO: Starting deletion of primary data. [2025-10-15T18:02:19.391721] [DEBUG] [LOCAL ] CIO: Deleted primary data file. [2025-10-15T18:02:19.391779] [INFO ] [MAIN ] CIO: Starting full primary refresh. [2025-10-15T18:02:19.786242] [INFO ] [REMOTE ] CIO: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:02:20.114019] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-04. [2025-10-15T18:02:20.487825] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-04 (0.37 seconds). [2025-10-15T18:02:20.914040] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-02. [2025-10-15T18:02:21.713993] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-05. [2025-10-15T18:02:21.854783] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-15T18:02:22.050073] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-10-15T18:02:22.513977] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-06. [2025-10-15T18:02:22.952701] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-10-15T18:02:23.313974] [INFO ] [REMOTE ] CIO: Fetching primary data for 2024-12. [2025-10-15T18:02:23.887144] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-06 (4.57 seconds). [2025-10-15T18:02:24.113998] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-07. [2025-10-15T18:02:24.146122] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-10-15T18:02:24.914015] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-01. [2025-10-15T18:02:25.129292] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-15T18:02:25.713986] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-08. [2025-10-15T18:02:25.961110] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-15T18:02:26.513992] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-07. [2025-10-15T18:02:27.018884] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-15T18:02:27.031461] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-10-15T18:02:27.314002] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-03. [2025-10-15T18:02:27.947089] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-15T18:02:28.113998] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-09. [2025-10-15T18:02:28.914013] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-02. [2025-10-15T18:02:29.713970] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-04. [2025-10-15T18:02:29.760113] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-15T18:02:30.514034] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-03. [2025-10-15T18:02:31.002207] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-09 (2.89 seconds). [2025-10-15T18:02:31.313976] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-10. [2025-10-15T18:02:31.377062] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-15T18:02:31.638796] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-15T18:02:32.114008] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-08. [2025-10-15T18:02:32.550810] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-10-15T18:02:32.834307] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-15T18:02:32.839968] [INFO ] [REMOTE ] CIM: Full fetch complete (55067 records). [2025-10-15T18:02:32.840152] [DEBUG] [VALIDATOR ] CIM: Validating primary data. [2025-10-15T18:02:32.919179] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-09. [2025-10-15T18:02:33.260276] [DEBUG] [VALIDATOR ] CIM: All expected trading days are present. [2025-10-15T18:02:33.260399] [DEBUG] [VALIDATOR ] CIM: Primary data validation passed. [2025-10-15T18:02:33.261980] [INFO ] [MAIN ] CIM: Fetched primary data is valid. [2025-10-15T18:02:33.262051] [DEBUG] [LOCAL ] CIM: Saving primary data. [2025-10-15T18:02:33.263793] [DEBUG] [LOCAL ] CIM: Trimmed 55067 records to 37688 (keeping 200 days of data) [2025-10-15T18:02:33.373306] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-10-15T18:02:33.542189] [DEBUG] [LOCAL ] CIM: Primary data saved (37688 records). [2025-10-15T18:02:33.542420] [INFO ] [MAIN ] CIM: Full history saved. [2025-10-15T18:02:33.543318] [INFO ] [MAIN ] Update Progress: 454/2369 symbols completed. CIM took 40.4s. Estimated remaining: 4h 23m 34s. Rate: 7.3 symbols/min [2025-10-15T18:02:33.724114] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-04. [2025-10-15T18:02:33.728206] [INFO ] [MAIN ] CION: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:02:33.729618] [DEBUG] [LOCAL ] CION: No existing data file found in primary storage. [2025-10-15T18:02:33.729700] [WARN ] [MAIN ] CION: No existing data found, performing full refresh instead. [2025-10-15T18:02:33.729820] [INFO ] [MAIN ] CION: Wiping existing primary data before full refresh. [2025-10-15T18:02:33.729864] [INFO ] [LOCAL ] CION: Starting deletion of primary data. [2025-10-15T18:02:33.729907] [DEBUG] [LOCAL ] CION: No primary data file found to delete. [2025-10-15T18:02:33.729941] [INFO ] [MAIN ] CION: Starting full primary refresh. [2025-10-15T18:02:34.086244] [INFO ] [REMOTE ] CION: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:02:34.513979] [INFO ] [REMOTE ] CION: Fetching primary data for 2024-12. [2025-10-15T18:02:34.916440] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-15T18:02:35.314028] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-05. [2025-10-15T18:02:35.457369] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-10-15T18:02:36.113977] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-10. [2025-10-15T18:02:36.236233] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-15T18:02:36.620123] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-15T18:02:36.621093] [INFO ] [REMOTE ] CIMN: Full fetch complete (3917 records). [2025-10-15T18:02:36.621161] [DEBUG] [VALIDATOR ] CIMN: Validating primary data. [2025-10-15T18:02:36.927804] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-05. [2025-10-15T18:02:36.968119] [DEBUG] [VALIDATOR ] CIMN: All expected trading days are present. [2025-10-15T18:02:36.968199] [DEBUG] [VALIDATOR ] CIMN: Primary data validation passed. [2025-10-15T18:02:36.968342] [INFO ] [MAIN ] CIMN: Fetched primary data is valid. [2025-10-15T18:02:36.968381] [DEBUG] [LOCAL ] CIMN: Saving primary data. [2025-10-15T18:02:36.968894] [DEBUG] [LOCAL ] CIMN: Trimmed 3917 records to 2756 (keeping 200 days of data) [2025-10-15T18:02:36.985321] [DEBUG] [LOCAL ] CIMN: Primary data saved (2756 records). [2025-10-15T18:02:36.985446] [INFO ] [MAIN ] CIMN: Full history saved. [2025-10-15T18:02:36.985573] [INFO ] [MAIN ] Update Progress: 455/2369 symbols completed. CIMN took 35.9s. Estimated remaining: 4h 23m 5s. Rate: 7.3 symbols/min [2025-10-15T18:02:37.154952] [INFO ] [MAIN ] CIVI: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:02:37.202693] [DEBUG] [LOCAL ] CIVI: Loaded 52673 existing records from primary storage. [2025-10-15T18:02:37.203004] [INFO ] [MAIN ] CIVI: Loaded 52673 existing records. [2025-10-15T18:02:37.375955] [WARN ] [MAIN ] CIVI: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:02:37.376225] [INFO ] [MAIN ] CIVI: Wiping existing primary data before full refresh. [2025-10-15T18:02:37.376270] [INFO ] [LOCAL ] CIVI: Starting deletion of primary data. [2025-10-15T18:02:37.376605] [DEBUG] [LOCAL ] CIVI: Deleted primary data file. [2025-10-15T18:02:37.376702] [INFO ] [MAIN ] CIVI: Starting full primary refresh. [2025-10-15T18:02:37.721145] [INFO ] [REMOTE ] CIVI: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:02:37.716611] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-06. [2025-10-15T18:02:37.906840] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-15T18:02:38.514075] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-01. [2025-10-15T18:02:38.716014] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-15T18:02:39.243842] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-15T18:02:39.313993] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-02. [2025-10-15T18:02:40.113999] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-06. [2025-10-15T18:02:40.287354] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-15T18:02:40.914054] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-03. [2025-10-15T18:02:41.066952] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-15T18:02:41.714062] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-07. [2025-10-15T18:02:42.215423] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-15T18:02:42.425770] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-15T18:02:42.514019] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-04. [2025-10-15T18:02:43.314031] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-08. [2025-10-15T18:02:43.937480] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-15T18:02:44.113991] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2024-12. [2025-10-15T18:02:44.771560] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-15T18:02:44.914056] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-05. [2025-10-15T18:02:45.713988] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-07. [2025-10-15T18:02:45.922798] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-15T18:02:46.513971] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-06. [2025-10-15T18:02:46.627337] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2024-12 (2.51 seconds). [2025-10-15T18:02:46.900482] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-15T18:02:47.313968] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-09. [2025-10-15T18:02:47.492806] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-15T18:02:48.101911] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-15T18:02:48.113961] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-10. [2025-10-15T18:02:48.914049] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-01. [2025-10-15T18:02:49.254580] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-15T18:02:49.259461] [INFO ] [REMOTE ] CINT: Full fetch complete (27835 records). [2025-10-15T18:02:49.259620] [DEBUG] [VALIDATOR ] CINT: Validating primary data. [2025-10-15T18:02:49.260324] [FATAL] [VALIDATOR ] CINT: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T18:02:49.260445] [FATAL] [MAIN ] CINT: Fetched primary data is invalid. Refusing to save it. [2025-10-15T18:02:49.260508] [WARN ] [MAIN ] CINT: Deleting existing primary and derivative data due to validation failure. [2025-10-15T18:02:49.260587] [INFO ] [LOCAL ] CINT: Starting deletion of primary data. [2025-10-15T18:02:49.260702] [DEBUG] [LOCAL ] CINT: No primary data file found to delete. [2025-10-15T18:02:49.260776] [INFO ] [LOCAL ] CINT: Starting deletion of derivative data. [2025-10-15T18:02:49.260986] [DEBUG] [LOCAL ] CINT: Deleted derivative data file. [2025-10-15T18:02:49.261103] [INFO ] [MAIN ] Update Progress: 456/2369 symbols completed. CINT took 44.9s. Estimated remaining: 4h 23m 14s. Rate: 7.3 symbols/min [2025-10-15T18:02:49.449846] [INFO ] [MAIN ] CL: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:02:49.450022] [DEBUG] [LOCAL ] CL: No existing data file found in primary storage. [2025-10-15T18:02:49.450059] [WARN ] [MAIN ] CL: No existing data found, performing full refresh instead. [2025-10-15T18:02:49.450174] [INFO ] [MAIN ] CL: Wiping existing primary data before full refresh. [2025-10-15T18:02:49.450238] [INFO ] [LOCAL ] CL: Starting deletion of primary data. [2025-10-15T18:02:49.450281] [DEBUG] [LOCAL ] CL: No primary data file found to delete. [2025-10-15T18:02:49.450313] [INFO ] [MAIN ] CL: Starting full primary refresh. [2025-10-15T18:02:49.724211] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-08. [2025-10-15T18:02:49.876230] [INFO ] [REMOTE ] CL: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:02:50.377363] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-15T18:02:50.514041] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-02. [2025-10-15T18:02:50.989918] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-15T18:02:51.314037] [INFO ] [REMOTE ] CL: Fetching primary data for 2024-12. [2025-10-15T18:02:51.910076] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-15T18:02:52.114034] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-07. [2025-10-15T18:02:52.913979] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-09. [2025-10-15T18:02:53.015986] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-15T18:02:53.139800] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-15T18:02:53.626014] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-15T18:02:53.713958] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-10. [2025-10-15T18:02:54.514036] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-08. [2025-10-15T18:02:54.581432] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-15T18:02:54.585210] [INFO ] [REMOTE ] CIO: Full fetch complete (29327 records). [2025-10-15T18:02:54.585349] [DEBUG] [VALIDATOR ] CIO: Validating primary data. [2025-10-15T18:02:54.586072] [FATAL] [VALIDATOR ] CIO: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T18:02:54.586167] [FATAL] [MAIN ] CIO: Fetched primary data is invalid. Refusing to save it. [2025-10-15T18:02:54.586212] [WARN ] [MAIN ] CIO: Deleting existing primary and derivative data due to validation failure. [2025-10-15T18:02:54.586255] [INFO ] [LOCAL ] CIO: Starting deletion of primary data. [2025-10-15T18:02:54.586322] [DEBUG] [LOCAL ] CIO: No primary data file found to delete. [2025-10-15T18:02:54.586364] [INFO ] [LOCAL ] CIO: Starting deletion of derivative data. [2025-10-15T18:02:54.586769] [DEBUG] [LOCAL ] CIO: Deleted derivative data file. [2025-10-15T18:02:54.587097] [INFO ] [MAIN ] Update Progress: 457/2369 symbols completed. CIO took 35.6s. Estimated remaining: 4h 22m 53s. Rate: 7.3 symbols/min [2025-10-15T18:02:54.780588] [INFO ] [MAIN ] CLB: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:02:54.822506] [DEBUG] [LOCAL ] CLB: Loaded 33361 existing records from primary storage. [2025-10-15T18:02:54.822930] [INFO ] [MAIN ] CLB: Loaded 33361 existing records. [2025-10-15T18:02:55.033798] [WARN ] [MAIN ] CLB: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:02:55.034133] [INFO ] [MAIN ] CLB: Wiping existing primary data before full refresh. [2025-10-15T18:02:55.034195] [INFO ] [LOCAL ] CLB: Starting deletion of primary data. [2025-10-15T18:02:55.034749] [DEBUG] [LOCAL ] CLB: Deleted primary data file. [2025-10-15T18:02:55.035012] [INFO ] [MAIN ] CLB: Starting full primary refresh. [2025-10-15T18:02:55.315254] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-01. [2025-10-15T18:02:55.435840] [INFO ] [REMOTE ] CLB: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:02:55.557667] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-15T18:02:56.114011] [INFO ] [REMOTE ] CLB: Fetching primary data for 2024-12. [2025-10-15T18:02:56.914028] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-09. [2025-10-15T18:02:57.020156] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-15T18:02:57.204685] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-15T18:02:57.714014] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-01. [2025-10-15T18:02:58.180462] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-15T18:02:58.513968] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-02. [2025-10-15T18:02:58.643917] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-15T18:02:59.314049] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-03. [2025-10-15T18:03:00.114045] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-10. [2025-10-15T18:03:00.699762] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-02 (2.19 seconds). [2025-10-15T18:03:00.914015] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-03. [2025-10-15T18:03:01.018472] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-15T18:03:01.021976] [INFO ] [REMOTE ] CION: Full fetch complete (40426 records). [2025-10-15T18:03:01.022189] [DEBUG] [VALIDATOR ] CION: Validating primary data. [2025-10-15T18:03:01.023029] [FATAL] [VALIDATOR ] CION: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T18:03:01.023135] [FATAL] [MAIN ] CION: Fetched primary data is invalid. Refusing to save it. [2025-10-15T18:03:01.023273] [WARN ] [MAIN ] CION: Deleting existing primary and derivative data due to validation failure. [2025-10-15T18:03:01.023379] [INFO ] [LOCAL ] CION: Starting deletion of primary data. [2025-10-15T18:03:01.023477] [DEBUG] [LOCAL ] CION: No primary data file found to delete. [2025-10-15T18:03:01.023536] [INFO ] [LOCAL ] CION: Starting deletion of derivative data. [2025-10-15T18:03:01.023583] [DEBUG] [LOCAL ] CION: No derivative data file found to delete. [2025-10-15T18:03:01.023670] [INFO ] [MAIN ] Update Progress: 458/2369 symbols completed. CION took 27.5s. Estimated remaining: 4h 22m 37s. Rate: 7.3 symbols/min [2025-10-15T18:03:01.201571] [INFO ] [MAIN ] CLCO: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:03:01.201869] [DEBUG] [LOCAL ] CLCO: No existing data file found in primary storage. [2025-10-15T18:03:01.201968] [WARN ] [MAIN ] CLCO: No existing data found, performing full refresh instead. [2025-10-15T18:03:01.202169] [INFO ] [MAIN ] CLCO: Wiping existing primary data before full refresh. [2025-10-15T18:03:01.202281] [INFO ] [LOCAL ] CLCO: Starting deletion of primary data. [2025-10-15T18:03:01.202365] [DEBUG] [LOCAL ] CLCO: No primary data file found to delete. [2025-10-15T18:03:01.202420] [INFO ] [MAIN ] CLCO: Starting full primary refresh. [2025-10-15T18:03:01.360400] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-10-15T18:03:01.652836] [INFO ] [REMOTE ] CLCO: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:03:01.714069] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-02. [2025-10-15T18:03:02.514188] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2024-12. [2025-10-15T18:03:02.848866] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-15T18:03:02.911702] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-15T18:03:03.314005] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-04. [2025-10-15T18:03:03.797285] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-15T18:03:04.114037] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-01. [2025-10-15T18:03:04.802340] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-15T18:03:04.881782] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-15T18:03:04.913955] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-05. [2025-10-15T18:03:05.714008] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-02. [2025-10-15T18:03:06.514028] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-04. [2025-10-15T18:03:06.649620] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-15T18:03:06.670520] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-15T18:03:07.314034] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-03. [2025-10-15T18:03:08.114042] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-06. [2025-10-15T18:03:08.289865] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-15T18:03:08.315770] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-15T18:03:08.914017] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-03. [2025-10-15T18:03:09.713977] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-04. [2025-10-15T18:03:09.974180] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-15T18:03:10.156446] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-15T18:03:10.513972] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-04. [2025-10-15T18:03:10.625157] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-15T18:03:11.313999] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-07. [2025-10-15T18:03:12.121389] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-05. [2025-10-15T18:03:12.137590] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-15T18:03:12.867082] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-15T18:03:12.913962] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-08. [2025-10-15T18:03:13.713990] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-05. [2025-10-15T18:03:14.156931] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-10-15T18:03:14.364921] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-15T18:03:14.514011] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-09. [2025-10-15T18:03:14.615339] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-15T18:03:15.314114] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-06. [2025-10-15T18:03:16.114003] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-06. [2025-10-15T18:03:16.448619] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-15T18:03:16.478592] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-15T18:03:16.914046] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-05. [2025-10-15T18:03:17.483335] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-15T18:03:17.713977] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-10. [2025-10-15T18:03:18.030347] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-10-15T18:03:18.235711] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-15T18:03:18.241739] [INFO ] [REMOTE ] CL: Full fetch complete (77414 records). [2025-10-15T18:03:18.241910] [DEBUG] [VALIDATOR ] CL: Validating primary data. [2025-10-15T18:03:18.242764] [FATAL] [VALIDATOR ] CL: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T18:03:18.242877] [FATAL] [MAIN ] CL: Fetched primary data is invalid. Refusing to save it. [2025-10-15T18:03:18.242921] [WARN ] [MAIN ] CL: Deleting existing primary and derivative data due to validation failure. [2025-10-15T18:03:18.242988] [INFO ] [LOCAL ] CL: Starting deletion of primary data. [2025-10-15T18:03:18.243053] [DEBUG] [LOCAL ] CL: No primary data file found to delete. [2025-10-15T18:03:18.243093] [INFO ] [LOCAL ] CL: Starting deletion of derivative data. [2025-10-15T18:03:18.243175] [DEBUG] [LOCAL ] CL: No derivative data file found to delete. [2025-10-15T18:03:18.243263] [INFO ] [MAIN ] Update Progress: 459/2369 symbols completed. CL took 29.0s. Estimated remaining: 4h 23m 6s. Rate: 7.3 symbols/min [2025-10-15T18:03:18.414748] [INFO ] [MAIN ] CLDT: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:03:18.438402] [DEBUG] [LOCAL ] CLDT: Loaded 25439 existing records from primary storage. [2025-10-15T18:03:18.438681] [INFO ] [MAIN ] CLDT: Loaded 25439 existing records. [2025-10-15T18:03:18.519146] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-06. [2025-10-15T18:03:18.616298] [WARN ] [MAIN ] CLDT: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:03:18.616482] [INFO ] [MAIN ] CLDT: Wiping existing primary data before full refresh. [2025-10-15T18:03:18.616528] [INFO ] [LOCAL ] CLDT: Starting deletion of primary data. [2025-10-15T18:03:18.617086] [DEBUG] [LOCAL ] CLDT: Deleted primary data file. [2025-10-15T18:03:18.617143] [INFO ] [MAIN ] CLDT: Starting full primary refresh. [2025-10-15T18:03:18.966156] [INFO ] [REMOTE ] CLDT: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:03:19.234974] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-15T18:03:19.313958] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-07. [2025-10-15T18:03:19.817918] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-10-15T18:03:20.113991] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-07. [2025-10-15T18:03:20.914004] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-07. [2025-10-15T18:03:21.713998] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2024-12. [2025-10-15T18:03:21.798092] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-15T18:03:22.073412] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-15T18:03:22.514038] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-08. [2025-10-15T18:03:22.713271] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-10-15T18:03:23.313971] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-01. [2025-10-15T18:03:24.114007] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-08. [2025-10-15T18:03:24.140024] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-15T18:03:24.258052] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-15T18:03:24.914034] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-08. [2025-10-15T18:03:24.922503] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-15T18:03:25.714024] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-09. [2025-10-15T18:03:25.873212] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-15T18:03:26.514005] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-09. [2025-10-15T18:03:26.966571] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-15T18:03:27.314004] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-09. [2025-10-15T18:03:27.523352] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-15T18:03:28.113978] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-02. [2025-10-15T18:03:28.225691] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-15T18:03:28.914061] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-10. [2025-10-15T18:03:29.067977] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-15T18:03:29.713995] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-10. [2025-10-15T18:03:30.241903] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-15T18:03:30.246142] [INFO ] [REMOTE ] CLB: Full fetch complete (47047 records). [2025-10-15T18:03:30.246232] [DEBUG] [VALIDATOR ] CLB: Validating primary data. [2025-10-15T18:03:30.521802] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-03. [2025-10-15T18:03:30.628048] [DEBUG] [VALIDATOR ] CLB: All expected trading days are present. [2025-10-15T18:03:30.628157] [DEBUG] [VALIDATOR ] CLB: Primary data validation passed. [2025-10-15T18:03:30.629097] [INFO ] [MAIN ] CLB: Fetched primary data is valid. [2025-10-15T18:03:30.629172] [DEBUG] [LOCAL ] CLB: Saving primary data. [2025-10-15T18:03:30.630558] [DEBUG] [LOCAL ] CLB: Trimmed 47047 records to 33430 (keeping 200 days of data) [2025-10-15T18:03:30.827501] [DEBUG] [LOCAL ] CLB: Primary data saved (33430 records). [2025-10-15T18:03:30.827675] [INFO ] [MAIN ] CLB: Full history saved. [2025-10-15T18:03:30.827793] [INFO ] [MAIN ] Update Progress: 460/2369 symbols completed. CLB took 36.2s. Estimated remaining: 4h 23m 16s. Rate: 7.3 symbols/min [2025-10-15T18:03:31.035154] [INFO ] [MAIN ] CLF: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:03:31.035340] [DEBUG] [LOCAL ] CLF: No existing data file found in primary storage. [2025-10-15T18:03:31.035379] [WARN ] [MAIN ] CLF: No existing data found, performing full refresh instead. [2025-10-15T18:03:31.035490] [INFO ] [MAIN ] CLF: Wiping existing primary data before full refresh. [2025-10-15T18:03:31.035534] [INFO ] [LOCAL ] CLF: Starting deletion of primary data. [2025-10-15T18:03:31.035578] [DEBUG] [LOCAL ] CLF: No primary data file found to delete. [2025-10-15T18:03:31.035613] [INFO ] [MAIN ] CLF: Starting full primary refresh. [2025-10-15T18:03:31.313989] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-10. [2025-10-15T18:03:31.399388] [INFO ] [REMOTE ] CLF: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:03:31.419072] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-15T18:03:31.425886] [INFO ] [REMOTE ] CIVI: Full fetch complete (75966 records). [2025-10-15T18:03:31.426046] [DEBUG] [VALIDATOR ] CIVI: Validating primary data. [2025-10-15T18:03:31.827000] [DEBUG] [VALIDATOR ] CIVI: All expected trading days are present. [2025-10-15T18:03:31.827176] [DEBUG] [VALIDATOR ] CIVI: Primary data validation passed. [2025-10-15T18:03:31.828435] [INFO ] [MAIN ] CIVI: Fetched primary data is valid. [2025-10-15T18:03:31.828745] [DEBUG] [LOCAL ] CIVI: Saving primary data. [2025-10-15T18:03:31.830372] [DEBUG] [LOCAL ] CIVI: Trimmed 75966 records to 52699 (keeping 200 days of data) [2025-10-15T18:03:31.943147] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-15T18:03:32.129283] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-04. [2025-10-15T18:03:32.170769] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-15T18:03:32.175665] [INFO ] [REMOTE ] CLCO: Full fetch complete (22908 records). [2025-10-15T18:03:32.176535] [DEBUG] [VALIDATOR ] CLCO: Validating primary data. [2025-10-15T18:03:32.267583] [DEBUG] [LOCAL ] CIVI: Primary data saved (52699 records). [2025-10-15T18:03:32.286030] [INFO ] [MAIN ] CIVI: Full history saved. [2025-10-15T18:03:32.288320] [INFO ] [MAIN ] Update Progress: 461/2369 symbols completed. CIVI took 55.3s. Estimated remaining: 4h 22m 40s. Rate: 7.3 symbols/min [2025-10-15T18:03:32.748713] [INFO ] [MAIN ] CLH: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:03:32.759291] [DEBUG] [LOCAL ] CLH: No existing data file found in primary storage. [2025-10-15T18:03:32.769733] [WARN ] [MAIN ] CLH: No existing data found, performing full refresh instead. [2025-10-15T18:03:32.806076] [INFO ] [MAIN ] CLH: Wiping existing primary data before full refresh. [2025-10-15T18:03:32.806974] [INFO ] [LOCAL ] CLH: Starting deletion of primary data. [2025-10-15T18:03:32.832172] [DEBUG] [VALIDATOR ] CLCO: All expected trading days are present. [2025-10-15T18:03:32.832013] [DEBUG] [LOCAL ] CLH: No primary data file found to delete. [2025-10-15T18:03:32.832279] [INFO ] [MAIN ] CLH: Starting full primary refresh. [2025-10-15T18:03:32.832333] [DEBUG] [VALIDATOR ] CLCO: Primary data validation passed. [2025-10-15T18:03:32.863473] [INFO ] [MAIN ] CLCO: Fetched primary data is valid. [2025-10-15T18:03:32.894723] [DEBUG] [LOCAL ] CLCO: Saving primary data. [2025-10-15T18:03:32.921252] [INFO ] [REMOTE ] CLF: Fetching primary data for 2024-12. [2025-10-15T18:03:32.933458] [DEBUG] [LOCAL ] CLCO: Trimmed 22908 records to 13176 (keeping 200 days of data) [2025-10-15T18:03:33.184124] [DEBUG] [LOCAL ] CLCO: Primary data saved (13176 records). [2025-10-15T18:03:33.196514] [INFO ] [MAIN ] CLCO: Full history saved. [2025-10-15T18:03:33.207367] [INFO ] [MAIN ] Update Progress: 462/2369 symbols completed. CLCO took 32.2s. Estimated remaining: 4h 22m 1s. Rate: 7.3 symbols/min [2025-10-15T18:03:33.444988] [INFO ] [REMOTE ] CLH: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:03:33.469489] [INFO ] [MAIN ] CLPR: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:03:33.469738] [DEBUG] [LOCAL ] CLPR: No existing data file found in primary storage. [2025-10-15T18:03:33.470018] [WARN ] [MAIN ] CLPR: No existing data found, performing full refresh instead. [2025-10-15T18:03:33.470143] [INFO ] [MAIN ] CLPR: Wiping existing primary data before full refresh. [2025-10-15T18:03:33.470196] [INFO ] [LOCAL ] CLPR: Starting deletion of primary data. [2025-10-15T18:03:33.470239] [DEBUG] [LOCAL ] CLPR: No primary data file found to delete. [2025-10-15T18:03:33.470271] [INFO ] [MAIN ] CLPR: Starting full primary refresh. [2025-10-15T18:03:33.718474] [INFO ] [REMOTE ] CLH: Fetching primary data for 2024-12. [2025-10-15T18:03:33.784624] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-15T18:03:33.857632] [INFO ] [REMOTE ] CLPR: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:03:34.513967] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2024-12. [2025-10-15T18:03:34.886249] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-15T18:03:34.989565] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2024-12 (2.07 seconds). [2025-10-15T18:03:35.313976] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-05. [2025-10-15T18:03:35.531994] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-15T18:03:36.114033] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-01. [2025-10-15T18:03:36.196585] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-15T18:03:36.688228] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-15T18:03:36.913997] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-01. [2025-10-15T18:03:37.713991] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-01. [2025-10-15T18:03:38.514003] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-02. [2025-10-15T18:03:38.845025] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-10-15T18:03:39.037942] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-10-15T18:03:39.066080] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-15T18:03:39.314052] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-02. [2025-10-15T18:03:40.114030] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-02. [2025-10-15T18:03:40.201027] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-15T18:03:40.913986] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-06. [2025-10-15T18:03:41.701621] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-15T18:03:41.713993] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-03. [2025-10-15T18:03:41.992592] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-10-15T18:03:42.514060] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-03. [2025-10-15T18:03:42.694212] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-15T18:03:43.314076] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-04. [2025-10-15T18:03:44.114004] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-07. [2025-10-15T18:03:44.248191] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-15T18:03:44.841098] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-15T18:03:44.914010] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-05. [2025-10-15T18:03:45.211153] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-15T18:03:45.713993] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-04. [2025-10-15T18:03:46.095814] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-15T18:03:46.513999] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-06. [2025-10-15T18:03:47.313973] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-03. [2025-10-15T18:03:47.629788] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-15T18:03:47.692682] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-15T18:03:48.114030] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-07. [2025-10-15T18:03:48.318571] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-15T18:03:48.913966] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-05. [2025-10-15T18:03:48.964625] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-15T18:03:49.714043] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-08. [2025-10-15T18:03:50.514008] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-04. [2025-10-15T18:03:50.714154] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-15T18:03:50.894440] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-15T18:03:51.068726] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-10-15T18:03:51.314005] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-09. [2025-10-15T18:03:52.113986] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-08. [2025-10-15T18:03:52.510269] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-15T18:03:52.913987] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-06. [2025-10-15T18:03:53.004892] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-15T18:03:53.714040] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-09. [2025-10-15T18:03:54.513954] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-05. [2025-10-15T18:03:54.538215] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-15T18:03:55.170567] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-06 (2.26 seconds). [2025-10-15T18:03:55.308145] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-15T18:03:55.313944] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-06. [2025-10-15T18:03:55.779510] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-10-15T18:03:56.114041] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-07. [2025-10-15T18:03:56.830034] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-15T18:03:56.914026] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-10. [2025-10-15T18:03:57.713988] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-08. [2025-10-15T18:03:58.059763] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-15T18:03:58.063494] [INFO ] [REMOTE ] CLDT: Full fetch complete (37360 records). [2025-10-15T18:03:58.063678] [DEBUG] [VALIDATOR ] CLDT: Validating primary data. [2025-10-15T18:03:58.477723] [DEBUG] [VALIDATOR ] CLDT: All expected trading days are present. [2025-10-15T18:03:58.477813] [DEBUG] [VALIDATOR ] CLDT: Primary data validation passed. [2025-10-15T18:03:58.478400] [INFO ] [MAIN ] CLDT: Fetched primary data is valid. [2025-10-15T18:03:58.478441] [DEBUG] [LOCAL ] CLDT: Saving primary data. [2025-10-15T18:03:58.479398] [DEBUG] [LOCAL ] CLDT: Trimmed 37360 records to 25429 (keeping 200 days of data) [2025-10-15T18:03:58.531875] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-10. [2025-10-15T18:03:58.633864] [DEBUG] [LOCAL ] CLDT: Primary data saved (25429 records). [2025-10-15T18:03:58.634001] [INFO ] [MAIN ] CLDT: Full history saved. [2025-10-15T18:03:58.634101] [INFO ] [MAIN ] Update Progress: 463/2369 symbols completed. CLDT took 40.4s. Estimated remaining: 4h 23m 4s. Rate: 7.2 symbols/min [2025-10-15T18:03:58.754784] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-15T18:03:58.815726] [INFO ] [MAIN ] CLS: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:03:58.866535] [DEBUG] [LOCAL ] CLS: Loaded 53583 existing records from primary storage. [2025-10-15T18:03:58.866888] [INFO ] [MAIN ] CLS: Loaded 53583 existing records. [2025-10-15T18:03:59.038983] [WARN ] [MAIN ] CLS: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:03:59.039199] [INFO ] [MAIN ] CLS: Wiping existing primary data before full refresh. [2025-10-15T18:03:59.039259] [INFO ] [LOCAL ] CLS: Starting deletion of primary data. [2025-10-15T18:03:59.039670] [DEBUG] [LOCAL ] CLS: Deleted primary data file. [2025-10-15T18:03:59.039725] [INFO ] [MAIN ] CLS: Starting full primary refresh. [2025-10-15T18:03:59.314843] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-07. [2025-10-15T18:03:59.394734] [INFO ] [REMOTE ] CLS: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:03:59.903271] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-15T18:03:59.909327] [INFO ] [REMOTE ] CLH: Full fetch complete (42039 records). [2025-10-15T18:03:59.909473] [DEBUG] [VALIDATOR ] CLH: Validating primary data. [2025-10-15T18:04:00.119170] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-09. [2025-10-15T18:04:00.306674] [DEBUG] [VALIDATOR ] CLH: All expected trading days are present. [2025-10-15T18:04:00.306798] [DEBUG] [VALIDATOR ] CLH: Primary data validation passed. [2025-10-15T18:04:00.307673] [INFO ] [MAIN ] CLH: Fetched primary data is valid. [2025-10-15T18:04:00.307766] [DEBUG] [LOCAL ] CLH: Saving primary data. [2025-10-15T18:04:00.309153] [DEBUG] [LOCAL ] CLH: Trimmed 42039 records to 27821 (keeping 200 days of data) [2025-10-15T18:04:00.507696] [DEBUG] [LOCAL ] CLH: Primary data saved (27821 records). [2025-10-15T18:04:00.507844] [INFO ] [MAIN ] CLH: Full history saved. [2025-10-15T18:04:00.507917] [INFO ] [MAIN ] Update Progress: 464/2369 symbols completed. CLH took 28.2s. Estimated remaining: 4h 22m 29s. Rate: 7.3 symbols/min [2025-10-15T18:04:00.677310] [INFO ] [MAIN ] CLVT: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:04:00.724107] [DEBUG] [LOCAL ] CLVT: Loaded 51954 existing records from primary storage. [2025-10-15T18:04:00.724426] [INFO ] [MAIN ] CLVT: Loaded 51954 existing records. [2025-10-15T18:04:00.819316] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-15T18:04:00.908560] [WARN ] [MAIN ] CLVT: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:04:00.908811] [INFO ] [MAIN ] CLVT: Wiping existing primary data before full refresh. [2025-10-15T18:04:00.908863] [INFO ] [LOCAL ] CLVT: Starting deletion of primary data. [2025-10-15T18:04:00.909318] [DEBUG] [LOCAL ] CLVT: Deleted primary data file. [2025-10-15T18:04:00.909375] [INFO ] [MAIN ] CLVT: Starting full primary refresh. [2025-10-15T18:04:00.920234] [INFO ] [REMOTE ] CLS: Fetching primary data for 2024-12. [2025-10-15T18:04:01.261536] [INFO ] [REMOTE ] CLVT: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:04:01.417484] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-10-15T18:04:01.714015] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-10. [2025-10-15T18:04:02.452095] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-15T18:04:02.453551] [INFO ] [REMOTE ] CLPR: Full fetch complete (16230 records). [2025-10-15T18:04:02.453622] [DEBUG] [VALIDATOR ] CLPR: Validating primary data. [2025-10-15T18:04:02.454042] [FATAL] [VALIDATOR ] CLPR: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T18:04:02.454128] [FATAL] [MAIN ] CLPR: Fetched primary data is invalid. Refusing to save it. [2025-10-15T18:04:02.454171] [WARN ] [MAIN ] CLPR: Deleting existing primary and derivative data due to validation failure. [2025-10-15T18:04:02.454210] [INFO ] [LOCAL ] CLPR: Starting deletion of primary data. [2025-10-15T18:04:02.454266] [DEBUG] [LOCAL ] CLPR: No primary data file found to delete. [2025-10-15T18:04:02.454301] [INFO ] [LOCAL ] CLPR: Starting deletion of derivative data. [2025-10-15T18:04:02.454340] [DEBUG] [LOCAL ] CLPR: No derivative data file found to delete. [2025-10-15T18:04:02.454392] [INFO ] [MAIN ] Update Progress: 465/2369 symbols completed. CLPR took 29.2s. Estimated remaining: 4h 21m 55s. Rate: 7.3 symbols/min [2025-10-15T18:04:02.514017] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2024-12. [2025-10-15T18:04:02.631538] [INFO ] [MAIN ] CLW: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:04:02.653011] [DEBUG] [LOCAL ] CLW: Loaded 21558 existing records from primary storage. [2025-10-15T18:04:02.653265] [INFO ] [MAIN ] CLW: Loaded 21558 existing records. [2025-10-15T18:04:02.857991] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-10-15T18:04:02.861174] [WARN ] [MAIN ] CLW: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:04:02.871540] [INFO ] [MAIN ] CLW: Wiping existing primary data before full refresh. [2025-10-15T18:04:02.872087] [INFO ] [LOCAL ] CLW: Starting deletion of primary data. [2025-10-15T18:04:02.872345] [DEBUG] [LOCAL ] CLW: Deleted primary data file. [2025-10-15T18:04:02.872401] [INFO ] [MAIN ] CLW: Starting full primary refresh. [2025-10-15T18:04:03.231591] [INFO ] [REMOTE ] CLW: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:04:03.313999] [INFO ] [REMOTE ] CLW: Fetching primary data for 2024-12. [2025-10-15T18:04:04.114043] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-01. [2025-10-15T18:04:04.226076] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-15T18:04:04.645229] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-15T18:04:04.914014] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-01. [2025-10-15T18:04:05.714037] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-08. [2025-10-15T18:04:06.359497] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-15T18:04:06.492252] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-01 (2.38 seconds). [2025-10-15T18:04:06.513948] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-02. [2025-10-15T18:04:07.313988] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-02. [2025-10-15T18:04:07.612599] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-15T18:04:08.113971] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-09. [2025-10-15T18:04:08.469190] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-10-15T18:04:08.730772] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-15T18:04:08.914014] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-03. [2025-10-15T18:04:09.713992] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-03. [2025-10-15T18:04:10.299945] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-09 (2.19 seconds). [2025-10-15T18:04:10.400728] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-15T18:04:10.513988] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-04. [2025-10-15T18:04:11.314075] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-10. [2025-10-15T18:04:12.033964] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-03 (2.32 seconds). [2025-10-15T18:04:12.114044] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-01. [2025-10-15T18:04:12.325977] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-15T18:04:12.914006] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-04. [2025-10-15T18:04:13.140014] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-15T18:04:13.147128] [INFO ] [REMOTE ] CLF: Full fetch complete (77918 records). [2025-10-15T18:04:13.147323] [DEBUG] [VALIDATOR ] CLF: Validating primary data. [2025-10-15T18:04:13.592818] [DEBUG] [VALIDATOR ] CLF: All expected trading days are present. [2025-10-15T18:04:13.593181] [DEBUG] [VALIDATOR ] CLF: Primary data validation passed. [2025-10-15T18:04:13.594201] [INFO ] [MAIN ] CLF: Fetched primary data is valid. [2025-10-15T18:04:13.595086] [DEBUG] [LOCAL ] CLF: Saving primary data. [2025-10-15T18:04:13.596764] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-15T18:04:13.608933] [DEBUG] [LOCAL ] CLF: Trimmed 77918 records to 53741 (keeping 200 days of data) [2025-10-15T18:04:13.727349] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-05. [2025-10-15T18:04:13.932392] [DEBUG] [LOCAL ] CLF: Primary data saved (53741 records). [2025-10-15T18:04:13.932549] [INFO ] [MAIN ] CLF: Full history saved. [2025-10-15T18:04:13.932629] [INFO ] [MAIN ] Update Progress: 466/2369 symbols completed. CLF took 43.1s. Estimated remaining: 4h 21m 60s. Rate: 7.3 symbols/min [2025-10-15T18:04:14.103263] [INFO ] [MAIN ] CLX: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:04:14.153154] [DEBUG] [LOCAL ] CLX: Loaded 51660 existing records from primary storage. [2025-10-15T18:04:14.153469] [INFO ] [MAIN ] CLX: Loaded 51660 existing records. [2025-10-15T18:04:14.334063] [WARN ] [MAIN ] CLX: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:04:14.334304] [INFO ] [MAIN ] CLX: Wiping existing primary data before full refresh. [2025-10-15T18:04:14.334355] [INFO ] [LOCAL ] CLX: Starting deletion of primary data. [2025-10-15T18:04:14.334754] [DEBUG] [LOCAL ] CLX: Deleted primary data file. [2025-10-15T18:04:14.334813] [INFO ] [MAIN ] CLX: Starting full primary refresh. [2025-10-15T18:04:14.541243] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-02. [2025-10-15T18:04:14.689735] [INFO ] [REMOTE ] CLX: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:04:15.314003] [INFO ] [REMOTE ] CLX: Fetching primary data for 2024-12. [2025-10-15T18:04:15.400088] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-04 (2.49 seconds). [2025-10-15T18:04:15.443841] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-15T18:04:15.872232] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-15T18:04:16.114040] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-06. [2025-10-15T18:04:16.883492] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-15T18:04:16.913967] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-05. [2025-10-15T18:04:17.710028] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-15T18:04:17.719541] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-03. [2025-10-15T18:04:18.513999] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-07. [2025-10-15T18:04:18.850521] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-15T18:04:18.922261] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-10-15T18:04:19.314057] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-06. [2025-10-15T18:04:20.109210] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-15T18:04:20.119327] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-04. [2025-10-15T18:04:20.913991] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-08. [2025-10-15T18:04:21.012972] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-15T18:04:21.089302] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-15T18:04:21.714003] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-05. [2025-10-15T18:04:22.175664] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-15T18:04:22.464312] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-15T18:04:22.513998] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-06. [2025-10-15T18:04:23.314008] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-09. [2025-10-15T18:04:23.487759] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-15T18:04:24.113997] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-07. [2025-10-15T18:04:24.914020] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-07. [2025-10-15T18:04:25.016501] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-15T18:04:25.713989] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-10. [2025-10-15T18:04:25.861352] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-15T18:04:26.514062] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-01. [2025-10-15T18:04:26.628168] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-07 (2.51 seconds). [2025-10-15T18:04:27.314099] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-08. [2025-10-15T18:04:27.735599] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-10 (2.02 seconds). [2025-10-15T18:04:27.741681] [INFO ] [REMOTE ] CLVT: Full fetch complete (75020 records). [2025-10-15T18:04:27.741847] [DEBUG] [VALIDATOR ] CLVT: Validating primary data. [2025-10-15T18:04:27.742618] [FATAL] [VALIDATOR ] CLVT: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T18:04:27.742754] [FATAL] [MAIN ] CLVT: Fetched primary data is invalid. Refusing to save it. [2025-10-15T18:04:27.742796] [WARN ] [MAIN ] CLVT: Deleting existing primary and derivative data due to validation failure. [2025-10-15T18:04:27.742835] [INFO ] [LOCAL ] CLVT: Starting deletion of primary data. [2025-10-15T18:04:27.742891] [DEBUG] [LOCAL ] CLVT: No primary data file found to delete. [2025-10-15T18:04:27.742924] [INFO ] [LOCAL ] CLVT: Starting deletion of derivative data. [2025-10-15T18:04:27.743088] [DEBUG] [LOCAL ] CLVT: Deleted derivative data file. [2025-10-15T18:04:27.743176] [INFO ] [MAIN ] Update Progress: 467/2369 symbols completed. CLVT took 27.2s. Estimated remaining: 4h 22m 14s. Rate: 7.3 symbols/min [2025-10-15T18:04:27.915448] [INFO ] [MAIN ] CM: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:04:27.961104] [DEBUG] [LOCAL ] CM: Loaded 48743 existing records from primary storage. [2025-10-15T18:04:27.961548] [INFO ] [MAIN ] CM: Loaded 48743 existing records. [2025-10-15T18:04:28.141870] [WARN ] [MAIN ] CM: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:04:28.142033] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-08. [2025-10-15T18:04:28.143138] [INFO ] [MAIN ] CM: Wiping existing primary data before full refresh. [2025-10-15T18:04:28.143204] [INFO ] [LOCAL ] CM: Starting deletion of primary data. [2025-10-15T18:04:28.143705] [DEBUG] [LOCAL ] CM: Deleted primary data file. [2025-10-15T18:04:28.143767] [INFO ] [MAIN ] CM: Starting full primary refresh. [2025-10-15T18:04:28.278402] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-15T18:04:28.540460] [INFO ] [REMOTE ] CM: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:04:28.913993] [INFO ] [REMOTE ] CM: Fetching primary data for 2024-12. [2025-10-15T18:04:29.714055] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-02. [2025-10-15T18:04:30.332865] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-08 (2.19 seconds). [2025-10-15T18:04:30.386679] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-15T18:04:30.513999] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-01. [2025-10-15T18:04:31.228312] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-15T18:04:31.314034] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-03. [2025-10-15T18:04:31.882870] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-08 (4.57 seconds). [2025-10-15T18:04:32.020950] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-15T18:04:32.114010] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-02. [2025-10-15T18:04:32.799159] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-15T18:04:32.914006] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-09. [2025-10-15T18:04:33.466240] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-15T18:04:33.714061] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-09. [2025-10-15T18:04:34.513990] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-03. [2025-10-15T18:04:34.615036] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-15T18:04:35.313979] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-04. [2025-10-15T18:04:35.654537] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-09 (2.74 seconds). [2025-10-15T18:04:36.117737] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-10. [2025-10-15T18:04:36.120991] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-15T18:04:36.783677] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-15T18:04:36.913988] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-05. [2025-10-15T18:04:37.231365] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-15T18:04:37.234066] [INFO ] [REMOTE ] CLW: Full fetch complete (33955 records). [2025-10-15T18:04:37.234144] [DEBUG] [VALIDATOR ] CLW: Validating primary data. [2025-10-15T18:04:37.589475] [DEBUG] [VALIDATOR ] CLW: All expected trading days are present. [2025-10-15T18:04:37.589552] [DEBUG] [VALIDATOR ] CLW: Primary data validation passed. [2025-10-15T18:04:37.590156] [INFO ] [MAIN ] CLW: Fetched primary data is valid. [2025-10-15T18:04:37.590218] [DEBUG] [LOCAL ] CLW: Saving primary data. [2025-10-15T18:04:37.591236] [DEBUG] [LOCAL ] CLW: Trimmed 33955 records to 21508 (keeping 200 days of data) [2025-10-15T18:04:37.723750] [DEBUG] [LOCAL ] CLW: Primary data saved (21508 records). [2025-10-15T18:04:37.715124] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-10. [2025-10-15T18:04:37.724056] [INFO ] [MAIN ] CLW: Full history saved. [2025-10-15T18:04:37.725034] [INFO ] [MAIN ] Update Progress: 468/2369 symbols completed. CLW took 35.3s. Estimated remaining: 4h 22m 13s. Rate: 7.2 symbols/min [2025-10-15T18:04:37.901142] [INFO ] [MAIN ] CMA: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:04:37.901350] [DEBUG] [LOCAL ] CMA: No existing data file found in primary storage. [2025-10-15T18:04:37.901387] [WARN ] [MAIN ] CMA: No existing data found, performing full refresh instead. [2025-10-15T18:04:37.901495] [INFO ] [MAIN ] CMA: Wiping existing primary data before full refresh. [2025-10-15T18:04:37.901537] [INFO ] [LOCAL ] CMA: Starting deletion of primary data. [2025-10-15T18:04:37.901576] [DEBUG] [LOCAL ] CMA: No primary data file found to delete. [2025-10-15T18:04:37.901607] [INFO ] [MAIN ] CMA: Starting full primary refresh. [2025-10-15T18:04:38.243976] [INFO ] [REMOTE ] CMA: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:04:38.465350] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-15T18:04:38.514007] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-04. [2025-10-15T18:04:39.314070] [INFO ] [REMOTE ] CMA: Fetching primary data for 2024-12. [2025-10-15T18:04:39.827559] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-15T18:04:39.986009] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-10 (2.27 seconds). [2025-10-15T18:04:39.992307] [INFO ] [REMOTE ] CLS: Full fetch complete (77677 records). [2025-10-15T18:04:39.992440] [DEBUG] [VALIDATOR ] CLS: Validating primary data. [2025-10-15T18:04:40.119200] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-06. [2025-10-15T18:04:40.391120] [DEBUG] [VALIDATOR ] CLS: All expected trading days are present. [2025-10-15T18:04:40.391202] [DEBUG] [VALIDATOR ] CLS: Primary data validation passed. [2025-10-15T18:04:40.392273] [INFO ] [MAIN ] CLS: Fetched primary data is valid. [2025-10-15T18:04:40.392339] [DEBUG] [LOCAL ] CLS: Saving primary data. [2025-10-15T18:04:40.394248] [DEBUG] [LOCAL ] CLS: Trimmed 77677 records to 53583 (keeping 200 days of data) [2025-10-15T18:04:40.768463] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-15T18:04:40.787617] [DEBUG] [LOCAL ] CLS: Primary data saved (53583 records). [2025-10-15T18:04:40.787810] [INFO ] [MAIN ] CLS: Full history saved. [2025-10-15T18:04:40.787939] [INFO ] [MAIN ] Update Progress: 469/2369 symbols completed. CLS took 42.2s. Estimated remaining: 4h 21m 43s. Rate: 7.3 symbols/min [2025-10-15T18:04:40.919149] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-01. [2025-10-15T18:04:40.986103] [INFO ] [MAIN ] CMBT: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:04:41.014532] [DEBUG] [LOCAL ] CMBT: Loaded 25911 existing records from primary storage. [2025-10-15T18:04:41.014849] [INFO ] [MAIN ] CMBT: Loaded 25911 existing records. [2025-10-15T18:04:41.210421] [WARN ] [MAIN ] CMBT: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:04:41.210630] [INFO ] [MAIN ] CMBT: Wiping existing primary data before full refresh. [2025-10-15T18:04:41.210717] [INFO ] [LOCAL ] CMBT: Starting deletion of primary data. [2025-10-15T18:04:41.210920] [DEBUG] [LOCAL ] CMBT: Deleted primary data file. [2025-10-15T18:04:41.210976] [INFO ] [MAIN ] CMBT: Starting full primary refresh. [2025-10-15T18:04:41.553635] [INFO ] [REMOTE ] CMBT: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:04:41.713956] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2024-12. [2025-10-15T18:04:42.168184] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-10-15T18:04:42.333075] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-15T18:04:42.514053] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-07. [2025-10-15T18:04:42.542709] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-10-15T18:04:43.314057] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-01. [2025-10-15T18:04:44.113996] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-05. [2025-10-15T18:04:44.393567] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-15T18:04:44.418271] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-15T18:04:44.914047] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-02. [2025-10-15T18:04:45.609353] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-15T18:04:45.714054] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-08. [2025-10-15T18:04:45.856860] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-15T18:04:46.514061] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-06. [2025-10-15T18:04:47.238521] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-15T18:04:47.314047] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-02. [2025-10-15T18:04:48.113974] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-09. [2025-10-15T18:04:48.204349] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-15T18:04:48.861156] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-15T18:04:48.914001] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-03. [2025-10-15T18:04:49.714087] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-03. [2025-10-15T18:04:50.020024] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-15T18:04:50.280192] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-15T18:04:50.514009] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-07. [2025-10-15T18:04:50.704896] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-15T18:04:51.314002] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-04. [2025-10-15T18:04:51.949975] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-15T18:04:52.114010] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-08. [2025-10-15T18:04:52.206970] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-15T18:04:52.913996] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-10. [2025-10-15T18:04:53.538922] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-15T18:04:53.714007] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-04. [2025-10-15T18:04:54.460203] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-15T18:04:54.466455] [INFO ] [REMOTE ] CLX: Full fetch complete (73524 records). [2025-10-15T18:04:54.466573] [DEBUG] [VALIDATOR ] CLX: Validating primary data. [2025-10-15T18:04:54.522102] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-09. [2025-10-15T18:04:54.853937] [DEBUG] [VALIDATOR ] CLX: All expected trading days are present. [2025-10-15T18:04:54.854038] [DEBUG] [VALIDATOR ] CLX: Primary data validation passed. [2025-10-15T18:04:54.855107] [INFO ] [MAIN ] CLX: Fetched primary data is valid. [2025-10-15T18:04:54.855173] [DEBUG] [LOCAL ] CLX: Saving primary data. [2025-10-15T18:04:54.856686] [DEBUG] [LOCAL ] CLX: Trimmed 73524 records to 51677 (keeping 200 days of data) [2025-10-15T18:04:55.186585] [DEBUG] [LOCAL ] CLX: Primary data saved (51677 records). [2025-10-15T18:04:55.186761] [INFO ] [MAIN ] CLX: Full history saved. [2025-10-15T18:04:55.186850] [INFO ] [MAIN ] Update Progress: 470/2369 symbols completed. CLX took 41.3s. Estimated remaining: 4h 21m 60s. Rate: 7.2 symbols/min [2025-10-15T18:04:55.332448] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-05. [2025-10-15T18:04:55.358743] [INFO ] [MAIN ] CMC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:04:55.400140] [DEBUG] [LOCAL ] CMC: Loaded 45430 existing records from primary storage. [2025-10-15T18:04:55.400446] [INFO ] [MAIN ] CMC: Loaded 45430 existing records. [2025-10-15T18:04:55.593040] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-15T18:04:55.616248] [WARN ] [MAIN ] CMC: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:04:55.626855] [INFO ] [MAIN ] CMC: Wiping existing primary data before full refresh. [2025-10-15T18:04:55.627082] [INFO ] [LOCAL ] CMC: Starting deletion of primary data. [2025-10-15T18:04:55.627449] [DEBUG] [LOCAL ] CMC: Deleted primary data file. [2025-10-15T18:04:55.627512] [INFO ] [MAIN ] CMC: Starting full primary refresh. [2025-10-15T18:04:55.983126] [INFO ] [REMOTE ] CMC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:04:56.113981] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-05. [2025-10-15T18:04:56.255591] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-15T18:04:56.280897] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-15T18:04:56.913971] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-10. [2025-10-15T18:04:57.659161] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-15T18:04:57.713959] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-06. [2025-10-15T18:04:58.294922] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-15T18:04:58.301283] [INFO ] [REMOTE ] CM: Full fetch complete (69851 records). [2025-10-15T18:04:58.301440] [DEBUG] [VALIDATOR ] CM: Validating primary data. [2025-10-15T18:04:58.519174] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-06. [2025-10-15T18:04:58.723554] [DEBUG] [VALIDATOR ] CM: All expected trading days are present. [2025-10-15T18:04:58.723748] [DEBUG] [VALIDATOR ] CM: Primary data validation passed. [2025-10-15T18:04:58.725064] [INFO ] [MAIN ] CM: Fetched primary data is valid. [2025-10-15T18:04:58.725148] [DEBUG] [LOCAL ] CM: Saving primary data. [2025-10-15T18:04:58.727109] [DEBUG] [LOCAL ] CM: Trimmed 69851 records to 48739 (keeping 200 days of data) [2025-10-15T18:04:59.040810] [DEBUG] [LOCAL ] CM: Primary data saved (48739 records). [2025-10-15T18:04:59.040968] [INFO ] [MAIN ] CM: Full history saved. [2025-10-15T18:04:59.041052] [INFO ] [MAIN ] Update Progress: 471/2369 symbols completed. CM took 31.3s. Estimated remaining: 4h 21m 34s. Rate: 7.3 symbols/min [2025-10-15T18:04:59.209351] [INFO ] [MAIN ] CMCM: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:04:59.216373] [DEBUG] [LOCAL ] CMCM: Loaded 4866 existing records from primary storage. [2025-10-15T18:04:59.216576] [INFO ] [MAIN ] CMCM: Loaded 4866 existing records. [2025-10-15T18:04:59.315956] [INFO ] [REMOTE ] CMC: Fetching primary data for 2024-12. [2025-10-15T18:04:59.401717] [WARN ] [MAIN ] CMCM: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:04:59.402181] [INFO ] [MAIN ] CMCM: Wiping existing primary data before full refresh. [2025-10-15T18:04:59.402310] [INFO ] [LOCAL ] CMCM: Starting deletion of primary data. [2025-10-15T18:04:59.402532] [DEBUG] [LOCAL ] CMCM: Deleted primary data file. [2025-10-15T18:04:59.402606] [INFO ] [MAIN ] CMCM: Starting full primary refresh. [2025-10-15T18:04:59.550597] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-15T18:04:59.599143] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-15T18:04:59.841301] [INFO ] [REMOTE ] CMCM: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:05:00.114033] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2024-12. [2025-10-15T18:05:00.685043] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-10-15T18:05:00.913968] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-01. [2025-10-15T18:05:01.258215] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-10-15T18:05:01.272743] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-01 (0.36 seconds). [2025-10-15T18:05:01.714019] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-07. [2025-10-15T18:05:02.514057] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-02. [2025-10-15T18:05:03.018789] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-10-15T18:05:03.314054] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-01. [2025-10-15T18:05:03.827583] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-10-15T18:05:04.114038] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-07. [2025-10-15T18:05:04.914038] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-08. [2025-10-15T18:05:04.974848] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-15T18:05:05.014923] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-15T18:05:05.714000] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-03. [2025-10-15T18:05:06.300288] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-15T18:05:06.513996] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-02. [2025-10-15T18:05:06.636609] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-15T18:05:07.314047] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-04. [2025-10-15T18:05:07.832976] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-10-15T18:05:08.114055] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-09. [2025-10-15T18:05:08.158015] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-15T18:05:08.914035] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-03. [2025-10-15T18:05:09.451239] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-15T18:05:09.714074] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-10. [2025-10-15T18:05:10.450399] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-15T18:05:10.513985] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-04. [2025-10-15T18:05:11.313989] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-05. [2025-10-15T18:05:11.506122] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-15T18:05:11.512935] [INFO ] [REMOTE ] CMA: Full fetch complete (73390 records). [2025-10-15T18:05:11.513062] [DEBUG] [VALIDATOR ] CMA: Validating primary data. [2025-10-15T18:05:11.906785] [DEBUG] [VALIDATOR ] CMA: All expected trading days are present. [2025-10-15T18:05:11.910734] [DEBUG] [VALIDATOR ] CMA: Primary data validation passed. [2025-10-15T18:05:11.910888] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-15T18:05:11.913638] [INFO ] [MAIN ] CMA: Fetched primary data is valid. [2025-10-15T18:05:11.913768] [DEBUG] [LOCAL ] CMA: Saving primary data. [2025-10-15T18:05:11.915758] [DEBUG] [LOCAL ] CMA: Trimmed 73390 records to 50122 (keeping 200 days of data) [2025-10-15T18:05:12.049901] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-15T18:05:12.133508] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-08. [2025-10-15T18:05:12.263469] [DEBUG] [LOCAL ] CMA: Primary data saved (50122 records). [2025-10-15T18:05:12.263625] [INFO ] [MAIN ] CMA: Full history saved. [2025-10-15T18:05:12.263741] [INFO ] [MAIN ] Update Progress: 472/2369 symbols completed. CMA took 34.5s. Estimated remaining: 4h 21m 45s. Rate: 7.2 symbols/min [2025-10-15T18:05:12.434026] [INFO ] [MAIN ] CMDB: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:05:12.434223] [DEBUG] [LOCAL ] CMDB: No existing data file found in primary storage. [2025-10-15T18:05:12.434261] [WARN ] [MAIN ] CMDB: No existing data found, performing full refresh instead. [2025-10-15T18:05:12.434374] [INFO ] [MAIN ] CMDB: Wiping existing primary data before full refresh. [2025-10-15T18:05:12.434415] [INFO ] [LOCAL ] CMDB: Starting deletion of primary data. [2025-10-15T18:05:12.434457] [DEBUG] [LOCAL ] CMDB: No primary data file found to delete. [2025-10-15T18:05:12.434489] [INFO ] [MAIN ] CMDB: Starting full primary refresh. [2025-10-15T18:05:12.776162] [INFO ] [REMOTE ] CMDB: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:05:12.914014] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-05. [2025-10-15T18:05:13.406788] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-15T18:05:13.713988] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-09. [2025-10-15T18:05:14.381699] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-15T18:05:14.514041] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-06. [2025-10-15T18:05:15.314016] [INFO ] [REMOTE ] CMDB: Fetching primary data for 2024-12. [2025-10-15T18:05:15.575313] [DEBUG] [REMOTE ] CMDB: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-15T18:05:15.577669] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-15T18:05:15.576279] [WARN ] [REMOTE ] CMDB: No data returned for month 2024-12 [2025-10-15T18:05:15.577893] [FATAL] [REMOTE ] CMDB: API call failed - aborting fetch to avoid wasting further API calls [2025-10-15T18:05:15.589135] [FATAL] [MAIN ] CMDB: Failed to fetch primary data. [2025-10-15T18:05:15.589234] [WARN ] [MAIN ] CMDB: Deleting existing primary and derivative data due to fetch failure. [2025-10-15T18:05:15.589701] [INFO ] [LOCAL ] CMDB: Starting deletion of primary data. [2025-10-15T18:05:15.589821] [DEBUG] [LOCAL ] CMDB: No primary data file found to delete. [2025-10-15T18:05:15.589872] [INFO ] [LOCAL ] CMDB: Starting deletion of derivative data. [2025-10-15T18:05:15.589914] [DEBUG] [LOCAL ] CMDB: No derivative data file found to delete. [2025-10-15T18:05:15.589959] [INFO ] [MAIN ] Update Progress: 473/2369 symbols completed. CMDB took 3.3s. Estimated remaining: 4h 21m 17s. Rate: 7.3 symbols/min [2025-10-15T18:05:15.755820] [INFO ] [MAIN ] CMG: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:05:15.813492] [DEBUG] [LOCAL ] CMG: Loaded 53720 existing records from primary storage. [2025-10-15T18:05:15.814064] [INFO ] [MAIN ] CMG: Loaded 53720 existing records. [2025-10-15T18:05:15.996300] [WARN ] [MAIN ] CMG: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:05:16.012598] [INFO ] [MAIN ] CMG: Wiping existing primary data before full refresh. [2025-10-15T18:05:16.021895] [INFO ] [LOCAL ] CMG: Starting deletion of primary data. [2025-10-15T18:05:16.023545] [DEBUG] [LOCAL ] CMG: Deleted primary data file. [2025-10-15T18:05:16.023675] [INFO ] [MAIN ] CMG: Starting full primary refresh. [2025-10-15T18:05:16.023479] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-15T18:05:16.119214] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-06. [2025-10-15T18:05:16.387078] [INFO ] [REMOTE ] CMG: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:05:16.600600] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-10-15T18:05:16.914028] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-07. [2025-10-15T18:05:17.423813] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-10-15T18:05:17.714166] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-08. [2025-10-15T18:05:18.323226] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-15T18:05:18.514013] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-07. [2025-10-15T18:05:19.314048] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-09. [2025-10-15T18:05:19.867205] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-15T18:05:20.050576] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-15T18:05:20.113991] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-08. [2025-10-15T18:05:20.913995] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-10. [2025-10-15T18:05:21.619892] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-15T18:05:21.713987] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-09. [2025-10-15T18:05:22.513973] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-10. [2025-10-15T18:05:22.686618] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-15T18:05:22.692708] [INFO ] [REMOTE ] CMBT: Full fetch complete (32610 records). [2025-10-15T18:05:22.692836] [DEBUG] [VALIDATOR ] CMBT: Validating primary data. [2025-10-15T18:05:23.061332] [DEBUG] [VALIDATOR ] CMBT: All expected trading days are present. [2025-10-15T18:05:23.061483] [DEBUG] [VALIDATOR ] CMBT: Primary data validation passed. [2025-10-15T18:05:23.062165] [INFO ] [MAIN ] CMBT: Fetched primary data is valid. [2025-10-15T18:05:23.062239] [DEBUG] [LOCAL ] CMBT: Saving primary data. [2025-10-15T18:05:23.063190] [DEBUG] [LOCAL ] CMBT: Trimmed 32610 records to 26155 (keeping 200 days of data) [2025-10-15T18:05:23.189949] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-15T18:05:23.193097] [INFO ] [REMOTE ] CMCM: Full fetch complete (6940 records). [2025-10-15T18:05:23.193749] [DEBUG] [VALIDATOR ] CMCM: Validating primary data. [2025-10-15T18:05:23.195094] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-15T18:05:23.314206] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-10. [2025-10-15T18:05:23.628960] [DEBUG] [VALIDATOR ] CMCM: All expected trading days are present. [2025-10-15T18:05:23.629585] [DEBUG] [VALIDATOR ] CMCM: Primary data validation passed. [2025-10-15T18:05:23.630487] [INFO ] [MAIN ] CMCM: Fetched primary data is valid. [2025-10-15T18:05:23.631867] [DEBUG] [LOCAL ] CMCM: Saving primary data. [2025-10-15T18:05:23.634177] [DEBUG] [LOCAL ] CMBT: Primary data saved (26155 records). [2025-10-15T18:05:23.634593] [INFO ] [MAIN ] CMBT: Full history saved. [2025-10-15T18:05:23.634982] [DEBUG] [LOCAL ] CMCM: Trimmed 6940 records to 4788 (keeping 200 days of data) [2025-10-15T18:05:23.635106] [INFO ] [MAIN ] Update Progress: 474/2369 symbols completed. CMBT took 42.8s. Estimated remaining: 4h 21m 8s. Rate: 7.3 symbols/min [2025-10-15T18:05:23.761913] [DEBUG] [LOCAL ] CMCM: Primary data saved (4788 records). [2025-10-15T18:05:23.777837] [INFO ] [MAIN ] CMCM: Full history saved. [2025-10-15T18:05:23.783061] [INFO ] [MAIN ] Update Progress: 475/2369 symbols completed. CMCM took 24.7s. Estimated remaining: 4h 20m 28s. Rate: 7.3 symbols/min [2025-10-15T18:05:23.902847] [INFO ] [MAIN ] CMI: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:05:24.005805] [INFO ] [MAIN ] CMP: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:05:24.036816] [DEBUG] [LOCAL ] CMI: Loaded 41661 existing records from primary storage. [2025-10-15T18:05:24.046136] [INFO ] [MAIN ] CMI: Loaded 41661 existing records. [2025-10-15T18:05:24.126540] [INFO ] [REMOTE ] CMG: Fetching primary data for 2024-12. [2025-10-15T18:05:24.169410] [DEBUG] [LOCAL ] CMP: Loaded 35866 existing records from primary storage. [2025-10-15T18:05:24.180861] [INFO ] [MAIN ] CMP: Loaded 35866 existing records. [2025-10-15T18:05:24.349591] [WARN ] [MAIN ] CMI: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:05:24.364503] [INFO ] [MAIN ] CMI: Wiping existing primary data before full refresh. [2025-10-15T18:05:24.364627] [INFO ] [LOCAL ] CMI: Starting deletion of primary data. [2025-10-15T18:05:24.365036] [DEBUG] [LOCAL ] CMI: Deleted primary data file. [2025-10-15T18:05:24.370614] [INFO ] [MAIN ] CMI: Starting full primary refresh. [2025-10-15T18:05:24.555296] [WARN ] [MAIN ] CMP: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:05:24.571097] [INFO ] [MAIN ] CMP: Wiping existing primary data before full refresh. [2025-10-15T18:05:24.605915] [INFO ] [LOCAL ] CMP: Starting deletion of primary data. [2025-10-15T18:05:24.619109] [DEBUG] [LOCAL ] CMP: Deleted primary data file. [2025-10-15T18:05:24.691576] [INFO ] [MAIN ] CMP: Starting full primary refresh. [2025-10-15T18:05:24.916902] [INFO ] [REMOTE ] CMI: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:05:24.917471] [INFO ] [REMOTE ] CMI: Fetching primary data for 2024-12. [2025-10-15T18:05:25.181085] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-10 (1.87 seconds). [2025-10-15T18:05:25.229039] [INFO ] [REMOTE ] CMP: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:05:25.229331] [INFO ] [REMOTE ] CMC: Full fetch complete (67057 records). [2025-10-15T18:05:25.230103] [DEBUG] [VALIDATOR ] CMC: Validating primary data. [2025-10-15T18:05:25.699481] [DEBUG] [VALIDATOR ] CMC: All expected trading days are present. [2025-10-15T18:05:25.699603] [DEBUG] [VALIDATOR ] CMC: Primary data validation passed. [2025-10-15T18:05:25.700858] [INFO ] [MAIN ] CMC: Fetched primary data is valid. [2025-10-15T18:05:25.700936] [DEBUG] [LOCAL ] CMC: Saving primary data. [2025-10-15T18:05:25.703712] [DEBUG] [LOCAL ] CMC: Trimmed 67057 records to 45483 (keeping 200 days of data) [2025-10-15T18:05:25.762454] [INFO ] [REMOTE ] CMP: Fetching primary data for 2024-12. [2025-10-15T18:05:25.991319] [DEBUG] [LOCAL ] CMC: Primary data saved (45483 records). [2025-10-15T18:05:25.991454] [INFO ] [MAIN ] CMC: Full history saved. [2025-10-15T18:05:25.991556] [INFO ] [MAIN ] Update Progress: 476/2369 symbols completed. CMC took 30.8s. Estimated remaining: 4h 19m 55s. Rate: 7.3 symbols/min [2025-10-15T18:05:26.159234] [INFO ] [MAIN ] CMPO: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:05:26.198881] [DEBUG] [LOCAL ] CMPO: Loaded 38842 existing records from primary storage. [2025-10-15T18:05:26.199182] [INFO ] [MAIN ] CMPO: Loaded 38842 existing records. [2025-10-15T18:05:26.381203] [WARN ] [MAIN ] CMPO: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:05:26.381469] [INFO ] [MAIN ] CMPO: Wiping existing primary data before full refresh. [2025-10-15T18:05:26.381630] [INFO ] [LOCAL ] CMPO: Starting deletion of primary data. [2025-10-15T18:05:26.382099] [DEBUG] [LOCAL ] CMPO: Deleted primary data file. [2025-10-15T18:05:26.382166] [INFO ] [MAIN ] CMPO: Starting full primary refresh. [2025-10-15T18:05:26.708065] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2024-12 (2.58 seconds). [2025-10-15T18:05:26.728799] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-01. [2025-10-15T18:05:26.809989] [INFO ] [REMOTE ] CMPO: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:05:26.831992] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-10-15T18:05:27.319085] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2024-12. [2025-10-15T18:05:27.334708] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-15T18:05:28.114027] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-01. [2025-10-15T18:05:28.637456] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-15T18:05:28.714873] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-15T18:05:28.914064] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-02. [2025-10-15T18:05:29.129035] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-15T18:05:29.713978] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-01. [2025-10-15T18:05:30.514009] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-01. [2025-10-15T18:05:30.650830] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-15T18:05:31.041720] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-15T18:05:31.314073] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-02. [2025-10-15T18:05:32.029731] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-15T18:05:32.114011] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-02. [2025-10-15T18:05:32.453079] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-15T18:05:32.914002] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-03. [2025-10-15T18:05:33.427336] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-15T18:05:33.713994] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-03. [2025-10-15T18:05:34.514035] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-02. [2025-10-15T18:05:34.736174] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-15T18:05:34.836033] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-15T18:05:35.314015] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-04. [2025-10-15T18:05:35.600631] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-15T18:05:36.114016] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-03. [2025-10-15T18:05:36.914039] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-03. [2025-10-15T18:05:37.592435] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-04 (2.28 seconds). [2025-10-15T18:05:37.687138] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-15T18:05:37.713952] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-04. [2025-10-15T18:05:38.120671] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-15T18:05:38.514064] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-04. [2025-10-15T18:05:39.108492] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-15T18:05:39.314075] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-04. [2025-10-15T18:05:39.674462] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-15T18:05:40.114076] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-05. [2025-10-15T18:05:40.779183] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-15T18:05:40.914024] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-05. [2025-10-15T18:05:41.714046] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-05. [2025-10-15T18:05:41.892954] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-15T18:05:42.519108] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-05. [2025-10-15T18:05:42.531263] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-15T18:05:42.934386] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-15T18:05:43.314024] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-06. [2025-10-15T18:05:43.824376] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-15T18:05:44.113990] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-06. [2025-10-15T18:05:44.516627] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-15T18:05:44.914008] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-07. [2025-10-15T18:05:45.626275] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-15T18:05:45.713983] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-07. [2025-10-15T18:05:46.021306] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-15T18:05:46.513996] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-06. [2025-10-15T18:05:47.080484] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-15T18:05:47.314052] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-06. [2025-10-15T18:05:47.971094] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-15T18:05:48.114047] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-07. [2025-10-15T18:05:48.913998] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-08. [2025-10-15T18:05:49.140042] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-15T18:05:49.374894] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-15T18:05:49.714013] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-08. [2025-10-15T18:05:50.455287] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-15T18:05:50.514017] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-08. [2025-10-15T18:05:51.313985] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-09. [2025-10-15T18:05:51.353336] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-15T18:05:51.728210] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-15T18:05:52.114070] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-09. [2025-10-15T18:05:52.922298] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-09. [2025-10-15T18:05:52.929634] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-15T18:05:52.965234] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-15T18:05:53.714024] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-07. [2025-10-15T18:05:54.428819] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-15T18:05:54.513971] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-10. [2025-10-15T18:05:55.314011] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-10. [2025-10-15T18:05:55.742459] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-10-15T18:05:56.094001] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-15T18:05:56.099596] [INFO ] [REMOTE ] CMI: Full fetch complete (60652 records). [2025-10-15T18:05:56.099828] [DEBUG] [VALIDATOR ] CMI: Validating primary data. [2025-10-15T18:05:56.121552] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-10. [2025-10-15T18:05:56.513025] [DEBUG] [VALIDATOR ] CMI: All expected trading days are present. [2025-10-15T18:05:56.512925] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-15T18:05:56.516467] [DEBUG] [VALIDATOR ] CMI: Primary data validation passed. [2025-10-15T18:05:56.518116] [INFO ] [MAIN ] CMI: Fetched primary data is valid. [2025-10-15T18:05:56.518233] [INFO ] [REMOTE ] CMP: Full fetch complete (51780 records). [2025-10-15T18:05:56.518358] [DEBUG] [VALIDATOR ] CMP: Validating primary data. [2025-10-15T18:05:56.518536] [DEBUG] [LOCAL ] CMI: Saving primary data. [2025-10-15T18:05:56.626937] [DEBUG] [LOCAL ] CMI: Trimmed 60652 records to 41687 (keeping 200 days of data) [2025-10-15T18:05:56.930563] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-08. [2025-10-15T18:05:57.042110] [DEBUG] [VALIDATOR ] CMP: All expected trading days are present. [2025-10-15T18:05:57.042461] [DEBUG] [VALIDATOR ] CMP: Primary data validation passed. [2025-10-15T18:05:57.044711] [INFO ] [MAIN ] CMP: Fetched primary data is valid. [2025-10-15T18:05:57.044790] [DEBUG] [LOCAL ] CMP: Saving primary data. [2025-10-15T18:05:57.054744] [DEBUG] [LOCAL ] CMP: Trimmed 51780 records to 35832 (keeping 200 days of data) [2025-10-15T18:05:57.401659] [DEBUG] [LOCAL ] CMP: Primary data saved (35832 records). [2025-10-15T18:05:57.402353] [INFO ] [MAIN ] CMP: Full history saved. [2025-10-15T18:05:57.403974] [INFO ] [MAIN ] Update Progress: 477/2369 symbols completed. CMP took 33.6s. Estimated remaining: 4h 21m 19s. Rate: 7.2 symbols/min [2025-10-15T18:05:57.422759] [DEBUG] [LOCAL ] CMI: Primary data saved (41687 records). [2025-10-15T18:05:57.422894] [INFO ] [MAIN ] CMI: Full history saved. [2025-10-15T18:05:57.422973] [INFO ] [MAIN ] Update Progress: 478/2369 symbols completed. CMI took 33.8s. Estimated remaining: 4h 20m 38s. Rate: 7.3 symbols/min [2025-10-15T18:05:57.460802] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-15T18:05:57.465123] [INFO ] [REMOTE ] CMPO: Full fetch complete (58588 records). [2025-10-15T18:05:57.465228] [DEBUG] [VALIDATOR ] CMPO: Validating primary data. [2025-10-15T18:05:57.859549] [DEBUG] [VALIDATOR ] CMPO: All expected trading days are present. [2025-10-15T18:05:57.859626] [DEBUG] [VALIDATOR ] CMPO: Primary data validation passed. [2025-10-15T18:05:57.860468] [INFO ] [MAIN ] CMPO: Fetched primary data is valid. [2025-10-15T18:05:57.860523] [DEBUG] [LOCAL ] CMPO: Saving primary data. [2025-10-15T18:05:57.861732] [DEBUG] [LOCAL ] CMPO: Trimmed 58588 records to 38834 (keeping 200 days of data) [2025-10-15T18:05:58.078985] [DEBUG] [LOCAL ] CMPO: Primary data saved (38834 records). [2025-10-15T18:05:58.079121] [INFO ] [MAIN ] CMPO: Full history saved. [2025-10-15T18:05:58.079199] [INFO ] [MAIN ] Update Progress: 479/2369 symbols completed. CMPO took 32.1s. Estimated remaining: 4h 19m 60s. Rate: 7.3 symbols/min [2025-10-15T18:05:59.046706] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-08 (2.12 seconds). [2025-10-15T18:05:59.059525] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-09. [2025-10-15T18:06:01.670007] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-09 (2.61 seconds). [2025-10-15T18:06:01.683143] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-10. [2025-10-15T18:06:02.317448] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-15T18:06:02.324964] [INFO ] [REMOTE ] CMG: Full fetch complete (77893 records). [2025-10-15T18:06:02.325174] [DEBUG] [VALIDATOR ] CMG: Validating primary data. [2025-10-15T18:06:02.728083] [DEBUG] [VALIDATOR ] CMG: All expected trading days are present. [2025-10-15T18:06:02.728170] [DEBUG] [VALIDATOR ] CMG: Primary data validation passed. [2025-10-15T18:06:02.729088] [INFO ] [MAIN ] CMG: Fetched primary data is valid. [2025-10-15T18:06:02.729156] [DEBUG] [LOCAL ] CMG: Saving primary data. [2025-10-15T18:06:02.730709] [DEBUG] [LOCAL ] CMG: Trimmed 77893 records to 53721 (keeping 200 days of data) [2025-10-15T18:06:03.058658] [DEBUG] [LOCAL ] CMG: Primary data saved (53721 records). [2025-10-15T18:06:03.058815] [INFO ] [MAIN ] CMG: Full history saved. [2025-10-15T18:06:03.059618] [INFO ] [MAIN ] Update Progress: 480/2369 symbols completed. CMG took 47.5s. Estimated remaining: 4h 19m 38s. Rate: 7.3 symbols/min [2025-10-15T18:06:03.812406] [INFO ] [MAIN ] CMRE: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:06:03.859409] [INFO ] [MAIN ] CMSC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:06:03.941316] [INFO ] [MAIN ] CMSA: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:06:03.946369] [INFO ] [MAIN ] CMS: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:06:03.946998] [DEBUG] [LOCAL ] CMSA: No existing data file found in primary storage. [2025-10-15T18:06:03.947546] [WARN ] [MAIN ] CMSA: No existing data found, performing full refresh instead. [2025-10-15T18:06:03.947944] [INFO ] [MAIN ] CMSA: Wiping existing primary data before full refresh. [2025-10-15T18:06:03.947993] [INFO ] [LOCAL ] CMSA: Starting deletion of primary data. [2025-10-15T18:06:03.948042] [DEBUG] [LOCAL ] CMSA: No primary data file found to delete. [2025-10-15T18:06:03.948081] [INFO ] [MAIN ] CMSA: Starting full primary refresh. [2025-10-15T18:06:03.997611] [DEBUG] [LOCAL ] CMSC: Loaded 4884 existing records from primary storage. [2025-10-15T18:06:04.041288] [INFO ] [MAIN ] CMSC: Loaded 4884 existing records. [2025-10-15T18:06:04.239372] [DEBUG] [LOCAL ] CMRE: Loaded 35862 existing records from primary storage. [2025-10-15T18:06:04.332147] [INFO ] [MAIN ] CMRE: Loaded 35862 existing records. [2025-10-15T18:06:04.624467] [DEBUG] [LOCAL ] CMS: Loaded 52623 existing records from primary storage. [2025-10-15T18:06:04.607175] [WARN ] [MAIN ] CMSC: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:06:04.630688] [INFO ] [MAIN ] CMS: Loaded 52623 existing records. [2025-10-15T18:06:04.630781] [INFO ] [MAIN ] CMSC: Wiping existing primary data before full refresh. [2025-10-15T18:06:04.666991] [INFO ] [LOCAL ] CMSC: Starting deletion of primary data. [2025-10-15T18:06:04.757788] [DEBUG] [LOCAL ] CMSC: Deleted primary data file. [2025-10-15T18:06:04.804755] [INFO ] [REMOTE ] CMSA: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:06:04.867361] [INFO ] [MAIN ] CMSC: Starting full primary refresh. [2025-10-15T18:06:04.885943] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2024-12. [2025-10-15T18:06:04.944556] [WARN ] [MAIN ] CMRE: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:06:05.006525] [INFO ] [MAIN ] CMRE: Wiping existing primary data before full refresh. [2025-10-15T18:06:05.055849] [INFO ] [LOCAL ] CMRE: Starting deletion of primary data. [2025-10-15T18:06:05.096767] [DEBUG] [LOCAL ] CMRE: Deleted primary data file. [2025-10-15T18:06:05.099807] [INFO ] [MAIN ] CMRE: Starting full primary refresh. [2025-10-15T18:06:05.089244] [WARN ] [MAIN ] CMS: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:06:05.152511] [INFO ] [MAIN ] CMS: Wiping existing primary data before full refresh. [2025-10-15T18:06:05.166411] [INFO ] [LOCAL ] CMS: Starting deletion of primary data. [2025-10-15T18:06:05.252462] [DEBUG] [LOCAL ] CMS: Deleted primary data file. [2025-10-15T18:06:05.270447] [INFO ] [MAIN ] CMS: Starting full primary refresh. [2025-10-15T18:06:05.781513] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-10-15T18:06:05.827224] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-01. [2025-10-15T18:06:05.865283] [INFO ] [REMOTE ] CMSC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:06:05.883031] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2024-12. [2025-10-15T18:06:06.093030] [INFO ] [REMOTE ] CMRE: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:06:06.116772] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2024-12. [2025-10-15T18:06:06.146388] [INFO ] [REMOTE ] CMS: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:06:06.146679] [INFO ] [REMOTE ] CMS: Fetching primary data for 2024-12. [2025-10-15T18:06:06.412067] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-15T18:06:06.414715] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-02. [2025-10-15T18:06:06.646971] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-10-15T18:06:06.648762] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-01. [2025-10-15T18:06:06.850354] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-15T18:06:06.852157] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-03. [2025-10-15T18:06:07.214715] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-10-15T18:06:07.216517] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-04. [2025-10-15T18:06:07.388256] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-15T18:06:07.393767] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-01. [2025-10-15T18:06:07.446578] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-15T18:06:07.448368] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-02. [2025-10-15T18:06:07.553208] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-04 (0.34 seconds). [2025-10-15T18:06:07.695466] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-15T18:06:07.916938] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-15T18:06:08.114005] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-01. [2025-10-15T18:06:08.431473] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-15T18:06:08.914014] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-03. [2025-10-15T18:06:09.384875] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-10-15T18:06:09.713986] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-04. [2025-10-15T18:06:09.795267] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-15T18:06:10.283513] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-15T18:06:10.514009] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-05. [2025-10-15T18:06:10.869595] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-05 (0.36 seconds). [2025-10-15T18:06:11.313996] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-06. [2025-10-15T18:06:11.784760] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-10-15T18:06:12.113996] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-07. [2025-10-15T18:06:12.455819] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-07 (0.34 seconds). [2025-10-15T18:06:12.914009] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-08. [2025-10-15T18:06:13.451938] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-10-15T18:06:13.714019] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-09. [2025-10-15T18:06:14.052591] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-09 (0.34 seconds). [2025-10-15T18:06:14.514002] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-10. [2025-10-15T18:06:15.049927] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-15T18:06:15.050925] [INFO ] [REMOTE ] CMSA: Full fetch complete (5098 records). [2025-10-15T18:06:15.050994] [DEBUG] [VALIDATOR ] CMSA: Validating primary data. [2025-10-15T18:06:15.051387] [FATAL] [VALIDATOR ] CMSA: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T18:06:15.051471] [FATAL] [MAIN ] CMSA: Fetched primary data is invalid. Refusing to save it. [2025-10-15T18:06:15.051515] [WARN ] [MAIN ] CMSA: Deleting existing primary and derivative data due to validation failure. [2025-10-15T18:06:15.051581] [INFO ] [LOCAL ] CMSA: Starting deletion of primary data. [2025-10-15T18:06:15.051666] [DEBUG] [LOCAL ] CMSA: No primary data file found to delete. [2025-10-15T18:06:15.051725] [INFO ] [LOCAL ] CMSA: Starting deletion of derivative data. [2025-10-15T18:06:15.051771] [DEBUG] [LOCAL ] CMSA: No derivative data file found to delete. [2025-10-15T18:06:15.051826] [INFO ] [MAIN ] Update Progress: 481/2369 symbols completed. CMSA took 12.0s. Estimated remaining: 4h 19m 45s. Rate: 7.3 symbols/min [2025-10-15T18:06:15.218616] [INFO ] [MAIN ] CMSD: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:06:15.227924] [DEBUG] [LOCAL ] CMSD: Loaded 7911 existing records from primary storage. [2025-10-15T18:06:15.228101] [INFO ] [MAIN ] CMSD: Loaded 7911 existing records. [2025-10-15T18:06:15.319111] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-02. [2025-10-15T18:06:15.410793] [WARN ] [MAIN ] CMSD: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:06:15.410999] [INFO ] [MAIN ] CMSD: Wiping existing primary data before full refresh. [2025-10-15T18:06:15.411082] [INFO ] [LOCAL ] CMSD: Starting deletion of primary data. [2025-10-15T18:06:15.411280] [DEBUG] [LOCAL ] CMSD: Deleted primary data file. [2025-10-15T18:06:15.411338] [INFO ] [MAIN ] CMSD: Starting full primary refresh. [2025-10-15T18:06:15.764572] [INFO ] [REMOTE ] CMSD: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:06:16.114005] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-02. [2025-10-15T18:06:16.571118] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-15T18:06:16.913999] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-03. [2025-10-15T18:06:17.391886] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-15T18:06:17.713982] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-03. [2025-10-15T18:06:18.334285] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-15T18:06:18.514001] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-04. [2025-10-15T18:06:19.314004] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-05. [2025-10-15T18:06:19.536631] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-15T18:06:19.592590] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-15T18:06:19.769373] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-10-15T18:06:20.114018] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-06. [2025-10-15T18:06:20.534498] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-10-15T18:06:20.914046] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-05. [2025-10-15T18:06:21.713981] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-07. [2025-10-15T18:06:21.984277] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-15T18:06:22.222085] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-10-15T18:06:22.514011] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-06. [2025-10-15T18:06:23.314005] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-08. [2025-10-15T18:06:23.434730] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-15T18:06:23.896447] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-15T18:06:24.113975] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-07. [2025-10-15T18:06:24.913995] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2024-12. [2025-10-15T18:06:25.496303] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-15T18:06:25.713991] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-08. [2025-10-15T18:06:25.926982] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-10-15T18:06:26.514036] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-09. [2025-10-15T18:06:26.955319] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-15T18:06:26.955586] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-10-15T18:06:27.314010] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-04. [2025-10-15T18:06:28.114011] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-09. [2025-10-15T18:06:28.914020] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-01. [2025-10-15T18:06:29.157109] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-15T18:06:29.471434] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-15T18:06:29.520831] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-15T18:06:29.714061] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-10. [2025-10-15T18:06:30.401257] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-15T18:06:30.402335] [INFO ] [REMOTE ] CMSC: Full fetch complete (7119 records). [2025-10-15T18:06:30.402404] [DEBUG] [VALIDATOR ] CMSC: Validating primary data. [2025-10-15T18:06:30.519168] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-02. [2025-10-15T18:06:30.770033] [DEBUG] [VALIDATOR ] CMSC: All expected trading days are present. [2025-10-15T18:06:30.770113] [DEBUG] [VALIDATOR ] CMSC: Primary data validation passed. [2025-10-15T18:06:30.770327] [INFO ] [MAIN ] CMSC: Fetched primary data is valid. [2025-10-15T18:06:30.770430] [DEBUG] [LOCAL ] CMSC: Saving primary data. [2025-10-15T18:06:30.770921] [DEBUG] [LOCAL ] CMSC: Trimmed 7119 records to 4881 (keeping 200 days of data) [2025-10-15T18:06:30.801010] [DEBUG] [LOCAL ] CMSC: Primary data saved (4881 records). [2025-10-15T18:06:30.801155] [INFO ] [MAIN ] CMSC: Full history saved. [2025-10-15T18:06:30.801242] [INFO ] [MAIN ] Update Progress: 482/2369 symbols completed. CMSC took 27.7s. Estimated remaining: 4h 20m 6s. Rate: 7.3 symbols/min [2025-10-15T18:06:30.968132] [INFO ] [MAIN ] CMTG: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:06:31.007578] [DEBUG] [LOCAL ] CMTG: Loaded 35934 existing records from primary storage. [2025-10-15T18:06:31.007920] [INFO ] [MAIN ] CMTG: Loaded 35934 existing records. [2025-10-15T18:06:31.182146] [WARN ] [MAIN ] CMTG: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:06:31.182363] [INFO ] [MAIN ] CMTG: Wiping existing primary data before full refresh. [2025-10-15T18:06:31.182411] [INFO ] [LOCAL ] CMTG: Starting deletion of primary data. [2025-10-15T18:06:31.182816] [DEBUG] [LOCAL ] CMTG: Deleted primary data file. [2025-10-15T18:06:31.182873] [INFO ] [MAIN ] CMTG: Starting full primary refresh. [2025-10-15T18:06:31.301547] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-15T18:06:31.317350] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-05. [2025-10-15T18:06:31.613444] [INFO ] [REMOTE ] CMTG: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:06:32.114060] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-10. [2025-10-15T18:06:32.883722] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-15T18:06:32.913998] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-06. [2025-10-15T18:06:33.526671] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-15T18:06:33.531794] [INFO ] [REMOTE ] CMRE: Full fetch complete (51055 records). [2025-10-15T18:06:33.531933] [DEBUG] [VALIDATOR ] CMRE: Validating primary data. [2025-10-15T18:06:33.721624] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2024-12. [2025-10-15T18:06:33.954843] [DEBUG] [VALIDATOR ] CMRE: All expected trading days are present. [2025-10-15T18:06:33.954921] [DEBUG] [VALIDATOR ] CMRE: Primary data validation passed. [2025-10-15T18:06:33.955630] [INFO ] [MAIN ] CMRE: Fetched primary data is valid. [2025-10-15T18:06:33.955707] [DEBUG] [LOCAL ] CMRE: Saving primary data. [2025-10-15T18:06:33.956722] [DEBUG] [LOCAL ] CMRE: Trimmed 51055 records to 35851 (keeping 200 days of data) [2025-10-15T18:06:34.167142] [DEBUG] [LOCAL ] CMRE: Primary data saved (35851 records). [2025-10-15T18:06:34.167282] [INFO ] [MAIN ] CMRE: Full history saved. [2025-10-15T18:06:34.167409] [INFO ] [MAIN ] Update Progress: 483/2369 symbols completed. CMRE took 31.1s. Estimated remaining: 4h 19m 39s. Rate: 7.3 symbols/min [2025-10-15T18:06:34.339789] [INFO ] [MAIN ] CMU: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:06:34.347938] [DEBUG] [LOCAL ] CMU: Loaded 6338 existing records from primary storage. [2025-10-15T18:06:34.348111] [INFO ] [MAIN ] CMU: Loaded 6338 existing records. [2025-10-15T18:06:34.528744] [WARN ] [MAIN ] CMU: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:06:34.529150] [INFO ] [MAIN ] CMU: Wiping existing primary data before full refresh. [2025-10-15T18:06:34.522725] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-03. [2025-10-15T18:06:34.529357] [INFO ] [LOCAL ] CMU: Starting deletion of primary data. [2025-10-15T18:06:34.530279] [DEBUG] [LOCAL ] CMU: Deleted primary data file. [2025-10-15T18:06:34.530364] [INFO ] [MAIN ] CMU: Starting full primary refresh. [2025-10-15T18:06:34.832298] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-10-15T18:06:34.938518] [INFO ] [REMOTE ] CMU: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:06:34.949537] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-10-15T18:06:35.152785] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-15T18:06:35.314008] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-04. [2025-10-15T18:06:35.980093] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-10-15T18:06:36.113967] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-05. [2025-10-15T18:06:36.884591] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-15T18:06:36.913964] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-06. [2025-10-15T18:06:37.612484] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-15T18:06:37.713981] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-07. [2025-10-15T18:06:38.151197] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-10-15T18:06:38.513996] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-08. [2025-10-15T18:06:39.164398] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-10-15T18:06:39.314005] [INFO ] [REMOTE ] CMU: Fetching primary data for 2024-12. [2025-10-15T18:06:40.104187] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-10-15T18:06:40.113953] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-01. [2025-10-15T18:06:40.505067] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-01 (0.39 seconds). [2025-10-15T18:06:40.914044] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-02. [2025-10-15T18:06:41.491122] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-15T18:06:41.713989] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-01. [2025-10-15T18:06:42.514067] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-09. [2025-10-15T18:06:42.786200] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-15T18:06:43.253544] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-15T18:06:43.313965] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-03. [2025-10-15T18:06:44.063734] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-15T18:06:44.113991] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-04. [2025-10-15T18:06:44.914036] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-02. [2025-10-15T18:06:44.924776] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-15T18:06:45.714009] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-07. [2025-10-15T18:06:46.040094] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-15T18:06:46.514053] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-03. [2025-10-15T18:06:47.122588] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-15T18:06:47.314046] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-10. [2025-10-15T18:06:48.072800] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-15T18:06:48.074445] [INFO ] [REMOTE ] CMSD: Full fetch complete (11876 records). [2025-10-15T18:06:48.074762] [DEBUG] [VALIDATOR ] CMSD: Validating primary data. [2025-10-15T18:06:48.119140] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-08. [2025-10-15T18:06:48.224234] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-15T18:06:48.483077] [DEBUG] [VALIDATOR ] CMSD: All expected trading days are present. [2025-10-15T18:06:48.483156] [DEBUG] [VALIDATOR ] CMSD: Primary data validation passed. [2025-10-15T18:06:48.483456] [INFO ] [MAIN ] CMSD: Fetched primary data is valid. [2025-10-15T18:06:48.483497] [DEBUG] [LOCAL ] CMSD: Saving primary data. [2025-10-15T18:06:48.483979] [DEBUG] [LOCAL ] CMSD: Trimmed 11876 records to 7835 (keeping 200 days of data) [2025-10-15T18:06:48.530979] [DEBUG] [LOCAL ] CMSD: Primary data saved (7835 records). [2025-10-15T18:06:48.531093] [INFO ] [MAIN ] CMSD: Full history saved. [2025-10-15T18:06:48.531170] [INFO ] [MAIN ] Update Progress: 484/2369 symbols completed. CMSD took 33.5s. Estimated remaining: 4h 19m 54s. Rate: 7.3 symbols/min [2025-10-15T18:06:48.699334] [INFO ] [MAIN ] CNA: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:06:48.730115] [DEBUG] [LOCAL ] CNA: Loaded 32938 existing records from primary storage. [2025-10-15T18:06:48.730411] [INFO ] [MAIN ] CNA: Loaded 32938 existing records. [2025-10-15T18:06:48.909678] [WARN ] [MAIN ] CNA: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:06:48.909876] [INFO ] [MAIN ] CNA: Wiping existing primary data before full refresh. [2025-10-15T18:06:48.909923] [INFO ] [LOCAL ] CNA: Starting deletion of primary data. [2025-10-15T18:06:48.910112] [DEBUG] [LOCAL ] CNA: Deleted primary data file. [2025-10-15T18:06:48.910168] [INFO ] [MAIN ] CNA: Starting full primary refresh. [2025-10-15T18:06:48.921032] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-04. [2025-10-15T18:06:49.256980] [INFO ] [REMOTE ] CNA: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:06:49.523447] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-15T18:06:49.714021] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-05. [2025-10-15T18:06:50.158485] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-10-15T18:06:50.508059] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-15T18:06:50.516398] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-09. [2025-10-15T18:06:51.313979] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-06. [2025-10-15T18:06:51.735874] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-10-15T18:06:51.946457] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-15T18:06:52.113980] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-10. [2025-10-15T18:06:52.914018] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-07. [2025-10-15T18:06:53.595997] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-15T18:06:53.603126] [INFO ] [REMOTE ] CMS: Full fetch complete (76185 records). [2025-10-15T18:06:53.603336] [DEBUG] [VALIDATOR ] CMS: Validating primary data. [2025-10-15T18:06:53.719114] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-05. [2025-10-15T18:06:53.724620] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-15T18:06:54.015174] [DEBUG] [VALIDATOR ] CMS: All expected trading days are present. [2025-10-15T18:06:54.015262] [DEBUG] [VALIDATOR ] CMS: Primary data validation passed. [2025-10-15T18:06:54.016263] [INFO ] [MAIN ] CMS: Fetched primary data is valid. [2025-10-15T18:06:54.016330] [DEBUG] [LOCAL ] CMS: Saving primary data. [2025-10-15T18:06:54.017892] [DEBUG] [LOCAL ] CMS: Trimmed 76185 records to 52615 (keeping 200 days of data) [2025-10-15T18:06:54.339670] [DEBUG] [LOCAL ] CMS: Primary data saved (52615 records). [2025-10-15T18:06:54.339806] [INFO ] [MAIN ] CMS: Full history saved. [2025-10-15T18:06:54.340830] [INFO ] [MAIN ] Update Progress: 485/2369 symbols completed. CMS took 51.3s. Estimated remaining: 4h 19m 36s. Rate: 7.3 symbols/min [2025-10-15T18:06:54.503671] [INFO ] [MAIN ] CNC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:06:54.514084] [INFO ] [REMOTE ] CNA: Fetching primary data for 2024-12. [2025-10-15T18:06:54.555208] [DEBUG] [LOCAL ] CNC: Loaded 53767 existing records from primary storage. [2025-10-15T18:06:54.555573] [INFO ] [MAIN ] CNC: Loaded 53767 existing records. [2025-10-15T18:06:54.726227] [WARN ] [MAIN ] CNC: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:06:54.727053] [INFO ] [MAIN ] CNC: Wiping existing primary data before full refresh. [2025-10-15T18:06:54.727105] [INFO ] [LOCAL ] CNC: Starting deletion of primary data. [2025-10-15T18:06:54.727564] [DEBUG] [LOCAL ] CNC: Deleted primary data file. [2025-10-15T18:06:54.727603] [INFO ] [MAIN ] CNC: Starting full primary refresh. [2025-10-15T18:06:55.078376] [INFO ] [REMOTE ] CNC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:06:55.104828] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-15T18:06:55.314054] [INFO ] [REMOTE ] CNC: Fetching primary data for 2024-12. [2025-10-15T18:06:55.462307] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-10-15T18:06:56.113998] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-06. [2025-10-15T18:06:56.855706] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-15T18:06:56.913989] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-01. [2025-10-15T18:06:57.219715] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-15T18:06:57.714044] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-01. [2025-10-15T18:06:58.399217] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-15T18:06:58.514031] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-08. [2025-10-15T18:06:58.912306] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-15T18:06:58.979545] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-10-15T18:06:59.314013] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-07. [2025-10-15T18:07:00.114046] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-09. [2025-10-15T18:07:00.658359] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-15T18:07:00.765222] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-15T18:07:00.914020] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-02. [2025-10-15T18:07:01.713999] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-08. [2025-10-15T18:07:02.514052] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-02. [2025-10-15T18:07:02.635046] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-15T18:07:03.006351] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-15T18:07:03.314016] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-03. [2025-10-15T18:07:03.701868] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-15T18:07:04.113993] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-09. [2025-10-15T18:07:04.790076] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-15T18:07:04.914043] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-04. [2025-10-15T18:07:05.270605] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-15T18:07:05.714003] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-10. [2025-10-15T18:07:06.520832] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-10. [2025-10-15T18:07:06.540921] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-15T18:07:06.636622] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-15T18:07:06.640702] [INFO ] [REMOTE ] CMTG: Full fetch complete (53421 records). [2025-10-15T18:07:06.640885] [DEBUG] [VALIDATOR ] CMTG: Validating primary data. [2025-10-15T18:07:07.054545] [DEBUG] [VALIDATOR ] CMTG: All expected trading days are present. [2025-10-15T18:07:07.054671] [DEBUG] [VALIDATOR ] CMTG: Primary data validation passed. [2025-10-15T18:07:07.055404] [INFO ] [MAIN ] CMTG: Fetched primary data is valid. [2025-10-15T18:07:07.055450] [DEBUG] [LOCAL ] CMTG: Saving primary data. [2025-10-15T18:07:07.056877] [DEBUG] [LOCAL ] CMTG: Trimmed 53421 records to 35854 (keeping 200 days of data) [2025-10-15T18:07:07.144301] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-15T18:07:07.146279] [INFO ] [REMOTE ] CMU: Full fetch complete (9538 records). [2025-10-15T18:07:07.146973] [DEBUG] [VALIDATOR ] CMU: Validating primary data. [2025-10-15T18:07:07.330613] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-03. [2025-10-15T18:07:07.591319] [DEBUG] [VALIDATOR ] CMU: All expected trading days are present. [2025-10-15T18:07:07.616326] [DEBUG] [VALIDATOR ] CMU: Primary data validation passed. [2025-10-15T18:07:07.617736] [INFO ] [MAIN ] CMU: Fetched primary data is valid. [2025-10-15T18:07:07.619792] [DEBUG] [LOCAL ] CMU: Saving primary data. [2025-10-15T18:07:07.622076] [DEBUG] [LOCAL ] CMU: Trimmed 9538 records to 6330 (keeping 200 days of data) [2025-10-15T18:07:07.685853] [DEBUG] [LOCAL ] CMU: Primary data saved (6330 records). [2025-10-15T18:07:07.686184] [INFO ] [MAIN ] CMU: Full history saved. [2025-10-15T18:07:07.685974] [DEBUG] [LOCAL ] CMTG: Primary data saved (35854 records). [2025-10-15T18:07:07.686386] [INFO ] [MAIN ] Update Progress: 486/2369 symbols completed. CMU took 33.5s. Estimated remaining: 4h 19m 48s. Rate: 7.2 symbols/min [2025-10-15T18:07:07.686503] [INFO ] [MAIN ] CMTG: Full history saved. [2025-10-15T18:07:07.707471] [INFO ] [MAIN ] Update Progress: 487/2369 symbols completed. CMTG took 36.9s. Estimated remaining: 4h 19m 7s. Rate: 7.3 symbols/min [2025-10-15T18:07:08.024763] [INFO ] [MAIN ] CNF: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:07:08.042241] [INFO ] [MAIN ] CNH: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:07:08.052947] [DEBUG] [LOCAL ] CNF: Loaded 10639 existing records from primary storage. [2025-10-15T18:07:08.053178] [INFO ] [MAIN ] CNF: Loaded 10639 existing records. [2025-10-15T18:07:08.114729] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-05. [2025-10-15T18:07:08.251106] [WARN ] [MAIN ] CNF: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:07:08.251793] [INFO ] [MAIN ] CNF: Wiping existing primary data before full refresh. [2025-10-15T18:07:08.251892] [INFO ] [LOCAL ] CNF: Starting deletion of primary data. [2025-10-15T18:07:08.252076] [DEBUG] [LOCAL ] CNF: Deleted primary data file. [2025-10-15T18:07:08.252116] [INFO ] [MAIN ] CNF: Starting full primary refresh. [2025-10-15T18:07:08.402232] [DEBUG] [LOCAL ] CNH: Loaded 53552 existing records from primary storage. [2025-10-15T18:07:08.432993] [INFO ] [MAIN ] CNH: Loaded 53552 existing records. [2025-10-15T18:07:08.763664] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-15T18:07:08.817319] [WARN ] [MAIN ] CNH: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:07:08.838971] [INFO ] [MAIN ] CNH: Wiping existing primary data before full refresh. [2025-10-15T18:07:08.860877] [INFO ] [LOCAL ] CNH: Starting deletion of primary data. [2025-10-15T18:07:08.881797] [INFO ] [REMOTE ] CNF: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:07:08.883104] [DEBUG] [LOCAL ] CNH: Deleted primary data file. [2025-10-15T18:07:08.883201] [INFO ] [MAIN ] CNH: Starting full primary refresh. [2025-10-15T18:07:08.919130] [INFO ] [REMOTE ] CNF: Fetching primary data for 2024-12. [2025-10-15T18:07:09.253988] [INFO ] [REMOTE ] CNH: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:07:09.713971] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-04. [2025-10-15T18:07:09.725114] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-10-15T18:07:09.947241] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-15T18:07:10.514010] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-01. [2025-10-15T18:07:10.689966] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-15T18:07:11.060882] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-15T18:07:11.314004] [INFO ] [REMOTE ] CNH: Fetching primary data for 2024-12. [2025-10-15T18:07:12.113999] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-06. [2025-10-15T18:07:12.914018] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-02. [2025-10-15T18:07:13.339921] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2024-12 (2.03 seconds). [2025-10-15T18:07:13.353211] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-15T18:07:13.585374] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-15T18:07:13.713963] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-01. [2025-10-15T18:07:14.514054] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-05. [2025-10-15T18:07:15.029804] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-15T18:07:15.314014] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-03. [2025-10-15T18:07:15.891400] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-15T18:07:16.097074] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-15T18:07:16.113952] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-02. [2025-10-15T18:07:16.913994] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-06. [2025-10-15T18:07:17.406399] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-15T18:07:17.713995] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-03. [2025-10-15T18:07:17.880763] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-15T18:07:18.514030] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-07. [2025-10-15T18:07:19.314009] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-04. [2025-10-15T18:07:19.514986] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-15T18:07:19.941546] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-10-15T18:07:20.114282] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-04. [2025-10-15T18:07:20.914048] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-07. [2025-10-15T18:07:21.207318] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-07 (2.69 seconds). [2025-10-15T18:07:21.713972] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-08. [2025-10-15T18:07:21.869206] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-15T18:07:21.966001] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-15T18:07:22.514017] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-05. [2025-10-15T18:07:23.314099] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-08. [2025-10-15T18:07:23.894871] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-08 (2.18 seconds). [2025-10-15T18:07:24.113977] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-09. [2025-10-15T18:07:24.251318] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-15T18:07:24.724750] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-15T18:07:24.914024] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-05. [2025-10-15T18:07:25.407726] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-15T18:07:25.713984] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-06. [2025-10-15T18:07:25.945864] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-15T18:07:26.513971] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-09. [2025-10-15T18:07:26.639515] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-15T18:07:27.314017] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-07. [2025-10-15T18:07:27.626907] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-15T18:07:27.777273] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-10-15T18:07:28.113998] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-08. [2025-10-15T18:07:28.212918] [DEBUG] [REMOTE ] CNF: Error fetching primary data for 2025-08: 'API call returned an empty response.' [2025-10-15T18:07:28.213229] [WARN ] [REMOTE ] CNF: No data returned for month 2025-08 [2025-10-15T18:07:28.213316] [FATAL] [REMOTE ] CNF: API call failed - aborting fetch to avoid wasting further API calls [2025-10-15T18:07:28.213397] [FATAL] [MAIN ] CNF: Failed to fetch primary data. [2025-10-15T18:07:28.213433] [WARN ] [MAIN ] CNF: Deleting existing primary and derivative data due to fetch failure. [2025-10-15T18:07:28.213502] [INFO ] [LOCAL ] CNF: Starting deletion of primary data. [2025-10-15T18:07:28.213568] [DEBUG] [LOCAL ] CNF: No primary data file found to delete. [2025-10-15T18:07:28.213602] [INFO ] [LOCAL ] CNF: Starting deletion of derivative data. [2025-10-15T18:07:28.213774] [DEBUG] [LOCAL ] CNF: Deleted derivative data file. [2025-10-15T18:07:28.213858] [INFO ] [MAIN ] Update Progress: 488/2369 symbols completed. CNF took 20.5s. Estimated remaining: 4h 19m 46s. Rate: 7.2 symbols/min [2025-10-15T18:07:28.377487] [INFO ] [MAIN ] CNI: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:07:28.425871] [DEBUG] [LOCAL ] CNI: Loaded 51687 existing records from primary storage. [2025-10-15T18:07:28.426197] [INFO ] [MAIN ] CNI: Loaded 51687 existing records. [2025-10-15T18:07:28.600066] [WARN ] [MAIN ] CNI: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:07:28.600270] [INFO ] [MAIN ] CNI: Wiping existing primary data before full refresh. [2025-10-15T18:07:28.600316] [INFO ] [LOCAL ] CNI: Starting deletion of primary data. [2025-10-15T18:07:28.600866] [DEBUG] [LOCAL ] CNI: Deleted primary data file. [2025-10-15T18:07:28.600928] [INFO ] [MAIN ] CNI: Starting full primary refresh. [2025-10-15T18:07:28.920609] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-06. [2025-10-15T18:07:28.941922] [INFO ] [REMOTE ] CNI: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:07:29.713982] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-10. [2025-10-15T18:07:30.512879] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-15T18:07:30.515036] [INFO ] [REMOTE ] CNI: Fetching primary data for 2024-12. [2025-10-15T18:07:30.520288] [INFO ] [REMOTE ] CNC: Full fetch complete (77844 records). [2025-10-15T18:07:30.520370] [DEBUG] [VALIDATOR ] CNC: Validating primary data. [2025-10-15T18:07:30.828555] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-10-15T18:07:30.962939] [DEBUG] [VALIDATOR ] CNC: All expected trading days are present. [2025-10-15T18:07:30.963071] [DEBUG] [VALIDATOR ] CNC: Primary data validation passed. [2025-10-15T18:07:30.964058] [INFO ] [MAIN ] CNC: Fetched primary data is valid. [2025-10-15T18:07:30.964121] [DEBUG] [LOCAL ] CNC: Saving primary data. [2025-10-15T18:07:30.965636] [DEBUG] [LOCAL ] CNC: Trimmed 77844 records to 53770 (keeping 200 days of data) [2025-10-15T18:07:31.273942] [DEBUG] [LOCAL ] CNC: Primary data saved (53770 records). [2025-10-15T18:07:31.274081] [INFO ] [MAIN ] CNC: Full history saved. [2025-10-15T18:07:31.274405] [INFO ] [MAIN ] Update Progress: 489/2369 symbols completed. CNC took 36.9s. Estimated remaining: 4h 19m 18s. Rate: 7.3 symbols/min [2025-10-15T18:07:31.319196] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-07. [2025-10-15T18:07:31.440367] [INFO ] [MAIN ] CNK: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:07:31.488945] [DEBUG] [LOCAL ] CNK: Loaded 52891 existing records from primary storage. [2025-10-15T18:07:31.489293] [INFO ] [MAIN ] CNK: Loaded 52891 existing records. [2025-10-15T18:07:31.662163] [WARN ] [MAIN ] CNK: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:07:31.662370] [INFO ] [MAIN ] CNK: Wiping existing primary data before full refresh. [2025-10-15T18:07:31.662417] [INFO ] [LOCAL ] CNK: Starting deletion of primary data. [2025-10-15T18:07:31.662983] [DEBUG] [LOCAL ] CNK: Deleted primary data file. [2025-10-15T18:07:31.663041] [INFO ] [MAIN ] CNK: Starting full primary refresh. [2025-10-15T18:07:32.005097] [INFO ] [REMOTE ] CNK: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:07:32.113973] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-10. [2025-10-15T18:07:32.395633] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-10-15T18:07:32.914114] [INFO ] [REMOTE ] CNK: Fetching primary data for 2024-12. [2025-10-15T18:07:33.248835] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-15T18:07:33.272138] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-15T18:07:33.276140] [INFO ] [REMOTE ] CNA: Full fetch complete (46015 records). [2025-10-15T18:07:33.276218] [DEBUG] [VALIDATOR ] CNA: Validating primary data. [2025-10-15T18:07:33.643880] [DEBUG] [VALIDATOR ] CNA: All expected trading days are present. [2025-10-15T18:07:33.643961] [DEBUG] [VALIDATOR ] CNA: Primary data validation passed. [2025-10-15T18:07:33.644617] [INFO ] [MAIN ] CNA: Fetched primary data is valid. [2025-10-15T18:07:33.644686] [DEBUG] [LOCAL ] CNA: Saving primary data. [2025-10-15T18:07:33.645595] [DEBUG] [LOCAL ] CNA: Trimmed 46015 records to 32932 (keeping 200 days of data) [2025-10-15T18:07:33.731741] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-01. [2025-10-15T18:07:33.838251] [DEBUG] [LOCAL ] CNA: Primary data saved (32932 records). [2025-10-15T18:07:33.838386] [INFO ] [MAIN ] CNA: Full history saved. [2025-10-15T18:07:33.838464] [INFO ] [MAIN ] Update Progress: 490/2369 symbols completed. CNA took 45.3s. Estimated remaining: 4h 18m 48s. Rate: 7.3 symbols/min [2025-10-15T18:07:34.003195] [INFO ] [MAIN ] CNM: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:07:34.049574] [DEBUG] [LOCAL ] CNM: Loaded 51023 existing records from primary storage. [2025-10-15T18:07:34.049898] [INFO ] [MAIN ] CNM: Loaded 51023 existing records. [2025-10-15T18:07:34.222491] [WARN ] [MAIN ] CNM: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:07:34.222679] [INFO ] [MAIN ] CNM: Wiping existing primary data before full refresh. [2025-10-15T18:07:34.222736] [INFO ] [LOCAL ] CNM: Starting deletion of primary data. [2025-10-15T18:07:34.223060] [DEBUG] [LOCAL ] CNM: Deleted primary data file. [2025-10-15T18:07:34.223120] [INFO ] [MAIN ] CNM: Starting full primary refresh. [2025-10-15T18:07:34.516922] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-08. [2025-10-15T18:07:34.581267] [INFO ] [REMOTE ] CNM: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:07:34.635985] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-15T18:07:35.121050] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-15T18:07:35.313981] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-02. [2025-10-15T18:07:35.944381] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-15T18:07:36.113980] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-09. [2025-10-15T18:07:36.514950] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-15T18:07:36.914006] [INFO ] [REMOTE ] CNM: Fetching primary data for 2024-12. [2025-10-15T18:07:37.630453] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-15T18:07:37.713951] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-10. [2025-10-15T18:07:38.513986] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-01. [2025-10-15T18:07:38.603266] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-15T18:07:39.314026] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-03. [2025-10-15T18:07:39.457297] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-15T18:07:39.464909] [INFO ] [REMOTE ] CNH: Full fetch complete (77705 records). [2025-10-15T18:07:39.465049] [DEBUG] [VALIDATOR ] CNH: Validating primary data. [2025-10-15T18:07:39.853009] [DEBUG] [VALIDATOR ] CNH: All expected trading days are present. [2025-10-15T18:07:39.853301] [DEBUG] [VALIDATOR ] CNH: Primary data validation passed. [2025-10-15T18:07:39.854418] [INFO ] [MAIN ] CNH: Fetched primary data is valid. [2025-10-15T18:07:39.854485] [DEBUG] [LOCAL ] CNH: Saving primary data. [2025-10-15T18:07:39.856179] [DEBUG] [LOCAL ] CNH: Trimmed 77705 records to 53552 (keeping 200 days of data) [2025-10-15T18:07:40.094908] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-15T18:07:40.114008] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-02. [2025-10-15T18:07:40.219532] [DEBUG] [LOCAL ] CNH: Primary data saved (53552 records). [2025-10-15T18:07:40.219709] [INFO ] [MAIN ] CNH: Full history saved. [2025-10-15T18:07:40.219806] [INFO ] [MAIN ] Update Progress: 491/2369 symbols completed. CNH took 32.5s. Estimated remaining: 4h 18m 32s. Rate: 7.3 symbols/min [2025-10-15T18:07:40.384202] [INFO ] [MAIN ] CNMD: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:07:40.413044] [DEBUG] [LOCAL ] CNMD: Loaded 32167 existing records from primary storage. [2025-10-15T18:07:40.413321] [INFO ] [MAIN ] CNMD: Loaded 32167 existing records. [2025-10-15T18:07:40.585572] [WARN ] [MAIN ] CNMD: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:07:40.585793] [INFO ] [MAIN ] CNMD: Wiping existing primary data before full refresh. [2025-10-15T18:07:40.585840] [INFO ] [LOCAL ] CNMD: Starting deletion of primary data. [2025-10-15T18:07:40.586586] [DEBUG] [LOCAL ] CNMD: Deleted primary data file. [2025-10-15T18:07:40.586680] [INFO ] [MAIN ] CNMD: Starting full primary refresh. [2025-10-15T18:07:40.914634] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-01. [2025-10-15T18:07:40.938252] [INFO ] [REMOTE ] CNMD: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:07:41.173039] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-15T18:07:41.439289] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-15T18:07:41.714073] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-04. [2025-10-15T18:07:42.400950] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-15T18:07:42.514068] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-02. [2025-10-15T18:07:43.230598] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-15T18:07:43.313975] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-03. [2025-10-15T18:07:44.018799] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-15T18:07:44.113955] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-03. [2025-10-15T18:07:44.781096] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-15T18:07:44.913997] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-04. [2025-10-15T18:07:45.626370] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-15T18:07:45.714006] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-04. [2025-10-15T18:07:46.266831] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-15T18:07:46.514062] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2024-12. [2025-10-15T18:07:47.304573] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-15T18:07:47.314697] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-05. [2025-10-15T18:07:47.755840] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-15T18:07:48.114006] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-05. [2025-10-15T18:07:48.913978] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-01. [2025-10-15T18:07:48.952437] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-15T18:07:49.400117] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-15T18:07:49.714003] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-06. [2025-10-15T18:07:49.815549] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-15T18:07:50.514003] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-05. [2025-10-15T18:07:51.185241] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-15T18:07:51.314055] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-02. [2025-10-15T18:07:52.113980] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-06. [2025-10-15T18:07:52.169187] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-15T18:07:52.350591] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-15T18:07:52.913993] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-06. [2025-10-15T18:07:53.535842] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-15T18:07:53.714014] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-03. [2025-10-15T18:07:54.514079] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-07. [2025-10-15T18:07:54.636194] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-15T18:07:54.830396] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-15T18:07:55.314009] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-07. [2025-10-15T18:07:56.114631] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-04. [2025-10-15T18:07:56.117310] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-15T18:07:56.831039] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-15T18:07:56.913978] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-08. [2025-10-15T18:07:57.383047] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-15T18:07:57.714005] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-07. [2025-10-15T18:07:58.338815] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-15T18:07:58.513987] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-09. [2025-10-15T18:07:59.109316] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-15T18:07:59.313992] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-08. [2025-10-15T18:07:59.949334] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-15T18:08:00.113990] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-10. [2025-10-15T18:08:00.821413] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-15T18:08:00.914010] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-09. [2025-10-15T18:08:01.714045] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-08. [2025-10-15T18:08:01.828447] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-15T18:08:01.834880] [INFO ] [REMOTE ] CNK: Full fetch complete (75727 records). [2025-10-15T18:08:01.835267] [DEBUG] [VALIDATOR ] CNK: Validating primary data. [2025-10-15T18:08:01.836239] [FATAL] [VALIDATOR ] CNK: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T18:08:01.836340] [FATAL] [MAIN ] CNK: Fetched primary data is invalid. Refusing to save it. [2025-10-15T18:08:01.836383] [WARN ] [MAIN ] CNK: Deleting existing primary and derivative data due to validation failure. [2025-10-15T18:08:01.836436] [INFO ] [LOCAL ] CNK: Starting deletion of primary data. [2025-10-15T18:08:01.836527] [DEBUG] [LOCAL ] CNK: No primary data file found to delete. [2025-10-15T18:08:01.836578] [INFO ] [LOCAL ] CNK: Starting deletion of derivative data. [2025-10-15T18:08:01.836780] [DEBUG] [LOCAL ] CNK: Deleted derivative data file. [2025-10-15T18:08:01.837232] [INFO ] [MAIN ] Update Progress: 492/2369 symbols completed. CNK took 30.6s. Estimated remaining: 4h 19m 15s. Rate: 7.2 symbols/min [2025-10-15T18:08:02.012341] [INFO ] [MAIN ] CNNE: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:08:02.048604] [DEBUG] [LOCAL ] CNNE: Loaded 36021 existing records from primary storage. [2025-10-15T18:08:02.049013] [INFO ] [MAIN ] CNNE: Loaded 36021 existing records. [2025-10-15T18:08:02.240417] [WARN ] [MAIN ] CNNE: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:08:02.240697] [INFO ] [MAIN ] CNNE: Wiping existing primary data before full refresh. [2025-10-15T18:08:02.240772] [INFO ] [LOCAL ] CNNE: Starting deletion of primary data. [2025-10-15T18:08:02.241411] [DEBUG] [LOCAL ] CNNE: Deleted primary data file. [2025-10-15T18:08:02.241469] [INFO ] [MAIN ] CNNE: Starting full primary refresh. [2025-10-15T18:08:02.520177] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-05. [2025-10-15T18:08:02.606435] [INFO ] [REMOTE ] CNNE: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:08:02.659825] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-15T18:08:03.227790] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-15T18:08:03.314046] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2024-12. [2025-10-15T18:08:03.595917] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-15T18:08:04.114064] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-09. [2025-10-15T18:08:04.556571] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-15T18:08:04.914099] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-06. [2025-10-15T18:08:05.658034] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-15T18:08:05.710913] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-15T18:08:05.716912] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-10. [2025-10-15T18:08:06.514044] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-07. [2025-10-15T18:08:07.314077] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-01. [2025-10-15T18:08:07.568251] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-10 (1.85 seconds). [2025-10-15T18:08:07.574319] [INFO ] [REMOTE ] CNI: Full fetch complete (74811 records). [2025-10-15T18:08:07.574448] [DEBUG] [VALIDATOR ] CNI: Validating primary data. [2025-10-15T18:08:07.976692] [DEBUG] [VALIDATOR ] CNI: All expected trading days are present. [2025-10-15T18:08:07.976951] [DEBUG] [VALIDATOR ] CNI: Primary data validation passed. [2025-10-15T18:08:07.978186] [INFO ] [MAIN ] CNI: Fetched primary data is valid. [2025-10-15T18:08:07.978289] [DEBUG] [LOCAL ] CNI: Saving primary data. [2025-10-15T18:08:08.000810] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-15T18:08:08.009459] [DEBUG] [LOCAL ] CNI: Trimmed 74811 records to 51698 (keeping 200 days of data) [2025-10-15T18:08:08.115131] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-08. [2025-10-15T18:08:08.331236] [DEBUG] [LOCAL ] CNI: Primary data saved (51698 records). [2025-10-15T18:08:08.331366] [INFO ] [MAIN ] CNI: Full history saved. [2025-10-15T18:08:08.331441] [INFO ] [MAIN ] Update Progress: 493/2369 symbols completed. CNI took 40.1s. Estimated remaining: 4h 18m 60s. Rate: 7.2 symbols/min [2025-10-15T18:08:08.518370] [INFO ] [MAIN ] CNO: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:08:08.519535] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-15T18:08:08.561099] [DEBUG] [LOCAL ] CNO: Loaded 40696 existing records from primary storage. [2025-10-15T18:08:08.561393] [INFO ] [MAIN ] CNO: Loaded 40696 existing records. [2025-10-15T18:08:08.734021] [WARN ] [MAIN ] CNO: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:08:08.734185] [INFO ] [MAIN ] CNO: Wiping existing primary data before full refresh. [2025-10-15T18:08:08.734230] [INFO ] [LOCAL ] CNO: Starting deletion of primary data. [2025-10-15T18:08:08.735073] [DEBUG] [LOCAL ] CNO: Deleted primary data file. [2025-10-15T18:08:08.735130] [INFO ] [MAIN ] CNO: Starting full primary refresh. [2025-10-15T18:08:08.919157] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-10. [2025-10-15T18:08:09.083791] [INFO ] [REMOTE ] CNO: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:08:09.463440] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-15T18:08:09.714055] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-02. [2025-10-15T18:08:10.320460] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-15T18:08:10.327036] [INFO ] [REMOTE ] CNM: Full fetch complete (73763 records). [2025-10-15T18:08:10.327210] [DEBUG] [VALIDATOR ] CNM: Validating primary data. [2025-10-15T18:08:10.526543] [INFO ] [REMOTE ] CNO: Fetching primary data for 2024-12. [2025-10-15T18:08:10.767543] [DEBUG] [VALIDATOR ] CNM: All expected trading days are present. [2025-10-15T18:08:10.767921] [DEBUG] [VALIDATOR ] CNM: Primary data validation passed. [2025-10-15T18:08:10.769170] [INFO ] [MAIN ] CNM: Fetched primary data is valid. [2025-10-15T18:08:10.769290] [DEBUG] [LOCAL ] CNM: Saving primary data. [2025-10-15T18:08:10.770974] [DEBUG] [LOCAL ] CNM: Trimmed 73763 records to 51035 (keeping 200 days of data) [2025-10-15T18:08:10.986546] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-15T18:08:11.087594] [DEBUG] [LOCAL ] CNM: Primary data saved (51035 records). [2025-10-15T18:08:11.087771] [INFO ] [MAIN ] CNM: Full history saved. [2025-10-15T18:08:11.087857] [INFO ] [MAIN ] Update Progress: 494/2369 symbols completed. CNM took 37.2s. Estimated remaining: 4h 18m 31s. Rate: 7.3 symbols/min [2025-10-15T18:08:11.251041] [INFO ] [MAIN ] CNP: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:08:11.296783] [DEBUG] [LOCAL ] CNP: Loaded 53480 existing records from primary storage. [2025-10-15T18:08:11.297082] [INFO ] [MAIN ] CNP: Loaded 53480 existing records. [2025-10-15T18:08:11.319178] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-09. [2025-10-15T18:08:11.474449] [WARN ] [MAIN ] CNP: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:08:11.474719] [INFO ] [MAIN ] CNP: Wiping existing primary data before full refresh. [2025-10-15T18:08:11.474779] [INFO ] [LOCAL ] CNP: Starting deletion of primary data. [2025-10-15T18:08:11.475828] [DEBUG] [LOCAL ] CNP: Deleted primary data file. [2025-10-15T18:08:11.475884] [INFO ] [MAIN ] CNP: Starting full primary refresh. [2025-10-15T18:08:11.827767] [INFO ] [REMOTE ] CNP: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:08:11.878596] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-15T18:08:12.113959] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-01. [2025-10-15T18:08:12.732707] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-15T18:08:12.913991] [INFO ] [REMOTE ] CNP: Fetching primary data for 2024-12. [2025-10-15T18:08:13.354831] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-15T18:08:13.714051] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-03. [2025-10-15T18:08:14.487578] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-15T18:08:14.513955] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-01. [2025-10-15T18:08:14.953067] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-15T18:08:15.314006] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-10. [2025-10-15T18:08:16.046222] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-15T18:08:16.113958] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-02. [2025-10-15T18:08:16.508306] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-15T18:08:16.512089] [INFO ] [REMOTE ] CNMD: Full fetch complete (47238 records). [2025-10-15T18:08:16.512200] [DEBUG] [VALIDATOR ] CNMD: Validating primary data. [2025-10-15T18:08:16.921922] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-04. [2025-10-15T18:08:16.924595] [DEBUG] [VALIDATOR ] CNMD: All expected trading days are present. [2025-10-15T18:08:16.925521] [DEBUG] [VALIDATOR ] CNMD: Primary data validation passed. [2025-10-15T18:08:16.926250] [INFO ] [MAIN ] CNMD: Fetched primary data is valid. [2025-10-15T18:08:16.926419] [DEBUG] [LOCAL ] CNMD: Saving primary data. [2025-10-15T18:08:16.927403] [DEBUG] [LOCAL ] CNMD: Trimmed 47238 records to 32127 (keeping 200 days of data) [2025-10-15T18:08:17.144993] [DEBUG] [LOCAL ] CNMD: Primary data saved (32127 records). [2025-10-15T18:08:17.145159] [INFO ] [MAIN ] CNMD: Full history saved. [2025-10-15T18:08:17.145261] [INFO ] [MAIN ] Update Progress: 495/2369 symbols completed. CNMD took 36.9s. Estimated remaining: 4h 18m 14s. Rate: 7.3 symbols/min [2025-10-15T18:08:17.311168] [INFO ] [MAIN ] CNQ: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:08:17.365434] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-15T18:08:17.391901] [DEBUG] [LOCAL ] CNQ: Loaded 53583 existing records from primary storage. [2025-10-15T18:08:17.392400] [INFO ] [MAIN ] CNQ: Loaded 53583 existing records. [2025-10-15T18:08:17.566744] [WARN ] [MAIN ] CNQ: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:08:17.566954] [INFO ] [MAIN ] CNQ: Wiping existing primary data before full refresh. [2025-10-15T18:08:17.567001] [INFO ] [LOCAL ] CNQ: Starting deletion of primary data. [2025-10-15T18:08:17.567974] [DEBUG] [LOCAL ] CNQ: Deleted primary data file. [2025-10-15T18:08:17.568038] [INFO ] [MAIN ] CNQ: Starting full primary refresh. [2025-10-15T18:08:17.720977] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-03. [2025-10-15T18:08:17.939227] [INFO ] [REMOTE ] CNQ: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:08:18.350988] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-15T18:08:18.514047] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2024-12. [2025-10-15T18:08:19.282566] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-15T18:08:19.313975] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-04. [2025-10-15T18:08:20.114044] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-02. [2025-10-15T18:08:20.338743] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-15T18:08:20.799849] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-15T18:08:20.914026] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-01. [2025-10-15T18:08:21.411740] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-15T18:08:21.714002] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-03. [2025-10-15T18:08:22.272169] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-15T18:08:22.513975] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-05. [2025-10-15T18:08:23.313978] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-02. [2025-10-15T18:08:23.413959] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-15T18:08:23.985506] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-15T18:08:24.113981] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-06. [2025-10-15T18:08:24.701300] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-15T18:08:24.913988] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-04. [2025-10-15T18:08:25.590373] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-15T18:08:25.713967] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-03. [2025-10-15T18:08:26.078493] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-15T18:08:26.513992] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-05. [2025-10-15T18:08:27.314014] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-07. [2025-10-15T18:08:27.499074] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-15T18:08:27.919384] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-15T18:08:28.114037] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-05. [2025-10-15T18:08:28.914033] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-04. [2025-10-15T18:08:28.916683] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-15T18:08:29.462175] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-15T18:08:29.714002] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-06. [2025-10-15T18:08:30.513974] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-06. [2025-10-15T18:08:30.568600] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-15T18:08:30.992334] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-15T18:08:31.314097] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-05. [2025-10-15T18:08:31.641488] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-15T18:08:32.114014] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-07. [2025-10-15T18:08:32.809353] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-15T18:08:32.913958] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-08. [2025-10-15T18:08:33.317227] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-15T18:08:33.714056] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-06. [2025-10-15T18:08:34.514083] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-08. [2025-10-15T18:08:34.734919] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-15T18:08:35.242190] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-15T18:08:35.314011] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-07. [2025-10-15T18:08:35.645793] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-15T18:08:36.114002] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-09. [2025-10-15T18:08:36.913983] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-09. [2025-10-15T18:08:37.247349] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-15T18:08:37.713982] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-07. [2025-10-15T18:08:37.815287] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-15T18:08:38.362299] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-15T18:08:38.514019] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-10. [2025-10-15T18:08:38.814474] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-15T18:08:39.314022] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-10. [2025-10-15T18:08:39.875407] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-15T18:08:39.880282] [INFO ] [REMOTE ] CNO: Full fetch complete (60772 records). [2025-10-15T18:08:39.880386] [DEBUG] [VALIDATOR ] CNO: Validating primary data. [2025-10-15T18:08:40.119109] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-08. [2025-10-15T18:08:40.298731] [DEBUG] [VALIDATOR ] CNO: All expected trading days are present. [2025-10-15T18:08:40.298818] [DEBUG] [VALIDATOR ] CNO: Primary data validation passed. [2025-10-15T18:08:40.299700] [INFO ] [MAIN ] CNO: Fetched primary data is valid. [2025-10-15T18:08:40.299765] [DEBUG] [LOCAL ] CNO: Saving primary data. [2025-10-15T18:08:40.300951] [DEBUG] [LOCAL ] CNO: Trimmed 60772 records to 40648 (keeping 200 days of data) [2025-10-15T18:08:40.546808] [DEBUG] [LOCAL ] CNO: Primary data saved (40648 records). [2025-10-15T18:08:40.546947] [INFO ] [MAIN ] CNO: Full history saved. [2025-10-15T18:08:40.547039] [INFO ] [MAIN ] Update Progress: 496/2369 symbols completed. CNO took 32.2s. Estimated remaining: 4h 19m 3s. Rate: 7.2 symbols/min [2025-10-15T18:08:40.716566] [INFO ] [MAIN ] CNR: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:08:40.716913] [DEBUG] [LOCAL ] CNR: No existing data file found in primary storage. [2025-10-15T18:08:40.716984] [WARN ] [MAIN ] CNR: No existing data found, performing full refresh instead. [2025-10-15T18:08:40.717318] [INFO ] [MAIN ] CNR: Wiping existing primary data before full refresh. [2025-10-15T18:08:40.717415] [INFO ] [LOCAL ] CNR: Starting deletion of primary data. [2025-10-15T18:08:40.717498] [DEBUG] [LOCAL ] CNR: No primary data file found to delete. [2025-10-15T18:08:40.717613] [INFO ] [MAIN ] CNR: Starting full primary refresh. [2025-10-15T18:08:40.912189] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-15T18:08:40.929221] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-08. [2025-10-15T18:08:40.983012] [INFO ] [REMOTE ] CNP: Full fetch complete (77547 records). [2025-10-15T18:08:41.003151] [DEBUG] [VALIDATOR ] CNP: Validating primary data. [2025-10-15T18:08:41.246600] [INFO ] [REMOTE ] CNR: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:08:41.553311] [DEBUG] [VALIDATOR ] CNP: All expected trading days are present. [2025-10-15T18:08:41.553402] [DEBUG] [VALIDATOR ] CNP: Primary data validation passed. [2025-10-15T18:08:41.554466] [INFO ] [MAIN ] CNP: Fetched primary data is valid. [2025-10-15T18:08:41.554532] [DEBUG] [LOCAL ] CNP: Saving primary data. [2025-10-15T18:08:41.556098] [DEBUG] [LOCAL ] CNP: Trimmed 77547 records to 53480 (keeping 200 days of data) [2025-10-15T18:08:41.702517] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-15T18:08:41.765469] [INFO ] [REMOTE ] CNR: Fetching primary data for 2024-12. [2025-10-15T18:08:41.921115] [DEBUG] [LOCAL ] CNP: Primary data saved (53480 records). [2025-10-15T18:08:41.921288] [INFO ] [MAIN ] CNP: Full history saved. [2025-10-15T18:08:41.921383] [INFO ] [MAIN ] Update Progress: 497/2369 symbols completed. CNP took 30.8s. Estimated remaining: 4h 18m 29s. Rate: 7.2 symbols/min [2025-10-15T18:08:42.064396] [DEBUG] [REMOTE ] CNR: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-15T18:08:42.087055] [WARN ] [REMOTE ] CNR: No data returned for month 2024-12 [2025-10-15T18:08:42.089470] [FATAL] [REMOTE ] CNR: API call failed - aborting fetch to avoid wasting further API calls [2025-10-15T18:08:42.089398] [INFO ] [MAIN ] CNS: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:08:42.089709] [FATAL] [MAIN ] CNR: Failed to fetch primary data. [2025-10-15T18:08:42.090097] [WARN ] [MAIN ] CNR: Deleting existing primary and derivative data due to fetch failure. [2025-10-15T18:08:42.090255] [INFO ] [LOCAL ] CNR: Starting deletion of primary data. [2025-10-15T18:08:42.090341] [DEBUG] [LOCAL ] CNR: No primary data file found to delete. [2025-10-15T18:08:42.090382] [INFO ] [LOCAL ] CNR: Starting deletion of derivative data. [2025-10-15T18:08:42.090436] [DEBUG] [LOCAL ] CNR: No derivative data file found to delete. [2025-10-15T18:08:42.090590] [INFO ] [MAIN ] Update Progress: 498/2369 symbols completed. CNR took 1.5s. Estimated remaining: 4h 17m 50s. Rate: 7.3 symbols/min [2025-10-15T18:08:42.278962] [INFO ] [MAIN ] CNX: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:08:42.279967] [DEBUG] [LOCAL ] CNS: Loaded 21073 existing records from primary storage. [2025-10-15T18:08:42.280783] [INFO ] [MAIN ] CNS: Loaded 21073 existing records. [2025-10-15T18:08:42.466004] [WARN ] [MAIN ] CNS: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:08:42.479416] [INFO ] [MAIN ] CNS: Wiping existing primary data before full refresh. [2025-10-15T18:08:42.479487] [INFO ] [LOCAL ] CNS: Starting deletion of primary data. [2025-10-15T18:08:42.480006] [DEBUG] [LOCAL ] CNS: Deleted primary data file. [2025-10-15T18:08:42.480063] [INFO ] [MAIN ] CNS: Starting full primary refresh. [2025-10-15T18:08:42.518717] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-09. [2025-10-15T18:08:42.626474] [DEBUG] [LOCAL ] CNX: Loaded 51365 existing records from primary storage. [2025-10-15T18:08:42.650570] [INFO ] [MAIN ] CNX: Loaded 51365 existing records. [2025-10-15T18:08:43.007283] [WARN ] [MAIN ] CNX: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:08:43.007699] [INFO ] [MAIN ] CNX: Wiping existing primary data before full refresh. [2025-10-15T18:08:43.007770] [INFO ] [LOCAL ] CNX: Starting deletion of primary data. [2025-10-15T18:08:43.031448] [DEBUG] [LOCAL ] CNX: Deleted primary data file. [2025-10-15T18:08:43.058222] [INFO ] [MAIN ] CNX: Starting full primary refresh. [2025-10-15T18:08:43.061115] [INFO ] [REMOTE ] CNS: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:08:43.317934] [INFO ] [REMOTE ] CNS: Fetching primary data for 2024-12. [2025-10-15T18:08:43.381939] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-08 (2.45 seconds). [2025-10-15T18:08:43.471480] [INFO ] [REMOTE ] CNX: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:08:43.864442] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-15T18:08:44.114015] [INFO ] [REMOTE ] CNX: Fetching primary data for 2024-12. [2025-10-15T18:08:44.475008] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-15T18:08:44.914022] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-01. [2025-10-15T18:08:45.714012] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-10. [2025-10-15T18:08:45.891567] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-15T18:08:45.989279] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-15T18:08:46.514040] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-09. [2025-10-15T18:08:46.989325] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-15T18:08:46.993571] [INFO ] [REMOTE ] CNNE: Full fetch complete (50455 records). [2025-10-15T18:08:46.993723] [DEBUG] [VALIDATOR ] CNNE: Validating primary data. [2025-10-15T18:08:47.327720] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-01. [2025-10-15T18:08:47.378904] [DEBUG] [VALIDATOR ] CNNE: All expected trading days are present. [2025-10-15T18:08:47.378998] [DEBUG] [VALIDATOR ] CNNE: Primary data validation passed. [2025-10-15T18:08:47.379754] [INFO ] [MAIN ] CNNE: Fetched primary data is valid. [2025-10-15T18:08:47.379822] [DEBUG] [LOCAL ] CNNE: Saving primary data. [2025-10-15T18:08:47.381011] [DEBUG] [LOCAL ] CNNE: Trimmed 50455 records to 35946 (keeping 200 days of data) [2025-10-15T18:08:47.597942] [DEBUG] [LOCAL ] CNNE: Primary data saved (35946 records). [2025-10-15T18:08:47.598126] [INFO ] [MAIN ] CNNE: Full history saved. [2025-10-15T18:08:47.598436] [INFO ] [MAIN ] Update Progress: 499/2369 symbols completed. CNNE took 45.8s. Estimated remaining: 4h 17m 31s. Rate: 7.3 symbols/min [2025-10-15T18:08:47.765744] [INFO ] [MAIN ] CODI: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:08:47.765919] [DEBUG] [LOCAL ] CODI: No existing data file found in primary storage. [2025-10-15T18:08:47.765975] [WARN ] [MAIN ] CODI: No existing data found, performing full refresh instead. [2025-10-15T18:08:47.766078] [INFO ] [MAIN ] CODI: Wiping existing primary data before full refresh. [2025-10-15T18:08:47.766120] [INFO ] [LOCAL ] CODI: Starting deletion of primary data. [2025-10-15T18:08:47.766162] [DEBUG] [LOCAL ] CODI: No primary data file found to delete. [2025-10-15T18:08:47.766195] [INFO ] [MAIN ] CODI: Starting full primary refresh. [2025-10-15T18:08:48.115241] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-02. [2025-10-15T18:08:48.115156] [INFO ] [REMOTE ] CODI: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:08:48.147914] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-15T18:08:48.914008] [INFO ] [REMOTE ] CODI: Fetching primary data for 2024-12. [2025-10-15T18:08:49.010563] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-15T18:08:49.091097] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-15T18:08:49.713973] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-10. [2025-10-15T18:08:50.100843] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-15T18:08:50.513995] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-02. [2025-10-15T18:08:51.229518] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-15T18:08:51.235983] [INFO ] [REMOTE ] CNQ: Full fetch complete (77737 records). [2025-10-15T18:08:51.236128] [DEBUG] [VALIDATOR ] CNQ: Validating primary data. [2025-10-15T18:08:51.319119] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-03. [2025-10-15T18:08:51.634250] [DEBUG] [VALIDATOR ] CNQ: All expected trading days are present. [2025-10-15T18:08:51.634328] [DEBUG] [VALIDATOR ] CNQ: Primary data validation passed. [2025-10-15T18:08:51.635248] [INFO ] [MAIN ] CNQ: Fetched primary data is valid. [2025-10-15T18:08:51.635312] [DEBUG] [LOCAL ] CNQ: Saving primary data. [2025-10-15T18:08:51.636911] [DEBUG] [LOCAL ] CNQ: Trimmed 77737 records to 53582 (keeping 200 days of data) [2025-10-15T18:08:51.895464] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-15T18:08:52.006510] [DEBUG] [LOCAL ] CNQ: Primary data saved (53582 records). [2025-10-15T18:08:52.006679] [INFO ] [MAIN ] CNQ: Full history saved. [2025-10-15T18:08:52.007764] [INFO ] [MAIN ] Update Progress: 500/2369 symbols completed. CNQ took 34.9s. Estimated remaining: 4h 17m 9s. Rate: 7.3 symbols/min [2025-10-15T18:08:52.119106] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-03. [2025-10-15T18:08:52.182360] [INFO ] [MAIN ] COF: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:08:52.235281] [DEBUG] [LOCAL ] COF: Loaded 53619 existing records from primary storage. [2025-10-15T18:08:52.235714] [INFO ] [MAIN ] COF: Loaded 53619 existing records. [2025-10-15T18:08:52.350187] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-15T18:08:52.432774] [WARN ] [MAIN ] COF: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:08:52.432991] [INFO ] [MAIN ] COF: Wiping existing primary data before full refresh. [2025-10-15T18:08:52.433038] [INFO ] [LOCAL ] COF: Starting deletion of primary data. [2025-10-15T18:08:52.434067] [DEBUG] [LOCAL ] COF: Deleted primary data file. [2025-10-15T18:08:52.434127] [INFO ] [MAIN ] COF: Starting full primary refresh. [2025-10-15T18:08:52.785430] [INFO ] [REMOTE ] COF: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:08:52.914018] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-01. [2025-10-15T18:08:53.618079] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-15T18:08:53.713983] [INFO ] [REMOTE ] COF: Fetching primary data for 2024-12. [2025-10-15T18:08:54.004000] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-15T18:08:54.514027] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-02. [2025-10-15T18:08:55.313966] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-04. [2025-10-15T18:08:55.444082] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-15T18:08:55.538399] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-15T18:08:56.114018] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-04. [2025-10-15T18:08:56.290520] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-15T18:08:56.914046] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-01. [2025-10-15T18:08:57.714025] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-05. [2025-10-15T18:08:57.927134] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-15T18:08:58.513993] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-03. [2025-10-15T18:08:58.618915] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-15T18:08:59.108453] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-01 (2.19 seconds). [2025-10-15T18:08:59.313989] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-06. [2025-10-15T18:08:59.414439] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-15T18:09:00.113987] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-05. [2025-10-15T18:09:00.168513] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-15T18:09:00.914012] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-02. [2025-10-15T18:09:01.714016] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-04. [2025-10-15T18:09:01.870940] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-15T18:09:02.514052] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-06. [2025-10-15T18:09:02.793046] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-10-15T18:09:02.949462] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-15T18:09:03.314012] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-05. [2025-10-15T18:09:03.889425] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-15T18:09:04.114065] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-03. [2025-10-15T18:09:04.914030] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-07. [2025-10-15T18:09:05.099762] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-15T18:09:05.713993] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-06. [2025-10-15T18:09:05.877435] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-15T18:09:06.484044] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-15T18:09:06.513963] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-08. [2025-10-15T18:09:07.108571] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-15T18:09:07.314016] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-07. [2025-10-15T18:09:07.806820] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-15T18:09:08.114012] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-04. [2025-10-15T18:09:08.530843] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-15T18:09:08.914009] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-07. [2025-10-15T18:09:09.713967] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-09. [2025-10-15T18:09:09.980494] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-15T18:09:10.138290] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-15T18:09:10.513999] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-08. [2025-10-15T18:09:11.226443] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-15T18:09:11.313329] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-15T18:09:11.317719] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-10. [2025-10-15T18:09:12.113990] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-05. [2025-10-15T18:09:12.914013] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-08. [2025-10-15T18:09:13.020731] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-15T18:09:13.027503] [INFO ] [REMOTE ] CNX: Full fetch complete (74928 records). [2025-10-15T18:09:13.027922] [DEBUG] [VALIDATOR ] CNX: Validating primary data. [2025-10-15T18:09:13.426063] [DEBUG] [VALIDATOR ] CNX: All expected trading days are present. [2025-10-15T18:09:13.426185] [DEBUG] [VALIDATOR ] CNX: Primary data validation passed. [2025-10-15T18:09:13.427333] [INFO ] [MAIN ] CNX: Fetched primary data is valid. [2025-10-15T18:09:13.427410] [DEBUG] [LOCAL ] CNX: Saving primary data. [2025-10-15T18:09:13.429428] [DEBUG] [LOCAL ] CNX: Trimmed 74928 records to 51367 (keeping 200 days of data) [2025-10-15T18:09:13.727683] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-09. [2025-10-15T18:09:13.750159] [DEBUG] [LOCAL ] CNX: Primary data saved (51367 records). [2025-10-15T18:09:13.750369] [INFO ] [MAIN ] CNX: Full history saved. [2025-10-15T18:09:13.750473] [INFO ] [MAIN ] Update Progress: 501/2369 symbols completed. CNX took 31.7s. Estimated remaining: 4h 17m 51s. Rate: 7.2 symbols/min [2025-10-15T18:09:13.940141] [INFO ] [MAIN ] COHR: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:09:14.000996] [DEBUG] [LOCAL ] COHR: Loaded 53376 existing records from primary storage. [2025-10-15T18:09:14.001575] [INFO ] [MAIN ] COHR: Loaded 53376 existing records. [2025-10-15T18:09:14.153328] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-10-15T18:09:14.255990] [WARN ] [MAIN ] COHR: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:09:14.256520] [INFO ] [MAIN ] COHR: Wiping existing primary data before full refresh. [2025-10-15T18:09:14.256610] [INFO ] [LOCAL ] COHR: Starting deletion of primary data. [2025-10-15T18:09:14.257089] [DEBUG] [LOCAL ] COHR: Deleted primary data file. [2025-10-15T18:09:14.257169] [INFO ] [MAIN ] COHR: Starting full primary refresh. [2025-10-15T18:09:14.516918] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-06. [2025-10-15T18:09:14.571526] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-15T18:09:14.702727] [INFO ] [REMOTE ] COHR: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:09:14.704074] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-15T18:09:15.314043] [INFO ] [REMOTE ] COHR: Fetching primary data for 2024-12. [2025-10-15T18:09:16.114071] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-10. [2025-10-15T18:09:16.394872] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-15T18:09:16.913980] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-09. [2025-10-15T18:09:17.256780] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-15T18:09:17.256477] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-10-15T18:09:17.270892] [INFO ] [REMOTE ] CNS: Full fetch complete (30764 records). [2025-10-15T18:09:17.270978] [DEBUG] [VALIDATOR ] CNS: Validating primary data. [2025-10-15T18:09:17.631443] [DEBUG] [VALIDATOR ] CNS: All expected trading days are present. [2025-10-15T18:09:17.631517] [DEBUG] [VALIDATOR ] CNS: Primary data validation passed. [2025-10-15T18:09:17.632073] [INFO ] [MAIN ] CNS: Fetched primary data is valid. [2025-10-15T18:09:17.632134] [DEBUG] [LOCAL ] CNS: Saving primary data. [2025-10-15T18:09:17.632916] [DEBUG] [LOCAL ] CNS: Trimmed 30764 records to 21154 (keeping 200 days of data) [2025-10-15T18:09:17.718887] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-01. [2025-10-15T18:09:17.762582] [DEBUG] [LOCAL ] CNS: Primary data saved (21154 records). [2025-10-15T18:09:17.762732] [INFO ] [MAIN ] CNS: Full history saved. [2025-10-15T18:09:17.762816] [INFO ] [MAIN ] Update Progress: 502/2369 symbols completed. CNS took 35.8s. Estimated remaining: 4h 17m 26s. Rate: 7.3 symbols/min [2025-10-15T18:09:17.933858] [INFO ] [MAIN ] COLD: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:09:17.985608] [DEBUG] [LOCAL ] COLD: Loaded 52370 existing records from primary storage. [2025-10-15T18:09:17.985965] [INFO ] [MAIN ] COLD: Loaded 52370 existing records. [2025-10-15T18:09:18.163517] [WARN ] [MAIN ] COLD: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:09:18.163753] [INFO ] [MAIN ] COLD: Wiping existing primary data before full refresh. [2025-10-15T18:09:18.163804] [INFO ] [LOCAL ] COLD: Starting deletion of primary data. [2025-10-15T18:09:18.164179] [DEBUG] [LOCAL ] COLD: Deleted primary data file. [2025-10-15T18:09:18.164219] [INFO ] [MAIN ] COLD: Starting full primary refresh. [2025-10-15T18:09:18.517996] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-07. [2025-10-15T18:09:18.547353] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-15T18:09:18.553214] [INFO ] [REMOTE ] COLD: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:09:19.313984] [INFO ] [REMOTE ] COLD: Fetching primary data for 2024-12. [2025-10-15T18:09:19.663170] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-10-15T18:09:20.114051] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-10. [2025-10-15T18:09:20.343541] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-15T18:09:20.777472] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-15T18:09:20.914010] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-08. [2025-10-15T18:09:21.645164] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-15T18:09:21.651204] [INFO ] [REMOTE ] CODI: Full fetch complete (52633 records). [2025-10-15T18:09:21.651374] [DEBUG] [VALIDATOR ] CODI: Validating primary data. [2025-10-15T18:09:21.719161] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-01. [2025-10-15T18:09:22.061757] [DEBUG] [VALIDATOR ] CODI: All expected trading days are present. [2025-10-15T18:09:22.061839] [DEBUG] [VALIDATOR ] CODI: Primary data validation passed. [2025-10-15T18:09:22.062585] [INFO ] [MAIN ] CODI: Fetched primary data is valid. [2025-10-15T18:09:22.062627] [DEBUG] [LOCAL ] CODI: Saving primary data. [2025-10-15T18:09:22.063781] [DEBUG] [LOCAL ] CODI: Trimmed 52633 records to 41441 (keeping 200 days of data) [2025-10-15T18:09:22.300187] [DEBUG] [LOCAL ] CODI: Primary data saved (41441 records). [2025-10-15T18:09:22.300316] [INFO ] [MAIN ] CODI: Full history saved. [2025-10-15T18:09:22.300388] [INFO ] [MAIN ] Update Progress: 503/2369 symbols completed. CODI took 34.7s. Estimated remaining: 4h 17m 4s. Rate: 7.3 symbols/min [2025-10-15T18:09:22.476141] [INFO ] [MAIN ] COMP: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:09:22.514034] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-02. [2025-10-15T18:09:22.530149] [DEBUG] [LOCAL ] COMP: Loaded 53405 existing records from primary storage. [2025-10-15T18:09:22.530419] [INFO ] [MAIN ] COMP: Loaded 53405 existing records. [2025-10-15T18:09:22.715622] [WARN ] [MAIN ] COMP: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:09:22.716128] [INFO ] [MAIN ] COMP: Wiping existing primary data before full refresh. [2025-10-15T18:09:22.716369] [INFO ] [LOCAL ] COMP: Starting deletion of primary data. [2025-10-15T18:09:22.716731] [DEBUG] [LOCAL ] COMP: Deleted primary data file. [2025-10-15T18:09:22.716792] [INFO ] [MAIN ] COMP: Starting full primary refresh. [2025-10-15T18:09:23.082557] [INFO ] [REMOTE ] COMP: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:09:23.153786] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-15T18:09:23.167249] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-08 (2.25 seconds). [2025-10-15T18:09:23.313981] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-02. [2025-10-15T18:09:24.113993] [INFO ] [REMOTE ] COMP: Fetching primary data for 2024-12. [2025-10-15T18:09:24.377192] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-10-15T18:09:24.549186] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-15T18:09:24.914026] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-03. [2025-10-15T18:09:25.714063] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-03. [2025-10-15T18:09:26.006074] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-10-15T18:09:26.514086] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-01. [2025-10-15T18:09:26.615294] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-15T18:09:27.038811] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-15T18:09:27.314401] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-09. [2025-10-15T18:09:27.917348] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-15T18:09:28.114097] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-04. [2025-10-15T18:09:28.914004] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-02. [2025-10-15T18:09:29.251768] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-10-15T18:09:29.674869] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-15T18:09:29.714204] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-05. [2025-10-15T18:09:30.519096] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-04. [2025-10-15T18:09:30.538440] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-15T18:09:31.314002] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-03. [2025-10-15T18:09:31.430822] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-15T18:09:31.863793] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-15T18:09:32.113985] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-05. [2025-10-15T18:09:32.891243] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-15T18:09:32.913967] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-04. [2025-10-15T18:09:33.378610] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-15T18:09:33.714058] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-10. [2025-10-15T18:09:34.386824] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-15T18:09:34.435621] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-15T18:09:34.442072] [INFO ] [REMOTE ] COF: Full fetch complete (77632 records). [2025-10-15T18:09:34.442200] [DEBUG] [VALIDATOR ] COF: Validating primary data. [2025-10-15T18:09:34.519071] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-06. [2025-10-15T18:09:34.822534] [DEBUG] [VALIDATOR ] COF: All expected trading days are present. [2025-10-15T18:09:34.822620] [DEBUG] [VALIDATOR ] COF: Primary data validation passed. [2025-10-15T18:09:34.823537] [INFO ] [MAIN ] COF: Fetched primary data is valid. [2025-10-15T18:09:34.823615] [DEBUG] [LOCAL ] COF: Saving primary data. [2025-10-15T18:09:34.825061] [DEBUG] [LOCAL ] COF: Trimmed 77632 records to 53622 (keeping 200 days of data) [2025-10-15T18:09:35.155384] [DEBUG] [LOCAL ] COF: Primary data saved (53622 records). [2025-10-15T18:09:35.155535] [INFO ] [MAIN ] COF: Full history saved. [2025-10-15T18:09:35.156394] [INFO ] [MAIN ] Update Progress: 504/2369 symbols completed. COF took 43.1s. Estimated remaining: 4h 17m 13s. Rate: 7.3 symbols/min [2025-10-15T18:09:35.319321] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-06. [2025-10-15T18:09:35.321833] [INFO ] [MAIN ] CON: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:09:35.360831] [DEBUG] [LOCAL ] CON: Loaded 38883 existing records from primary storage. [2025-10-15T18:09:35.361104] [INFO ] [MAIN ] CON: Loaded 38883 existing records. [2025-10-15T18:09:35.533725] [WARN ] [MAIN ] CON: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:09:35.533945] [INFO ] [MAIN ] CON: Wiping existing primary data before full refresh. [2025-10-15T18:09:35.533994] [INFO ] [LOCAL ] CON: Starting deletion of primary data. [2025-10-15T18:09:35.534895] [DEBUG] [LOCAL ] CON: Deleted primary data file. [2025-10-15T18:09:35.534979] [INFO ] [MAIN ] CON: Starting full primary refresh. [2025-10-15T18:09:35.885158] [INFO ] [REMOTE ] CON: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:09:35.959548] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-15T18:09:36.113976] [INFO ] [REMOTE ] CON: Fetching primary data for 2024-12. [2025-10-15T18:09:36.870840] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-15T18:09:36.913955] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-07. [2025-10-15T18:09:37.676336] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-15T18:09:37.713953] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-01. [2025-10-15T18:09:38.513976] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-05. [2025-10-15T18:09:38.590256] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-15T18:09:38.703018] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-15T18:09:39.314065] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-02. [2025-10-15T18:09:40.114055] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-08. [2025-10-15T18:09:40.175258] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-15T18:09:40.338579] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-15T18:09:40.914012] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-07. [2025-10-15T18:09:41.714005] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-06. [2025-10-15T18:09:42.363126] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-08 (2.25 seconds). [2025-10-15T18:09:42.514013] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-03. [2025-10-15T18:09:42.659167] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-15T18:09:43.314030] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-09. [2025-10-15T18:09:43.365951] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-15T18:09:43.918458] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-15T18:09:44.113995] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-07. [2025-10-15T18:09:44.914027] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-04. [2025-10-15T18:09:45.489456] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-09 (2.18 seconds). [2025-10-15T18:09:45.663088] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-15T18:09:45.713984] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-08. [2025-10-15T18:09:45.987277] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-15T18:09:46.514050] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-08. [2025-10-15T18:09:47.314006] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-10. [2025-10-15T18:09:47.535700] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-15T18:09:48.113986] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-09. [2025-10-15T18:09:48.202461] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-15T18:09:48.914032] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-09. [2025-10-15T18:09:49.169285] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-10 (1.86 seconds). [2025-10-15T18:09:49.176200] [INFO ] [REMOTE ] COHR: Full fetch complete (77421 records). [2025-10-15T18:09:49.176391] [DEBUG] [VALIDATOR ] COHR: Validating primary data. [2025-10-15T18:09:49.573703] [DEBUG] [VALIDATOR ] COHR: All expected trading days are present. [2025-10-15T18:09:49.573852] [DEBUG] [VALIDATOR ] COHR: Primary data validation passed. [2025-10-15T18:09:49.574952] [INFO ] [MAIN ] COHR: Fetched primary data is valid. [2025-10-15T18:09:49.575017] [DEBUG] [LOCAL ] COHR: Saving primary data. [2025-10-15T18:09:49.576567] [DEBUG] [LOCAL ] COHR: Trimmed 77421 records to 53381 (keeping 200 days of data) [2025-10-15T18:09:49.776090] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-05. [2025-10-15T18:09:49.937573] [DEBUG] [LOCAL ] COHR: Primary data saved (53381 records). [2025-10-15T18:09:49.937821] [INFO ] [MAIN ] COHR: Full history saved. [2025-10-15T18:09:49.938032] [INFO ] [MAIN ] Update Progress: 505/2369 symbols completed. COHR took 36.2s. Estimated remaining: 4h 17m 29s. Rate: 7.2 symbols/min [2025-10-15T18:09:50.077380] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-10-15T18:09:50.163706] [INFO ] [MAIN ] COOK: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:09:50.187067] [DEBUG] [LOCAL ] COOK: Loaded 24891 existing records from primary storage. [2025-10-15T18:09:50.187349] [INFO ] [MAIN ] COOK: Loaded 24891 existing records. [2025-10-15T18:09:50.365884] [WARN ] [MAIN ] COOK: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:09:50.366292] [INFO ] [MAIN ] COOK: Wiping existing primary data before full refresh. [2025-10-15T18:09:50.366368] [INFO ] [LOCAL ] COOK: Starting deletion of primary data. [2025-10-15T18:09:50.367203] [DEBUG] [LOCAL ] COOK: Deleted primary data file. [2025-10-15T18:09:50.367266] [INFO ] [MAIN ] COOK: Starting full primary refresh. [2025-10-15T18:09:50.521212] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-10. [2025-10-15T18:09:50.723121] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-15T18:09:50.794409] [INFO ] [REMOTE ] COOK: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:09:51.221005] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-15T18:09:51.314034] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-10. [2025-10-15T18:09:52.114039] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-06. [2025-10-15T18:09:52.357230] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-15T18:09:52.363733] [INFO ] [REMOTE ] COMP: Full fetch complete (77385 records). [2025-10-15T18:09:52.363910] [DEBUG] [VALIDATOR ] COMP: Validating primary data. [2025-10-15T18:09:52.766239] [DEBUG] [VALIDATOR ] COMP: All expected trading days are present. [2025-10-15T18:09:52.766405] [DEBUG] [VALIDATOR ] COMP: Primary data validation passed. [2025-10-15T18:09:52.767947] [INFO ] [MAIN ] COMP: Fetched primary data is valid. [2025-10-15T18:09:52.768029] [DEBUG] [LOCAL ] COMP: Saving primary data. [2025-10-15T18:09:52.770736] [DEBUG] [LOCAL ] COMP: Trimmed 77385 records to 53406 (keeping 200 days of data) [2025-10-15T18:09:52.941138] [INFO ] [REMOTE ] COOK: Fetching primary data for 2024-12. [2025-10-15T18:09:53.098416] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-15T18:09:53.123428] [INFO ] [REMOTE ] COLD: Full fetch complete (74696 records). [2025-10-15T18:09:53.125891] [DEBUG] [VALIDATOR ] COLD: Validating primary data. [2025-10-15T18:09:53.165342] [DEBUG] [LOCAL ] COMP: Primary data saved (53406 records). [2025-10-15T18:09:53.205381] [INFO ] [MAIN ] COMP: Full history saved. [2025-10-15T18:09:53.217036] [INFO ] [MAIN ] Update Progress: 506/2369 symbols completed. COMP took 30.9s. Estimated remaining: 4h 17m 2s. Rate: 7.2 symbols/min [2025-10-15T18:09:53.614336] [INFO ] [MAIN ] COP: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:09:53.722900] [DEBUG] [VALIDATOR ] COLD: All expected trading days are present. [2025-10-15T18:09:53.723120] [DEBUG] [VALIDATOR ] COLD: Primary data validation passed. [2025-10-15T18:09:53.724538] [INFO ] [MAIN ] COLD: Fetched primary data is valid. [2025-10-15T18:09:53.739499] [DEBUG] [LOCAL ] COLD: Saving primary data. [2025-10-15T18:09:53.750231] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-15T18:09:53.762047] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-07. [2025-10-15T18:09:53.763341] [DEBUG] [LOCAL ] COLD: Trimmed 74696 records to 52391 (keeping 200 days of data) [2025-10-15T18:09:53.925884] [DEBUG] [LOCAL ] COP: Loaded 53727 existing records from primary storage. [2025-10-15T18:09:53.927540] [INFO ] [MAIN ] COP: Loaded 53727 existing records. [2025-10-15T18:09:54.344184] [WARN ] [MAIN ] COP: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:09:54.360680] [INFO ] [MAIN ] COP: Wiping existing primary data before full refresh. [2025-10-15T18:09:54.362795] [INFO ] [LOCAL ] COP: Starting deletion of primary data. [2025-10-15T18:09:54.366293] [DEBUG] [LOCAL ] COP: Deleted primary data file. [2025-10-15T18:09:54.365853] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-15T18:09:54.369088] [INFO ] [MAIN ] COP: Starting full primary refresh. [2025-10-15T18:09:54.383709] [DEBUG] [LOCAL ] COLD: Primary data saved (52391 records). [2025-10-15T18:09:54.438771] [INFO ] [MAIN ] COLD: Full history saved. [2025-10-15T18:09:54.461030] [INFO ] [MAIN ] Update Progress: 507/2369 symbols completed. COLD took 36.7s. Estimated remaining: 4h 16m 28s. Rate: 7.3 symbols/min [2025-10-15T18:09:54.519287] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-01. [2025-10-15T18:09:54.835083] [INFO ] [MAIN ] COR: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:09:54.950862] [INFO ] [REMOTE ] COP: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:09:54.978809] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-15T18:09:55.021502] [DEBUG] [LOCAL ] COR: Loaded 46682 existing records from primary storage. [2025-10-15T18:09:55.021926] [INFO ] [MAIN ] COR: Loaded 46682 existing records. [2025-10-15T18:09:55.195691] [WARN ] [MAIN ] COR: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:09:55.195929] [INFO ] [MAIN ] COR: Wiping existing primary data before full refresh. [2025-10-15T18:09:55.195980] [INFO ] [LOCAL ] COR: Starting deletion of primary data. [2025-10-15T18:09:55.196816] [DEBUG] [LOCAL ] COR: Deleted primary data file. [2025-10-15T18:09:55.196887] [INFO ] [MAIN ] COR: Starting full primary refresh. [2025-10-15T18:09:55.319180] [INFO ] [REMOTE ] COP: Fetching primary data for 2024-12. [2025-10-15T18:09:55.548760] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-15T18:09:55.578978] [INFO ] [REMOTE ] COR: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:09:56.114030] [INFO ] [REMOTE ] COR: Fetching primary data for 2024-12. [2025-10-15T18:09:56.914067] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-02. [2025-10-15T18:09:57.499174] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2024-12 (2.18 seconds). [2025-10-15T18:09:57.519078] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-15T18:09:57.713982] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-03. [2025-10-15T18:09:57.799405] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-15T18:09:58.514023] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-01. [2025-10-15T18:09:58.748740] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-15T18:09:59.314024] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-01. [2025-10-15T18:10:00.114044] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-04. [2025-10-15T18:10:00.361433] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-15T18:10:00.913970] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-02. [2025-10-15T18:10:00.996193] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-15T18:10:01.083481] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-15T18:10:01.713998] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-02. [2025-10-15T18:10:02.513983] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-08. [2025-10-15T18:10:02.727274] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-15T18:10:03.092437] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-15T18:10:03.313999] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-05. [2025-10-15T18:10:03.757848] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-15T18:10:04.114040] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-09. [2025-10-15T18:10:04.754958] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-15T18:10:04.913993] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-06. [2025-10-15T18:10:05.575161] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-15T18:10:05.713996] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-03. [2025-10-15T18:10:05.932266] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-15T18:10:06.513988] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-07. [2025-10-15T18:10:07.224884] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-15T18:10:07.312481] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-15T18:10:07.317612] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-03. [2025-10-15T18:10:08.114016] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-08. [2025-10-15T18:10:08.914046] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-10. [2025-10-15T18:10:09.015895] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-15T18:10:09.274881] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-15T18:10:09.714042] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-09. [2025-10-15T18:10:10.073966] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-15T18:10:10.078790] [INFO ] [REMOTE ] CON: Full fetch complete (56911 records). [2025-10-15T18:10:10.078912] [DEBUG] [VALIDATOR ] CON: Validating primary data. [2025-10-15T18:10:10.452070] [DEBUG] [VALIDATOR ] CON: All expected trading days are present. [2025-10-15T18:10:10.452150] [DEBUG] [VALIDATOR ] CON: Primary data validation passed. [2025-10-15T18:10:10.452901] [INFO ] [MAIN ] CON: Fetched primary data is valid. [2025-10-15T18:10:10.452964] [DEBUG] [LOCAL ] CON: Saving primary data. [2025-10-15T18:10:10.455469] [DEBUG] [LOCAL ] CON: Trimmed 56911 records to 38935 (keeping 200 days of data) [2025-10-15T18:10:10.517790] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-04. [2025-10-15T18:10:10.692581] [DEBUG] [LOCAL ] CON: Primary data saved (38935 records). [2025-10-15T18:10:10.692776] [INFO ] [MAIN ] CON: Full history saved. [2025-10-15T18:10:10.692892] [INFO ] [MAIN ] Update Progress: 508/2369 symbols completed. CON took 35.5s. Estimated remaining: 4h 16m 49s. Rate: 7.2 symbols/min [2025-10-15T18:10:10.866768] [INFO ] [MAIN ] COTY: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:10:10.914612] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-15T18:10:10.942873] [DEBUG] [LOCAL ] COTY: Loaded 53268 existing records from primary storage. [2025-10-15T18:10:10.943290] [INFO ] [MAIN ] COTY: Loaded 53268 existing records. [2025-10-15T18:10:11.126837] [WARN ] [MAIN ] COTY: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:10:11.127110] [INFO ] [MAIN ] COTY: Wiping existing primary data before full refresh. [2025-10-15T18:10:11.127163] [INFO ] [LOCAL ] COTY: Starting deletion of primary data. [2025-10-15T18:10:11.127900] [DEBUG] [LOCAL ] COTY: Deleted primary data file. [2025-10-15T18:10:11.127957] [INFO ] [MAIN ] COTY: Starting full primary refresh. [2025-10-15T18:10:11.322680] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-10. [2025-10-15T18:10:11.495925] [INFO ] [REMOTE ] COTY: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:10:12.114114] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-04. [2025-10-15T18:10:12.368006] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-15T18:10:12.914016] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-05. [2025-10-15T18:10:13.724052] [INFO ] [REMOTE ] COTY: Fetching primary data for 2024-12. [2025-10-15T18:10:13.726626] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-15T18:10:14.149009] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-10 (2.83 seconds). [2025-10-15T18:10:14.152754] [INFO ] [REMOTE ] COOK: Full fetch complete (33222 records). [2025-10-15T18:10:14.152847] [DEBUG] [VALIDATOR ] COOK: Validating primary data. [2025-10-15T18:10:14.516733] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-05. [2025-10-15T18:10:14.528625] [DEBUG] [VALIDATOR ] COOK: All expected trading days are present. [2025-10-15T18:10:14.528879] [DEBUG] [VALIDATOR ] COOK: Primary data validation passed. [2025-10-15T18:10:14.530064] [INFO ] [MAIN ] COOK: Fetched primary data is valid. [2025-10-15T18:10:14.530140] [DEBUG] [LOCAL ] COOK: Saving primary data. [2025-10-15T18:10:14.531068] [DEBUG] [LOCAL ] COOK: Trimmed 33222 records to 24994 (keeping 200 days of data) [2025-10-15T18:10:14.672668] [DEBUG] [LOCAL ] COOK: Primary data saved (24994 records). [2025-10-15T18:10:14.672813] [INFO ] [MAIN ] COOK: Full history saved. [2025-10-15T18:10:14.672892] [INFO ] [MAIN ] Update Progress: 509/2369 symbols completed. COOK took 24.7s. Estimated remaining: 4h 16m 25s. Rate: 7.3 symbols/min [2025-10-15T18:10:14.844453] [INFO ] [MAIN ] COUR: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:10:14.887101] [DEBUG] [LOCAL ] COUR: Loaded 49240 existing records from primary storage. [2025-10-15T18:10:14.887444] [INFO ] [MAIN ] COUR: Loaded 49240 existing records. [2025-10-15T18:10:15.074869] [WARN ] [MAIN ] COUR: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:10:15.075231] [INFO ] [MAIN ] COUR: Wiping existing primary data before full refresh. [2025-10-15T18:10:15.075314] [INFO ] [LOCAL ] COUR: Starting deletion of primary data. [2025-10-15T18:10:15.091226] [DEBUG] [LOCAL ] COUR: Deleted primary data file. [2025-10-15T18:10:15.101817] [INFO ] [MAIN ] COUR: Starting full primary refresh. [2025-10-15T18:10:15.183522] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-05 (2.27 seconds). [2025-10-15T18:10:15.339194] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-06. [2025-10-15T18:10:15.488745] [INFO ] [REMOTE ] COUR: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:10:16.113964] [INFO ] [REMOTE ] COUR: Fetching primary data for 2024-12. [2025-10-15T18:10:16.240550] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-15T18:10:16.914065] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-06. [2025-10-15T18:10:17.351845] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2024-12 (3.63 seconds). [2025-10-15T18:10:17.463766] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-06 (2.12 seconds). [2025-10-15T18:10:17.714056] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-07. [2025-10-15T18:10:17.918955] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-15T18:10:18.514016] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-01. [2025-10-15T18:10:18.576362] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-15T18:10:19.314056] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-07. [2025-10-15T18:10:20.113989] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-01. [2025-10-15T18:10:20.318140] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-15T18:10:20.355789] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-07 (2.64 seconds). [2025-10-15T18:10:20.710511] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-15T18:10:20.914080] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-08. [2025-10-15T18:10:21.680716] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-15T18:10:21.713962] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-02. [2025-10-15T18:10:22.513987] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-08. [2025-10-15T18:10:22.563198] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-15T18:10:22.828361] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-15T18:10:23.314004] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-03. [2025-10-15T18:10:24.123739] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-09. [2025-10-15T18:10:24.146140] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-15T18:10:24.564295] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-15T18:10:24.914056] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-04. [2025-10-15T18:10:25.714061] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-02. [2025-10-15T18:10:25.847602] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-15T18:10:26.258929] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-15T18:10:26.514094] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-10. [2025-10-15T18:10:27.078206] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-15T18:10:27.086076] [INFO ] [REMOTE ] COP: Full fetch complete (77906 records). [2025-10-15T18:10:27.086254] [DEBUG] [VALIDATOR ] COP: Validating primary data. [2025-10-15T18:10:27.319147] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-05. [2025-10-15T18:10:27.509273] [DEBUG] [VALIDATOR ] COP: All expected trading days are present. [2025-10-15T18:10:27.524439] [DEBUG] [VALIDATOR ] COP: Primary data validation passed. [2025-10-15T18:10:27.538238] [INFO ] [MAIN ] COP: Fetched primary data is valid. [2025-10-15T18:10:27.538364] [DEBUG] [LOCAL ] COP: Saving primary data. [2025-10-15T18:10:27.540758] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-15T18:10:27.552294] [DEBUG] [LOCAL ] COP: Trimmed 77906 records to 53727 (keeping 200 days of data) [2025-10-15T18:10:27.870708] [DEBUG] [LOCAL ] COP: Primary data saved (53727 records). [2025-10-15T18:10:27.870842] [INFO ] [MAIN ] COP: Full history saved. [2025-10-15T18:10:27.870918] [INFO ] [MAIN ] Update Progress: 510/2369 symbols completed. COP took 34.6s. Estimated remaining: 4h 16m 35s. Rate: 7.2 symbols/min [2025-10-15T18:10:28.061231] [INFO ] [MAIN ] CP: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:10:28.107298] [DEBUG] [LOCAL ] CP: Loaded 53250 existing records from primary storage. [2025-10-15T18:10:28.107593] [INFO ] [MAIN ] CP: Loaded 53250 existing records. [2025-10-15T18:10:28.120156] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-03. [2025-10-15T18:10:28.286868] [WARN ] [MAIN ] CP: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:10:28.287086] [INFO ] [MAIN ] CP: Wiping existing primary data before full refresh. [2025-10-15T18:10:28.287132] [INFO ] [LOCAL ] CP: Starting deletion of primary data. [2025-10-15T18:10:28.288088] [DEBUG] [LOCAL ] CP: Deleted primary data file. [2025-10-15T18:10:28.288145] [INFO ] [MAIN ] CP: Starting full primary refresh. [2025-10-15T18:10:28.640609] [INFO ] [REMOTE ] CP: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:10:28.913986] [INFO ] [REMOTE ] CP: Fetching primary data for 2024-12. [2025-10-15T18:10:29.038874] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-15T18:10:29.714022] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-06. [2025-10-15T18:10:30.144504] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-10-15T18:10:30.514002] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-04. [2025-10-15T18:10:30.566602] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-15T18:10:31.270175] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-15T18:10:31.313968] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-07. [2025-10-15T18:10:32.113974] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-09. [2025-10-15T18:10:32.283375] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-15T18:10:32.913985] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-01. [2025-10-15T18:10:33.097336] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-15T18:10:33.515307] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-15T18:10:33.714023] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-10. [2025-10-15T18:10:34.162583] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-15T18:10:34.514003] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-08. [2025-10-15T18:10:35.290328] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-15T18:10:35.295598] [INFO ] [REMOTE ] COR: Full fetch complete (68607 records). [2025-10-15T18:10:35.295800] [DEBUG] [VALIDATOR ] COR: Validating primary data. [2025-10-15T18:10:35.319147] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-05. [2025-10-15T18:10:35.681825] [DEBUG] [VALIDATOR ] COR: All expected trading days are present. [2025-10-15T18:10:35.681914] [DEBUG] [VALIDATOR ] COR: Primary data validation passed. [2025-10-15T18:10:35.682839] [INFO ] [MAIN ] COR: Fetched primary data is valid. [2025-10-15T18:10:35.682908] [DEBUG] [LOCAL ] COR: Saving primary data. [2025-10-15T18:10:35.684456] [DEBUG] [LOCAL ] COR: Trimmed 68607 records to 46611 (keeping 200 days of data) [2025-10-15T18:10:35.977825] [DEBUG] [LOCAL ] COR: Primary data saved (46611 records). [2025-10-15T18:10:35.978000] [INFO ] [MAIN ] COR: Full history saved. [2025-10-15T18:10:35.978112] [INFO ] [MAIN ] Update Progress: 511/2369 symbols completed. COR took 41.5s. Estimated remaining: 4h 16m 26s. Rate: 7.2 symbols/min [2025-10-15T18:10:36.124853] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-02. [2025-10-15T18:10:36.158264] [INFO ] [MAIN ] CPA: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:10:36.186741] [DEBUG] [LOCAL ] CPA: Loaded 28481 existing records from primary storage. [2025-10-15T18:10:36.187117] [INFO ] [MAIN ] CPA: Loaded 28481 existing records. [2025-10-15T18:10:36.376250] [WARN ] [MAIN ] CPA: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:10:36.376560] [INFO ] [MAIN ] CPA: Wiping existing primary data before full refresh. [2025-10-15T18:10:36.376620] [INFO ] [LOCAL ] CPA: Starting deletion of primary data. [2025-10-15T18:10:36.416065] [DEBUG] [LOCAL ] CPA: Deleted primary data file. [2025-10-15T18:10:36.416235] [INFO ] [MAIN ] CPA: Starting full primary refresh. [2025-10-15T18:10:36.485807] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-10-15T18:10:36.814385] [INFO ] [REMOTE ] CPA: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:10:36.919121] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-09. [2025-10-15T18:10:36.933332] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-15T18:10:37.714050] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-06. [2025-10-15T18:10:37.827753] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-15T18:10:38.314423] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-15T18:10:38.513988] [INFO ] [REMOTE ] CPA: Fetching primary data for 2024-12. [2025-10-15T18:10:39.314035] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-03. [2025-10-15T18:10:39.383382] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-15T18:10:40.004122] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-15T18:10:40.114034] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-07. [2025-10-15T18:10:40.913977] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-10. [2025-10-15T18:10:41.044924] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-15T18:10:41.629106] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-15T18:10:41.713968] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-08. [2025-10-15T18:10:42.514054] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-01. [2025-10-15T18:10:42.803250] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-10 (1.89 seconds). [2025-10-15T18:10:42.809720] [INFO ] [REMOTE ] COUR: Full fetch complete (71018 records). [2025-10-15T18:10:42.809867] [DEBUG] [VALIDATOR ] COUR: Validating primary data. [2025-10-15T18:10:43.190001] [DEBUG] [VALIDATOR ] COUR: All expected trading days are present. [2025-10-15T18:10:43.190134] [DEBUG] [VALIDATOR ] COUR: Primary data validation passed. [2025-10-15T18:10:43.191040] [INFO ] [MAIN ] COUR: Fetched primary data is valid. [2025-10-15T18:10:43.191103] [DEBUG] [LOCAL ] COUR: Saving primary data. [2025-10-15T18:10:43.192422] [DEBUG] [LOCAL ] COUR: Trimmed 71018 records to 49310 (keeping 200 days of data) [2025-10-15T18:10:43.352254] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-04. [2025-10-15T18:10:43.481543] [DEBUG] [LOCAL ] COUR: Primary data saved (49310 records). [2025-10-15T18:10:43.482057] [INFO ] [MAIN ] COUR: Full history saved. [2025-10-15T18:10:43.482376] [INFO ] [MAIN ] Update Progress: 512/2369 symbols completed. COUR took 28.8s. Estimated remaining: 4h 16m 14s. Rate: 7.2 symbols/min [2025-10-15T18:10:43.652679] [INFO ] [MAIN ] CPAC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:10:43.653153] [DEBUG] [LOCAL ] CPAC: No existing data file found in primary storage. [2025-10-15T18:10:43.682840] [WARN ] [MAIN ] CPAC: No existing data found, performing full refresh instead. [2025-10-15T18:10:43.685377] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-10-15T18:10:43.685536] [INFO ] [MAIN ] CPAC: Wiping existing primary data before full refresh. [2025-10-15T18:10:43.696312] [INFO ] [LOCAL ] CPAC: Starting deletion of primary data. [2025-10-15T18:10:43.696593] [DEBUG] [LOCAL ] CPAC: No primary data file found to delete. [2025-10-15T18:10:43.696842] [INFO ] [MAIN ] CPAC: Starting full primary refresh. [2025-10-15T18:10:43.993635] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-15T18:10:44.097966] [INFO ] [REMOTE ] CPAC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:10:44.114039] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-09. [2025-10-15T18:10:44.913966] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-02. [2025-10-15T18:10:45.005097] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-15T18:10:45.721126] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2024-12. [2025-10-15T18:10:45.726535] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-15T18:10:46.158795] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-15T18:10:46.167354] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2024-12 (0.45 seconds). [2025-10-15T18:10:46.514009] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-01. [2025-10-15T18:10:46.841768] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-01 (0.33 seconds). [2025-10-15T18:10:47.313994] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-05. [2025-10-15T18:10:48.114033] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-02. [2025-10-15T18:10:48.457520] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-10-15T18:10:48.896526] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-15T18:10:48.913941] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-06. [2025-10-15T18:10:49.713991] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-03. [2025-10-15T18:10:50.263881] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-15T18:10:50.513970] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-03. [2025-10-15T18:10:50.851846] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-03 (0.34 seconds). [2025-10-15T18:10:51.185976] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-15T18:10:51.313989] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-04. [2025-10-15T18:10:51.651468] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-04 (0.34 seconds). [2025-10-15T18:10:52.113996] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-04. [2025-10-15T18:10:52.913990] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-05. [2025-10-15T18:10:53.225134] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-05 (0.31 seconds). [2025-10-15T18:10:53.245513] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-15T18:10:53.713995] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-10. [2025-10-15T18:10:54.514011] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-07. [2025-10-15T18:10:55.314004] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-05. [2025-10-15T18:10:55.676522] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-10 (1.96 seconds). [2025-10-15T18:10:55.683134] [INFO ] [REMOTE ] COTY: Full fetch complete (77287 records). [2025-10-15T18:10:55.683252] [DEBUG] [VALIDATOR ] COTY: Validating primary data. [2025-10-15T18:10:56.071190] [DEBUG] [VALIDATOR ] COTY: All expected trading days are present. [2025-10-15T18:10:56.071339] [DEBUG] [VALIDATOR ] COTY: Primary data validation passed. [2025-10-15T18:10:56.072299] [INFO ] [MAIN ] COTY: Fetched primary data is valid. [2025-10-15T18:10:56.072385] [DEBUG] [LOCAL ] COTY: Saving primary data. [2025-10-15T18:10:56.073981] [DEBUG] [LOCAL ] COTY: Trimmed 77287 records to 53271 (keeping 200 days of data) [2025-10-15T18:10:56.119887] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-06. [2025-10-15T18:10:56.403712] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-15T18:10:56.415332] [DEBUG] [LOCAL ] COTY: Primary data saved (53271 records). [2025-10-15T18:10:56.425970] [INFO ] [MAIN ] COTY: Full history saved. [2025-10-15T18:10:56.427513] [INFO ] [MAIN ] Update Progress: 513/2369 symbols completed. COTY took 45.7s. Estimated remaining: 4h 16m 23s. Rate: 7.2 symbols/min [2025-10-15T18:10:56.599866] [INFO ] [MAIN ] CPAY: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:10:56.600151] [DEBUG] [LOCAL ] CPAY: No existing data file found in primary storage. [2025-10-15T18:10:56.600204] [WARN ] [MAIN ] CPAY: No existing data found, performing full refresh instead. [2025-10-15T18:10:56.600371] [INFO ] [MAIN ] CPAY: Wiping existing primary data before full refresh. [2025-10-15T18:10:56.600427] [INFO ] [LOCAL ] CPAY: Starting deletion of primary data. [2025-10-15T18:10:56.600501] [DEBUG] [LOCAL ] CPAY: No primary data file found to delete. [2025-10-15T18:10:56.600662] [INFO ] [MAIN ] CPAY: Starting full primary refresh. [2025-10-15T18:10:56.665087] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-10-15T18:10:56.773292] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-15T18:10:56.919075] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-07. [2025-10-15T18:10:56.985150] [INFO ] [REMOTE ] CPAY: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:10:57.408303] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-10-15T18:10:57.714012] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2024-12. [2025-10-15T18:10:58.514055] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-08. [2025-10-15T18:10:58.854616] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-08 (0.34 seconds). [2025-10-15T18:10:58.905606] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-15T18:10:59.313997] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-09. [2025-10-15T18:10:59.751545] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-10-15T18:11:00.114008] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-06. [2025-10-15T18:11:00.914000] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-01. [2025-10-15T18:11:01.714012] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-10. [2025-10-15T18:11:01.784786] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-15T18:11:02.207676] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-15T18:11:02.245708] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-15T18:11:02.246524] [INFO ] [REMOTE ] CPAC: Full fetch complete (1852 records). [2025-10-15T18:11:02.246595] [DEBUG] [VALIDATOR ] CPAC: Validating primary data. [2025-10-15T18:11:02.437519] [WARN ] [VALIDATOR ] CPAC: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-15T18:11:02.437777] [FATAL] [MAIN ] CPAC: Fetched primary data is invalid. Refusing to save it. [2025-10-15T18:11:02.437869] [WARN ] [MAIN ] CPAC: Deleting existing primary and derivative data due to validation failure. [2025-10-15T18:11:02.437943] [INFO ] [LOCAL ] CPAC: Starting deletion of primary data. [2025-10-15T18:11:02.438011] [DEBUG] [LOCAL ] CPAC: No primary data file found to delete. [2025-10-15T18:11:02.438048] [INFO ] [LOCAL ] CPAC: Starting deletion of derivative data. [2025-10-15T18:11:02.438087] [DEBUG] [LOCAL ] CPAC: No derivative data file found to delete. [2025-10-15T18:11:02.438146] [INFO ] [MAIN ] Update Progress: 514/2369 symbols completed. CPAC took 19.0s. Estimated remaining: 4h 16m 7s. Rate: 7.2 symbols/min [2025-10-15T18:11:02.519195] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-02. [2025-10-15T18:11:02.630351] [INFO ] [MAIN ] CPF: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:11:02.630532] [DEBUG] [LOCAL ] CPF: No existing data file found in primary storage. [2025-10-15T18:11:02.630570] [WARN ] [MAIN ] CPF: No existing data found, performing full refresh instead. [2025-10-15T18:11:02.630709] [INFO ] [MAIN ] CPF: Wiping existing primary data before full refresh. [2025-10-15T18:11:02.630762] [INFO ] [LOCAL ] CPF: Starting deletion of primary data. [2025-10-15T18:11:02.630804] [DEBUG] [LOCAL ] CPF: No primary data file found to delete. [2025-10-15T18:11:02.630837] [INFO ] [MAIN ] CPF: Starting full primary refresh. [2025-10-15T18:11:03.032212] [INFO ] [REMOTE ] CPF: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:11:03.314010] [INFO ] [REMOTE ] CPF: Fetching primary data for 2024-12. [2025-10-15T18:11:03.906584] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-15T18:11:04.113984] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-08. [2025-10-15T18:11:04.343276] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-15T18:11:04.914014] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-03. [2025-10-15T18:11:05.714005] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-07. [2025-10-15T18:11:05.910796] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-15T18:11:06.368040] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-15T18:11:06.513976] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-04. [2025-10-15T18:11:06.992935] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-15T18:11:07.314112] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-01. [2025-10-15T18:11:07.737490] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-15T18:11:07.990856] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-15T18:11:08.114026] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-08. [2025-10-15T18:11:08.914072] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-09. [2025-10-15T18:11:09.250694] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-15T18:11:09.714015] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-09. [2025-10-15T18:11:10.480940] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-15T18:11:10.513952] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-10. [2025-10-15T18:11:10.788707] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-15T18:11:11.313991] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-05. [2025-10-15T18:11:12.113983] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-02. [2025-10-15T18:11:12.307247] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-15T18:11:12.313602] [INFO ] [REMOTE ] CP: Full fetch complete (77292 records). [2025-10-15T18:11:12.313795] [DEBUG] [VALIDATOR ] CP: Validating primary data. [2025-10-15T18:11:12.703397] [DEBUG] [VALIDATOR ] CP: All expected trading days are present. [2025-10-15T18:11:12.703575] [DEBUG] [VALIDATOR ] CP: Primary data validation passed. [2025-10-15T18:11:12.704537] [INFO ] [MAIN ] CP: Fetched primary data is valid. [2025-10-15T18:11:12.704600] [DEBUG] [LOCAL ] CP: Saving primary data. [2025-10-15T18:11:12.706370] [DEBUG] [LOCAL ] CP: Trimmed 77292 records to 53238 (keeping 200 days of data) [2025-10-15T18:11:12.724889] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-15T18:11:12.915677] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-10. [2025-10-15T18:11:13.061879] [DEBUG] [LOCAL ] CP: Primary data saved (53238 records). [2025-10-15T18:11:13.062095] [INFO ] [MAIN ] CP: Full history saved. [2025-10-15T18:11:13.062337] [INFO ] [MAIN ] Update Progress: 515/2369 symbols completed. CP took 45.2s. Estimated remaining: 4h 16m 7s. Rate: 7.2 symbols/min [2025-10-15T18:11:13.191127] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-15T18:11:13.242055] [INFO ] [MAIN ] CPK: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:11:13.259182] [DEBUG] [LOCAL ] CPK: Loaded 13850 existing records from primary storage. [2025-10-15T18:11:13.259422] [INFO ] [MAIN ] CPK: Loaded 13850 existing records. [2025-10-15T18:11:13.428417] [WARN ] [MAIN ] CPK: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:11:13.428635] [INFO ] [MAIN ] CPK: Wiping existing primary data before full refresh. [2025-10-15T18:11:13.428720] [INFO ] [LOCAL ] CPK: Starting deletion of primary data. [2025-10-15T18:11:13.428973] [DEBUG] [LOCAL ] CPK: Deleted primary data file. [2025-10-15T18:11:13.429028] [INFO ] [MAIN ] CPK: Starting full primary refresh. [2025-10-15T18:11:13.719192] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-03. [2025-10-15T18:11:13.779759] [INFO ] [REMOTE ] CPK: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:11:14.017726] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-15T18:11:14.021165] [INFO ] [REMOTE ] CPA: Full fetch complete (41508 records). [2025-10-15T18:11:14.021247] [DEBUG] [VALIDATOR ] CPA: Validating primary data. [2025-10-15T18:11:14.388007] [DEBUG] [VALIDATOR ] CPA: All expected trading days are present. [2025-10-15T18:11:14.388084] [DEBUG] [VALIDATOR ] CPA: Primary data validation passed. [2025-10-15T18:11:14.388727] [INFO ] [MAIN ] CPA: Fetched primary data is valid. [2025-10-15T18:11:14.388787] [DEBUG] [LOCAL ] CPA: Saving primary data. [2025-10-15T18:11:14.389616] [DEBUG] [LOCAL ] CPA: Trimmed 41508 records to 28423 (keeping 200 days of data) [2025-10-15T18:11:14.515068] [INFO ] [REMOTE ] CPK: Fetching primary data for 2024-12. [2025-10-15T18:11:14.569326] [DEBUG] [LOCAL ] CPA: Primary data saved (28423 records). [2025-10-15T18:11:14.569525] [INFO ] [MAIN ] CPA: Full history saved. [2025-10-15T18:11:14.569615] [INFO ] [MAIN ] Update Progress: 516/2369 symbols completed. CPA took 38.6s. Estimated remaining: 4h 15m 34s. Rate: 7.3 symbols/min [2025-10-15T18:11:14.752074] [INFO ] [MAIN ] CPNG: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:11:14.765077] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-15T18:11:14.823709] [DEBUG] [LOCAL ] CPNG: Loaded 53679 existing records from primary storage. [2025-10-15T18:11:14.824047] [INFO ] [MAIN ] CPNG: Loaded 53679 existing records. [2025-10-15T18:11:15.011180] [WARN ] [MAIN ] CPNG: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:11:15.011413] [INFO ] [MAIN ] CPNG: Wiping existing primary data before full refresh. [2025-10-15T18:11:15.011460] [INFO ] [LOCAL ] CPNG: Starting deletion of primary data. [2025-10-15T18:11:15.011960] [DEBUG] [LOCAL ] CPNG: Deleted primary data file. [2025-10-15T18:11:15.012014] [INFO ] [MAIN ] CPNG: Starting full primary refresh. [2025-10-15T18:11:15.317699] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-04. [2025-10-15T18:11:15.389415] [INFO ] [REMOTE ] CPNG: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:11:15.390411] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-15T18:11:16.113988] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-06. [2025-10-15T18:11:16.399837] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-15T18:11:16.914011] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-05. [2025-10-15T18:11:17.279178] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-15T18:11:17.463928] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-10-15T18:11:17.713990] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2024-12. [2025-10-15T18:11:18.514012] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-07. [2025-10-15T18:11:19.314062] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-06. [2025-10-15T18:11:19.898746] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-15T18:11:20.068413] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2024-12 (2.35 seconds). [2025-10-15T18:11:20.109134] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-15T18:11:20.113942] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-07. [2025-10-15T18:11:20.833039] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-15T18:11:20.914000] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-08. [2025-10-15T18:11:21.713999] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-01. [2025-10-15T18:11:21.908916] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-15T18:11:22.514001] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-08. [2025-10-15T18:11:23.314060] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-01. [2025-10-15T18:11:23.578405] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-15T18:11:23.844183] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-01 (2.13 seconds). [2025-10-15T18:11:23.873822] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-15T18:11:24.114007] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-02. [2025-10-15T18:11:24.914050] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-09. [2025-10-15T18:11:25.714037] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-02. [2025-10-15T18:11:25.742389] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-15T18:11:26.235559] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-02 (2.12 seconds). [2025-10-15T18:11:26.439320] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-15T18:11:26.514020] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-03. [2025-10-15T18:11:27.314002] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-09. [2025-10-15T18:11:28.114001] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-10. [2025-10-15T18:11:28.456035] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-15T18:11:28.567793] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-10-15T18:11:28.913971] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-04. [2025-10-15T18:11:29.131327] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-15T18:11:29.133691] [INFO ] [REMOTE ] CPF: Full fetch complete (23595 records). [2025-10-15T18:11:29.133765] [DEBUG] [VALIDATOR ] CPF: Validating primary data. [2025-10-15T18:11:29.493206] [DEBUG] [VALIDATOR ] CPF: All expected trading days are present. [2025-10-15T18:11:29.493280] [DEBUG] [VALIDATOR ] CPF: Primary data validation passed. [2025-10-15T18:11:29.493781] [INFO ] [MAIN ] CPF: Fetched primary data is valid. [2025-10-15T18:11:29.493840] [DEBUG] [LOCAL ] CPF: Saving primary data. [2025-10-15T18:11:29.494404] [DEBUG] [LOCAL ] CPF: Trimmed 23595 records to 15271 (keeping 200 days of data) [2025-10-15T18:11:29.589684] [DEBUG] [LOCAL ] CPF: Primary data saved (15271 records). [2025-10-15T18:11:29.589834] [INFO ] [MAIN ] CPF: Full history saved. [2025-10-15T18:11:29.589909] [INFO ] [MAIN ] Update Progress: 517/2369 symbols completed. CPF took 27.2s. Estimated remaining: 4h 15m 50s. Rate: 7.2 symbols/min [2025-10-15T18:11:29.714051] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-10. [2025-10-15T18:11:30.514060] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-03. [2025-10-15T18:11:30.736128] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-15T18:11:30.915838] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-15T18:11:30.919546] [INFO ] [REMOTE ] CPAY: Full fetch complete (44821 records). [2025-10-15T18:11:30.919740] [DEBUG] [VALIDATOR ] CPAY: Validating primary data. [2025-10-15T18:11:31.308101] [DEBUG] [VALIDATOR ] CPAY: All expected trading days are present. [2025-10-15T18:11:31.308236] [DEBUG] [VALIDATOR ] CPAY: Primary data validation passed. [2025-10-15T18:11:31.309008] [INFO ] [MAIN ] CPAY: Fetched primary data is valid. [2025-10-15T18:11:31.309102] [DEBUG] [LOCAL ] CPAY: Saving primary data. [2025-10-15T18:11:31.310322] [DEBUG] [LOCAL ] CPAY: Trimmed 44821 records to 30434 (keeping 200 days of data) [2025-10-15T18:11:31.314056] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-05. [2025-10-15T18:11:31.419831] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-15T18:11:31.510125] [DEBUG] [LOCAL ] CPAY: Primary data saved (30434 records). [2025-10-15T18:11:31.510268] [INFO ] [MAIN ] CPAY: Full history saved. [2025-10-15T18:11:31.510341] [INFO ] [MAIN ] Update Progress: 518/2369 symbols completed. CPAY took 35.1s. Estimated remaining: 4h 15m 19s. Rate: 7.2 symbols/min [2025-10-15T18:11:32.114044] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-04. [2025-10-15T18:11:33.199190] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-15T18:11:33.204002] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-05. [2025-10-15T18:11:33.478351] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-05 (2.16 seconds). [2025-10-15T18:11:33.714041] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-06. [2025-10-15T18:11:33.962196] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-15T18:11:34.514040] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-06. [2025-10-15T18:11:35.372040] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-15T18:11:35.377006] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-07. [2025-10-15T18:11:35.809208] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-06 (2.10 seconds). [2025-10-15T18:11:36.077534] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-15T18:11:36.114070] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-08. [2025-10-15T18:11:36.914034] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-07. [2025-10-15T18:11:37.034255] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-15T18:11:37.714046] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-09. [2025-10-15T18:11:38.572197] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-15T18:11:38.575572] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-10. [2025-10-15T18:11:39.230583] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-07 (2.32 seconds). [2025-10-15T18:11:39.313961] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-08. [2025-10-15T18:11:39.549954] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-15T18:11:39.553486] [INFO ] [REMOTE ] CPK: Full fetch complete (18430 records). [2025-10-15T18:11:39.553582] [DEBUG] [VALIDATOR ] CPK: Validating primary data. [2025-10-15T18:11:39.930399] [DEBUG] [VALIDATOR ] CPK: All expected trading days are present. [2025-10-15T18:11:39.930495] [DEBUG] [VALIDATOR ] CPK: Primary data validation passed. [2025-10-15T18:11:39.930922] [INFO ] [MAIN ] CPK: Fetched primary data is valid. [2025-10-15T18:11:39.930982] [DEBUG] [LOCAL ] CPK: Saving primary data. [2025-10-15T18:11:39.931508] [DEBUG] [LOCAL ] CPK: Trimmed 18430 records to 13940 (keeping 200 days of data) [2025-10-15T18:11:40.020318] [DEBUG] [LOCAL ] CPK: Primary data saved (13940 records). [2025-10-15T18:11:40.020465] [INFO ] [MAIN ] CPK: Full history saved. [2025-10-15T18:11:40.020576] [INFO ] [MAIN ] Update Progress: 519/2369 symbols completed. CPK took 27.0s. Estimated remaining: 4h 15m 11s. Rate: 7.2 symbols/min [2025-10-15T18:11:41.466835] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-08 (2.15 seconds). [2025-10-15T18:11:41.478320] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-09. [2025-10-15T18:11:43.762419] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-09 (2.28 seconds). [2025-10-15T18:11:43.774416] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-10. [2025-10-15T18:11:45.822047] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-10 (2.05 seconds). [2025-10-15T18:11:45.828471] [INFO ] [REMOTE ] CPNG: Full fetch complete (77780 records). [2025-10-15T18:11:45.828597] [DEBUG] [VALIDATOR ] CPNG: Validating primary data. [2025-10-15T18:11:46.218754] [DEBUG] [VALIDATOR ] CPNG: All expected trading days are present. [2025-10-15T18:11:46.218832] [DEBUG] [VALIDATOR ] CPNG: Primary data validation passed. [2025-10-15T18:11:46.219748] [INFO ] [MAIN ] CPNG: Fetched primary data is valid. [2025-10-15T18:11:46.219810] [DEBUG] [LOCAL ] CPNG: Saving primary data. [2025-10-15T18:11:46.221221] [DEBUG] [LOCAL ] CPNG: Trimmed 77780 records to 53679 (keeping 200 days of data) [2025-10-15T18:11:46.533859] [DEBUG] [LOCAL ] CPNG: Primary data saved (53679 records). [2025-10-15T18:11:46.533993] [INFO ] [MAIN ] CPNG: Full history saved. [2025-10-15T18:11:46.534067] [INFO ] [MAIN ] Update Progress: 520/2369 symbols completed. CPNG took 32.0s. Estimated remaining: 4h 14m 57s. Rate: 7.3 symbols/min [2025-10-15T18:11:47.199933] [INFO ] [MAIN ] CPS: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:11:47.111440] [INFO ] [MAIN ] CPT: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:11:47.196893] [INFO ] [MAIN ] CQP: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:11:47.224377] [INFO ] [MAIN ] CPRI: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:11:47.254396] [DEBUG] [LOCAL ] CQP: Loaded 18820 existing records from primary storage. [2025-10-15T18:11:47.254869] [INFO ] [MAIN ] CQP: Loaded 18820 existing records. [2025-10-15T18:11:47.336203] [DEBUG] [LOCAL ] CPS: Loaded 25324 existing records from primary storage. [2025-10-15T18:11:47.364267] [INFO ] [MAIN ] CPS: Loaded 25324 existing records. [2025-10-15T18:11:47.498014] [DEBUG] [LOCAL ] CPT: Loaded 44529 existing records from primary storage. [2025-10-15T18:11:47.514784] [DEBUG] [LOCAL ] CPRI: Loaded 52473 existing records from primary storage. [2025-10-15T18:11:47.536023] [INFO ] [MAIN ] CPRI: Loaded 52473 existing records. [2025-10-15T18:11:47.572979] [INFO ] [MAIN ] CPT: Loaded 44529 existing records. [2025-10-15T18:11:47.724369] [WARN ] [MAIN ] CQP: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:11:47.740059] [INFO ] [MAIN ] CQP: Wiping existing primary data before full refresh. [2025-10-15T18:11:47.812593] [INFO ] [LOCAL ] CQP: Starting deletion of primary data. [2025-10-15T18:11:47.865710] [DEBUG] [LOCAL ] CQP: Deleted primary data file. [2025-10-15T18:11:47.865898] [INFO ] [MAIN ] CQP: Starting full primary refresh. [2025-10-15T18:11:47.893041] [WARN ] [MAIN ] CPS: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:11:47.994383] [INFO ] [MAIN ] CPS: Wiping existing primary data before full refresh. [2025-10-15T18:11:48.026270] [INFO ] [LOCAL ] CPS: Starting deletion of primary data. [2025-10-15T18:11:48.119634] [DEBUG] [LOCAL ] CPS: Deleted primary data file. [2025-10-15T18:11:48.171418] [WARN ] [MAIN ] CPRI: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:11:48.159817] [INFO ] [MAIN ] CPS: Starting full primary refresh. [2025-10-15T18:11:48.215629] [WARN ] [MAIN ] CPT: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:11:48.216185] [INFO ] [MAIN ] CPT: Wiping existing primary data before full refresh. [2025-10-15T18:11:48.231774] [INFO ] [MAIN ] CPRI: Wiping existing primary data before full refresh. [2025-10-15T18:11:48.256224] [INFO ] [LOCAL ] CPT: Starting deletion of primary data. [2025-10-15T18:11:48.317863] [DEBUG] [LOCAL ] CPT: Deleted primary data file. [2025-10-15T18:11:48.300703] [INFO ] [LOCAL ] CPRI: Starting deletion of primary data. [2025-10-15T18:11:48.318005] [INFO ] [MAIN ] CPT: Starting full primary refresh. [2025-10-15T18:11:48.375876] [DEBUG] [LOCAL ] CPRI: Deleted primary data file. [2025-10-15T18:11:48.480857] [INFO ] [MAIN ] CPRI: Starting full primary refresh. [2025-10-15T18:11:49.172502] [INFO ] [REMOTE ] CQP: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:11:49.251617] [INFO ] [REMOTE ] CQP: Fetching primary data for 2024-12. [2025-10-15T18:11:49.234325] [INFO ] [REMOTE ] CPS: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:11:49.305810] [INFO ] [REMOTE ] CPS: Fetching primary data for 2024-12. [2025-10-15T18:11:49.564979] [INFO ] [REMOTE ] CPT: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:11:49.584122] [INFO ] [REMOTE ] CPT: Fetching primary data for 2024-12. [2025-10-15T18:11:49.628258] [INFO ] [REMOTE ] CPRI: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:11:49.628635] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2024-12. [2025-10-15T18:11:50.280155] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-10-15T18:11:50.284512] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-01. [2025-10-15T18:11:50.557962] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-15T18:11:50.562390] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-01. [2025-10-15T18:11:51.110563] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-15T18:11:51.118934] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-01. [2025-10-15T18:11:51.132287] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-15T18:11:51.136900] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-02. [2025-10-15T18:11:51.290459] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-15T18:11:51.301121] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-01. [2025-10-15T18:11:51.730040] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-15T18:11:51.735784] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-02. [2025-10-15T18:11:52.123537] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-15T18:11:52.128863] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-03. [2025-10-15T18:11:52.374724] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-15T18:11:52.383433] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-02. [2025-10-15T18:11:52.555327] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-15T18:11:52.565579] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-02. [2025-10-15T18:11:52.903413] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-15T18:11:52.908715] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-03. [2025-10-15T18:11:53.317451] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-15T18:11:53.323513] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-04. [2025-10-15T18:11:53.563990] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-10-15T18:11:53.699533] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-15T18:11:53.713945] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-03. [2025-10-15T18:11:53.772991] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-15T18:11:54.445389] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-15T18:11:54.513953] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-05. [2025-10-15T18:11:54.968916] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-15T18:11:55.314007] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-03. [2025-10-15T18:11:55.616795] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-15T18:11:56.114045] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-04. [2025-10-15T18:11:56.749584] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-15T18:11:56.814746] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-10-15T18:11:56.913964] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-04. [2025-10-15T18:11:57.714003] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-04. [2025-10-15T18:11:58.513974] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-05. [2025-10-15T18:11:58.593120] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-15T18:11:59.279853] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-15T18:11:59.313956] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-05. [2025-10-15T18:11:59.565297] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-15T18:12:00.114070] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-05. [2025-10-15T18:12:00.913971] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-06. [2025-10-15T18:12:01.413964] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-05 (2.10 seconds). [2025-10-15T18:12:01.713975] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-06. [2025-10-15T18:12:01.830198] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-15T18:12:02.273781] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-15T18:12:02.513983] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-07. [2025-10-15T18:12:03.271895] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-15T18:12:03.313957] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-07. [2025-10-15T18:12:03.687786] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-15T18:12:04.114003] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-06. [2025-10-15T18:12:04.913963] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-06. [2025-10-15T18:12:05.036205] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-15T18:12:05.135260] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-15T18:12:05.714011] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-07. [2025-10-15T18:12:06.364801] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-15T18:12:06.513985] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-07. [2025-10-15T18:12:06.535163] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-15T18:12:07.314050] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-08. [2025-10-15T18:12:08.077904] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-15T18:12:08.097458] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-15T18:12:08.113956] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-08. [2025-10-15T18:12:08.914056] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-09. [2025-10-15T18:12:09.714048] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-08. [2025-10-15T18:12:09.725190] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-15T18:12:09.849489] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-15T18:12:10.514054] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-10. [2025-10-15T18:12:11.233021] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-15T18:12:11.234965] [INFO ] [REMOTE ] CQP: Full fetch complete (29941 records). [2025-10-15T18:12:11.235048] [DEBUG] [VALIDATOR ] CQP: Validating primary data. [2025-10-15T18:12:11.326384] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-08. [2025-10-15T18:12:11.577072] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-15T18:12:11.703452] [DEBUG] [VALIDATOR ] CQP: All expected trading days are present. [2025-10-15T18:12:11.703532] [DEBUG] [VALIDATOR ] CQP: Primary data validation passed. [2025-10-15T18:12:11.704147] [INFO ] [MAIN ] CQP: Fetched primary data is valid. [2025-10-15T18:12:11.704210] [DEBUG] [LOCAL ] CQP: Saving primary data. [2025-10-15T18:12:11.705001] [DEBUG] [LOCAL ] CQP: Trimmed 29941 records to 18825 (keeping 200 days of data) [2025-10-15T18:12:11.819024] [DEBUG] [LOCAL ] CQP: Primary data saved (18825 records). [2025-10-15T18:12:11.819188] [INFO ] [MAIN ] CQP: Full history saved. [2025-10-15T18:12:11.819283] [INFO ] [MAIN ] Update Progress: 521/2369 symbols completed. CQP took 25.3s. Estimated remaining: 4h 15m 49s. Rate: 7.2 symbols/min [2025-10-15T18:12:11.993225] [INFO ] [MAIN ] CR: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:12:12.017535] [DEBUG] [LOCAL ] CR: Loaded 24122 existing records from primary storage. [2025-10-15T18:12:12.017870] [INFO ] [MAIN ] CR: Loaded 24122 existing records. [2025-10-15T18:12:12.119537] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-09. [2025-10-15T18:12:12.203627] [WARN ] [MAIN ] CR: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:12:12.203945] [INFO ] [MAIN ] CR: Wiping existing primary data before full refresh. [2025-10-15T18:12:12.204009] [INFO ] [LOCAL ] CR: Starting deletion of primary data. [2025-10-15T18:12:12.204391] [DEBUG] [LOCAL ] CR: Deleted primary data file. [2025-10-15T18:12:12.204448] [INFO ] [MAIN ] CR: Starting full primary refresh. [2025-10-15T18:12:12.524265] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-15T18:12:12.591879] [INFO ] [REMOTE ] CR: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:12:12.913990] [INFO ] [REMOTE ] CR: Fetching primary data for 2024-12. [2025-10-15T18:12:13.655137] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-15T18:12:13.713965] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-10. [2025-10-15T18:12:14.161287] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-15T18:12:14.514066] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-01. [2025-10-15T18:12:15.283449] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-15T18:12:15.288520] [INFO ] [REMOTE ] CPT: Full fetch complete (63997 records). [2025-10-15T18:12:15.288705] [DEBUG] [VALIDATOR ] CPT: Validating primary data. [2025-10-15T18:12:15.289535] [FATAL] [VALIDATOR ] CPT: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T18:12:15.289624] [FATAL] [MAIN ] CPT: Fetched primary data is invalid. Refusing to save it. [2025-10-15T18:12:15.289719] [WARN ] [MAIN ] CPT: Deleting existing primary and derivative data due to validation failure. [2025-10-15T18:12:15.289781] [INFO ] [LOCAL ] CPT: Starting deletion of primary data. [2025-10-15T18:12:15.289859] [DEBUG] [LOCAL ] CPT: No primary data file found to delete. [2025-10-15T18:12:15.289914] [INFO ] [LOCAL ] CPT: Starting deletion of derivative data. [2025-10-15T18:12:15.290224] [DEBUG] [LOCAL ] CPT: Deleted derivative data file. [2025-10-15T18:12:15.290788] [INFO ] [MAIN ] Update Progress: 522/2369 symbols completed. CPT took 28.8s. Estimated remaining: 4h 15m 24s. Rate: 7.2 symbols/min [2025-10-15T18:12:15.321260] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-09. [2025-10-15T18:12:15.469174] [INFO ] [MAIN ] CRBD: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:12:15.481030] [DEBUG] [LOCAL ] CRBD: Loaded 8944 existing records from primary storage. [2025-10-15T18:12:15.481254] [INFO ] [MAIN ] CRBD: Loaded 8944 existing records. [2025-10-15T18:12:15.674390] [WARN ] [MAIN ] CRBD: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:12:15.669451] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-15T18:12:15.679718] [INFO ] [MAIN ] CRBD: Wiping existing primary data before full refresh. [2025-10-15T18:12:15.679776] [INFO ] [LOCAL ] CRBD: Starting deletion of primary data. [2025-10-15T18:12:15.679937] [DEBUG] [LOCAL ] CRBD: Deleted primary data file. [2025-10-15T18:12:15.679991] [INFO ] [MAIN ] CRBD: Starting full primary refresh. [2025-10-15T18:12:16.018527] [INFO ] [REMOTE ] CRBD: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:12:16.113951] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2024-12. [2025-10-15T18:12:16.341189] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-15T18:12:16.914042] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-09. [2025-10-15T18:12:17.242492] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-15T18:12:17.714002] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-01. [2025-10-15T18:12:18.506942] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-15T18:12:18.517575] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-10. [2025-10-15T18:12:18.541839] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-15T18:12:19.313963] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-02. [2025-10-15T18:12:19.394246] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-15T18:12:19.397029] [INFO ] [REMOTE ] CPS: Full fetch complete (36312 records). [2025-10-15T18:12:19.397136] [DEBUG] [VALIDATOR ] CPS: Validating primary data. [2025-10-15T18:12:19.759683] [DEBUG] [VALIDATOR ] CPS: All expected trading days are present. [2025-10-15T18:12:19.759768] [DEBUG] [VALIDATOR ] CPS: Primary data validation passed. [2025-10-15T18:12:19.760343] [INFO ] [MAIN ] CPS: Fetched primary data is valid. [2025-10-15T18:12:19.760383] [DEBUG] [LOCAL ] CPS: Saving primary data. [2025-10-15T18:12:19.761173] [DEBUG] [LOCAL ] CPS: Trimmed 36312 records to 25220 (keeping 200 days of data) [2025-10-15T18:12:19.901797] [DEBUG] [LOCAL ] CPS: Primary data saved (25220 records). [2025-10-15T18:12:19.901933] [INFO ] [MAIN ] CPS: Full history saved. [2025-10-15T18:12:19.902013] [INFO ] [MAIN ] Update Progress: 523/2369 symbols completed. CPS took 33.4s. Estimated remaining: 4h 15m 2s. Rate: 7.2 symbols/min [2025-10-15T18:12:20.074988] [INFO ] [MAIN ] CRBG: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:12:20.125164] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-02. [2025-10-15T18:12:20.127982] [DEBUG] [LOCAL ] CRBG: Loaded 52568 existing records from primary storage. [2025-10-15T18:12:20.128374] [INFO ] [MAIN ] CRBG: Loaded 52568 existing records. [2025-10-15T18:12:20.305978] [WARN ] [MAIN ] CRBG: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:12:20.306277] [INFO ] [MAIN ] CRBG: Wiping existing primary data before full refresh. [2025-10-15T18:12:20.306465] [INFO ] [LOCAL ] CRBG: Starting deletion of primary data. [2025-10-15T18:12:20.318290] [DEBUG] [LOCAL ] CRBG: Deleted primary data file. [2025-10-15T18:12:20.318408] [INFO ] [MAIN ] CRBG: Starting full primary refresh. [2025-10-15T18:12:20.361754] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-15T18:12:20.675796] [INFO ] [REMOTE ] CRBG: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:12:20.682467] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-15T18:12:20.914007] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2024-12. [2025-10-15T18:12:21.714043] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-03. [2025-10-15T18:12:22.514046] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-03. [2025-10-15T18:12:22.591194] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-15T18:12:22.608453] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-15T18:12:23.280521] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-15T18:12:23.314063] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-04. [2025-10-15T18:12:23.925041] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-15T18:12:24.114024] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-04. [2025-10-15T18:12:24.914017] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-10. [2025-10-15T18:12:25.289906] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-15T18:12:25.714091] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-01. [2025-10-15T18:12:26.514071] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-05. [2025-10-15T18:12:26.707990] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-15T18:12:26.715119] [INFO ] [REMOTE ] CPRI: Full fetch complete (76217 records). [2025-10-15T18:12:26.715360] [DEBUG] [VALIDATOR ] CPRI: Validating primary data. [2025-10-15T18:12:27.050955] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-10-15T18:12:27.144273] [DEBUG] [VALIDATOR ] CPRI: All expected trading days are present. [2025-10-15T18:12:27.144393] [DEBUG] [VALIDATOR ] CPRI: Primary data validation passed. [2025-10-15T18:12:27.145508] [INFO ] [MAIN ] CPRI: Fetched primary data is valid. [2025-10-15T18:12:27.145605] [DEBUG] [LOCAL ] CPRI: Saving primary data. [2025-10-15T18:12:27.147373] [DEBUG] [LOCAL ] CPRI: Trimmed 76217 records to 52475 (keeping 200 days of data) [2025-10-15T18:12:27.320090] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-05. [2025-10-15T18:12:27.488535] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-15T18:12:27.490985] [DEBUG] [LOCAL ] CPRI: Primary data saved (52475 records). [2025-10-15T18:12:27.501437] [INFO ] [MAIN ] CPRI: Full history saved. [2025-10-15T18:12:27.501690] [INFO ] [MAIN ] Update Progress: 524/2369 symbols completed. CPRI took 41.0s. Estimated remaining: 4h 14m 52s. Rate: 7.2 symbols/min [2025-10-15T18:12:27.673256] [INFO ] [MAIN ] CRC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:12:27.713589] [DEBUG] [LOCAL ] CRC: Loaded 44076 existing records from primary storage. [2025-10-15T18:12:27.713919] [INFO ] [MAIN ] CRC: Loaded 44076 existing records. [2025-10-15T18:12:27.894808] [WARN ] [MAIN ] CRC: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:12:27.895042] [INFO ] [MAIN ] CRC: Wiping existing primary data before full refresh. [2025-10-15T18:12:27.895088] [INFO ] [LOCAL ] CRC: Starting deletion of primary data. [2025-10-15T18:12:27.895431] [DEBUG] [LOCAL ] CRC: Deleted primary data file. [2025-10-15T18:12:27.895486] [INFO ] [MAIN ] CRC: Starting full primary refresh. [2025-10-15T18:12:28.118957] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-02. [2025-10-15T18:12:28.271017] [INFO ] [REMOTE ] CRC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:12:28.272490] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-15T18:12:28.914022] [INFO ] [REMOTE ] CRC: Fetching primary data for 2024-12. [2025-10-15T18:12:29.498574] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-15T18:12:29.714014] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-06. [2025-10-15T18:12:30.329980] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-15T18:12:30.514041] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-06. [2025-10-15T18:12:30.790333] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-15T18:12:31.101248] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-15T18:12:31.314014] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-07. [2025-10-15T18:12:32.053458] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-15T18:12:32.114050] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-08. [2025-10-15T18:12:32.698773] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-15T18:12:32.914000] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-09. [2025-10-15T18:12:33.576091] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-15T18:12:33.713998] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-01. [2025-10-15T18:12:34.514003] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-03. [2025-10-15T18:12:35.143851] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-15T18:12:35.314013] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-02. [2025-10-15T18:12:36.114005] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-10. [2025-10-15T18:12:36.164196] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-15T18:12:36.485295] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-15T18:12:36.599860] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-15T18:12:36.601281] [INFO ] [REMOTE ] CRBD: Full fetch complete (13455 records). [2025-10-15T18:12:36.601348] [DEBUG] [VALIDATOR ] CRBD: Validating primary data. [2025-10-15T18:12:36.913977] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-03. [2025-10-15T18:12:36.952841] [DEBUG] [VALIDATOR ] CRBD: All expected trading days are present. [2025-10-15T18:12:36.952912] [DEBUG] [VALIDATOR ] CRBD: Primary data validation passed. [2025-10-15T18:12:36.953224] [INFO ] [MAIN ] CRBD: Fetched primary data is valid. [2025-10-15T18:12:36.953264] [DEBUG] [LOCAL ] CRBD: Saving primary data. [2025-10-15T18:12:36.953768] [DEBUG] [LOCAL ] CRBD: Trimmed 13455 records to 8927 (keeping 200 days of data) [2025-10-15T18:12:37.006626] [DEBUG] [LOCAL ] CRBD: Primary data saved (8927 records). [2025-10-15T18:12:37.006757] [INFO ] [MAIN ] CRBD: Full history saved. [2025-10-15T18:12:37.006842] [INFO ] [MAIN ] Update Progress: 525/2369 symbols completed. CRBD took 21.7s. Estimated remaining: 4h 14m 48s. Rate: 7.2 symbols/min [2025-10-15T18:12:37.169552] [INFO ] [MAIN ] CRCL: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:12:37.169732] [DEBUG] [LOCAL ] CRCL: No existing data file found in primary storage. [2025-10-15T18:12:37.169777] [WARN ] [MAIN ] CRCL: No existing data found, performing full refresh instead. [2025-10-15T18:12:37.169907] [INFO ] [MAIN ] CRCL: Wiping existing primary data before full refresh. [2025-10-15T18:12:37.169980] [INFO ] [LOCAL ] CRCL: Starting deletion of primary data. [2025-10-15T18:12:37.170043] [DEBUG] [LOCAL ] CRCL: No primary data file found to delete. [2025-10-15T18:12:37.170078] [INFO ] [MAIN ] CRCL: Starting full primary refresh. [2025-10-15T18:12:37.516076] [INFO ] [REMOTE ] CRCL: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:12:37.714007] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-04. [2025-10-15T18:12:38.311098] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-15T18:12:38.514018] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-04. [2025-10-15T18:12:39.154326] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-15T18:12:39.313977] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-05. [2025-10-15T18:12:39.971823] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-15T18:12:40.114049] [INFO ] [REMOTE ] CRCL: Fetching primary data for 2024-12. [2025-10-15T18:12:40.301272] [DEBUG] [REMOTE ] CRCL: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-15T18:12:40.301580] [WARN ] [REMOTE ] CRCL: No data returned for month 2024-12 [2025-10-15T18:12:40.301688] [FATAL] [REMOTE ] CRCL: API call failed - aborting fetch to avoid wasting further API calls [2025-10-15T18:12:40.301785] [FATAL] [MAIN ] CRCL: Failed to fetch primary data. [2025-10-15T18:12:40.301841] [WARN ] [MAIN ] CRCL: Deleting existing primary and derivative data due to fetch failure. [2025-10-15T18:12:40.301903] [INFO ] [LOCAL ] CRCL: Starting deletion of primary data. [2025-10-15T18:12:40.301970] [DEBUG] [LOCAL ] CRCL: No primary data file found to delete. [2025-10-15T18:12:40.302008] [INFO ] [LOCAL ] CRCL: Starting deletion of derivative data. [2025-10-15T18:12:40.302047] [DEBUG] [LOCAL ] CRCL: No derivative data file found to delete. [2025-10-15T18:12:40.302092] [INFO ] [MAIN ] Update Progress: 526/2369 symbols completed. CRCL took 3.3s. Estimated remaining: 4h 14m 22s. Rate: 7.2 symbols/min [2025-10-15T18:12:40.476556] [INFO ] [MAIN ] CRGY: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:12:40.523907] [DEBUG] [LOCAL ] CRGY: Loaded 52500 existing records from primary storage. [2025-10-15T18:12:40.524248] [INFO ] [MAIN ] CRGY: Loaded 52500 existing records. [2025-10-15T18:12:40.706669] [WARN ] [MAIN ] CRGY: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:12:40.706876] [INFO ] [MAIN ] CRGY: Wiping existing primary data before full refresh. [2025-10-15T18:12:40.706923] [INFO ] [LOCAL ] CRGY: Starting deletion of primary data. [2025-10-15T18:12:40.707490] [DEBUG] [LOCAL ] CRGY: Deleted primary data file. [2025-10-15T18:12:40.707548] [INFO ] [MAIN ] CRGY: Starting full primary refresh. [2025-10-15T18:12:40.924313] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-07. [2025-10-15T18:12:41.071778] [INFO ] [REMOTE ] CRGY: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:12:41.104566] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-15T18:12:41.714018] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-06. [2025-10-15T18:12:42.211473] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-15T18:12:42.513996] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-08. [2025-10-15T18:12:43.222846] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-15T18:12:43.284346] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-15T18:12:43.313972] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-07. [2025-10-15T18:12:44.114055] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2024-12. [2025-10-15T18:12:44.775767] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-15T18:12:44.914036] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-05. [2025-10-15T18:12:45.714029] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-09. [2025-10-15T18:12:45.862249] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-15T18:12:46.263999] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-15T18:12:46.513962] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-01. [2025-10-15T18:12:46.702726] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-15T18:12:47.314051] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-10. [2025-10-15T18:12:47.833054] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-15T18:12:48.113997] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-02. [2025-10-15T18:12:48.518091] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-15T18:12:48.520993] [INFO ] [REMOTE ] CR: Full fetch complete (34634 records). [2025-10-15T18:12:48.521076] [DEBUG] [VALIDATOR ] CR: Validating primary data. [2025-10-15T18:12:48.905890] [DEBUG] [VALIDATOR ] CR: All expected trading days are present. [2025-10-15T18:12:48.906006] [DEBUG] [VALIDATOR ] CR: Primary data validation passed. [2025-10-15T18:12:48.906711] [INFO ] [MAIN ] CR: Fetched primary data is valid. [2025-10-15T18:12:48.906770] [DEBUG] [LOCAL ] CR: Saving primary data. [2025-10-15T18:12:48.907924] [DEBUG] [LOCAL ] CR: Trimmed 34634 records to 24087 (keeping 200 days of data) [2025-10-15T18:12:48.962561] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-06. [2025-10-15T18:12:49.057234] [DEBUG] [LOCAL ] CR: Primary data saved (24087 records). [2025-10-15T18:12:49.057358] [INFO ] [MAIN ] CR: Full history saved. [2025-10-15T18:12:49.057436] [INFO ] [MAIN ] Update Progress: 527/2369 symbols completed. CR took 37.2s. Estimated remaining: 4h 14m 15s. Rate: 7.2 symbols/min [2025-10-15T18:12:49.220918] [INFO ] [MAIN ] CRH: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:12:49.272211] [DEBUG] [LOCAL ] CRH: Loaded 53443 existing records from primary storage. [2025-10-15T18:12:49.272516] [INFO ] [MAIN ] CRH: Loaded 53443 existing records. [2025-10-15T18:12:49.447129] [WARN ] [MAIN ] CRH: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:12:49.447357] [INFO ] [MAIN ] CRH: Wiping existing primary data before full refresh. [2025-10-15T18:12:49.447404] [INFO ] [LOCAL ] CRH: Starting deletion of primary data. [2025-10-15T18:12:49.447701] [DEBUG] [LOCAL ] CRH: Deleted primary data file. [2025-10-15T18:12:49.447766] [INFO ] [MAIN ] CRH: Starting full primary refresh. [2025-10-15T18:12:49.720635] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-08. [2025-10-15T18:12:49.803549] [INFO ] [REMOTE ] CRH: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:12:49.829911] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-15T18:12:50.442374] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-15T18:12:50.514009] [INFO ] [REMOTE ] CRH: Fetching primary data for 2024-12. [2025-10-15T18:12:51.313970] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-07. [2025-10-15T18:12:51.408761] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-15T18:12:52.006488] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-15T18:12:52.113967] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-01. [2025-10-15T18:12:52.707876] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-15T18:12:52.914008] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-08. [2025-10-15T18:12:53.713973] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-03. [2025-10-15T18:12:53.967550] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-15T18:12:54.058179] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-15T18:12:54.514020] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-09. [2025-10-15T18:12:55.314046] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-02. [2025-10-15T18:12:55.458851] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-15T18:12:56.070092] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-15T18:12:56.114031] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-04. [2025-10-15T18:12:56.913991] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-09. [2025-10-15T18:12:56.975468] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-15T18:12:57.714122] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-03. [2025-10-15T18:12:58.060187] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-15T18:12:58.362468] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-15T18:12:58.513981] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-10. [2025-10-15T18:12:59.314008] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-05. [2025-10-15T18:12:59.642905] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-15T18:12:59.902070] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-15T18:12:59.908332] [INFO ] [REMOTE ] CRBG: Full fetch complete (75989 records). [2025-10-15T18:12:59.908476] [DEBUG] [VALIDATOR ] CRBG: Validating primary data. [2025-10-15T18:13:00.119306] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-10. [2025-10-15T18:13:00.347828] [DEBUG] [VALIDATOR ] CRBG: All expected trading days are present. [2025-10-15T18:13:00.347940] [DEBUG] [VALIDATOR ] CRBG: Primary data validation passed. [2025-10-15T18:13:00.348992] [INFO ] [MAIN ] CRBG: Fetched primary data is valid. [2025-10-15T18:13:00.349059] [DEBUG] [LOCAL ] CRBG: Saving primary data. [2025-10-15T18:13:00.350559] [DEBUG] [LOCAL ] CRBG: Trimmed 75989 records to 52586 (keeping 200 days of data) [2025-10-15T18:13:00.701106] [DEBUG] [LOCAL ] CRBG: Primary data saved (52586 records). [2025-10-15T18:13:00.701250] [INFO ] [MAIN ] CRBG: Full history saved. [2025-10-15T18:13:00.702216] [INFO ] [MAIN ] Update Progress: 528/2369 symbols completed. CRBG took 40.8s. Estimated remaining: 4h 14m 19s. Rate: 7.2 symbols/min [2025-10-15T18:13:00.896088] [INFO ] [MAIN ] CRI: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:13:00.923597] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-04. [2025-10-15T18:13:00.943707] [DEBUG] [LOCAL ] CRI: Loaded 49699 existing records from primary storage. [2025-10-15T18:13:00.944031] [INFO ] [MAIN ] CRI: Loaded 49699 existing records. [2025-10-15T18:13:01.130211] [WARN ] [MAIN ] CRI: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:13:01.130625] [INFO ] [MAIN ] CRI: Wiping existing primary data before full refresh. [2025-10-15T18:13:01.130817] [INFO ] [LOCAL ] CRI: Starting deletion of primary data. [2025-10-15T18:13:01.131101] [DEBUG] [LOCAL ] CRI: Deleted primary data file. [2025-10-15T18:13:01.131243] [INFO ] [MAIN ] CRI: Starting full primary refresh. [2025-10-15T18:13:01.413506] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-05 (2.10 seconds). [2025-10-15T18:13:01.535746] [INFO ] [REMOTE ] CRI: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:13:01.713963] [INFO ] [REMOTE ] CRI: Fetching primary data for 2024-12. [2025-10-15T18:13:02.064493] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-10 (1.95 seconds). [2025-10-15T18:13:02.070273] [INFO ] [REMOTE ] CRC: Full fetch complete (62855 records). [2025-10-15T18:13:02.070393] [DEBUG] [VALIDATOR ] CRC: Validating primary data. [2025-10-15T18:13:02.448606] [DEBUG] [VALIDATOR ] CRC: All expected trading days are present. [2025-10-15T18:13:02.448716] [DEBUG] [VALIDATOR ] CRC: Primary data validation passed. [2025-10-15T18:13:02.449551] [INFO ] [MAIN ] CRC: Fetched primary data is valid. [2025-10-15T18:13:02.449593] [DEBUG] [LOCAL ] CRC: Saving primary data. [2025-10-15T18:13:02.450863] [DEBUG] [LOCAL ] CRC: Trimmed 62855 records to 44068 (keeping 200 days of data) [2025-10-15T18:13:02.539621] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-06. [2025-10-15T18:13:02.731370] [DEBUG] [LOCAL ] CRC: Primary data saved (44068 records). [2025-10-15T18:13:02.731738] [INFO ] [MAIN ] CRC: Full history saved. [2025-10-15T18:13:02.731833] [INFO ] [MAIN ] Update Progress: 529/2369 symbols completed. CRC took 35.2s. Estimated remaining: 4h 13m 49s. Rate: 7.2 symbols/min [2025-10-15T18:13:02.866538] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-15T18:13:02.955351] [INFO ] [MAIN ] CRK: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:13:02.955758] [DEBUG] [LOCAL ] CRK: No existing data file found in primary storage. [2025-10-15T18:13:02.955810] [WARN ] [MAIN ] CRK: No existing data found, performing full refresh instead. [2025-10-15T18:13:02.955922] [INFO ] [MAIN ] CRK: Wiping existing primary data before full refresh. [2025-10-15T18:13:02.955963] [INFO ] [LOCAL ] CRK: Starting deletion of primary data. [2025-10-15T18:13:02.956003] [DEBUG] [LOCAL ] CRK: No primary data file found to delete. [2025-10-15T18:13:02.956052] [INFO ] [MAIN ] CRK: Starting full primary refresh. [2025-10-15T18:13:03.322824] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-05. [2025-10-15T18:13:03.327986] [INFO ] [REMOTE ] CRK: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:13:03.388946] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-15T18:13:04.114083] [INFO ] [REMOTE ] CRK: Fetching primary data for 2024-12. [2025-10-15T18:13:04.243222] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-15T18:13:04.914036] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-07. [2025-10-15T18:13:05.234040] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-15T18:13:05.717834] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-06. [2025-10-15T18:13:05.725127] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-15T18:13:06.514012] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-01. [2025-10-15T18:13:06.573579] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-15T18:13:07.222369] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-15T18:13:07.313996] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-07. [2025-10-15T18:13:08.114036] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-08. [2025-10-15T18:13:08.228488] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-15T18:13:08.913962] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-02. [2025-10-15T18:13:08.976527] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-15T18:13:09.567041] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-15T18:13:09.714001] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-09. [2025-10-15T18:13:10.286389] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-15T18:13:10.514005] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-08. [2025-10-15T18:13:11.139269] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-15T18:13:11.314025] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-10. [2025-10-15T18:13:12.013435] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-15T18:13:12.113983] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-09. [2025-10-15T18:13:12.914040] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-01. [2025-10-15T18:13:12.988615] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-15T18:13:12.995358] [INFO ] [REMOTE ] CRGY: Full fetch complete (76137 records). [2025-10-15T18:13:12.995494] [DEBUG] [VALIDATOR ] CRGY: Validating primary data. [2025-10-15T18:13:13.430217] [DEBUG] [VALIDATOR ] CRGY: All expected trading days are present. [2025-10-15T18:13:13.430317] [DEBUG] [VALIDATOR ] CRGY: Primary data validation passed. [2025-10-15T18:13:13.431418] [INFO ] [MAIN ] CRGY: Fetched primary data is valid. [2025-10-15T18:13:13.431485] [DEBUG] [LOCAL ] CRGY: Saving primary data. [2025-10-15T18:13:13.433001] [DEBUG] [LOCAL ] CRGY: Trimmed 76137 records to 52507 (keeping 200 days of data) [2025-10-15T18:13:13.719711] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-03. [2025-10-15T18:13:13.759220] [DEBUG] [LOCAL ] CRGY: Primary data saved (52507 records). [2025-10-15T18:13:13.759398] [INFO ] [MAIN ] CRGY: Full history saved. [2025-10-15T18:13:13.759791] [INFO ] [MAIN ] Update Progress: 530/2369 symbols completed. CRGY took 33.5s. Estimated remaining: 4h 13m 50s. Rate: 7.2 symbols/min [2025-10-15T18:13:13.954936] [INFO ] [MAIN ] CRL: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:13:14.000015] [DEBUG] [LOCAL ] CRL: Loaded 42908 existing records from primary storage. [2025-10-15T18:13:14.000322] [INFO ] [MAIN ] CRL: Loaded 42908 existing records. [2025-10-15T18:13:14.212803] [WARN ] [MAIN ] CRL: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:13:14.213114] [INFO ] [MAIN ] CRL: Wiping existing primary data before full refresh. [2025-10-15T18:13:14.213247] [INFO ] [LOCAL ] CRL: Starting deletion of primary data. [2025-10-15T18:13:14.213800] [DEBUG] [LOCAL ] CRL: Deleted primary data file. [2025-10-15T18:13:14.213941] [INFO ] [MAIN ] CRL: Starting full primary refresh. [2025-10-15T18:13:14.381210] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-09 (2.27 seconds). [2025-10-15T18:13:14.521693] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-10. [2025-10-15T18:13:14.684963] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-15T18:13:14.719178] [INFO ] [REMOTE ] CRL: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:13:15.314029] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-02. [2025-10-15T18:13:15.410903] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-15T18:13:16.114016] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-04. [2025-10-15T18:13:16.235614] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-15T18:13:16.244623] [INFO ] [REMOTE ] CRH: Full fetch complete (77113 records). [2025-10-15T18:13:16.244875] [DEBUG] [VALIDATOR ] CRH: Validating primary data. [2025-10-15T18:13:16.245920] [FATAL] [VALIDATOR ] CRH: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T18:13:16.246076] [FATAL] [MAIN ] CRH: Fetched primary data is invalid. Refusing to save it. [2025-10-15T18:13:16.246140] [WARN ] [MAIN ] CRH: Deleting existing primary and derivative data due to validation failure. [2025-10-15T18:13:16.246204] [INFO ] [LOCAL ] CRH: Starting deletion of primary data. [2025-10-15T18:13:16.246289] [DEBUG] [LOCAL ] CRH: No primary data file found to delete. [2025-10-15T18:13:16.246350] [INFO ] [LOCAL ] CRH: Starting deletion of derivative data. [2025-10-15T18:13:16.246561] [DEBUG] [LOCAL ] CRH: Deleted derivative data file. [2025-10-15T18:13:16.246723] [INFO ] [MAIN ] Update Progress: 531/2369 symbols completed. CRH took 27.2s. Estimated remaining: 4h 13m 21s. Rate: 7.3 symbols/min [2025-10-15T18:13:16.515452] [INFO ] [MAIN ] CRM: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:13:16.576912] [DEBUG] [LOCAL ] CRM: Loaded 53770 existing records from primary storage. [2025-10-15T18:13:16.577258] [INFO ] [MAIN ] CRM: Loaded 53770 existing records. [2025-10-15T18:13:16.782467] [WARN ] [MAIN ] CRM: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:13:16.783075] [INFO ] [MAIN ] CRM: Wiping existing primary data before full refresh. [2025-10-15T18:13:16.783177] [INFO ] [LOCAL ] CRM: Starting deletion of primary data. [2025-10-15T18:13:16.792711] [DEBUG] [LOCAL ] CRM: Deleted primary data file. [2025-10-15T18:13:16.810140] [INFO ] [MAIN ] CRM: Starting full primary refresh. [2025-10-15T18:13:16.845885] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-15T18:13:16.918203] [INFO ] [REMOTE ] CRL: Fetching primary data for 2024-12. [2025-10-15T18:13:17.203231] [INFO ] [REMOTE ] CRM: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:13:17.714113] [INFO ] [REMOTE ] CRM: Fetching primary data for 2024-12. [2025-10-15T18:13:18.244595] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-10-15T18:13:18.513974] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-03. [2025-10-15T18:13:18.545043] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-15T18:13:19.313995] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-05. [2025-10-15T18:13:19.779621] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2024-12 (2.07 seconds). [2025-10-15T18:13:20.113981] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-01. [2025-10-15T18:13:20.244094] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-15T18:13:20.568489] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-15T18:13:20.913979] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-06. [2025-10-15T18:13:21.408842] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-15T18:13:21.714057] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-04. [2025-10-15T18:13:22.417320] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-15T18:13:22.513964] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-07. [2025-10-15T18:13:23.207008] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-15T18:13:23.314030] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-02. [2025-10-15T18:13:24.113979] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-05. [2025-10-15T18:13:24.186369] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-15T18:13:24.913986] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-08. [2025-10-15T18:13:24.954194] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-15T18:13:25.435564] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-15T18:13:25.713998] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-06. [2025-10-15T18:13:26.209702] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-15T18:13:26.514012] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-03. [2025-10-15T18:13:27.086729] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-15T18:13:27.313988] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-01. [2025-10-15T18:13:28.113987] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-09. [2025-10-15T18:13:28.269177] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-15T18:13:28.913994] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-04. [2025-10-15T18:13:29.387351] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-01 (2.07 seconds). [2025-10-15T18:13:29.714011] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-07. [2025-10-15T18:13:29.895390] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-15T18:13:30.513979] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-02. [2025-10-15T18:13:30.568839] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-15T18:13:30.671675] [DEBUG] [REMOTE ] CRM: Error fetching primary data for 2025-02: 'API call returned an empty response.' [2025-10-15T18:13:30.671963] [WARN ] [REMOTE ] CRM: No data returned for month 2025-02 [2025-10-15T18:13:30.672052] [FATAL] [REMOTE ] CRM: API call failed - aborting fetch to avoid wasting further API calls [2025-10-15T18:13:30.672144] [FATAL] [MAIN ] CRM: Failed to fetch primary data. [2025-10-15T18:13:30.672206] [WARN ] [MAIN ] CRM: Deleting existing primary and derivative data due to fetch failure. [2025-10-15T18:13:30.672274] [INFO ] [LOCAL ] CRM: Starting deletion of primary data. [2025-10-15T18:13:30.672337] [DEBUG] [LOCAL ] CRM: No primary data file found to delete. [2025-10-15T18:13:30.672372] [INFO ] [LOCAL ] CRM: Starting deletion of derivative data. [2025-10-15T18:13:30.672514] [DEBUG] [LOCAL ] CRM: Deleted derivative data file. [2025-10-15T18:13:30.672595] [INFO ] [MAIN ] Update Progress: 532/2369 symbols completed. CRM took 14.4s. Estimated remaining: 4h 13m 34s. Rate: 7.2 symbols/min [2025-10-15T18:13:30.839679] [INFO ] [MAIN ] CRS: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:13:30.879358] [DEBUG] [LOCAL ] CRS: Loaded 43223 existing records from primary storage. [2025-10-15T18:13:30.879668] [INFO ] [MAIN ] CRS: Loaded 43223 existing records. [2025-10-15T18:13:31.054747] [WARN ] [MAIN ] CRS: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:13:31.054953] [INFO ] [MAIN ] CRS: Wiping existing primary data before full refresh. [2025-10-15T18:13:31.055000] [INFO ] [LOCAL ] CRS: Starting deletion of primary data. [2025-10-15T18:13:31.055434] [DEBUG] [LOCAL ] CRS: Deleted primary data file. [2025-10-15T18:13:31.055478] [INFO ] [MAIN ] CRS: Starting full primary refresh. [2025-10-15T18:13:31.319188] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-10. [2025-10-15T18:13:31.412030] [INFO ] [REMOTE ] CRS: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:13:31.448337] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-15T18:13:32.114002] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-08. [2025-10-15T18:13:32.916505] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-05. [2025-10-15T18:13:32.920311] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-15T18:13:32.926858] [INFO ] [REMOTE ] CRK: Full fetch complete (75830 records). [2025-10-15T18:13:32.926999] [DEBUG] [VALIDATOR ] CRK: Validating primary data. [2025-10-15T18:13:33.332537] [DEBUG] [VALIDATOR ] CRK: All expected trading days are present. [2025-10-15T18:13:33.332960] [DEBUG] [VALIDATOR ] CRK: Primary data validation passed. [2025-10-15T18:13:33.333997] [INFO ] [MAIN ] CRK: Fetched primary data is valid. [2025-10-15T18:13:33.334128] [DEBUG] [LOCAL ] CRK: Saving primary data. [2025-10-15T18:13:33.335494] [DEBUG] [LOCAL ] CRK: Trimmed 75830 records to 52246 (keeping 200 days of data) [2025-10-15T18:13:33.589304] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-15T18:13:33.683237] [DEBUG] [LOCAL ] CRK: Primary data saved (52246 records). [2025-10-15T18:13:33.683399] [INFO ] [MAIN ] CRK: Full history saved. [2025-10-15T18:13:33.683481] [INFO ] [MAIN ] Update Progress: 533/2369 symbols completed. CRK took 30.9s. Estimated remaining: 4h 13m 8s. Rate: 7.3 symbols/min [2025-10-15T18:13:33.719112] [INFO ] [REMOTE ] CRS: Fetching primary data for 2024-12. [2025-10-15T18:13:33.865405] [INFO ] [MAIN ] CRT: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:13:33.873507] [DEBUG] [LOCAL ] CRT: Loaded 4916 existing records from primary storage. [2025-10-15T18:13:33.873769] [INFO ] [MAIN ] CRT: Loaded 4916 existing records. [2025-10-15T18:13:34.058164] [WARN ] [MAIN ] CRT: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:13:34.058398] [INFO ] [MAIN ] CRT: Wiping existing primary data before full refresh. [2025-10-15T18:13:34.058447] [INFO ] [LOCAL ] CRT: Starting deletion of primary data. [2025-10-15T18:13:34.058609] [DEBUG] [LOCAL ] CRT: Deleted primary data file. [2025-10-15T18:13:34.058686] [INFO ] [MAIN ] CRT: Starting full primary refresh. [2025-10-15T18:13:34.407480] [INFO ] [REMOTE ] CRT: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:13:34.513975] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-09. [2025-10-15T18:13:34.615507] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-15T18:13:35.290501] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-15T18:13:35.313965] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-01. [2025-10-15T18:13:35.965133] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-15T18:13:36.114008] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-10. [2025-10-15T18:13:36.881824] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-15T18:13:36.913956] [INFO ] [REMOTE ] CRT: Fetching primary data for 2024-12. [2025-10-15T18:13:37.485210] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-15T18:13:37.490751] [INFO ] [REMOTE ] CRI: Full fetch complete (70931 records). [2025-10-15T18:13:37.490901] [DEBUG] [VALIDATOR ] CRI: Validating primary data. [2025-10-15T18:13:37.689109] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-10-15T18:13:37.720120] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-02. [2025-10-15T18:13:37.886572] [DEBUG] [VALIDATOR ] CRI: All expected trading days are present. [2025-10-15T18:13:37.886682] [DEBUG] [VALIDATOR ] CRI: Primary data validation passed. [2025-10-15T18:13:37.887538] [INFO ] [MAIN ] CRI: Fetched primary data is valid. [2025-10-15T18:13:37.887583] [DEBUG] [LOCAL ] CRI: Saving primary data. [2025-10-15T18:13:37.889181] [DEBUG] [LOCAL ] CRI: Trimmed 70931 records to 49669 (keeping 200 days of data) [2025-10-15T18:13:38.184165] [DEBUG] [LOCAL ] CRI: Primary data saved (49669 records). [2025-10-15T18:13:38.184314] [INFO ] [MAIN ] CRI: Full history saved. [2025-10-15T18:13:38.185315] [INFO ] [MAIN ] Update Progress: 534/2369 symbols completed. CRI took 37.5s. Estimated remaining: 4h 12m 47s. Rate: 7.3 symbols/min [2025-10-15T18:13:38.350329] [INFO ] [MAIN ] CSAN: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:13:38.396435] [DEBUG] [LOCAL ] CSAN: Loaded 42149 existing records from primary storage. [2025-10-15T18:13:38.396797] [INFO ] [MAIN ] CSAN: Loaded 42149 existing records. [2025-10-15T18:13:38.519148] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-06. [2025-10-15T18:13:38.573926] [WARN ] [MAIN ] CSAN: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:13:38.574181] [INFO ] [MAIN ] CSAN: Wiping existing primary data before full refresh. [2025-10-15T18:13:38.574230] [INFO ] [LOCAL ] CSAN: Starting deletion of primary data. [2025-10-15T18:13:38.574753] [DEBUG] [LOCAL ] CSAN: Deleted primary data file. [2025-10-15T18:13:38.574808] [INFO ] [MAIN ] CSAN: Starting full primary refresh. [2025-10-15T18:13:38.916324] [INFO ] [REMOTE ] CSAN: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:13:39.314008] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2024-12. [2025-10-15T18:13:39.406713] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-15T18:13:39.826688] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-15T18:13:40.113975] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-03. [2025-10-15T18:13:40.542912] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-10-15T18:13:40.914008] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-01. [2025-10-15T18:13:41.476500] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-15T18:13:41.714004] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-04. [2025-10-15T18:13:42.301016] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-15T18:13:42.513985] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-02. [2025-10-15T18:13:43.064943] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-15T18:13:43.313979] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-01. [2025-10-15T18:13:43.853761] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-10-15T18:13:43.875672] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-15T18:13:44.113970] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-07. [2025-10-15T18:13:44.914052] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-02. [2025-10-15T18:13:45.451978] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-15T18:13:45.645511] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-15T18:13:45.714001] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-05. [2025-10-15T18:13:46.514025] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-08. [2025-10-15T18:13:47.314023] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-03. [2025-10-15T18:13:47.562158] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-15T18:13:47.754501] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-15T18:13:47.825846] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-10-15T18:13:48.114009] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-09. [2025-10-15T18:13:48.914040] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-03. [2025-10-15T18:13:49.375474] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-15T18:13:49.714029] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-10. [2025-10-15T18:13:50.255075] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-15T18:13:50.514023] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-04. [2025-10-15T18:13:51.051284] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-10-15T18:13:51.241994] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-15T18:13:51.247171] [INFO ] [REMOTE ] CRL: Full fetch complete (63407 records). [2025-10-15T18:13:51.247284] [DEBUG] [VALIDATOR ] CRL: Validating primary data. [2025-10-15T18:13:51.319059] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-04. [2025-10-15T18:13:51.645911] [DEBUG] [VALIDATOR ] CRL: All expected trading days are present. [2025-10-15T18:13:51.645990] [DEBUG] [VALIDATOR ] CRL: Primary data validation passed. [2025-10-15T18:13:51.646886] [INFO ] [MAIN ] CRL: Fetched primary data is valid. [2025-10-15T18:13:51.646953] [DEBUG] [LOCAL ] CRL: Saving primary data. [2025-10-15T18:13:51.648240] [DEBUG] [LOCAL ] CRL: Trimmed 63407 records to 42812 (keeping 200 days of data) [2025-10-15T18:13:51.905856] [DEBUG] [LOCAL ] CRL: Primary data saved (42812 records). [2025-10-15T18:13:51.905982] [INFO ] [MAIN ] CRL: Full history saved. [2025-10-15T18:13:51.906310] [INFO ] [MAIN ] Update Progress: 535/2369 symbols completed. CRL took 38.1s. Estimated remaining: 4h 12m 57s. Rate: 7.3 symbols/min [2025-10-15T18:13:52.087929] [INFO ] [MAIN ] CSL: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:13:52.122386] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-05. [2025-10-15T18:13:52.125613] [DEBUG] [LOCAL ] CSL: Loaded 31497 existing records from primary storage. [2025-10-15T18:13:52.125996] [INFO ] [MAIN ] CSL: Loaded 31497 existing records. [2025-10-15T18:13:52.306668] [WARN ] [MAIN ] CSL: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:13:52.306892] [INFO ] [MAIN ] CSL: Wiping existing primary data before full refresh. [2025-10-15T18:13:52.306939] [INFO ] [LOCAL ] CSL: Starting deletion of primary data. [2025-10-15T18:13:52.307274] [DEBUG] [LOCAL ] CSL: Deleted primary data file. [2025-10-15T18:13:52.307312] [INFO ] [MAIN ] CSL: Starting full primary refresh. [2025-10-15T18:13:52.668181] [INFO ] [REMOTE ] CSL: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:13:52.688284] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-15T18:13:52.913964] [INFO ] [REMOTE ] CSL: Fetching primary data for 2024-12. [2025-10-15T18:13:53.018202] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-15T18:13:53.714017] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-06. [2025-10-15T18:13:54.121778] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-15T18:13:54.513974] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-01. [2025-10-15T18:13:55.314933] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-05. [2025-10-15T18:13:55.314852] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-15T18:13:55.758963] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-15T18:13:56.113998] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-06. [2025-10-15T18:13:56.802416] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-15T18:13:56.829608] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-15T18:13:56.913979] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-02. [2025-10-15T18:13:57.713996] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-06. [2025-10-15T18:13:58.267257] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-15T18:13:58.514030] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-07. [2025-10-15T18:13:58.724397] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-15T18:13:59.314053] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-07. [2025-10-15T18:14:00.113973] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-07. [2025-10-15T18:14:00.254477] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-15T18:14:00.796014] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-10-15T18:14:00.795865] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-15T18:14:00.913947] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-08. [2025-10-15T18:14:01.713995] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-08. [2025-10-15T18:14:02.184563] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-10-15T18:14:02.240033] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-15T18:14:02.514004] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-03. [2025-10-15T18:14:03.314010] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-08. [2025-10-15T18:14:03.904899] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-15T18:14:04.114007] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-09. [2025-10-15T18:14:04.689857] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-15T18:14:04.914046] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-04. [2025-10-15T18:14:05.699843] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-15T18:14:05.713949] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-10. [2025-10-15T18:14:06.343306] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-15T18:14:06.513973] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-05. [2025-10-15T18:14:07.257680] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-15T18:14:07.262434] [INFO ] [REMOTE ] CSAN: Full fetch complete (60439 records). [2025-10-15T18:14:07.262579] [DEBUG] [VALIDATOR ] CSAN: Validating primary data. [2025-10-15T18:14:07.324457] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-09. [2025-10-15T18:14:07.670468] [DEBUG] [VALIDATOR ] CSAN: All expected trading days are present. [2025-10-15T18:14:07.670678] [DEBUG] [VALIDATOR ] CSAN: Primary data validation passed. [2025-10-15T18:14:07.671537] [INFO ] [MAIN ] CSAN: Fetched primary data is valid. [2025-10-15T18:14:07.671728] [DEBUG] [LOCAL ] CSAN: Saving primary data. [2025-10-15T18:14:07.690220] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-15T18:14:07.696710] [DEBUG] [LOCAL ] CSAN: Trimmed 60439 records to 42170 (keeping 200 days of data) [2025-10-15T18:14:07.928159] [DEBUG] [LOCAL ] CSAN: Primary data saved (42170 records). [2025-10-15T18:14:07.928289] [INFO ] [MAIN ] CSAN: Full history saved. [2025-10-15T18:14:07.928370] [INFO ] [MAIN ] Update Progress: 536/2369 symbols completed. CSAN took 29.7s. Estimated remaining: 4h 13m 15s. Rate: 7.2 symbols/min [2025-10-15T18:14:08.092523] [INFO ] [MAIN ] CSR: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:14:08.106947] [DEBUG] [LOCAL ] CSR: Loaded 13282 existing records from primary storage. [2025-10-15T18:14:08.107185] [INFO ] [MAIN ] CSR: Loaded 13282 existing records. [2025-10-15T18:14:08.119755] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-09. [2025-10-15T18:14:08.287120] [WARN ] [MAIN ] CSR: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:14:08.287328] [INFO ] [MAIN ] CSR: Wiping existing primary data before full refresh. [2025-10-15T18:14:08.287375] [INFO ] [LOCAL ] CSR: Starting deletion of primary data. [2025-10-15T18:14:08.287690] [DEBUG] [LOCAL ] CSR: Deleted primary data file. [2025-10-15T18:14:08.287749] [INFO ] [MAIN ] CSR: Starting full primary refresh. [2025-10-15T18:14:08.668953] [INFO ] [REMOTE ] CSR: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:14:08.847493] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-15T18:14:08.847893] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-15T18:14:08.914236] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-06. [2025-10-15T18:14:09.714077] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-10. [2025-10-15T18:14:10.215663] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-15T18:14:10.307384] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-15T18:14:10.308502] [INFO ] [REMOTE ] CRT: Full fetch complete (7407 records). [2025-10-15T18:14:10.308572] [DEBUG] [VALIDATOR ] CRT: Validating primary data. [2025-10-15T18:14:10.523819] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-10. [2025-10-15T18:14:10.679728] [DEBUG] [VALIDATOR ] CRT: All expected trading days are present. [2025-10-15T18:14:10.679812] [DEBUG] [VALIDATOR ] CRT: Primary data validation passed. [2025-10-15T18:14:10.680027] [INFO ] [MAIN ] CRT: Fetched primary data is valid. [2025-10-15T18:14:10.680065] [DEBUG] [LOCAL ] CRT: Saving primary data. [2025-10-15T18:14:10.680451] [DEBUG] [LOCAL ] CRT: Trimmed 7407 records to 4885 (keeping 200 days of data) [2025-10-15T18:14:10.711292] [DEBUG] [LOCAL ] CRT: Primary data saved (4885 records). [2025-10-15T18:14:10.711462] [INFO ] [MAIN ] CRT: Full history saved. [2025-10-15T18:14:10.711545] [INFO ] [MAIN ] Update Progress: 537/2369 symbols completed. CRT took 37.0s. Estimated remaining: 4h 12m 48s. Rate: 7.2 symbols/min [2025-10-15T18:14:10.884727] [INFO ] [MAIN ] CSTM: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:14:10.930000] [DEBUG] [LOCAL ] CSTM: Loaded 47568 existing records from primary storage. [2025-10-15T18:14:10.930307] [INFO ] [MAIN ] CSTM: Loaded 47568 existing records. [2025-10-15T18:14:11.104132] [WARN ] [MAIN ] CSTM: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:14:11.104345] [INFO ] [MAIN ] CSTM: Wiping existing primary data before full refresh. [2025-10-15T18:14:11.104393] [INFO ] [LOCAL ] CSTM: Starting deletion of primary data. [2025-10-15T18:14:11.104849] [DEBUG] [LOCAL ] CSTM: Deleted primary data file. [2025-10-15T18:14:11.104905] [INFO ] [MAIN ] CSTM: Starting full primary refresh. [2025-10-15T18:14:11.322094] [INFO ] [REMOTE ] CSR: Fetching primary data for 2024-12. [2025-10-15T18:14:11.460087] [INFO ] [REMOTE ] CSTM: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:14:11.996115] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-15T18:14:12.001905] [INFO ] [REMOTE ] CRS: Full fetch complete (62604 records). [2025-10-15T18:14:12.002063] [DEBUG] [VALIDATOR ] CRS: Validating primary data. [2025-10-15T18:14:12.115210] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-07. [2025-10-15T18:14:12.367107] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-15T18:14:12.439430] [DEBUG] [VALIDATOR ] CRS: All expected trading days are present. [2025-10-15T18:14:12.439531] [DEBUG] [VALIDATOR ] CRS: Primary data validation passed. [2025-10-15T18:14:12.440630] [INFO ] [MAIN ] CRS: Fetched primary data is valid. [2025-10-15T18:14:12.440738] [DEBUG] [LOCAL ] CRS: Saving primary data. [2025-10-15T18:14:12.442198] [DEBUG] [LOCAL ] CRS: Trimmed 62604 records to 43214 (keeping 200 days of data) [2025-10-15T18:14:12.720896] [DEBUG] [LOCAL ] CRS: Primary data saved (43214 records). [2025-10-15T18:14:12.721044] [INFO ] [MAIN ] CRS: Full history saved. [2025-10-15T18:14:12.721135] [INFO ] [MAIN ] Update Progress: 538/2369 symbols completed. CRS took 42.0s. Estimated remaining: 4h 12m 19s. Rate: 7.3 symbols/min [2025-10-15T18:14:12.892236] [INFO ] [MAIN ] CSV: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:14:12.906169] [DEBUG] [LOCAL ] CSV: Loaded 12742 existing records from primary storage. [2025-10-15T18:14:12.906457] [INFO ] [MAIN ] CSV: Loaded 12742 existing records. [2025-10-15T18:14:12.920186] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2024-12. [2025-10-15T18:14:13.127418] [WARN ] [MAIN ] CSV: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:14:13.127722] [INFO ] [MAIN ] CSV: Wiping existing primary data before full refresh. [2025-10-15T18:14:13.127781] [INFO ] [LOCAL ] CSV: Starting deletion of primary data. [2025-10-15T18:14:13.128028] [DEBUG] [LOCAL ] CSV: Deleted primary data file. [2025-10-15T18:14:13.128083] [INFO ] [MAIN ] CSV: Starting full primary refresh. [2025-10-15T18:14:13.496355] [INFO ] [REMOTE ] CSV: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:14:13.538594] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-15T18:14:13.714014] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-08. [2025-10-15T18:14:14.513985] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-01. [2025-10-15T18:14:14.722071] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-15T18:14:15.132535] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-15T18:14:15.250465] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-15T18:14:15.314010] [INFO ] [REMOTE ] CSV: Fetching primary data for 2024-12. [2025-10-15T18:14:16.008554] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-10-15T18:14:16.113988] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-01. [2025-10-15T18:14:16.914002] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-09. [2025-10-15T18:14:17.121350] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-15T18:14:17.714019] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-02. [2025-10-15T18:14:18.188446] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-15T18:14:18.514042] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-10. [2025-10-15T18:14:18.564088] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-15T18:14:19.314021] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-03. [2025-10-15T18:14:20.020094] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-15T18:14:20.024222] [INFO ] [REMOTE ] CSL: Full fetch complete (45458 records). [2025-10-15T18:14:20.024383] [DEBUG] [VALIDATOR ] CSL: Validating primary data. [2025-10-15T18:14:20.119773] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-01. [2025-10-15T18:14:20.324209] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-15T18:14:20.416924] [DEBUG] [VALIDATOR ] CSL: All expected trading days are present. [2025-10-15T18:14:20.417006] [DEBUG] [VALIDATOR ] CSL: Primary data validation passed. [2025-10-15T18:14:20.417716] [INFO ] [MAIN ] CSL: Fetched primary data is valid. [2025-10-15T18:14:20.417780] [DEBUG] [LOCAL ] CSL: Saving primary data. [2025-10-15T18:14:20.418808] [DEBUG] [LOCAL ] CSL: Trimmed 45458 records to 31478 (keeping 200 days of data) [2025-10-15T18:14:20.615841] [DEBUG] [LOCAL ] CSL: Primary data saved (31478 records). [2025-10-15T18:14:20.615988] [INFO ] [MAIN ] CSL: Full history saved. [2025-10-15T18:14:20.616136] [INFO ] [MAIN ] Update Progress: 539/2369 symbols completed. CSL took 28.7s. Estimated remaining: 4h 12m 9s. Rate: 7.3 symbols/min [2025-10-15T18:14:20.794349] [INFO ] [MAIN ] CSW: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:14:20.794543] [DEBUG] [LOCAL ] CSW: No existing data file found in primary storage. [2025-10-15T18:14:20.794581] [WARN ] [MAIN ] CSW: No existing data found, performing full refresh instead. [2025-10-15T18:14:20.794724] [INFO ] [MAIN ] CSW: Wiping existing primary data before full refresh. [2025-10-15T18:14:20.794772] [INFO ] [LOCAL ] CSW: Starting deletion of primary data. [2025-10-15T18:14:20.794815] [DEBUG] [LOCAL ] CSW: No primary data file found to delete. [2025-10-15T18:14:20.794849] [INFO ] [MAIN ] CSW: Starting full primary refresh. [2025-10-15T18:14:20.919125] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-04. [2025-10-15T18:14:21.159477] [INFO ] [REMOTE ] CSW: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:14:21.501206] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-15T18:14:21.713966] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-02. [2025-10-15T18:14:21.850932] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-15T18:14:22.514003] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-02. [2025-10-15T18:14:23.160691] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-15T18:14:23.314917] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-05. [2025-10-15T18:14:23.323583] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-15T18:14:24.114033] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-03. [2025-10-15T18:14:24.215720] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-15T18:14:24.913970] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-06. [2025-10-15T18:14:25.561994] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-15T18:14:25.650415] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-15T18:14:25.714031] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-07. [2025-10-15T18:14:26.514054] [INFO ] [REMOTE ] CSW: Fetching primary data for 2024-12. [2025-10-15T18:14:26.634256] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-15T18:14:26.710539] [DEBUG] [REMOTE ] CSW: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-15T18:14:26.710959] [WARN ] [REMOTE ] CSW: No data returned for month 2024-12 [2025-10-15T18:14:26.711050] [FATAL] [REMOTE ] CSW: API call failed - aborting fetch to avoid wasting further API calls [2025-10-15T18:14:26.711097] [FATAL] [MAIN ] CSW: Failed to fetch primary data. [2025-10-15T18:14:26.711167] [WARN ] [MAIN ] CSW: Deleting existing primary and derivative data due to fetch failure. [2025-10-15T18:14:26.711237] [INFO ] [LOCAL ] CSW: Starting deletion of primary data. [2025-10-15T18:14:26.711299] [DEBUG] [LOCAL ] CSW: No primary data file found to delete. [2025-10-15T18:14:26.711334] [INFO ] [LOCAL ] CSW: Starting deletion of derivative data. [2025-10-15T18:14:26.711373] [DEBUG] [LOCAL ] CSW: No derivative data file found to delete. [2025-10-15T18:14:26.711420] [INFO ] [MAIN ] Update Progress: 540/2369 symbols completed. CSW took 6.1s. Estimated remaining: 4h 11m 54s. Rate: 7.3 symbols/min [2025-10-15T18:14:26.887884] [INFO ] [MAIN ] CTBB: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:14:26.896930] [DEBUG] [LOCAL ] CTBB: Loaded 6891 existing records from primary storage. [2025-10-15T18:14:26.897179] [INFO ] [MAIN ] CTBB: Loaded 6891 existing records. [2025-10-15T18:14:27.107475] [WARN ] [MAIN ] CTBB: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:14:27.107813] [INFO ] [MAIN ] CTBB: Wiping existing primary data before full refresh. [2025-10-15T18:14:27.107878] [INFO ] [LOCAL ] CTBB: Starting deletion of primary data. [2025-10-15T18:14:27.108110] [DEBUG] [LOCAL ] CTBB: Deleted primary data file. [2025-10-15T18:14:27.108179] [INFO ] [MAIN ] CTBB: Starting full primary refresh. [2025-10-15T18:14:27.319921] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-08. [2025-10-15T18:14:27.486072] [INFO ] [REMOTE ] CTBB: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:14:28.113981] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-03. [2025-10-15T18:14:28.145342] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-15T18:14:28.698266] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-15T18:14:28.913988] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-04. [2025-10-15T18:14:29.714049] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-04. [2025-10-15T18:14:30.513988] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-09. [2025-10-15T18:14:30.571754] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-15T18:14:30.684443] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-15T18:14:31.117668] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-15T18:14:31.313998] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-05. [2025-10-15T18:14:32.065704] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-15T18:14:32.113977] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-06. [2025-10-15T18:14:32.760444] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-15T18:14:32.914057] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-07. [2025-10-15T18:14:33.713970] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-10. [2025-10-15T18:14:33.849602] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-15T18:14:34.514067] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-08. [2025-10-15T18:14:34.541074] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-15T18:14:34.543828] [INFO ] [REMOTE ] CSV: Full fetch complete (19249 records). [2025-10-15T18:14:34.543899] [DEBUG] [VALIDATOR ] CSV: Validating primary data. [2025-10-15T18:14:34.916990] [DEBUG] [VALIDATOR ] CSV: All expected trading days are present. [2025-10-15T18:14:34.917079] [DEBUG] [VALIDATOR ] CSV: Primary data validation passed. [2025-10-15T18:14:34.917492] [INFO ] [MAIN ] CSV: Fetched primary data is valid. [2025-10-15T18:14:34.917532] [DEBUG] [LOCAL ] CSV: Saving primary data. [2025-10-15T18:14:34.918985] [DEBUG] [LOCAL ] CSV: Trimmed 19249 records to 12707 (keeping 200 days of data) [2025-10-15T18:14:34.995863] [DEBUG] [LOCAL ] CSV: Primary data saved (12707 records). [2025-10-15T18:14:34.996008] [INFO ] [MAIN ] CSV: Full history saved. [2025-10-15T18:14:34.996089] [INFO ] [MAIN ] Update Progress: 541/2369 symbols completed. CSV took 22.3s. Estimated remaining: 4h 11m 45s. Rate: 7.3 symbols/min [2025-10-15T18:14:35.162313] [INFO ] [MAIN ] CTDD: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:14:35.162485] [DEBUG] [LOCAL ] CTDD: No existing data file found in primary storage. [2025-10-15T18:14:35.162521] [WARN ] [MAIN ] CTDD: No existing data found, performing full refresh instead. [2025-10-15T18:14:35.162636] [INFO ] [MAIN ] CTDD: Wiping existing primary data before full refresh. [2025-10-15T18:14:35.162714] [INFO ] [LOCAL ] CTDD: Starting deletion of primary data. [2025-10-15T18:14:35.162763] [DEBUG] [LOCAL ] CTDD: No primary data file found to delete. [2025-10-15T18:14:35.162795] [INFO ] [MAIN ] CTDD: Starting full primary refresh. [2025-10-15T18:14:35.316950] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2024-12. [2025-10-15T18:14:35.471856] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-15T18:14:35.532724] [INFO ] [REMOTE ] CTDD: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:14:36.045866] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-10-15T18:14:36.114055] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-09. [2025-10-15T18:14:36.914088] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-01. [2025-10-15T18:14:36.951872] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-15T18:14:37.434719] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-10-15T18:14:37.714035] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-05. [2025-10-15T18:14:38.514063] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-02. [2025-10-15T18:14:39.101903] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-15T18:14:39.131513] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-15T18:14:39.314002] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2024-12. [2025-10-15T18:14:40.113973] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-03. [2025-10-15T18:14:40.143617] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-10-15T18:14:40.883526] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-15T18:14:40.914032] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-10. [2025-10-15T18:14:41.713972] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-04. [2025-10-15T18:14:41.744349] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-15T18:14:41.747092] [INFO ] [REMOTE ] CSR: Full fetch complete (17968 records). [2025-10-15T18:14:41.747170] [DEBUG] [VALIDATOR ] CSR: Validating primary data. [2025-10-15T18:14:42.106217] [DEBUG] [VALIDATOR ] CSR: All expected trading days are present. [2025-10-15T18:14:42.106292] [DEBUG] [VALIDATOR ] CSR: Primary data validation passed. [2025-10-15T18:14:42.106728] [INFO ] [MAIN ] CSR: Fetched primary data is valid. [2025-10-15T18:14:42.106789] [DEBUG] [LOCAL ] CSR: Saving primary data. [2025-10-15T18:14:42.107294] [DEBUG] [LOCAL ] CSR: Trimmed 17968 records to 13403 (keeping 200 days of data) [2025-10-15T18:14:42.186525] [DEBUG] [LOCAL ] CSR: Primary data saved (13403 records). [2025-10-15T18:14:42.186674] [INFO ] [MAIN ] CSR: Full history saved. [2025-10-15T18:14:42.186770] [INFO ] [MAIN ] Update Progress: 542/2369 symbols completed. CSR took 34.3s. Estimated remaining: 4h 11m 34s. Rate: 7.3 symbols/min [2025-10-15T18:14:42.367496] [INFO ] [MAIN ] CTEV: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:14:42.371130] [DEBUG] [LOCAL ] CTEV: No existing data file found in primary storage. [2025-10-15T18:14:42.371191] [WARN ] [MAIN ] CTEV: No existing data found, performing full refresh instead. [2025-10-15T18:14:42.371325] [INFO ] [MAIN ] CTEV: Wiping existing primary data before full refresh. [2025-10-15T18:14:42.371379] [INFO ] [LOCAL ] CTEV: Starting deletion of primary data. [2025-10-15T18:14:42.371423] [DEBUG] [LOCAL ] CTEV: No primary data file found to delete. [2025-10-15T18:14:42.371456] [INFO ] [MAIN ] CTEV: Starting full primary refresh. [2025-10-15T18:14:42.481333] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-15T18:14:42.522476] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-05. [2025-10-15T18:14:42.738188] [INFO ] [REMOTE ] CTEV: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:14:43.170623] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-15T18:14:43.313993] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-01. [2025-10-15T18:14:43.953228] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-15T18:14:44.113969] [INFO ] [REMOTE ] CTEV: Fetching primary data for 2024-12. [2025-10-15T18:14:44.302329] [DEBUG] [REMOTE ] CTEV: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-15T18:14:44.302544] [WARN ] [REMOTE ] CTEV: No data returned for month 2024-12 [2025-10-15T18:14:44.302629] [FATAL] [REMOTE ] CTEV: API call failed - aborting fetch to avoid wasting further API calls [2025-10-15T18:14:44.302715] [FATAL] [MAIN ] CTEV: Failed to fetch primary data. [2025-10-15T18:14:44.302778] [WARN ] [MAIN ] CTEV: Deleting existing primary and derivative data due to fetch failure. [2025-10-15T18:14:44.302845] [INFO ] [LOCAL ] CTEV: Starting deletion of primary data. [2025-10-15T18:14:44.302903] [DEBUG] [LOCAL ] CTEV: No primary data file found to delete. [2025-10-15T18:14:44.302938] [INFO ] [LOCAL ] CTEV: Starting deletion of derivative data. [2025-10-15T18:14:44.302976] [DEBUG] [LOCAL ] CTEV: No derivative data file found to delete. [2025-10-15T18:14:44.303018] [INFO ] [MAIN ] Update Progress: 543/2369 symbols completed. CTEV took 2.1s. Estimated remaining: 4h 11m 5s. Rate: 7.3 symbols/min [2025-10-15T18:14:44.477442] [INFO ] [MAIN ] CTO: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:14:44.505774] [DEBUG] [LOCAL ] CTO: Loaded 27742 existing records from primary storage. [2025-10-15T18:14:44.506029] [INFO ] [MAIN ] CTO: Loaded 27742 existing records. [2025-10-15T18:14:44.677925] [WARN ] [MAIN ] CTO: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:14:44.678129] [INFO ] [MAIN ] CTO: Wiping existing primary data before full refresh. [2025-10-15T18:14:44.678178] [INFO ] [LOCAL ] CTO: Starting deletion of primary data. [2025-10-15T18:14:44.678516] [DEBUG] [LOCAL ] CTO: Deleted primary data file. [2025-10-15T18:14:44.678570] [INFO ] [MAIN ] CTO: Starting full primary refresh. [2025-10-15T18:14:44.919111] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-02. [2025-10-15T18:14:45.047534] [INFO ] [REMOTE ] CTO: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:14:45.535914] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-15T18:14:45.713999] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-06. [2025-10-15T18:14:46.513994] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-06. [2025-10-15T18:14:46.524298] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-15T18:14:47.314047] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-03. [2025-10-15T18:14:47.858466] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-10-15T18:14:48.052372] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-15T18:14:48.114010] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-07. [2025-10-15T18:14:48.914002] [INFO ] [REMOTE ] CTO: Fetching primary data for 2024-12. [2025-10-15T18:14:49.545934] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-15T18:14:49.713984] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-08. [2025-10-15T18:14:50.260904] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-15T18:14:50.513998] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-04. [2025-10-15T18:14:51.050144] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-10-15T18:14:51.322703] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-05. [2025-10-15T18:14:51.339916] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-15T18:14:51.911099] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-15T18:14:52.113973] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-07. [2025-10-15T18:14:52.736388] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-15T18:14:52.914043] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-06. [2025-10-15T18:14:53.364058] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-15T18:14:53.714010] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-07. [2025-10-15T18:14:54.362476] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-15T18:14:54.513996] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-08. [2025-10-15T18:14:54.986058] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-10-15T18:14:55.313988] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-09. [2025-10-15T18:14:56.114005] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-01. [2025-10-15T18:14:56.874878] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-15T18:14:56.913997] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-10. [2025-10-15T18:14:57.074114] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-15T18:14:57.714000] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-09. [2025-10-15T18:14:58.265708] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-15T18:14:58.271963] [INFO ] [REMOTE ] CSTM: Full fetch complete (69466 records). [2025-10-15T18:14:58.272124] [DEBUG] [VALIDATOR ] CSTM: Validating primary data. [2025-10-15T18:14:58.403112] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-10-15T18:14:58.523563] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-10. [2025-10-15T18:14:58.690041] [DEBUG] [VALIDATOR ] CSTM: All expected trading days are present. [2025-10-15T18:14:58.690125] [DEBUG] [VALIDATOR ] CSTM: Primary data validation passed. [2025-10-15T18:14:58.690990] [INFO ] [MAIN ] CSTM: Fetched primary data is valid. [2025-10-15T18:14:58.691051] [DEBUG] [LOCAL ] CSTM: Saving primary data. [2025-10-15T18:14:58.692391] [DEBUG] [LOCAL ] CSTM: Trimmed 69466 records to 47572 (keeping 200 days of data) [2025-10-15T18:14:58.958571] [DEBUG] [LOCAL ] CSTM: Primary data saved (47572 records). [2025-10-15T18:14:58.958725] [INFO ] [MAIN ] CSTM: Full history saved. [2025-10-15T18:14:58.958812] [INFO ] [MAIN ] Update Progress: 544/2369 symbols completed. CSTM took 48.2s. Estimated remaining: 4h 11m 18s. Rate: 7.3 symbols/min [2025-10-15T18:14:59.123332] [INFO ] [MAIN ] CTOS: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:14:59.157664] [DEBUG] [LOCAL ] CTOS: Loaded 37068 existing records from primary storage. [2025-10-15T18:14:59.157958] [INFO ] [MAIN ] CTOS: Loaded 37068 existing records. [2025-10-15T18:14:59.286143] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-15T18:14:59.323711] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-02. [2025-10-15T18:14:59.338745] [INFO ] [REMOTE ] CTDD: Full fetch complete (8154 records). [2025-10-15T18:14:59.343810] [DEBUG] [VALIDATOR ] CTDD: Validating primary data. [2025-10-15T18:14:59.343639] [WARN ] [MAIN ] CTOS: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:14:59.387731] [INFO ] [MAIN ] CTOS: Wiping existing primary data before full refresh. [2025-10-15T18:14:59.387913] [INFO ] [LOCAL ] CTOS: Starting deletion of primary data. [2025-10-15T18:14:59.421864] [DEBUG] [LOCAL ] CTOS: Deleted primary data file. [2025-10-15T18:14:59.444090] [INFO ] [MAIN ] CTOS: Starting full primary refresh. [2025-10-15T18:15:00.032385] [DEBUG] [VALIDATOR ] CTDD: All expected trading days are present. [2025-10-15T18:15:00.037718] [DEBUG] [VALIDATOR ] CTDD: Primary data validation passed. [2025-10-15T18:15:00.037985] [INFO ] [MAIN ] CTDD: Fetched primary data is valid. [2025-10-15T18:15:00.038055] [DEBUG] [LOCAL ] CTDD: Saving primary data. [2025-10-15T18:15:00.090630] [DEBUG] [LOCAL ] CTDD: Trimmed 8154 records to 5471 (keeping 200 days of data) [2025-10-15T18:15:00.110161] [INFO ] [REMOTE ] CTOS: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:15:00.126562] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2024-12. [2025-10-15T18:15:00.148278] [DEBUG] [LOCAL ] CTDD: Primary data saved (5471 records). [2025-10-15T18:15:00.148405] [INFO ] [MAIN ] CTDD: Full history saved. [2025-10-15T18:15:00.148475] [INFO ] [MAIN ] Update Progress: 545/2369 symbols completed. CTDD took 25.2s. Estimated remaining: 4h 10m 46s. Rate: 7.3 symbols/min [2025-10-15T18:15:00.328590] [INFO ] [MAIN ] CTRA: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:15:00.356951] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-15T18:15:00.401092] [DEBUG] [LOCAL ] CTRA: Loaded 53647 existing records from primary storage. [2025-10-15T18:15:00.401434] [INFO ] [MAIN ] CTRA: Loaded 53647 existing records. [2025-10-15T18:15:00.582137] [WARN ] [MAIN ] CTRA: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:15:00.582378] [INFO ] [MAIN ] CTRA: Wiping existing primary data before full refresh. [2025-10-15T18:15:00.582435] [INFO ] [LOCAL ] CTRA: Starting deletion of primary data. [2025-10-15T18:15:00.582905] [DEBUG] [LOCAL ] CTRA: Deleted primary data file. [2025-10-15T18:15:00.582960] [INFO ] [MAIN ] CTRA: Starting full primary refresh. [2025-10-15T18:15:00.927349] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-03. [2025-10-15T18:15:00.971105] [INFO ] [REMOTE ] CTRA: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:15:01.713964] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2024-12. [2025-10-15T18:15:01.805525] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-15T18:15:02.519134] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-08. [2025-10-15T18:15:02.532053] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-15T18:15:03.209693] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-15T18:15:03.314029] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-04. [2025-10-15T18:15:03.831251] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2024-12 (2.12 seconds). [2025-10-15T18:15:04.113993] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-01. [2025-10-15T18:15:04.602138] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-15T18:15:04.913997] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-01. [2025-10-15T18:15:05.513528] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-15T18:15:05.714064] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-09. [2025-10-15T18:15:06.302007] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-15T18:15:06.513985] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-10. [2025-10-15T18:15:06.793058] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-15T18:15:07.293748] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-15T18:15:07.295040] [INFO ] [REMOTE ] CTBB: Full fetch complete (10361 records). [2025-10-15T18:15:07.295123] [DEBUG] [VALIDATOR ] CTBB: Validating primary data. [2025-10-15T18:15:07.319110] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-02. [2025-10-15T18:15:07.674683] [DEBUG] [VALIDATOR ] CTBB: All expected trading days are present. [2025-10-15T18:15:07.674772] [DEBUG] [VALIDATOR ] CTBB: Primary data validation passed. [2025-10-15T18:15:07.675043] [INFO ] [MAIN ] CTBB: Fetched primary data is valid. [2025-10-15T18:15:07.675095] [DEBUG] [LOCAL ] CTBB: Saving primary data. [2025-10-15T18:15:07.675571] [DEBUG] [LOCAL ] CTBB: Trimmed 10361 records to 6784 (keeping 200 days of data) [2025-10-15T18:15:07.717128] [DEBUG] [LOCAL ] CTBB: Primary data saved (6784 records). [2025-10-15T18:15:07.717257] [INFO ] [MAIN ] CTBB: Full history saved. [2025-10-15T18:15:07.717335] [INFO ] [MAIN ] Update Progress: 546/2369 symbols completed. CTBB took 41.0s. Estimated remaining: 4h 10m 35s. Rate: 7.3 symbols/min [2025-10-15T18:15:07.892693] [INFO ] [MAIN ] CTRE: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:15:07.940715] [DEBUG] [LOCAL ] CTRE: Loaded 49413 existing records from primary storage. [2025-10-15T18:15:07.941080] [INFO ] [MAIN ] CTRE: Loaded 49413 existing records. [2025-10-15T18:15:08.119311] [WARN ] [MAIN ] CTRE: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:15:08.115789] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-05. [2025-10-15T18:15:08.119589] [INFO ] [MAIN ] CTRE: Wiping existing primary data before full refresh. [2025-10-15T18:15:08.119693] [INFO ] [LOCAL ] CTRE: Starting deletion of primary data. [2025-10-15T18:15:08.121236] [DEBUG] [LOCAL ] CTRE: Deleted primary data file. [2025-10-15T18:15:08.121292] [INFO ] [MAIN ] CTRE: Starting full primary refresh. [2025-10-15T18:15:08.496812] [INFO ] [REMOTE ] CTRE: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:15:08.672717] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-15T18:15:08.913995] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-02. [2025-10-15T18:15:09.373565] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-15T18:15:09.714011] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-03. [2025-10-15T18:15:10.513976] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2024-12. [2025-10-15T18:15:10.604594] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-15T18:15:10.715918] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-15T18:15:11.313996] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-03. [2025-10-15T18:15:12.114000] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-04. [2025-10-15T18:15:12.526330] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-10-15T18:15:12.913975] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-01. [2025-10-15T18:15:13.284402] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-15T18:15:13.321307] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-15T18:15:13.714028] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-04. [2025-10-15T18:15:14.514021] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-05. [2025-10-15T18:15:14.562757] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-15T18:15:15.193276] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-15T18:15:15.314009] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-06. [2025-10-15T18:15:15.715333] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-15T18:15:16.113995] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-02. [2025-10-15T18:15:16.913967] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-06. [2025-10-15T18:15:16.956476] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-15T18:15:17.664406] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-15T18:15:17.713975] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-03. [2025-10-15T18:15:18.020327] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-15T18:15:18.514263] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-05. [2025-10-15T18:15:19.124211] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-15T18:15:19.314091] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-07. [2025-10-15T18:15:20.114041] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-07. [2025-10-15T18:15:20.304597] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-15T18:15:20.786606] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-15T18:15:20.913961] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-08. [2025-10-15T18:15:21.074220] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-15T18:15:21.714016] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-04. [2025-10-15T18:15:21.926138] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-15T18:15:22.514010] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-09. [2025-10-15T18:15:23.314024] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-06. [2025-10-15T18:15:23.460860] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-15T18:15:23.663223] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-15T18:15:24.114032] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-08. [2025-10-15T18:15:24.914064] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-10. [2025-10-15T18:15:25.048896] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-15T18:15:25.247997] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-15T18:15:25.714037] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-09. [2025-10-15T18:15:25.951596] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-15T18:15:25.956855] [INFO ] [REMOTE ] CTOS: Full fetch complete (53892 records). [2025-10-15T18:15:25.957006] [DEBUG] [VALIDATOR ] CTOS: Validating primary data. [2025-10-15T18:15:26.407917] [DEBUG] [VALIDATOR ] CTOS: All expected trading days are present. [2025-10-15T18:15:26.408013] [DEBUG] [VALIDATOR ] CTOS: Primary data validation passed. [2025-10-15T18:15:26.408847] [INFO ] [MAIN ] CTOS: Fetched primary data is valid. [2025-10-15T18:15:26.408919] [DEBUG] [LOCAL ] CTOS: Saving primary data. [2025-10-15T18:15:26.410197] [DEBUG] [LOCAL ] CTOS: Trimmed 53892 records to 37188 (keeping 200 days of data) [2025-10-15T18:15:26.516112] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-05. [2025-10-15T18:15:26.624027] [DEBUG] [LOCAL ] CTOS: Primary data saved (37188 records). [2025-10-15T18:15:26.624208] [INFO ] [MAIN ] CTOS: Full history saved. [2025-10-15T18:15:26.624300] [INFO ] [MAIN ] Update Progress: 547/2369 symbols completed. CTOS took 27.7s. Estimated remaining: 4h 11m 3s. Rate: 7.3 symbols/min [2025-10-15T18:15:26.822937] [INFO ] [MAIN ] CTRI: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:15:26.824814] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-15T18:15:26.865488] [DEBUG] [LOCAL ] CTRI: Loaded 39942 existing records from primary storage. [2025-10-15T18:15:26.865869] [INFO ] [MAIN ] CTRI: Loaded 39942 existing records. [2025-10-15T18:15:27.041041] [WARN ] [MAIN ] CTRI: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:15:27.041279] [INFO ] [MAIN ] CTRI: Wiping existing primary data before full refresh. [2025-10-15T18:15:27.041327] [INFO ] [LOCAL ] CTRI: Starting deletion of primary data. [2025-10-15T18:15:27.041739] [DEBUG] [LOCAL ] CTRI: Deleted primary data file. [2025-10-15T18:15:27.041797] [INFO ] [MAIN ] CTRI: Starting full primary refresh. [2025-10-15T18:15:27.319095] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-10. [2025-10-15T18:15:27.437018] [INFO ] [REMOTE ] CTRI: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:15:28.113977] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-07. [2025-10-15T18:15:28.235401] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-15T18:15:28.566360] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-15T18:15:28.570499] [INFO ] [REMOTE ] CTO: Full fetch complete (41673 records). [2025-10-15T18:15:28.570606] [DEBUG] [VALIDATOR ] CTO: Validating primary data. [2025-10-15T18:15:28.941742] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2024-12. [2025-10-15T18:15:28.958475] [DEBUG] [VALIDATOR ] CTO: All expected trading days are present. [2025-10-15T18:15:28.958585] [DEBUG] [VALIDATOR ] CTO: Primary data validation passed. [2025-10-15T18:15:28.959270] [INFO ] [MAIN ] CTO: Fetched primary data is valid. [2025-10-15T18:15:28.959343] [DEBUG] [LOCAL ] CTO: Saving primary data. [2025-10-15T18:15:28.960437] [DEBUG] [LOCAL ] CTO: Trimmed 41673 records to 27682 (keeping 200 days of data) [2025-10-15T18:15:29.124690] [DEBUG] [LOCAL ] CTO: Primary data saved (27682 records). [2025-10-15T18:15:29.124835] [INFO ] [MAIN ] CTO: Full history saved. [2025-10-15T18:15:29.124914] [INFO ] [MAIN ] Update Progress: 548/2369 symbols completed. CTO took 44.8s. Estimated remaining: 4h 10m 35s. Rate: 7.3 symbols/min [2025-10-15T18:15:29.292367] [INFO ] [MAIN ] CTS: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:15:29.312566] [DEBUG] [LOCAL ] CTS: Loaded 19598 existing records from primary storage. [2025-10-15T18:15:29.312840] [INFO ] [MAIN ] CTS: Loaded 19598 existing records. [2025-10-15T18:15:29.489304] [WARN ] [MAIN ] CTS: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:15:29.489499] [INFO ] [MAIN ] CTS: Wiping existing primary data before full refresh. [2025-10-15T18:15:29.489545] [INFO ] [LOCAL ] CTS: Starting deletion of primary data. [2025-10-15T18:15:29.489802] [DEBUG] [LOCAL ] CTS: Deleted primary data file. [2025-10-15T18:15:29.489860] [INFO ] [MAIN ] CTS: Starting full primary refresh. [2025-10-15T18:15:29.743308] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-06. [2025-10-15T18:15:29.849990] [INFO ] [REMOTE ] CTS: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:15:29.882078] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-15T18:15:30.117783] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-15T18:15:30.513995] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-01. [2025-10-15T18:15:31.082608] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-15T18:15:31.314060] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-08. [2025-10-15T18:15:31.450699] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-15T18:15:32.113998] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-02. [2025-10-15T18:15:32.913982] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-07. [2025-10-15T18:15:33.073945] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-15T18:15:33.113367] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-15T18:15:33.713996] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-09. [2025-10-15T18:15:34.513970] [INFO ] [REMOTE ] CTS: Fetching primary data for 2024-12. [2025-10-15T18:15:34.674348] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-15T18:15:35.285417] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-15T18:15:35.313968] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-10. [2025-10-15T18:15:35.500257] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-10-15T18:15:36.114028] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-01. [2025-10-15T18:15:36.913995] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-03. [2025-10-15T18:15:37.045089] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-15T18:15:37.262238] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-10 (1.95 seconds). [2025-10-15T18:15:37.268722] [INFO ] [REMOTE ] CTRA: Full fetch complete (77821 records). [2025-10-15T18:15:37.268862] [DEBUG] [VALIDATOR ] CTRA: Validating primary data. [2025-10-15T18:15:37.656513] [DEBUG] [VALIDATOR ] CTRA: All expected trading days are present. [2025-10-15T18:15:37.656606] [DEBUG] [VALIDATOR ] CTRA: Primary data validation passed. [2025-10-15T18:15:37.657508] [INFO ] [MAIN ] CTRA: Fetched primary data is valid. [2025-10-15T18:15:37.657571] [DEBUG] [LOCAL ] CTRA: Saving primary data. [2025-10-15T18:15:37.658997] [DEBUG] [LOCAL ] CTRA: Trimmed 77821 records to 53648 (keeping 200 days of data) [2025-10-15T18:15:37.715344] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-02. [2025-10-15T18:15:37.984376] [DEBUG] [LOCAL ] CTRA: Primary data saved (53648 records). [2025-10-15T18:15:37.984504] [INFO ] [MAIN ] CTRA: Full history saved. [2025-10-15T18:15:37.984579] [INFO ] [MAIN ] Update Progress: 549/2369 symbols completed. CTRA took 37.8s. Estimated remaining: 4h 10m 29s. Rate: 7.3 symbols/min [2025-10-15T18:15:38.163071] [INFO ] [MAIN ] CTVA: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:15:38.209264] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-15T18:15:38.231623] [DEBUG] [LOCAL ] CTVA: Loaded 53288 existing records from primary storage. [2025-10-15T18:15:38.231957] [INFO ] [MAIN ] CTVA: Loaded 53288 existing records. [2025-10-15T18:15:38.414261] [WARN ] [MAIN ] CTVA: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:15:38.414511] [INFO ] [MAIN ] CTVA: Wiping existing primary data before full refresh. [2025-10-15T18:15:38.414560] [INFO ] [LOCAL ] CTVA: Starting deletion of primary data. [2025-10-15T18:15:38.415036] [DEBUG] [LOCAL ] CTVA: Deleted primary data file. [2025-10-15T18:15:38.415092] [INFO ] [MAIN ] CTVA: Starting full primary refresh. [2025-10-15T18:15:38.517583] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-04. [2025-10-15T18:15:38.735599] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-15T18:15:38.796712] [INFO ] [REMOTE ] CTVA: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:15:39.313968] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2024-12. [2025-10-15T18:15:39.519746] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-15T18:15:40.114007] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-08. [2025-10-15T18:15:40.728833] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-15T18:15:40.913976] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-01. [2025-10-15T18:15:41.714002] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-05. [2025-10-15T18:15:41.867577] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-15T18:15:42.446210] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-15T18:15:42.514022] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-02. [2025-10-15T18:15:42.715058] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-15T18:15:43.314028] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-09. [2025-10-15T18:15:43.779105] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-15T18:15:44.114003] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-06. [2025-10-15T18:15:44.913997] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-03. [2025-10-15T18:15:45.023014] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-15T18:15:45.541043] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-15T18:15:45.713992] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-10. [2025-10-15T18:15:46.513961] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-03. [2025-10-15T18:15:46.579906] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-15T18:15:47.313963] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-07. [2025-10-15T18:15:47.516749] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-15T18:15:47.523226] [INFO ] [REMOTE ] CTRE: Full fetch complete (71374 records). [2025-10-15T18:15:47.523366] [DEBUG] [VALIDATOR ] CTRE: Validating primary data. [2025-10-15T18:15:47.717785] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-15T18:15:47.938388] [DEBUG] [VALIDATOR ] CTRE: All expected trading days are present. [2025-10-15T18:15:47.938470] [DEBUG] [VALIDATOR ] CTRE: Primary data validation passed. [2025-10-15T18:15:47.939450] [INFO ] [MAIN ] CTRE: Fetched primary data is valid. [2025-10-15T18:15:47.939517] [DEBUG] [LOCAL ] CTRE: Saving primary data. [2025-10-15T18:15:47.940948] [DEBUG] [LOCAL ] CTRE: Trimmed 71374 records to 49482 (keeping 200 days of data) [2025-10-15T18:15:48.114878] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-04. [2025-10-15T18:15:48.244911] [DEBUG] [LOCAL ] CTRE: Primary data saved (49482 records). [2025-10-15T18:15:48.245042] [INFO ] [MAIN ] CTRE: Full history saved. [2025-10-15T18:15:48.245409] [INFO ] [MAIN ] Update Progress: 550/2369 symbols completed. CTRE took 40.5s. Estimated remaining: 4h 10m 27s. Rate: 7.3 symbols/min [2025-10-15T18:15:48.420984] [INFO ] [MAIN ] CUBB: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:15:48.421153] [DEBUG] [LOCAL ] CUBB: No existing data file found in primary storage. [2025-10-15T18:15:48.421202] [WARN ] [MAIN ] CUBB: No existing data found, performing full refresh instead. [2025-10-15T18:15:48.421332] [INFO ] [MAIN ] CUBB: Wiping existing primary data before full refresh. [2025-10-15T18:15:48.421396] [INFO ] [LOCAL ] CUBB: Starting deletion of primary data. [2025-10-15T18:15:48.421447] [DEBUG] [LOCAL ] CUBB: No primary data file found to delete. [2025-10-15T18:15:48.421479] [INFO ] [MAIN ] CUBB: Starting full primary refresh. [2025-10-15T18:15:48.791325] [INFO ] [REMOTE ] CUBB: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:15:48.812618] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-15T18:15:48.913967] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2024-12. [2025-10-15T18:15:49.341543] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2024-12 (0.43 seconds). [2025-10-15T18:15:49.642917] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-15T18:15:49.714000] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-05. [2025-10-15T18:15:50.514061] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-01. [2025-10-15T18:15:50.770458] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-01 (0.26 seconds). [2025-10-15T18:15:51.313990] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-02. [2025-10-15T18:15:51.564327] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-15T18:15:51.629608] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-02 (0.32 seconds). [2025-10-15T18:15:52.114001] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-06. [2025-10-15T18:15:52.914048] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-03. [2025-10-15T18:15:53.254781] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-03 (0.34 seconds). [2025-10-15T18:15:53.714059] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-08. [2025-10-15T18:15:53.778069] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-15T18:15:54.513990] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-04. [2025-10-15T18:15:55.313991] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-07. [2025-10-15T18:15:55.363624] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-15T18:15:55.774513] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-15T18:15:56.114032] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-04. [2025-10-15T18:15:56.394808] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-04 (0.28 seconds). [2025-10-15T18:15:56.913970] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-09. [2025-10-15T18:15:57.092338] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-15T18:15:57.713996] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-05. [2025-10-15T18:15:58.033404] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-05 (0.32 seconds). [2025-10-15T18:15:58.250684] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-15T18:15:58.513964] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-06. [2025-10-15T18:15:58.762521] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-06 (0.25 seconds). [2025-10-15T18:15:59.314008] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-08. [2025-10-15T18:16:00.114004] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-05. [2025-10-15T18:16:00.914010] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-07. [2025-10-15T18:16:01.412785] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-10-15T18:16:01.459975] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-15T18:16:01.476665] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-15T18:16:01.713982] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-08. [2025-10-15T18:16:02.036680] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-08 (0.32 seconds). [2025-10-15T18:16:02.514064] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-06. [2025-10-15T18:16:03.314060] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-09. [2025-10-15T18:16:03.444933] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-15T18:16:04.114004] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-09. [2025-10-15T18:16:04.452863] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-09 (0.34 seconds). [2025-10-15T18:16:04.913993] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-10. [2025-10-15T18:16:05.379113] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-09 (2.07 seconds). [2025-10-15T18:16:05.714015] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-07. [2025-10-15T18:16:06.514004] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-10. [2025-10-15T18:16:06.564481] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-15T18:16:06.569971] [INFO ] [REMOTE ] CTRI: Full fetch complete (53092 records). [2025-10-15T18:16:06.570102] [DEBUG] [VALIDATOR ] CTRI: Validating primary data. [2025-10-15T18:16:06.570810] [FATAL] [VALIDATOR ] CTRI: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T18:16:06.570893] [FATAL] [MAIN ] CTRI: Fetched primary data is invalid. Refusing to save it. [2025-10-15T18:16:06.570934] [WARN ] [MAIN ] CTRI: Deleting existing primary and derivative data due to validation failure. [2025-10-15T18:16:06.570996] [INFO ] [LOCAL ] CTRI: Starting deletion of primary data. [2025-10-15T18:16:06.571059] [DEBUG] [LOCAL ] CTRI: No primary data file found to delete. [2025-10-15T18:16:06.571093] [INFO ] [LOCAL ] CTRI: Starting deletion of derivative data. [2025-10-15T18:16:06.571246] [DEBUG] [LOCAL ] CTRI: Deleted derivative data file. [2025-10-15T18:16:06.571334] [INFO ] [MAIN ] Update Progress: 551/2369 symbols completed. CTRI took 39.9s. Estimated remaining: 4h 10m 52s. Rate: 7.2 symbols/min [2025-10-15T18:16:06.739055] [INFO ] [MAIN ] CUBE: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:16:06.760081] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-15T18:16:06.809460] [DEBUG] [LOCAL ] CUBE: Loaded 50859 existing records from primary storage. [2025-10-15T18:16:06.809839] [INFO ] [MAIN ] CUBE: Loaded 50859 existing records. [2025-10-15T18:16:06.932020] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-10 (0.42 seconds). [2025-10-15T18:16:06.959798] [INFO ] [REMOTE ] CUBB: Full fetch complete (950 records). [2025-10-15T18:16:06.962916] [DEBUG] [VALIDATOR ] CUBB: Validating primary data. [2025-10-15T18:16:07.071067] [WARN ] [MAIN ] CUBE: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:16:07.090086] [INFO ] [MAIN ] CUBE: Wiping existing primary data before full refresh. [2025-10-15T18:16:07.092389] [INFO ] [LOCAL ] CUBE: Starting deletion of primary data. [2025-10-15T18:16:07.098236] [DEBUG] [LOCAL ] CUBE: Deleted primary data file. [2025-10-15T18:16:07.108509] [INFO ] [MAIN ] CUBE: Starting full primary refresh. [2025-10-15T18:16:07.273469] [WARN ] [VALIDATOR ] CUBB: Validation failed - insufficient historical data. Have 181 unique days, need 200 days [2025-10-15T18:16:07.274071] [FATAL] [MAIN ] CUBB: Fetched primary data is invalid. Refusing to save it. [2025-10-15T18:16:07.284741] [WARN ] [MAIN ] CUBB: Deleting existing primary and derivative data due to validation failure. [2025-10-15T18:16:07.295128] [INFO ] [LOCAL ] CUBB: Starting deletion of primary data. [2025-10-15T18:16:07.323034] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-08. [2025-10-15T18:16:07.322976] [DEBUG] [LOCAL ] CUBB: No primary data file found to delete. [2025-10-15T18:16:07.350716] [INFO ] [LOCAL ] CUBB: Starting deletion of derivative data. [2025-10-15T18:16:07.358245] [DEBUG] [LOCAL ] CUBB: No derivative data file found to delete. [2025-10-15T18:16:07.391462] [INFO ] [MAIN ] Update Progress: 552/2369 symbols completed. CUBB took 19.1s. Estimated remaining: 4h 10m 19s. Rate: 7.3 symbols/min [2025-10-15T18:16:07.690381] [INFO ] [REMOTE ] CUBE: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:16:07.707319] [INFO ] [MAIN ] CUBI: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:16:07.733702] [DEBUG] [LOCAL ] CUBI: Loaded 27208 existing records from primary storage. [2025-10-15T18:16:07.733974] [INFO ] [MAIN ] CUBI: Loaded 27208 existing records. [2025-10-15T18:16:07.911052] [WARN ] [MAIN ] CUBI: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:16:07.911379] [INFO ] [MAIN ] CUBI: Wiping existing primary data before full refresh. [2025-10-15T18:16:07.911445] [INFO ] [LOCAL ] CUBI: Starting deletion of primary data. [2025-10-15T18:16:07.911827] [DEBUG] [LOCAL ] CUBI: Deleted primary data file. [2025-10-15T18:16:07.911900] [INFO ] [MAIN ] CUBI: Starting full primary refresh. [2025-10-15T18:16:08.119749] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-10. [2025-10-15T18:16:08.304084] [INFO ] [REMOTE ] CUBI: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:16:08.454516] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-15T18:16:08.914055] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2024-12. [2025-10-15T18:16:09.714011] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2024-12. [2025-10-15T18:16:10.132316] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-10 (2.01 seconds). [2025-10-15T18:16:10.139626] [INFO ] [REMOTE ] CTVA: Full fetch complete (77189 records). [2025-10-15T18:16:10.139854] [DEBUG] [VALIDATOR ] CTVA: Validating primary data. [2025-10-15T18:16:10.414750] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-15T18:16:10.519159] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-09. [2025-10-15T18:16:10.597752] [DEBUG] [VALIDATOR ] CTVA: All expected trading days are present. [2025-10-15T18:16:10.597849] [DEBUG] [VALIDATOR ] CTVA: Primary data validation passed. [2025-10-15T18:16:10.599080] [INFO ] [MAIN ] CTVA: Fetched primary data is valid. [2025-10-15T18:16:10.599194] [DEBUG] [LOCAL ] CTVA: Saving primary data. [2025-10-15T18:16:10.601107] [DEBUG] [LOCAL ] CTVA: Trimmed 77189 records to 53298 (keeping 200 days of data) [2025-10-15T18:16:10.925199] [DEBUG] [LOCAL ] CTVA: Primary data saved (53298 records). [2025-10-15T18:16:10.925333] [INFO ] [MAIN ] CTVA: Full history saved. [2025-10-15T18:16:10.925412] [INFO ] [MAIN ] Update Progress: 553/2369 symbols completed. CTVA took 32.9s. Estimated remaining: 4h 9m 56s. Rate: 7.3 symbols/min [2025-10-15T18:16:11.113767] [INFO ] [MAIN ] CUK: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:16:11.173697] [DEBUG] [LOCAL ] CUK: Loaded 51044 existing records from primary storage. [2025-10-15T18:16:11.174240] [INFO ] [MAIN ] CUK: Loaded 51044 existing records. [2025-10-15T18:16:11.319145] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-01. [2025-10-15T18:16:11.410859] [WARN ] [MAIN ] CUK: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:16:11.412082] [INFO ] [MAIN ] CUK: Wiping existing primary data before full refresh. [2025-10-15T18:16:11.412346] [INFO ] [LOCAL ] CUK: Starting deletion of primary data. [2025-10-15T18:16:11.412954] [DEBUG] [LOCAL ] CUK: Deleted primary data file. [2025-10-15T18:16:11.413030] [INFO ] [MAIN ] CUK: Starting full primary refresh. [2025-10-15T18:16:11.708574] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-15T18:16:11.723847] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-10-15T18:16:12.034573] [INFO ] [REMOTE ] CUK: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:16:12.114086] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-10. [2025-10-15T18:16:12.375626] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-15T18:16:12.914072] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-01. [2025-10-15T18:16:13.240617] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-15T18:16:13.243401] [INFO ] [REMOTE ] CTS: Full fetch complete (26993 records). [2025-10-15T18:16:13.243486] [DEBUG] [VALIDATOR ] CTS: Validating primary data. [2025-10-15T18:16:13.603704] [DEBUG] [VALIDATOR ] CTS: All expected trading days are present. [2025-10-15T18:16:13.603786] [DEBUG] [VALIDATOR ] CTS: Primary data validation passed. [2025-10-15T18:16:13.604292] [INFO ] [MAIN ] CTS: Fetched primary data is valid. [2025-10-15T18:16:13.604330] [DEBUG] [LOCAL ] CTS: Saving primary data. [2025-10-15T18:16:13.605045] [DEBUG] [LOCAL ] CTS: Trimmed 26993 records to 19649 (keeping 200 days of data) [2025-10-15T18:16:13.713983] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-02. [2025-10-15T18:16:13.729740] [DEBUG] [LOCAL ] CTS: Primary data saved (19649 records). [2025-10-15T18:16:13.729847] [INFO ] [MAIN ] CTS: Full history saved. [2025-10-15T18:16:13.729923] [INFO ] [MAIN ] Update Progress: 554/2369 symbols completed. CTS took 44.6s. Estimated remaining: 4h 9m 30s. Rate: 7.3 symbols/min [2025-10-15T18:16:13.922534] [INFO ] [MAIN ] CULP: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:16:13.922751] [DEBUG] [LOCAL ] CULP: No existing data file found in primary storage. [2025-10-15T18:16:13.922795] [WARN ] [MAIN ] CULP: No existing data found, performing full refresh instead. [2025-10-15T18:16:13.922913] [INFO ] [MAIN ] CULP: Wiping existing primary data before full refresh. [2025-10-15T18:16:13.922974] [INFO ] [LOCAL ] CULP: Starting deletion of primary data. [2025-10-15T18:16:13.923017] [DEBUG] [LOCAL ] CULP: No primary data file found to delete. [2025-10-15T18:16:13.923048] [INFO ] [MAIN ] CULP: Starting full primary refresh. [2025-10-15T18:16:14.283588] [INFO ] [REMOTE ] CULP: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:16:14.333265] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-15T18:16:14.513989] [INFO ] [REMOTE ] CUK: Fetching primary data for 2024-12. [2025-10-15T18:16:14.758708] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-15T18:16:15.314001] [INFO ] [REMOTE ] CULP: Fetching primary data for 2024-12. [2025-10-15T18:16:16.009881] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-10-15T18:16:16.113962] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-01. [2025-10-15T18:16:16.471743] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-10-15T18:16:16.582095] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-10-15T18:16:16.913986] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-02. [2025-10-15T18:16:17.316532] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-10-15T18:16:17.713996] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-03. [2025-10-15T18:16:18.337846] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-15T18:16:18.514075] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-01. [2025-10-15T18:16:19.314028] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-03. [2025-10-15T18:16:19.990338] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-15T18:16:20.114002] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-02. [2025-10-15T18:16:20.594748] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-15T18:16:20.914013] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-04. [2025-10-15T18:16:21.581865] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-10-15T18:16:21.713997] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-02. [2025-10-15T18:16:21.889834] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-15T18:16:22.513972] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-03. [2025-10-15T18:16:23.217172] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-15T18:16:23.314028] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-03. [2025-10-15T18:16:23.914225] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-15T18:16:24.114019] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-04. [2025-10-15T18:16:24.890866] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-15T18:16:24.913953] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-04. [2025-10-15T18:16:25.117823] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-15T18:16:25.713990] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-05. [2025-10-15T18:16:26.513975] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-05. [2025-10-15T18:16:26.744244] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-15T18:16:26.938767] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-10-15T18:16:26.988286] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-15T18:16:27.314055] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-06. [2025-10-15T18:16:28.114018] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-04. [2025-10-15T18:16:28.194505] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-15T18:16:28.913992] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-05. [2025-10-15T18:16:29.714022] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-06. [2025-10-15T18:16:29.870254] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-15T18:16:30.159465] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-15T18:16:30.514024] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-05. [2025-10-15T18:16:30.637543] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-15T18:16:31.314028] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-07. [2025-10-15T18:16:31.910324] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-15T18:16:32.114003] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-07. [2025-10-15T18:16:32.349019] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-15T18:16:32.913991] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-08. [2025-10-15T18:16:33.016930] [DEBUG] [REMOTE ] CULP: Error fetching primary data for 2025-08: 'API call returned an empty response.' [2025-10-15T18:16:33.017240] [WARN ] [REMOTE ] CULP: No data returned for month 2025-08 [2025-10-15T18:16:33.017328] [FATAL] [REMOTE ] CULP: API call failed - aborting fetch to avoid wasting further API calls [2025-10-15T18:16:33.017446] [FATAL] [MAIN ] CULP: Failed to fetch primary data. [2025-10-15T18:16:33.017525] [WARN ] [MAIN ] CULP: Deleting existing primary and derivative data due to fetch failure. [2025-10-15T18:16:33.017610] [INFO ] [LOCAL ] CULP: Starting deletion of primary data. [2025-10-15T18:16:33.017755] [DEBUG] [LOCAL ] CULP: No primary data file found to delete. [2025-10-15T18:16:33.017809] [INFO ] [LOCAL ] CULP: Starting deletion of derivative data. [2025-10-15T18:16:33.017864] [DEBUG] [LOCAL ] CULP: No derivative data file found to delete. [2025-10-15T18:16:33.017925] [INFO ] [MAIN ] Update Progress: 555/2369 symbols completed. CULP took 19.3s. Estimated remaining: 4h 9m 57s. Rate: 7.3 symbols/min [2025-10-15T18:16:33.187310] [INFO ] [MAIN ] CURB: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:16:33.187470] [DEBUG] [LOCAL ] CURB: No existing data file found in primary storage. [2025-10-15T18:16:33.187507] [WARN ] [MAIN ] CURB: No existing data found, performing full refresh instead. [2025-10-15T18:16:33.187613] [INFO ] [MAIN ] CURB: Wiping existing primary data before full refresh. [2025-10-15T18:16:33.187711] [INFO ] [LOCAL ] CURB: Starting deletion of primary data. [2025-10-15T18:16:33.187758] [DEBUG] [LOCAL ] CURB: No primary data file found to delete. [2025-10-15T18:16:33.187791] [INFO ] [MAIN ] CURB: Starting full primary refresh. [2025-10-15T18:16:33.542159] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-15T18:16:33.569534] [INFO ] [REMOTE ] CURB: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:16:33.714000] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-08. [2025-10-15T18:16:34.513980] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-06. [2025-10-15T18:16:34.824341] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-15T18:16:35.314044] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-09. [2025-10-15T18:16:36.059788] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-15T18:16:36.113957] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-07. [2025-10-15T18:16:36.467998] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-15T18:16:36.914000] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-10. [2025-10-15T18:16:37.713994] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-06. [2025-10-15T18:16:37.897848] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-15T18:16:37.901109] [INFO ] [REMOTE ] CUBI: Full fetch complete (39121 records). [2025-10-15T18:16:37.901210] [DEBUG] [VALIDATOR ] CUBI: Validating primary data. [2025-10-15T18:16:38.289857] [DEBUG] [VALIDATOR ] CUBI: All expected trading days are present. [2025-10-15T18:16:38.289968] [DEBUG] [VALIDATOR ] CUBI: Primary data validation passed. [2025-10-15T18:16:38.290700] [INFO ] [MAIN ] CUBI: Fetched primary data is valid. [2025-10-15T18:16:38.290781] [DEBUG] [LOCAL ] CUBI: Saving primary data. [2025-10-15T18:16:38.323592] [DEBUG] [LOCAL ] CUBI: Trimmed 39121 records to 27163 (keeping 200 days of data) [2025-10-15T18:16:38.326800] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-07 (2.21 seconds). [2025-10-15T18:16:38.497882] [DEBUG] [LOCAL ] CUBI: Primary data saved (27163 records). [2025-10-15T18:16:38.498034] [INFO ] [MAIN ] CUBI: Full history saved. [2025-10-15T18:16:38.498118] [INFO ] [MAIN ] Update Progress: 556/2369 symbols completed. CUBI took 31.1s. Estimated remaining: 4h 9m 40s. Rate: 7.3 symbols/min [2025-10-15T18:16:38.519178] [INFO ] [REMOTE ] CURB: Fetching primary data for 2024-12. [2025-10-15T18:16:38.668068] [INFO ] [MAIN ] CURV: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:16:38.695290] [DEBUG] [LOCAL ] CURV: Loaded 26882 existing records from primary storage. [2025-10-15T18:16:38.695559] [INFO ] [MAIN ] CURV: Loaded 26882 existing records. [2025-10-15T18:16:38.869726] [WARN ] [MAIN ] CURV: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:16:38.869946] [INFO ] [MAIN ] CURV: Wiping existing primary data before full refresh. [2025-10-15T18:16:38.869993] [INFO ] [LOCAL ] CURV: Starting deletion of primary data. [2025-10-15T18:16:38.870235] [DEBUG] [LOCAL ] CURV: Deleted primary data file. [2025-10-15T18:16:38.870291] [INFO ] [MAIN ] CURV: Starting full primary refresh. [2025-10-15T18:16:39.218946] [INFO ] [REMOTE ] CURV: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:16:39.313984] [INFO ] [REMOTE ] CURV: Fetching primary data for 2024-12. [2025-10-15T18:16:39.580913] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-10-15T18:16:39.842280] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-15T18:16:40.114006] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-01. [2025-10-15T18:16:40.640344] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-15T18:16:40.914001] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-07. [2025-10-15T18:16:41.411570] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-15T18:16:41.713996] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-02. [2025-10-15T18:16:42.513963] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-01. [2025-10-15T18:16:42.813039] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-15T18:16:42.902539] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-15T18:16:43.313965] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-08. [2025-10-15T18:16:43.474593] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-15T18:16:44.114003] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-02. [2025-10-15T18:16:44.749355] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-15T18:16:44.792059] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-15T18:16:44.913997] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-03. [2025-10-15T18:16:45.714004] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-03. [2025-10-15T18:16:46.093343] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-15T18:16:46.514066] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-08. [2025-10-15T18:16:46.893803] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-15T18:16:47.314054] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-04. [2025-10-15T18:16:47.977326] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-15T18:16:48.113996] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-09. [2025-10-15T18:16:48.720559] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-15T18:16:48.913995] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-04. [2025-10-15T18:16:49.719678] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-09. [2025-10-15T18:16:49.724757] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-15T18:16:49.774474] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-15T18:16:50.514048] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-05. [2025-10-15T18:16:51.264562] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-15T18:16:51.286512] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-15T18:16:51.313977] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-10. [2025-10-15T18:16:52.114003] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-06. [2025-10-15T18:16:52.913969] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-05. [2025-10-15T18:16:53.206106] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-15T18:16:53.222953] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-10 (1.91 seconds). [2025-10-15T18:16:53.229834] [INFO ] [REMOTE ] CUK: Full fetch complete (74254 records). [2025-10-15T18:16:53.230024] [DEBUG] [VALIDATOR ] CUK: Validating primary data. [2025-10-15T18:16:53.660261] [DEBUG] [VALIDATOR ] CUK: All expected trading days are present. [2025-10-15T18:16:53.660355] [DEBUG] [VALIDATOR ] CUK: Primary data validation passed. [2025-10-15T18:16:53.661463] [INFO ] [MAIN ] CUK: Fetched primary data is valid. [2025-10-15T18:16:53.661533] [DEBUG] [LOCAL ] CUK: Saving primary data. [2025-10-15T18:16:53.663061] [DEBUG] [LOCAL ] CUK: Trimmed 74254 records to 51046 (keeping 200 days of data) [2025-10-15T18:16:53.721794] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-07. [2025-10-15T18:16:53.985743] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-15T18:16:54.010844] [DEBUG] [LOCAL ] CUK: Primary data saved (51046 records). [2025-10-15T18:16:54.010980] [INFO ] [MAIN ] CUK: Full history saved. [2025-10-15T18:16:54.011110] [INFO ] [MAIN ] Update Progress: 557/2369 symbols completed. CUK took 43.1s. Estimated remaining: 4h 9m 55s. Rate: 7.3 symbols/min [2025-10-15T18:16:54.514012] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-10. [2025-10-15T18:16:54.836572] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-15T18:16:55.314012] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-08. [2025-10-15T18:16:55.817708] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-15T18:16:55.824147] [INFO ] [REMOTE ] CUBE: Full fetch complete (73222 records). [2025-10-15T18:16:55.824325] [DEBUG] [VALIDATOR ] CUBE: Validating primary data. [2025-10-15T18:16:56.119164] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-06. [2025-10-15T18:16:56.278589] [DEBUG] [VALIDATOR ] CUBE: All expected trading days are present. [2025-10-15T18:16:56.278717] [DEBUG] [VALIDATOR ] CUBE: Primary data validation passed. [2025-10-15T18:16:56.279667] [INFO ] [MAIN ] CUBE: Fetched primary data is valid. [2025-10-15T18:16:56.279877] [DEBUG] [LOCAL ] CUBE: Saving primary data. [2025-10-15T18:16:56.281439] [DEBUG] [LOCAL ] CUBE: Trimmed 73222 records to 50909 (keeping 200 days of data) [2025-10-15T18:16:56.600045] [DEBUG] [LOCAL ] CUBE: Primary data saved (50909 records). [2025-10-15T18:16:56.614899] [INFO ] [MAIN ] CUBE: Full history saved. [2025-10-15T18:16:56.615252] [INFO ] [MAIN ] Update Progress: 558/2369 symbols completed. CUBE took 50.0s. Estimated remaining: 4h 9m 29s. Rate: 7.3 symbols/min [2025-10-15T18:16:56.617136] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-15T18:16:56.914020] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-09. [2025-10-15T18:16:57.229293] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-15T18:16:57.714008] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-07. [2025-10-15T18:16:58.295368] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-15T18:16:58.514005] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-10. [2025-10-15T18:16:58.805822] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-15T18:16:59.313991] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-08. [2025-10-15T18:16:59.813581] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-15T18:16:59.817899] [INFO ] [REMOTE ] CURV: Full fetch complete (39002 records). [2025-10-15T18:16:59.818035] [DEBUG] [VALIDATOR ] CURV: Validating primary data. [2025-10-15T18:17:00.180767] [DEBUG] [VALIDATOR ] CURV: All expected trading days are present. [2025-10-15T18:17:00.180853] [DEBUG] [VALIDATOR ] CURV: Primary data validation passed. [2025-10-15T18:17:00.181459] [INFO ] [MAIN ] CURV: Fetched primary data is valid. [2025-10-15T18:17:00.181500] [DEBUG] [LOCAL ] CURV: Saving primary data. [2025-10-15T18:17:00.182437] [DEBUG] [LOCAL ] CURV: Trimmed 39002 records to 26989 (keeping 200 days of data) [2025-10-15T18:17:00.335855] [DEBUG] [LOCAL ] CURV: Primary data saved (26989 records). [2025-10-15T18:17:00.335990] [INFO ] [MAIN ] CURV: Full history saved. [2025-10-15T18:17:00.336071] [INFO ] [MAIN ] Update Progress: 559/2369 symbols completed. CURV took 21.8s. Estimated remaining: 4h 9m 6s. Rate: 7.3 symbols/min [2025-10-15T18:17:00.735816] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-15T18:17:00.743443] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-09. [2025-10-15T18:17:02.204254] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-15T18:17:02.211610] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-10. [2025-10-15T18:17:03.536687] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-15T18:17:03.543175] [INFO ] [REMOTE ] CURB: Full fetch complete (47288 records). [2025-10-15T18:17:03.543347] [DEBUG] [VALIDATOR ] CURB: Validating primary data. [2025-10-15T18:17:03.981677] [DEBUG] [VALIDATOR ] CURB: All expected trading days are present. [2025-10-15T18:17:03.981798] [DEBUG] [VALIDATOR ] CURB: Primary data validation passed. [2025-10-15T18:17:03.982596] [INFO ] [MAIN ] CURB: Fetched primary data is valid. [2025-10-15T18:17:03.982718] [DEBUG] [LOCAL ] CURB: Saving primary data. [2025-10-15T18:17:03.984040] [DEBUG] [LOCAL ] CURB: Trimmed 47288 records to 32854 (keeping 200 days of data) [2025-10-15T18:17:04.208985] [DEBUG] [LOCAL ] CURB: Primary data saved (32854 records). [2025-10-15T18:17:04.209144] [INFO ] [MAIN ] CURB: Full history saved. [2025-10-15T18:17:04.209250] [INFO ] [MAIN ] Update Progress: 560/2369 symbols completed. CURB took 31.2s. Estimated remaining: 4h 8m 43s. Rate: 7.3 symbols/min [2025-10-15T18:17:05.070715] [INFO ] [MAIN ] CUZ: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:17:05.168625] [INFO ] [MAIN ] CVE: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:17:05.144294] [INFO ] [MAIN ] CVI: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:17:05.251708] [INFO ] [MAIN ] CVEO: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:17:05.302876] [DEBUG] [LOCAL ] CVEO: Loaded 15396 existing records from primary storage. [2025-10-15T18:17:05.303373] [INFO ] [MAIN ] CVEO: Loaded 15396 existing records. [2025-10-15T18:17:05.459226] [DEBUG] [LOCAL ] CUZ: Loaded 49608 existing records from primary storage. [2025-10-15T18:17:05.458491] [DEBUG] [LOCAL ] CVE: Loaded 53562 existing records from primary storage. [2025-10-15T18:17:05.473395] [INFO ] [MAIN ] CVE: Loaded 53562 existing records. [2025-10-15T18:17:05.473270] [INFO ] [MAIN ] CUZ: Loaded 49608 existing records. [2025-10-15T18:17:05.530005] [DEBUG] [LOCAL ] CVI: Loaded 46631 existing records from primary storage. [2025-10-15T18:17:05.644893] [WARN ] [MAIN ] CVEO: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:17:05.659527] [INFO ] [MAIN ] CVI: Loaded 46631 existing records. [2025-10-15T18:17:05.685843] [INFO ] [MAIN ] CVEO: Wiping existing primary data before full refresh. [2025-10-15T18:17:05.736743] [INFO ] [LOCAL ] CVEO: Starting deletion of primary data. [2025-10-15T18:17:05.793432] [DEBUG] [LOCAL ] CVEO: Deleted primary data file. [2025-10-15T18:17:05.834972] [INFO ] [MAIN ] CVEO: Starting full primary refresh. [2025-10-15T18:17:06.037427] [WARN ] [MAIN ] CVE: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:17:06.126119] [INFO ] [MAIN ] CVE: Wiping existing primary data before full refresh. [2025-10-15T18:17:06.150145] [WARN ] [MAIN ] CUZ: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:17:06.155700] [INFO ] [MAIN ] CUZ: Wiping existing primary data before full refresh. [2025-10-15T18:17:06.134046] [INFO ] [LOCAL ] CVE: Starting deletion of primary data. [2025-10-15T18:17:06.175593] [INFO ] [LOCAL ] CUZ: Starting deletion of primary data. [2025-10-15T18:17:06.241890] [WARN ] [MAIN ] CVI: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:17:06.238560] [DEBUG] [LOCAL ] CVE: Deleted primary data file. [2025-10-15T18:17:06.271137] [INFO ] [MAIN ] CVI: Wiping existing primary data before full refresh. [2025-10-15T18:17:06.238492] [DEBUG] [LOCAL ] CUZ: Deleted primary data file. [2025-10-15T18:17:06.290469] [INFO ] [MAIN ] CUZ: Starting full primary refresh. [2025-10-15T18:17:06.304410] [INFO ] [LOCAL ] CVI: Starting deletion of primary data. [2025-10-15T18:17:06.281503] [INFO ] [MAIN ] CVE: Starting full primary refresh. [2025-10-15T18:17:06.368751] [DEBUG] [LOCAL ] CVI: Deleted primary data file. [2025-10-15T18:17:06.433708] [INFO ] [MAIN ] CVI: Starting full primary refresh. [2025-10-15T18:17:06.961468] [INFO ] [REMOTE ] CVEO: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:17:07.018416] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2024-12. [2025-10-15T18:17:07.456023] [INFO ] [REMOTE ] CUZ: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:17:07.522526] [INFO ] [REMOTE ] CVE: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:17:07.528045] [INFO ] [REMOTE ] CVE: Fetching primary data for 2024-12. [2025-10-15T18:17:07.533397] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2024-12. [2025-10-15T18:17:07.600129] [INFO ] [REMOTE ] CVI: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:17:07.600448] [INFO ] [REMOTE ] CVI: Fetching primary data for 2024-12. [2025-10-15T18:17:08.017868] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-10-15T18:17:08.020429] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-01. [2025-10-15T18:17:08.761721] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-15T18:17:08.763983] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-02. [2025-10-15T18:17:08.972320] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-15T18:17:08.982006] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-01. [2025-10-15T18:17:09.056088] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-15T18:17:09.066628] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-01. [2025-10-15T18:17:09.230752] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-15T18:17:09.240636] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-01. [2025-10-15T18:17:09.580389] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-15T18:17:09.583514] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-03. [2025-10-15T18:17:10.228380] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-15T18:17:10.232219] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-04. [2025-10-15T18:17:10.438540] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-15T18:17:10.513950] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-02. [2025-10-15T18:17:10.819318] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-15T18:17:10.914830] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-15T18:17:11.215253] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-15T18:17:11.314012] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-05. [2025-10-15T18:17:11.850202] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-15T18:17:12.072010] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-15T18:17:12.114012] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-02. [2025-10-15T18:17:12.914016] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-06. [2025-10-15T18:17:13.432299] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-15T18:17:13.714009] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-02. [2025-10-15T18:17:13.867029] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-15T18:17:14.514003] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-07. [2025-10-15T18:17:15.039078] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-15T18:17:15.063000] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-10-15T18:17:15.313994] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-08. [2025-10-15T18:17:16.114019] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-03. [2025-10-15T18:17:16.215326] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-15T18:17:16.913983] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-03. [2025-10-15T18:17:17.611403] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-15T18:17:17.713967] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-04. [2025-10-15T18:17:18.513994] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-03. [2025-10-15T18:17:18.783963] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-15T18:17:19.314029] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-09. [2025-10-15T18:17:19.501574] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-15T18:17:20.094758] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-15T18:17:20.113970] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-04. [2025-10-15T18:17:20.156210] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-15T18:17:20.913997] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-05. [2025-10-15T18:17:21.713967] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-04. [2025-10-15T18:17:21.766053] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-15T18:17:22.327188] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-15T18:17:22.514014] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-05. [2025-10-15T18:17:23.313957] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-10. [2025-10-15T18:17:23.480764] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-15T18:17:23.934590] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-15T18:17:24.114009] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-06. [2025-10-15T18:17:24.241306] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-15T18:17:24.245093] [INFO ] [REMOTE ] CVEO: Full fetch complete (20770 records). [2025-10-15T18:17:24.245294] [DEBUG] [VALIDATOR ] CVEO: Validating primary data. [2025-10-15T18:17:24.658379] [DEBUG] [VALIDATOR ] CVEO: All expected trading days are present. [2025-10-15T18:17:24.658482] [DEBUG] [VALIDATOR ] CVEO: Primary data validation passed. [2025-10-15T18:17:24.658960] [INFO ] [MAIN ] CVEO: Fetched primary data is valid. [2025-10-15T18:17:24.659023] [DEBUG] [LOCAL ] CVEO: Saving primary data. [2025-10-15T18:17:24.659704] [DEBUG] [LOCAL ] CVEO: Trimmed 20770 records to 15382 (keeping 200 days of data) [2025-10-15T18:17:24.747075] [DEBUG] [LOCAL ] CVEO: Primary data saved (15382 records). [2025-10-15T18:17:24.747221] [INFO ] [MAIN ] CVEO: Full history saved. [2025-10-15T18:17:24.747315] [INFO ] [MAIN ] Update Progress: 561/2369 symbols completed. CVEO took 20.5s. Estimated remaining: 4h 9m 15s. Rate: 7.3 symbols/min [2025-10-15T18:17:24.912230] [INFO ] [MAIN ] CVLG: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:17:24.914005] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-05. [2025-10-15T18:17:24.928741] [DEBUG] [LOCAL ] CVLG: Loaded 15571 existing records from primary storage. [2025-10-15T18:17:24.928972] [INFO ] [MAIN ] CVLG: Loaded 15571 existing records. [2025-10-15T18:17:25.104451] [WARN ] [MAIN ] CVLG: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:17:25.104746] [INFO ] [MAIN ] CVLG: Wiping existing primary data before full refresh. [2025-10-15T18:17:25.104817] [INFO ] [LOCAL ] CVLG: Starting deletion of primary data. [2025-10-15T18:17:25.105034] [DEBUG] [LOCAL ] CVLG: Deleted primary data file. [2025-10-15T18:17:25.105075] [INFO ] [MAIN ] CVLG: Starting full primary refresh. [2025-10-15T18:17:25.471248] [INFO ] [REMOTE ] CVLG: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:17:25.659060] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-15T18:17:25.713992] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-07. [2025-10-15T18:17:26.518838] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2024-12. [2025-10-15T18:17:26.531256] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-15T18:17:26.986952] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-15T18:17:27.079859] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2024-12 (0.56 seconds). [2025-10-15T18:17:27.314055] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-08. [2025-10-15T18:17:28.114010] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-01. [2025-10-15T18:17:28.661732] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-15T18:17:28.913969] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-09. [2025-10-15T18:17:28.981128] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-15T18:17:29.714069] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-06. [2025-10-15T18:17:30.513979] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-02. [2025-10-15T18:17:30.626636] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-15T18:17:31.062867] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-15T18:17:31.313979] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-10. [2025-10-15T18:17:31.495450] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-15T18:17:32.113974] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-06. [2025-10-15T18:17:32.608027] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-15T18:17:32.613629] [INFO ] [REMOTE ] CVI: Full fetch complete (67271 records). [2025-10-15T18:17:32.613764] [DEBUG] [VALIDATOR ] CVI: Validating primary data. [2025-10-15T18:17:32.918223] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-07. [2025-10-15T18:17:33.014052] [DEBUG] [VALIDATOR ] CVI: All expected trading days are present. [2025-10-15T18:17:33.014133] [DEBUG] [VALIDATOR ] CVI: Primary data validation passed. [2025-10-15T18:17:33.015028] [INFO ] [MAIN ] CVI: Fetched primary data is valid. [2025-10-15T18:17:33.015092] [DEBUG] [LOCAL ] CVI: Saving primary data. [2025-10-15T18:17:33.016351] [DEBUG] [LOCAL ] CVI: Trimmed 67271 records to 46660 (keeping 200 days of data) [2025-10-15T18:17:33.292417] [DEBUG] [LOCAL ] CVI: Primary data saved (46660 records). [2025-10-15T18:17:33.292547] [INFO ] [MAIN ] CVI: Full history saved. [2025-10-15T18:17:33.293539] [INFO ] [MAIN ] Update Progress: 562/2369 symbols completed. CVI took 29.1s. Estimated remaining: 4h 9m 7s. Rate: 7.3 symbols/min [2025-10-15T18:17:33.463876] [INFO ] [MAIN ] CVNA: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:17:33.522409] [DEBUG] [LOCAL ] CVNA: Loaded 52872 existing records from primary storage. [2025-10-15T18:17:33.522764] [INFO ] [MAIN ] CVNA: Loaded 52872 existing records. [2025-10-15T18:17:33.711284] [WARN ] [MAIN ] CVNA: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:17:33.711587] [INFO ] [MAIN ] CVNA: Wiping existing primary data before full refresh. [2025-10-15T18:17:33.711687] [INFO ] [LOCAL ] CVNA: Starting deletion of primary data. [2025-10-15T18:17:33.712116] [DEBUG] [LOCAL ] CVNA: Deleted primary data file. [2025-10-15T18:17:33.712187] [INFO ] [MAIN ] CVNA: Starting full primary refresh. [2025-10-15T18:17:33.724731] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-03. [2025-10-15T18:17:34.065090] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-10-15T18:17:34.111436] [INFO ] [REMOTE ] CVNA: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:17:34.342549] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-15T18:17:34.514023] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-08. [2025-10-15T18:17:34.692965] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-15T18:17:35.314052] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2024-12. [2025-10-15T18:17:35.967709] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-15T18:17:36.114025] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-07. [2025-10-15T18:17:36.914009] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-04. [2025-10-15T18:17:37.344189] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2024-12 (2.03 seconds). [2025-10-15T18:17:37.714081] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-09. [2025-10-15T18:17:37.737836] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-15T18:17:37.818603] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-15T18:17:38.513991] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-05. [2025-10-15T18:17:39.193236] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-15T18:17:39.314024] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-01. [2025-10-15T18:17:39.530599] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-15T18:17:40.113996] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-06. [2025-10-15T18:17:40.913967] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-10. [2025-10-15T18:17:41.117046] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-15T18:17:41.415182] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-01 (2.10 seconds). [2025-10-15T18:17:41.714003] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-07. [2025-10-15T18:17:42.412468] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-15T18:17:42.418916] [INFO ] [REMOTE ] CUZ: Full fetch complete (70912 records). [2025-10-15T18:17:42.419033] [DEBUG] [VALIDATOR ] CUZ: Validating primary data. [2025-10-15T18:17:42.519131] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-08. [2025-10-15T18:17:42.625095] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-15T18:17:42.843274] [DEBUG] [VALIDATOR ] CUZ: All expected trading days are present. [2025-10-15T18:17:42.843357] [DEBUG] [VALIDATOR ] CUZ: Primary data validation passed. [2025-10-15T18:17:42.844227] [INFO ] [MAIN ] CUZ: Fetched primary data is valid. [2025-10-15T18:17:42.844303] [DEBUG] [LOCAL ] CUZ: Saving primary data. [2025-10-15T18:17:42.845713] [DEBUG] [LOCAL ] CUZ: Trimmed 70912 records to 49639 (keeping 200 days of data) [2025-10-15T18:17:43.149801] [DEBUG] [LOCAL ] CUZ: Primary data saved (49639 records). [2025-10-15T18:17:43.149939] [INFO ] [MAIN ] CUZ: Full history saved. [2025-10-15T18:17:43.150024] [INFO ] [MAIN ] Update Progress: 563/2369 symbols completed. CUZ took 38.9s. Estimated remaining: 4h 9m 4s. Rate: 7.3 symbols/min [2025-10-15T18:17:43.328449] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-02. [2025-10-15T18:17:43.332047] [INFO ] [MAIN ] CVS: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:17:43.382058] [DEBUG] [LOCAL ] CVS: Loaded 53694 existing records from primary storage. [2025-10-15T18:17:43.382402] [INFO ] [MAIN ] CVS: Loaded 53694 existing records. [2025-10-15T18:17:43.557039] [WARN ] [MAIN ] CVS: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:17:43.557267] [INFO ] [MAIN ] CVS: Wiping existing primary data before full refresh. [2025-10-15T18:17:43.557317] [INFO ] [LOCAL ] CVS: Starting deletion of primary data. [2025-10-15T18:17:43.557684] [DEBUG] [LOCAL ] CVS: Deleted primary data file. [2025-10-15T18:17:43.557742] [INFO ] [MAIN ] CVS: Starting full primary refresh. [2025-10-15T18:17:43.909189] [INFO ] [REMOTE ] CVS: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:17:44.114002] [INFO ] [REMOTE ] CVS: Fetching primary data for 2024-12. [2025-10-15T18:17:44.310594] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-15T18:17:44.914003] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-08. [2025-10-15T18:17:45.227449] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-10-15T18:17:45.494715] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-15T18:17:45.713977] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-09. [2025-10-15T18:17:46.513966] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-03. [2025-10-15T18:17:46.561170] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2024-12 (2.45 seconds). [2025-10-15T18:17:46.586598] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-15T18:17:47.314014] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-01. [2025-10-15T18:17:48.114086] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-10. [2025-10-15T18:17:48.427389] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-15T18:17:48.913971] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-09. [2025-10-15T18:17:48.939043] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-15T18:17:48.941107] [INFO ] [REMOTE ] CVLG: Full fetch complete (21218 records). [2025-10-15T18:17:48.941182] [DEBUG] [VALIDATOR ] CVLG: Validating primary data. [2025-10-15T18:17:48.941626] [FATAL] [VALIDATOR ] CVLG: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T18:17:48.941726] [FATAL] [MAIN ] CVLG: Fetched primary data is invalid. Refusing to save it. [2025-10-15T18:17:48.941768] [WARN ] [MAIN ] CVLG: Deleting existing primary and derivative data due to validation failure. [2025-10-15T18:17:48.941830] [INFO ] [LOCAL ] CVLG: Starting deletion of primary data. [2025-10-15T18:17:48.941928] [DEBUG] [LOCAL ] CVLG: No primary data file found to delete. [2025-10-15T18:17:48.941969] [INFO ] [LOCAL ] CVLG: Starting deletion of derivative data. [2025-10-15T18:17:48.942145] [DEBUG] [LOCAL ] CVLG: Deleted derivative data file. [2025-10-15T18:17:48.942229] [INFO ] [MAIN ] Update Progress: 564/2369 symbols completed. CVLG took 24.2s. Estimated remaining: 4h 8m 48s. Rate: 7.3 symbols/min [2025-10-15T18:17:49.113291] [INFO ] [MAIN ] CVX: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:17:49.166958] [DEBUG] [LOCAL ] CVX: Loaded 53760 existing records from primary storage. [2025-10-15T18:17:49.167272] [INFO ] [MAIN ] CVX: Loaded 53760 existing records. [2025-10-15T18:17:49.342414] [WARN ] [MAIN ] CVX: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:17:49.342829] [INFO ] [MAIN ] CVX: Wiping existing primary data before full refresh. [2025-10-15T18:17:49.342894] [INFO ] [LOCAL ] CVX: Starting deletion of primary data. [2025-10-15T18:17:49.343409] [DEBUG] [LOCAL ] CVX: Deleted primary data file. [2025-10-15T18:17:49.343524] [INFO ] [MAIN ] CVX: Starting full primary refresh. [2025-10-15T18:17:49.543516] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-01 (2.23 seconds). [2025-10-15T18:17:49.715190] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-04. [2025-10-15T18:17:49.739157] [INFO ] [REMOTE ] CVX: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:17:50.514057] [INFO ] [REMOTE ] CVX: Fetching primary data for 2024-12. [2025-10-15T18:17:50.635832] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-15T18:17:51.314005] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-10. [2025-10-15T18:17:52.041376] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-04 (2.33 seconds). [2025-10-15T18:17:52.113962] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-05. [2025-10-15T18:17:52.511954] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2024-12 (2.00 seconds). [2025-10-15T18:17:52.913997] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-01. [2025-10-15T18:17:53.109081] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-15T18:17:53.117588] [INFO ] [REMOTE ] CVE: Full fetch complete (77326 records). [2025-10-15T18:17:53.117844] [DEBUG] [VALIDATOR ] CVE: Validating primary data. [2025-10-15T18:17:53.119324] [FATAL] [VALIDATOR ] CVE: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T18:17:53.119462] [FATAL] [MAIN ] CVE: Fetched primary data is invalid. Refusing to save it. [2025-10-15T18:17:53.119530] [WARN ] [MAIN ] CVE: Deleting existing primary and derivative data due to validation failure. [2025-10-15T18:17:53.119613] [INFO ] [LOCAL ] CVE: Starting deletion of primary data. [2025-10-15T18:17:53.119735] [DEBUG] [LOCAL ] CVE: No primary data file found to delete. [2025-10-15T18:17:53.119795] [INFO ] [LOCAL ] CVE: Starting deletion of derivative data. [2025-10-15T18:17:53.119965] [DEBUG] [LOCAL ] CVE: Deleted derivative data file. [2025-10-15T18:17:53.120080] [INFO ] [MAIN ] Update Progress: 565/2369 symbols completed. CVE took 48.9s. Estimated remaining: 4h 8m 26s. Rate: 7.3 symbols/min [2025-10-15T18:17:53.291308] [INFO ] [MAIN ] CW: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:17:53.314063] [DEBUG] [LOCAL ] CW: Loaded 22123 existing records from primary storage. [2025-10-15T18:17:53.314341] [INFO ] [MAIN ] CW: Loaded 22123 existing records. [2025-10-15T18:17:53.488852] [WARN ] [MAIN ] CW: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:17:53.489070] [INFO ] [MAIN ] CW: Wiping existing primary data before full refresh. [2025-10-15T18:17:53.489116] [INFO ] [LOCAL ] CW: Starting deletion of primary data. [2025-10-15T18:17:53.489426] [DEBUG] [LOCAL ] CW: Deleted primary data file. [2025-10-15T18:17:53.489480] [INFO ] [MAIN ] CW: Starting full primary refresh. [2025-10-15T18:17:53.729954] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-02. [2025-10-15T18:17:53.870025] [INFO ] [REMOTE ] CW: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:17:54.300931] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-05 (2.19 seconds). [2025-10-15T18:17:54.513977] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-06. [2025-10-15T18:17:55.121961] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-01 (2.21 seconds). [2025-10-15T18:17:55.314009] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-02. [2025-10-15T18:17:55.627860] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-10-15T18:17:56.114003] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-03. [2025-10-15T18:17:56.451729] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-10-15T18:17:56.914013] [INFO ] [REMOTE ] CW: Fetching primary data for 2024-12. [2025-10-15T18:17:57.297550] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-10-15T18:17:57.714018] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-07. [2025-10-15T18:17:58.087433] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-15T18:17:58.149448] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-10-15T18:17:58.513997] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-04. [2025-10-15T18:17:59.313993] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-01. [2025-10-15T18:18:00.038053] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-07 (2.32 seconds). [2025-10-15T18:18:00.113989] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-08. [2025-10-15T18:18:00.264053] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-15T18:18:00.729181] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-04 (2.22 seconds). [2025-10-15T18:18:00.913992] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-05. [2025-10-15T18:18:01.714028] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-02. [2025-10-15T18:18:02.016480] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-15T18:18:02.514001] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-09. [2025-10-15T18:18:02.979996] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-15T18:18:03.152475] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-05 (2.24 seconds). [2025-10-15T18:18:03.314185] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-06. [2025-10-15T18:18:04.114056] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-03. [2025-10-15T18:18:04.464325] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-15T18:18:04.914096] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-10. [2025-10-15T18:18:05.140902] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-15T18:18:05.714053] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-07. [2025-10-15T18:18:06.265429] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-03 (2.15 seconds). [2025-10-15T18:18:06.514060] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-04. [2025-10-15T18:18:07.024948] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-10 (2.11 seconds). [2025-10-15T18:18:07.031900] [INFO ] [REMOTE ] CVNA: Full fetch complete (76396 records). [2025-10-15T18:18:07.032135] [DEBUG] [VALIDATOR ] CVNA: Validating primary data. [2025-10-15T18:18:07.033262] [FATAL] [VALIDATOR ] CVNA: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T18:18:07.033367] [FATAL] [MAIN ] CVNA: Fetched primary data is invalid. Refusing to save it. [2025-10-15T18:18:07.033431] [WARN ] [MAIN ] CVNA: Deleting existing primary and derivative data due to validation failure. [2025-10-15T18:18:07.033519] [INFO ] [LOCAL ] CVNA: Starting deletion of primary data. [2025-10-15T18:18:07.033601] [DEBUG] [LOCAL ] CVNA: No primary data file found to delete. [2025-10-15T18:18:07.033725] [INFO ] [LOCAL ] CVNA: Starting deletion of derivative data. [2025-10-15T18:18:07.033892] [DEBUG] [LOCAL ] CVNA: Deleted derivative data file. [2025-10-15T18:18:07.034795] [INFO ] [MAIN ] Update Progress: 566/2369 symbols completed. CVNA took 33.7s. Estimated remaining: 4h 8m 36s. Rate: 7.3 symbols/min [2025-10-15T18:18:07.214668] [INFO ] [MAIN ] CWAN: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:18:07.268326] [DEBUG] [LOCAL ] CWAN: Loaded 52586 existing records from primary storage. [2025-10-15T18:18:07.268695] [INFO ] [MAIN ] CWAN: Loaded 52586 existing records. [2025-10-15T18:18:07.336708] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-03. [2025-10-15T18:18:07.456163] [WARN ] [MAIN ] CWAN: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:18:07.456443] [INFO ] [MAIN ] CWAN: Wiping existing primary data before full refresh. [2025-10-15T18:18:07.456543] [INFO ] [LOCAL ] CWAN: Starting deletion of primary data. [2025-10-15T18:18:07.456812] [DEBUG] [LOCAL ] CWAN: Deleted primary data file. [2025-10-15T18:18:07.456869] [INFO ] [MAIN ] CWAN: Starting full primary refresh. [2025-10-15T18:18:07.820279] [INFO ] [REMOTE ] CWAN: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:18:07.854104] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-07 (2.14 seconds). [2025-10-15T18:18:08.114014] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-08. [2025-10-15T18:18:08.599031] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-15T18:18:08.914010] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-04. [2025-10-15T18:18:09.043158] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-04 (2.53 seconds). [2025-10-15T18:18:09.713987] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2024-12. [2025-10-15T18:18:10.145697] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-10-15T18:18:10.271525] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-15T18:18:10.514045] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-05. [2025-10-15T18:18:11.217096] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-15T18:18:11.314001] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-05. [2025-10-15T18:18:11.561192] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-15T18:18:12.114072] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-01. [2025-10-15T18:18:12.914048] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-09. [2025-10-15T18:18:13.714049] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-06. [2025-10-15T18:18:13.836833] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-05 (2.52 seconds). [2025-10-15T18:18:13.876787] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-15T18:18:14.514404] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-06. [2025-10-15T18:18:14.991595] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-10-15T18:18:15.027071] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-15T18:18:15.313996] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-02. [2025-10-15T18:18:16.114004] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-10. [2025-10-15T18:18:16.729803] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-06 (2.22 seconds). [2025-10-15T18:18:16.925944] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-07. [2025-10-15T18:18:16.948255] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-15T18:18:16.949283] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-15T18:18:16.966425] [INFO ] [REMOTE ] CVS: Full fetch complete (77874 records). [2025-10-15T18:18:16.966563] [DEBUG] [VALIDATOR ] CVS: Validating primary data. [2025-10-15T18:18:17.390783] [DEBUG] [VALIDATOR ] CVS: All expected trading days are present. [2025-10-15T18:18:17.390882] [DEBUG] [VALIDATOR ] CVS: Primary data validation passed. [2025-10-15T18:18:17.391821] [INFO ] [MAIN ] CVS: Fetched primary data is valid. [2025-10-15T18:18:17.391885] [DEBUG] [LOCAL ] CVS: Saving primary data. [2025-10-15T18:18:17.393454] [DEBUG] [LOCAL ] CVS: Trimmed 77874 records to 53694 (keeping 200 days of data) [2025-10-15T18:18:17.714065] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-03. [2025-10-15T18:18:17.733587] [DEBUG] [LOCAL ] CVS: Primary data saved (53694 records). [2025-10-15T18:18:17.733777] [INFO ] [MAIN ] CVS: Full history saved. [2025-10-15T18:18:17.733867] [INFO ] [MAIN ] Update Progress: 567/2369 symbols completed. CVS took 34.6s. Estimated remaining: 4h 8m 36s. Rate: 7.2 symbols/min [2025-10-15T18:18:17.921850] [INFO ] [MAIN ] CWEN: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:18:17.922022] [DEBUG] [LOCAL ] CWEN: No existing data file found in primary storage. [2025-10-15T18:18:17.922058] [WARN ] [MAIN ] CWEN: No existing data found, performing full refresh instead. [2025-10-15T18:18:17.922171] [INFO ] [MAIN ] CWEN: Wiping existing primary data before full refresh. [2025-10-15T18:18:17.922231] [INFO ] [LOCAL ] CWEN: Starting deletion of primary data. [2025-10-15T18:18:17.922273] [DEBUG] [LOCAL ] CWEN: No primary data file found to delete. [2025-10-15T18:18:17.922307] [INFO ] [MAIN ] CWEN: Starting full primary refresh. [2025-10-15T18:18:18.275971] [INFO ] [REMOTE ] CWEN: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:18:18.514018] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2024-12. [2025-10-15T18:18:19.264893] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-07 (2.34 seconds). [2025-10-15T18:18:19.319146] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-08. [2025-10-15T18:18:19.338419] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-15T18:18:19.934395] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-15T18:18:20.114007] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-01. [2025-10-15T18:18:20.913993] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-07. [2025-10-15T18:18:21.323337] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-10-15T18:18:21.555243] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-15T18:18:21.713993] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-02. [2025-10-15T18:18:21.744278] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-15T18:18:22.514008] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-09. [2025-10-15T18:18:22.930991] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-15T18:18:23.313997] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-04. [2025-10-15T18:18:24.113991] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-08. [2025-10-15T18:18:24.726600] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-09 (2.21 seconds). [2025-10-15T18:18:24.840938] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-15T18:18:24.896111] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-15T18:18:24.913949] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-05. [2025-10-15T18:18:25.714059] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-09. [2025-10-15T18:18:26.328284] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-15T18:18:26.514018] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-06. [2025-10-15T18:18:26.529731] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-15T18:18:27.313977] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-10. [2025-10-15T18:18:27.810579] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-15T18:18:28.114026] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-10. [2025-10-15T18:18:28.443392] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-15T18:18:28.446007] [INFO ] [REMOTE ] CW: Full fetch complete (33157 records). [2025-10-15T18:18:28.446087] [DEBUG] [VALIDATOR ] CW: Validating primary data. [2025-10-15T18:18:28.835685] [DEBUG] [VALIDATOR ] CW: All expected trading days are present. [2025-10-15T18:18:28.835824] [DEBUG] [VALIDATOR ] CW: Primary data validation passed. [2025-10-15T18:18:28.836545] [INFO ] [MAIN ] CW: Fetched primary data is valid. [2025-10-15T18:18:28.836691] [DEBUG] [LOCAL ] CW: Saving primary data. [2025-10-15T18:18:28.840920] [DEBUG] [LOCAL ] CW: Trimmed 33157 records to 22100 (keeping 200 days of data) [2025-10-15T18:18:28.931810] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-07. [2025-10-15T18:18:28.953043] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-15T18:18:28.963156] [INFO ] [REMOTE ] CVX: Full fetch complete (77940 records). [2025-10-15T18:18:28.965235] [DEBUG] [VALIDATOR ] CVX: Validating primary data. [2025-10-15T18:18:29.392856] [DEBUG] [LOCAL ] CW: Primary data saved (22100 records). [2025-10-15T18:18:29.414544] [DEBUG] [VALIDATOR ] CVX: All expected trading days are present. [2025-10-15T18:18:29.410935] [INFO ] [MAIN ] CW: Full history saved. [2025-10-15T18:18:29.414613] [DEBUG] [VALIDATOR ] CVX: Primary data validation passed. [2025-10-15T18:18:29.415723] [INFO ] [MAIN ] CVX: Fetched primary data is valid. [2025-10-15T18:18:29.415801] [DEBUG] [LOCAL ] CVX: Saving primary data. [2025-10-15T18:18:29.415925] [INFO ] [MAIN ] Update Progress: 568/2369 symbols completed. CW took 36.3s. Estimated remaining: 4h 8m 38s. Rate: 7.2 symbols/min [2025-10-15T18:18:29.528452] [DEBUG] [LOCAL ] CVX: Trimmed 77940 records to 53760 (keeping 200 days of data) [2025-10-15T18:18:29.703913] [INFO ] [MAIN ] CWH: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:18:29.704612] [DEBUG] [LOCAL ] CWH: No existing data file found in primary storage. [2025-10-15T18:18:29.705275] [WARN ] [MAIN ] CWH: No existing data found, performing full refresh instead. [2025-10-15T18:18:29.705705] [INFO ] [MAIN ] CWH: Wiping existing primary data before full refresh. [2025-10-15T18:18:29.707165] [INFO ] [LOCAL ] CWH: Starting deletion of primary data. [2025-10-15T18:18:29.709078] [DEBUG] [LOCAL ] CWH: No primary data file found to delete. [2025-10-15T18:18:29.709951] [INFO ] [MAIN ] CWH: Starting full primary refresh. [2025-10-15T18:18:29.715431] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-03. [2025-10-15T18:18:30.309729] [INFO ] [REMOTE ] CWH: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:18:30.328631] [DEBUG] [LOCAL ] CVX: Primary data saved (53760 records). [2025-10-15T18:18:30.328766] [INFO ] [MAIN ] CVX: Full history saved. [2025-10-15T18:18:30.329227] [INFO ] [MAIN ] Update Progress: 569/2369 symbols completed. CVX took 41.4s. Estimated remaining: 4h 8m 7s. Rate: 7.3 symbols/min [2025-10-15T18:18:30.507956] [INFO ] [MAIN ] CWK: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:18:30.508244] [DEBUG] [LOCAL ] CWK: No existing data file found in primary storage. [2025-10-15T18:18:30.508297] [WARN ] [MAIN ] CWK: No existing data found, performing full refresh instead. [2025-10-15T18:18:30.508477] [INFO ] [MAIN ] CWK: Wiping existing primary data before full refresh. [2025-10-15T18:18:30.508529] [INFO ] [LOCAL ] CWK: Starting deletion of primary data. [2025-10-15T18:18:30.508579] [DEBUG] [LOCAL ] CWK: No primary data file found to delete. [2025-10-15T18:18:30.508617] [INFO ] [MAIN ] CWK: Starting full primary refresh. [2025-10-15T18:18:30.539254] [INFO ] [REMOTE ] CWH: Fetching primary data for 2024-12. [2025-10-15T18:18:30.893496] [INFO ] [REMOTE ] CWK: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:18:30.918683] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-15T18:18:31.301827] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-15T18:18:31.313954] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-04. [2025-10-15T18:18:32.113968] [INFO ] [REMOTE ] CWK: Fetching primary data for 2024-12. [2025-10-15T18:18:32.459491] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-10-15T18:18:32.658152] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-15T18:18:32.914015] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-05. [2025-10-15T18:18:33.592861] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-15T18:18:33.713958] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-01. [2025-10-15T18:18:34.430144] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-15T18:18:34.513963] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-06. [2025-10-15T18:18:35.303683] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-15T18:18:35.313954] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-01. [2025-10-15T18:18:35.827884] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-15T18:18:36.113992] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-02. [2025-10-15T18:18:36.884380] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-15T18:18:36.913961] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-02. [2025-10-15T18:18:37.533094] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-15T18:18:37.714011] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-03. [2025-10-15T18:18:38.413166] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-15T18:18:38.513990] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-03. [2025-10-15T18:18:39.093450] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-15T18:18:39.314008] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-07. [2025-10-15T18:18:39.947074] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-15T18:18:40.113985] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-04. [2025-10-15T18:18:40.913981] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-04. [2025-10-15T18:18:40.983137] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-15T18:18:41.545883] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-15T18:18:41.713967] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-05. [2025-10-15T18:18:42.392872] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-15T18:18:42.513981] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-08. [2025-10-15T18:18:43.313963] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-05. [2025-10-15T18:18:43.670842] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-15T18:18:44.113976] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-06. [2025-10-15T18:18:44.219400] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-15T18:18:44.686354] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-15T18:18:44.914039] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-06. [2025-10-15T18:18:45.714026] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-08. [2025-10-15T18:18:45.836633] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-15T18:18:46.430067] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-15T18:18:46.513985] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-07. [2025-10-15T18:18:47.313976] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-07. [2025-10-15T18:18:47.460803] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-15T18:18:48.114028] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-09. [2025-10-15T18:18:48.144853] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-15T18:18:48.914027] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-09. [2025-10-15T18:18:49.083515] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-15T18:18:49.586256] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-15T18:18:49.713988] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-10. [2025-10-15T18:18:50.345614] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-15T18:18:50.514064] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-08. [2025-10-15T18:18:51.322989] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-08. [2025-10-15T18:18:51.334904] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-15T18:18:51.341594] [INFO ] [REMOTE ] CWAN: Full fetch complete (75488 records). [2025-10-15T18:18:51.341740] [DEBUG] [VALIDATOR ] CWAN: Validating primary data. [2025-10-15T18:18:51.724431] [DEBUG] [VALIDATOR ] CWAN: All expected trading days are present. [2025-10-15T18:18:51.724544] [DEBUG] [VALIDATOR ] CWAN: Primary data validation passed. [2025-10-15T18:18:51.725531] [INFO ] [MAIN ] CWAN: Fetched primary data is valid. [2025-10-15T18:18:51.725614] [DEBUG] [LOCAL ] CWAN: Saving primary data. [2025-10-15T18:18:51.727372] [DEBUG] [LOCAL ] CWAN: Trimmed 75488 records to 52616 (keeping 200 days of data) [2025-10-15T18:18:51.958531] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-15T18:18:52.070323] [DEBUG] [LOCAL ] CWAN: Primary data saved (52616 records). [2025-10-15T18:18:52.070454] [INFO ] [MAIN ] CWAN: Full history saved. [2025-10-15T18:18:52.071225] [INFO ] [MAIN ] Update Progress: 570/2369 symbols completed. CWAN took 45.0s. Estimated remaining: 4h 8m 41s. Rate: 7.2 symbols/min [2025-10-15T18:18:52.121606] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-09. [2025-10-15T18:18:52.245413] [INFO ] [MAIN ] CWT: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:18:52.276458] [DEBUG] [LOCAL ] CWT: Loaded 28136 existing records from primary storage. [2025-10-15T18:18:52.276792] [INFO ] [MAIN ] CWT: Loaded 28136 existing records. [2025-10-15T18:18:52.453502] [WARN ] [MAIN ] CWT: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:18:52.453809] [INFO ] [MAIN ] CWT: Wiping existing primary data before full refresh. [2025-10-15T18:18:52.453866] [INFO ] [LOCAL ] CWT: Starting deletion of primary data. [2025-10-15T18:18:52.454338] [DEBUG] [LOCAL ] CWT: Deleted primary data file. [2025-10-15T18:18:52.454394] [INFO ] [MAIN ] CWT: Starting full primary refresh. [2025-10-15T18:18:52.802442] [INFO ] [REMOTE ] CWT: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:18:52.913954] [INFO ] [REMOTE ] CWT: Fetching primary data for 2024-12. [2025-10-15T18:18:52.986756] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-15T18:18:53.713978] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-10. [2025-10-15T18:18:53.873961] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-15T18:18:53.898531] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-10-15T18:18:54.513992] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-09. [2025-10-15T18:18:55.313968] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-10. [2025-10-15T18:18:55.423805] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-15T18:18:55.429917] [INFO ] [REMOTE ] CWEN: Full fetch complete (65378 records). [2025-10-15T18:18:55.430053] [DEBUG] [VALIDATOR ] CWEN: Validating primary data. [2025-10-15T18:18:55.820823] [DEBUG] [VALIDATOR ] CWEN: All expected trading days are present. [2025-10-15T18:18:55.820899] [DEBUG] [VALIDATOR ] CWEN: Primary data validation passed. [2025-10-15T18:18:55.821714] [INFO ] [MAIN ] CWEN: Fetched primary data is valid. [2025-10-15T18:18:55.821776] [DEBUG] [LOCAL ] CWEN: Saving primary data. [2025-10-15T18:18:55.823037] [DEBUG] [LOCAL ] CWEN: Trimmed 65378 records to 45322 (keeping 200 days of data) [2025-10-15T18:18:55.962124] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-15T18:18:56.119729] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-01. [2025-10-15T18:18:56.129854] [DEBUG] [LOCAL ] CWEN: Primary data saved (45322 records). [2025-10-15T18:18:56.129935] [INFO ] [MAIN ] CWEN: Full history saved. [2025-10-15T18:18:56.130002] [INFO ] [MAIN ] Update Progress: 571/2369 symbols completed. CWEN took 38.4s. Estimated remaining: 4h 8m 19s. Rate: 7.2 symbols/min [2025-10-15T18:18:56.292926] [INFO ] [MAIN ] CX: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:18:56.339429] [DEBUG] [LOCAL ] CX: Loaded 52837 existing records from primary storage. [2025-10-15T18:18:56.339781] [INFO ] [MAIN ] CX: Loaded 52837 existing records. [2025-10-15T18:18:56.509939] [WARN ] [MAIN ] CX: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:18:56.510129] [INFO ] [MAIN ] CX: Wiping existing primary data before full refresh. [2025-10-15T18:18:56.510174] [INFO ] [LOCAL ] CX: Starting deletion of primary data. [2025-10-15T18:18:56.510514] [DEBUG] [LOCAL ] CX: Deleted primary data file. [2025-10-15T18:18:56.510568] [INFO ] [MAIN ] CX: Starting full primary refresh. [2025-10-15T18:18:56.858422] [INFO ] [REMOTE ] CX: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:18:56.913947] [INFO ] [REMOTE ] CX: Fetching primary data for 2024-12. [2025-10-15T18:18:57.081470] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-15T18:18:57.087351] [INFO ] [REMOTE ] CWH: Full fetch complete (73222 records). [2025-10-15T18:18:57.087462] [DEBUG] [VALIDATOR ] CWH: Validating primary data. [2025-10-15T18:18:57.470144] [DEBUG] [VALIDATOR ] CWH: All expected trading days are present. [2025-10-15T18:18:57.470243] [DEBUG] [VALIDATOR ] CWH: Primary data validation passed. [2025-10-15T18:18:57.471238] [INFO ] [MAIN ] CWH: Fetched primary data is valid. [2025-10-15T18:18:57.471318] [DEBUG] [LOCAL ] CWH: Saving primary data. [2025-10-15T18:18:57.488614] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-15T18:18:57.494794] [DEBUG] [LOCAL ] CWH: Trimmed 73222 records to 51349 (keeping 200 days of data) [2025-10-15T18:18:57.714690] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-02. [2025-10-15T18:18:57.801391] [DEBUG] [LOCAL ] CWH: Primary data saved (51349 records). [2025-10-15T18:18:57.801513] [INFO ] [MAIN ] CWH: Full history saved. [2025-10-15T18:18:57.801580] [INFO ] [MAIN ] Update Progress: 572/2369 symbols completed. CWH took 28.4s. Estimated remaining: 4h 7m 50s. Rate: 7.3 symbols/min [2025-10-15T18:18:57.969562] [INFO ] [MAIN ] CXE: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:18:57.977190] [DEBUG] [LOCAL ] CXE: Loaded 6134 existing records from primary storage. [2025-10-15T18:18:57.977381] [INFO ] [MAIN ] CXE: Loaded 6134 existing records. [2025-10-15T18:18:58.156185] [WARN ] [MAIN ] CXE: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:18:58.156411] [INFO ] [MAIN ] CXE: Wiping existing primary data before full refresh. [2025-10-15T18:18:58.156538] [INFO ] [LOCAL ] CXE: Starting deletion of primary data. [2025-10-15T18:18:58.156722] [DEBUG] [LOCAL ] CXE: Deleted primary data file. [2025-10-15T18:18:58.156784] [INFO ] [MAIN ] CXE: Starting full primary refresh. [2025-10-15T18:18:58.527226] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-10. [2025-10-15T18:18:58.527163] [INFO ] [REMOTE ] CXE: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:18:58.547425] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-15T18:18:58.845512] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-15T18:18:59.314017] [INFO ] [REMOTE ] CXE: Fetching primary data for 2024-12. [2025-10-15T18:19:00.114008] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-03. [2025-10-15T18:19:00.175927] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-10-15T18:19:00.202405] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-15T18:19:00.209975] [INFO ] [REMOTE ] CWK: Full fetch complete (71238 records). [2025-10-15T18:19:00.210203] [DEBUG] [VALIDATOR ] CWK: Validating primary data. [2025-10-15T18:19:00.660976] [DEBUG] [VALIDATOR ] CWK: All expected trading days are present. [2025-10-15T18:19:00.661106] [DEBUG] [VALIDATOR ] CWK: Primary data validation passed. [2025-10-15T18:19:00.662365] [INFO ] [MAIN ] CWK: Fetched primary data is valid. [2025-10-15T18:19:00.662431] [DEBUG] [LOCAL ] CWK: Saving primary data. [2025-10-15T18:19:00.664355] [DEBUG] [LOCAL ] CWK: Trimmed 71238 records to 49628 (keeping 200 days of data) [2025-10-15T18:19:00.914038] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-01. [2025-10-15T18:19:00.989930] [DEBUG] [LOCAL ] CWK: Primary data saved (49628 records). [2025-10-15T18:19:00.990144] [INFO ] [MAIN ] CWK: Full history saved. [2025-10-15T18:19:00.990271] [INFO ] [MAIN ] Update Progress: 573/2369 symbols completed. CWK took 30.7s. Estimated remaining: 4h 7m 26s. Rate: 7.3 symbols/min [2025-10-15T18:19:01.171765] [INFO ] [MAIN ] CXH: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:19:01.180390] [DEBUG] [LOCAL ] CXH: Loaded 4435 existing records from primary storage. [2025-10-15T18:19:01.180778] [INFO ] [MAIN ] CXH: Loaded 4435 existing records. [2025-10-15T18:19:01.383435] [WARN ] [MAIN ] CXH: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:19:01.383880] [INFO ] [MAIN ] CXH: Wiping existing primary data before full refresh. [2025-10-15T18:19:01.383965] [INFO ] [LOCAL ] CXH: Starting deletion of primary data. [2025-10-15T18:19:01.384301] [DEBUG] [LOCAL ] CXH: Deleted primary data file. [2025-10-15T18:19:01.384423] [INFO ] [MAIN ] CXH: Starting full primary refresh. [2025-10-15T18:19:01.588484] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-15T18:19:01.717132] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-01. [2025-10-15T18:19:01.746377] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-15T18:19:01.833559] [INFO ] [REMOTE ] CXH: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:19:02.514016] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-04. [2025-10-15T18:19:03.228350] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-15T18:19:03.314005] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-02. [2025-10-15T18:19:03.573863] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-15T18:19:04.113989] [INFO ] [REMOTE ] CXH: Fetching primary data for 2024-12. [2025-10-15T18:19:04.651898] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2024-12 (0.54 seconds). [2025-10-15T18:19:04.914000] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-05. [2025-10-15T18:19:04.984002] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-15T18:19:05.714027] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-02. [2025-10-15T18:19:06.038826] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-15T18:19:06.501504] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-15T18:19:06.513944] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-03. [2025-10-15T18:19:07.118226] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-15T18:19:07.314057] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-01. [2025-10-15T18:19:07.627162] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-01 (0.31 seconds). [2025-10-15T18:19:08.114039] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-03. [2025-10-15T18:19:08.914067] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-04. [2025-10-15T18:19:09.520147] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-15T18:19:09.713993] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-02. [2025-10-15T18:19:09.901531] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-15T18:19:10.121426] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-10-15T18:19:10.514045] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-03. [2025-10-15T18:19:11.043087] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-10-15T18:19:11.314030] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-06. [2025-10-15T18:19:12.114045] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-04. [2025-10-15T18:19:12.467597] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-15T18:19:12.519319] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-04 (0.41 seconds). [2025-10-15T18:19:12.913988] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-04. [2025-10-15T18:19:13.714035] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-05. [2025-10-15T18:19:14.176057] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-10-15T18:19:14.446627] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-15T18:19:14.513966] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-05. [2025-10-15T18:19:15.314000] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-06. [2025-10-15T18:19:16.123292] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-07. [2025-10-15T18:19:16.128003] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-15T18:19:16.135059] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-15T18:19:16.913990] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-06. [2025-10-15T18:19:17.445037] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-15T18:19:17.714012] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-05. [2025-10-15T18:19:18.324042] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-15T18:19:18.514035] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-07. [2025-10-15T18:19:18.548182] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-15T18:19:19.314054] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-07. [2025-10-15T18:19:20.114877] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-08. [2025-10-15T18:19:20.115742] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-15T18:19:20.355682] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-15T18:19:20.914026] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-08. [2025-10-15T18:19:21.121773] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-15T18:19:21.267793] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-10-15T18:19:21.713978] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-08. [2025-10-15T18:19:22.514014] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-09. [2025-10-15T18:19:23.134065] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-15T18:19:23.314008] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-09. [2025-10-15T18:19:23.736975] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-15T18:19:23.744364] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-10-15T18:19:24.114003] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-10. [2025-10-15T18:19:24.620785] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-15T18:19:24.621566] [INFO ] [REMOTE ] CXH: Full fetch complete (5336 records). [2025-10-15T18:19:24.621631] [DEBUG] [VALIDATOR ] CXH: Validating primary data. [2025-10-15T18:19:24.919228] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-06. [2025-10-15T18:19:24.978347] [DEBUG] [VALIDATOR ] CXH: All expected trading days are present. [2025-10-15T18:19:24.978431] [DEBUG] [VALIDATOR ] CXH: Primary data validation passed. [2025-10-15T18:19:24.978618] [INFO ] [MAIN ] CXH: Fetched primary data is valid. [2025-10-15T18:19:24.978683] [DEBUG] [LOCAL ] CXH: Saving primary data. [2025-10-15T18:19:24.979070] [DEBUG] [LOCAL ] CXH: Trimmed 5336 records to 4432 (keeping 200 days of data) [2025-10-15T18:19:25.008228] [DEBUG] [LOCAL ] CXH: Primary data saved (4432 records). [2025-10-15T18:19:25.008376] [INFO ] [MAIN ] CXH: Full history saved. [2025-10-15T18:19:25.008473] [INFO ] [MAIN ] Update Progress: 574/2369 symbols completed. CXH took 24.0s. Estimated remaining: 4h 8m 7s. Rate: 7.2 symbols/min [2025-10-15T18:19:25.176528] [INFO ] [MAIN ] CXM: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:19:25.217935] [DEBUG] [LOCAL ] CXM: Loaded 47569 existing records from primary storage. [2025-10-15T18:19:25.218223] [INFO ] [MAIN ] CXM: Loaded 47569 existing records. [2025-10-15T18:19:25.392769] [WARN ] [MAIN ] CXM: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:19:25.398251] [INFO ] [MAIN ] CXM: Wiping existing primary data before full refresh. [2025-10-15T18:19:25.398480] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-10-15T18:19:25.398566] [INFO ] [LOCAL ] CXM: Starting deletion of primary data. [2025-10-15T18:19:25.402019] [DEBUG] [LOCAL ] CXM: Deleted primary data file. [2025-10-15T18:19:25.402086] [INFO ] [MAIN ] CXM: Starting full primary refresh. [2025-10-15T18:19:25.719113] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-09. [2025-10-15T18:19:25.754131] [INFO ] [REMOTE ] CXM: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:19:26.514041] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-10. [2025-10-15T18:19:27.281579] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-15T18:19:27.313950] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-10. [2025-10-15T18:19:27.895626] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-15T18:19:27.899366] [INFO ] [REMOTE ] CWT: Full fetch complete (41021 records). [2025-10-15T18:19:27.899445] [DEBUG] [VALIDATOR ] CWT: Validating primary data. [2025-10-15T18:19:28.120854] [INFO ] [REMOTE ] CXM: Fetching primary data for 2024-12. [2025-10-15T18:19:28.272440] [DEBUG] [VALIDATOR ] CWT: All expected trading days are present. [2025-10-15T18:19:28.272537] [DEBUG] [VALIDATOR ] CWT: Primary data validation passed. [2025-10-15T18:19:28.273484] [INFO ] [MAIN ] CWT: Fetched primary data is valid. [2025-10-15T18:19:28.273551] [DEBUG] [LOCAL ] CWT: Saving primary data. [2025-10-15T18:19:28.274679] [DEBUG] [LOCAL ] CWT: Trimmed 41021 records to 28121 (keeping 200 days of data) [2025-10-15T18:19:28.463564] [DEBUG] [LOCAL ] CWT: Primary data saved (28121 records). [2025-10-15T18:19:28.463730] [INFO ] [MAIN ] CWT: Full history saved. [2025-10-15T18:19:28.463839] [INFO ] [MAIN ] Update Progress: 575/2369 symbols completed. CWT took 36.4s. Estimated remaining: 4h 7m 43s. Rate: 7.2 symbols/min [2025-10-15T18:19:28.649994] [INFO ] [MAIN ] CXT: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:19:28.683427] [DEBUG] [LOCAL ] CXT: Loaded 31022 existing records from primary storage. [2025-10-15T18:19:28.683737] [INFO ] [MAIN ] CXT: Loaded 31022 existing records. [2025-10-15T18:19:28.894875] [WARN ] [MAIN ] CXT: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:19:28.895158] [INFO ] [MAIN ] CXT: Wiping existing primary data before full refresh. [2025-10-15T18:19:28.895229] [INFO ] [LOCAL ] CXT: Starting deletion of primary data. [2025-10-15T18:19:28.900538] [DEBUG] [LOCAL ] CXT: Deleted primary data file. [2025-10-15T18:19:28.908859] [INFO ] [MAIN ] CXT: Starting full primary refresh. [2025-10-15T18:19:28.915061] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-15T18:19:28.915169] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-07. [2025-10-15T18:19:28.981986] [INFO ] [REMOTE ] CX: Full fetch complete (76169 records). [2025-10-15T18:19:29.017854] [DEBUG] [VALIDATOR ] CX: Validating primary data. [2025-10-15T18:19:29.031749] [FATAL] [VALIDATOR ] CX: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T18:19:29.047170] [FATAL] [MAIN ] CX: Fetched primary data is invalid. Refusing to save it. [2025-10-15T18:19:29.063985] [WARN ] [MAIN ] CX: Deleting existing primary and derivative data due to validation failure. [2025-10-15T18:19:29.075506] [INFO ] [LOCAL ] CX: Starting deletion of primary data. [2025-10-15T18:19:29.094740] [DEBUG] [LOCAL ] CX: No primary data file found to delete. [2025-10-15T18:19:29.164144] [INFO ] [LOCAL ] CX: Starting deletion of derivative data. [2025-10-15T18:19:29.194683] [DEBUG] [LOCAL ] CX: Deleted derivative data file. [2025-10-15T18:19:29.194850] [INFO ] [MAIN ] Update Progress: 576/2369 symbols completed. CX took 33.1s. Estimated remaining: 4h 7m 12s. Rate: 7.3 symbols/min [2025-10-15T18:19:29.389298] [INFO ] [REMOTE ] CXT: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:19:29.473005] [INFO ] [MAIN ] CXW: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:19:29.473236] [DEBUG] [LOCAL ] CXW: No existing data file found in primary storage. [2025-10-15T18:19:29.473307] [WARN ] [MAIN ] CXW: No existing data found, performing full refresh instead. [2025-10-15T18:19:29.473446] [INFO ] [MAIN ] CXW: Wiping existing primary data before full refresh. [2025-10-15T18:19:29.473528] [INFO ] [LOCAL ] CXW: Starting deletion of primary data. [2025-10-15T18:19:29.473794] [DEBUG] [LOCAL ] CXW: No primary data file found to delete. [2025-10-15T18:19:29.473878] [INFO ] [MAIN ] CXW: Starting full primary refresh. [2025-10-15T18:19:29.722419] [INFO ] [REMOTE ] CXT: Fetching primary data for 2024-12. [2025-10-15T18:19:29.764372] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-15T18:19:29.813780] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-15T18:19:29.898998] [INFO ] [REMOTE ] CXW: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:19:30.514047] [INFO ] [REMOTE ] CXW: Fetching primary data for 2024-12. [2025-10-15T18:19:30.920191] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-15T18:19:31.314024] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-08. [2025-10-15T18:19:31.793933] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-10-15T18:19:32.121050] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-01. [2025-10-15T18:19:32.126043] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-15T18:19:32.914048] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-09. [2025-10-15T18:19:33.497107] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-15T18:19:33.621727] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-15T18:19:33.714000] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-02. [2025-10-15T18:19:34.514015] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-01. [2025-10-15T18:19:34.786426] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-15T18:19:35.313998] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-03. [2025-10-15T18:19:35.669042] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-15T18:19:36.114006] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-02. [2025-10-15T18:19:36.352562] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-15T18:19:36.913984] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-10. [2025-10-15T18:19:37.529536] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-15T18:19:37.530711] [INFO ] [REMOTE ] CXE: Full fetch complete (11480 records). [2025-10-15T18:19:37.530784] [DEBUG] [VALIDATOR ] CXE: Validating primary data. [2025-10-15T18:19:37.708332] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-15T18:19:37.717692] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-01. [2025-10-15T18:19:37.936241] [DEBUG] [VALIDATOR ] CXE: All expected trading days are present. [2025-10-15T18:19:37.936327] [DEBUG] [VALIDATOR ] CXE: Primary data validation passed. [2025-10-15T18:19:37.936595] [INFO ] [MAIN ] CXE: Fetched primary data is valid. [2025-10-15T18:19:37.936633] [DEBUG] [LOCAL ] CXE: Saving primary data. [2025-10-15T18:19:37.937114] [DEBUG] [LOCAL ] CXE: Trimmed 11480 records to 6145 (keeping 200 days of data) [2025-10-15T18:19:37.973308] [DEBUG] [LOCAL ] CXE: Primary data saved (6145 records). [2025-10-15T18:19:37.973439] [INFO ] [MAIN ] CXE: Full history saved. [2025-10-15T18:19:37.973518] [INFO ] [MAIN ] Update Progress: 577/2369 symbols completed. CXE took 40.2s. Estimated remaining: 4h 7m 5s. Rate: 7.3 symbols/min [2025-10-15T18:19:38.145849] [INFO ] [MAIN ] CYD: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:19:38.172753] [DEBUG] [LOCAL ] CYD: Loaded 26757 existing records from primary storage. [2025-10-15T18:19:38.173007] [INFO ] [MAIN ] CYD: Loaded 26757 existing records. [2025-10-15T18:19:38.348193] [WARN ] [MAIN ] CYD: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:19:38.348429] [INFO ] [MAIN ] CYD: Wiping existing primary data before full refresh. [2025-10-15T18:19:38.348502] [INFO ] [LOCAL ] CYD: Starting deletion of primary data. [2025-10-15T18:19:38.348852] [DEBUG] [LOCAL ] CYD: Deleted primary data file. [2025-10-15T18:19:38.348920] [INFO ] [MAIN ] CYD: Starting full primary refresh. [2025-10-15T18:19:38.519859] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-03. [2025-10-15T18:19:38.702841] [INFO ] [REMOTE ] CYD: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:19:39.290235] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-15T18:19:39.313963] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-04. [2025-10-15T18:19:40.113973] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-02. [2025-10-15T18:19:40.198113] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-15T18:19:40.653150] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-15T18:19:40.914058] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-04. [2025-10-15T18:19:41.714012] [INFO ] [REMOTE ] CYD: Fetching primary data for 2024-12. [2025-10-15T18:19:42.320062] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-15T18:19:42.469465] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-10-15T18:19:42.513991] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-01. [2025-10-15T18:19:42.912706] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-01 (0.40 seconds). [2025-10-15T18:19:43.313999] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-02. [2025-10-15T18:19:43.344400] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-02 (3.23 seconds). [2025-10-15T18:19:44.088518] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-15T18:19:44.113951] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-03. [2025-10-15T18:19:44.914028] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-05. [2025-10-15T18:19:45.330017] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-15T18:19:45.714010] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-05. [2025-10-15T18:19:46.080493] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-15T18:19:46.514052] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-03. [2025-10-15T18:19:47.114436] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-15T18:19:47.313982] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-06. [2025-10-15T18:19:47.961223] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-15T18:19:48.113966] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-04. [2025-10-15T18:19:48.622817] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-15T18:19:48.913996] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-06. [2025-10-15T18:19:49.457982] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-15T18:19:49.713986] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-07. [2025-10-15T18:19:50.200249] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-15T18:19:50.514038] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-05. [2025-10-15T18:19:51.161504] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-15T18:19:51.313951] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-08. [2025-10-15T18:19:52.017270] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-15T18:19:52.113949] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-06. [2025-10-15T18:19:52.875427] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-15T18:19:52.913951] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-09. [2025-10-15T18:19:53.451520] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-15T18:19:53.713992] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-07. [2025-10-15T18:19:54.102890] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-15T18:19:54.513993] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-10. [2025-10-15T18:19:55.198695] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-15T18:19:55.314000] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-08. [2025-10-15T18:19:56.114026] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-07. [2025-10-15T18:19:56.237759] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-15T18:19:56.244016] [INFO ] [REMOTE ] CXM: Full fetch complete (68677 records). [2025-10-15T18:19:56.244195] [DEBUG] [VALIDATOR ] CXM: Validating primary data. [2025-10-15T18:19:56.710342] [DEBUG] [VALIDATOR ] CXM: All expected trading days are present. [2025-10-15T18:19:56.710577] [DEBUG] [VALIDATOR ] CXM: Primary data validation passed. [2025-10-15T18:19:56.711932] [INFO ] [MAIN ] CXM: Fetched primary data is valid. [2025-10-15T18:19:56.712070] [DEBUG] [LOCAL ] CXM: Saving primary data. [2025-10-15T18:19:56.714324] [DEBUG] [LOCAL ] CXM: Trimmed 68677 records to 47569 (keeping 200 days of data) [2025-10-15T18:19:56.746515] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-15T18:19:56.923467] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-09. [2025-10-15T18:19:57.048181] [DEBUG] [LOCAL ] CXM: Primary data saved (47569 records). [2025-10-15T18:19:57.048420] [INFO ] [MAIN ] CXM: Full history saved. [2025-10-15T18:19:57.048913] [INFO ] [MAIN ] Update Progress: 578/2369 symbols completed. CXM took 32.0s. Estimated remaining: 4h 7m 30s. Rate: 7.2 symbols/min [2025-10-15T18:19:57.235166] [INFO ] [MAIN ] CYH: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:19:57.288071] [DEBUG] [LOCAL ] CYH: Loaded 47721 existing records from primary storage. [2025-10-15T18:19:57.288545] [INFO ] [MAIN ] CYH: Loaded 47721 existing records. [2025-10-15T18:19:57.488156] [WARN ] [MAIN ] CYH: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:19:57.488573] [INFO ] [MAIN ] CYH: Wiping existing primary data before full refresh. [2025-10-15T18:19:57.488872] [INFO ] [LOCAL ] CYH: Starting deletion of primary data. [2025-10-15T18:19:57.489264] [DEBUG] [LOCAL ] CYH: Deleted primary data file. [2025-10-15T18:19:57.489318] [INFO ] [MAIN ] CYH: Starting full primary refresh. [2025-10-15T18:19:57.633328] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-15T18:19:57.724493] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-08. [2025-10-15T18:19:57.889294] [INFO ] [REMOTE ] CYH: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:19:58.281819] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-15T18:19:58.514041] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-04. [2025-10-15T18:19:58.737284] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-15T18:19:59.314076] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-10. [2025-10-15T18:19:59.909245] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-15T18:20:00.114013] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-09. [2025-10-15T18:20:00.696861] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-15T18:20:00.702773] [INFO ] [REMOTE ] CXW: Full fetch complete (65007 records). [2025-10-15T18:20:00.702941] [DEBUG] [VALIDATOR ] CXW: Validating primary data. [2025-10-15T18:20:00.919173] [INFO ] [REMOTE ] CYH: Fetching primary data for 2024-12. [2025-10-15T18:20:01.114064] [DEBUG] [VALIDATOR ] CXW: All expected trading days are present. [2025-10-15T18:20:01.114163] [DEBUG] [VALIDATOR ] CXW: Primary data validation passed. [2025-10-15T18:20:01.115128] [INFO ] [MAIN ] CXW: Fetched primary data is valid. [2025-10-15T18:20:01.115193] [DEBUG] [LOCAL ] CXW: Saving primary data. [2025-10-15T18:20:01.116676] [DEBUG] [LOCAL ] CXW: Trimmed 65007 records to 43921 (keeping 200 days of data) [2025-10-15T18:20:01.411440] [DEBUG] [LOCAL ] CXW: Primary data saved (43921 records). [2025-10-15T18:20:01.411627] [INFO ] [MAIN ] CXW: Full history saved. [2025-10-15T18:20:01.411957] [INFO ] [MAIN ] Update Progress: 579/2369 symbols completed. CXW took 32.2s. Estimated remaining: 4h 7m 10s. Rate: 7.2 symbols/min [2025-10-15T18:20:01.690811] [INFO ] [MAIN ] D: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:20:01.725740] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-05. [2025-10-15T18:20:01.731043] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-15T18:20:01.820908] [DEBUG] [LOCAL ] D: Loaded 53647 existing records from primary storage. [2025-10-15T18:20:01.821403] [INFO ] [MAIN ] D: Loaded 53647 existing records. [2025-10-15T18:20:02.101386] [WARN ] [MAIN ] D: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:20:02.101720] [INFO ] [MAIN ] D: Wiping existing primary data before full refresh. [2025-10-15T18:20:02.101799] [INFO ] [LOCAL ] D: Starting deletion of primary data. [2025-10-15T18:20:02.102391] [DEBUG] [LOCAL ] D: Deleted primary data file. [2025-10-15T18:20:02.102469] [INFO ] [MAIN ] D: Starting full primary refresh. [2025-10-15T18:20:02.519219] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-10. [2025-10-15T18:20:02.590056] [INFO ] [REMOTE ] D: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:20:02.984673] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-15T18:20:03.067949] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2024-12 (2.15 seconds). [2025-10-15T18:20:03.314043] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-01. [2025-10-15T18:20:04.002278] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-15T18:20:04.008432] [INFO ] [REMOTE ] CXT: Full fetch complete (45658 records). [2025-10-15T18:20:04.008617] [DEBUG] [VALIDATOR ] CXT: Validating primary data. [2025-10-15T18:20:04.119079] [INFO ] [REMOTE ] D: Fetching primary data for 2024-12. [2025-10-15T18:20:04.390950] [DEBUG] [VALIDATOR ] CXT: All expected trading days are present. [2025-10-15T18:20:04.391027] [DEBUG] [VALIDATOR ] CXT: Primary data validation passed. [2025-10-15T18:20:04.391716] [INFO ] [MAIN ] CXT: Fetched primary data is valid. [2025-10-15T18:20:04.391777] [DEBUG] [LOCAL ] CXT: Saving primary data. [2025-10-15T18:20:04.392718] [DEBUG] [LOCAL ] CXT: Trimmed 45658 records to 31065 (keeping 200 days of data) [2025-10-15T18:20:04.577093] [DEBUG] [LOCAL ] CXT: Primary data saved (31065 records). [2025-10-15T18:20:04.577222] [INFO ] [MAIN ] CXT: Full history saved. [2025-10-15T18:20:04.577298] [INFO ] [MAIN ] Update Progress: 580/2369 symbols completed. CXT took 36.1s. Estimated remaining: 4h 6m 46s. Rate: 7.2 symbols/min [2025-10-15T18:20:04.747133] [INFO ] [MAIN ] DAC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:20:04.747308] [DEBUG] [LOCAL ] DAC: No existing data file found in primary storage. [2025-10-15T18:20:04.747345] [WARN ] [MAIN ] DAC: No existing data found, performing full refresh instead. [2025-10-15T18:20:04.747452] [INFO ] [MAIN ] DAC: Wiping existing primary data before full refresh. [2025-10-15T18:20:04.747493] [INFO ] [LOCAL ] DAC: Starting deletion of primary data. [2025-10-15T18:20:04.747534] [DEBUG] [LOCAL ] DAC: No primary data file found to delete. [2025-10-15T18:20:04.747566] [INFO ] [MAIN ] DAC: Starting full primary refresh. [2025-10-15T18:20:04.919626] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-06. [2025-10-15T18:20:05.126777] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-15T18:20:05.150176] [INFO ] [REMOTE ] DAC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:20:05.714003] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-02. [2025-10-15T18:20:05.860021] [INFO ] [REMOTE ] D: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-15T18:20:05.949952] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-15T18:20:06.513970] [INFO ] [REMOTE ] D: Fetching primary data for 2025-01. [2025-10-15T18:20:07.141149] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-15T18:20:07.314177] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-07. [2025-10-15T18:20:08.114182] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-03. [2025-10-15T18:20:08.146107] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-15T18:20:08.440376] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-15T18:20:08.914010] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-08. [2025-10-15T18:20:09.719256] [INFO ] [REMOTE ] D: Fetching primary data for 2025-02. [2025-10-15T18:20:09.736391] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-15T18:20:10.167687] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-15T18:20:10.514225] [INFO ] [REMOTE ] DAC: Fetching primary data for 2024-12. [2025-10-15T18:20:11.252780] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-15T18:20:11.257196] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-10-15T18:20:11.313951] [INFO ] [REMOTE ] D: Fetching primary data for 2025-03. [2025-10-15T18:20:12.114034] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-09. [2025-10-15T18:20:12.914016] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-01. [2025-10-15T18:20:13.120558] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-15T18:20:13.439756] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-15T18:20:13.713976] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-10. [2025-10-15T18:20:13.748495] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-15T18:20:14.514021] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-02. [2025-10-15T18:20:15.314000] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-04. [2025-10-15T18:20:15.525486] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-15T18:20:16.114704] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-03. [2025-10-15T18:20:16.116503] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-10 (2.40 seconds). [2025-10-15T18:20:16.121260] [INFO ] [REMOTE ] CYD: Full fetch complete (34930 records). [2025-10-15T18:20:16.121364] [DEBUG] [VALIDATOR ] CYD: Validating primary data. [2025-10-15T18:20:16.489212] [DEBUG] [VALIDATOR ] CYD: All expected trading days are present. [2025-10-15T18:20:16.489288] [DEBUG] [VALIDATOR ] CYD: Primary data validation passed. [2025-10-15T18:20:16.489886] [INFO ] [MAIN ] CYD: Fetched primary data is valid. [2025-10-15T18:20:16.489949] [DEBUG] [LOCAL ] CYD: Saving primary data. [2025-10-15T18:20:16.490720] [DEBUG] [LOCAL ] CYD: Trimmed 34930 records to 26842 (keeping 200 days of data) [2025-10-15T18:20:16.644908] [DEBUG] [LOCAL ] CYD: Primary data saved (26842 records). [2025-10-15T18:20:16.645035] [INFO ] [MAIN ] CYD: Full history saved. [2025-10-15T18:20:16.645108] [INFO ] [MAIN ] Update Progress: 581/2369 symbols completed. CYD took 38.7s. Estimated remaining: 4h 6m 49s. Rate: 7.2 symbols/min [2025-10-15T18:20:16.815153] [INFO ] [MAIN ] DAL: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:20:16.815301] [DEBUG] [LOCAL ] DAL: No existing data file found in primary storage. [2025-10-15T18:20:16.815338] [WARN ] [MAIN ] DAL: No existing data found, performing full refresh instead. [2025-10-15T18:20:16.815446] [INFO ] [MAIN ] DAL: Wiping existing primary data before full refresh. [2025-10-15T18:20:16.815513] [INFO ] [LOCAL ] DAL: Starting deletion of primary data. [2025-10-15T18:20:16.815574] [DEBUG] [LOCAL ] DAL: No primary data file found to delete. [2025-10-15T18:20:16.815618] [INFO ] [MAIN ] DAL: Starting full primary refresh. [2025-10-15T18:20:16.919546] [INFO ] [REMOTE ] D: Fetching primary data for 2025-04. [2025-10-15T18:20:16.924515] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-15T18:20:17.174718] [INFO ] [REMOTE ] DAL: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:20:17.376435] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-10-15T18:20:17.714072] [INFO ] [REMOTE ] DAL: Fetching primary data for 2024-12. [2025-10-15T18:20:18.514050] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-04. [2025-10-15T18:20:19.314066] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-05. [2025-10-15T18:20:19.355486] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-15T18:20:19.990767] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2024-12 (2.28 seconds). [2025-10-15T18:20:20.114026] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-05. [2025-10-15T18:20:20.352726] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-04 (3.43 seconds). [2025-10-15T18:20:20.865254] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-15T18:20:20.913958] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-06. [2025-10-15T18:20:21.172260] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-15T18:20:21.713977] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-06. [2025-10-15T18:20:21.741161] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-15T18:20:22.514055] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-01. [2025-10-15T18:20:23.090826] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-15T18:20:23.314014] [INFO ] [REMOTE ] D: Fetching primary data for 2025-05. [2025-10-15T18:20:24.114008] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-07. [2025-10-15T18:20:24.322286] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-15T18:20:24.918511] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-02. [2025-10-15T18:20:24.926222] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-15T18:20:25.008270] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-15T18:20:25.714006] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-07. [2025-10-15T18:20:26.514055] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-08. [2025-10-15T18:20:26.650400] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-15T18:20:27.323465] [INFO ] [REMOTE ] D: Fetching primary data for 2025-06. [2025-10-15T18:20:27.352422] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-15T18:20:27.504734] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-15T18:20:28.114032] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-09. [2025-10-15T18:20:28.697308] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-15T18:20:28.913985] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-03. [2025-10-15T18:20:29.149459] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-15T18:20:29.713983] [INFO ] [REMOTE ] D: Fetching primary data for 2025-07. [2025-10-15T18:20:30.514048] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-08. [2025-10-15T18:20:31.311875] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-03 (2.40 seconds). [2025-10-15T18:20:31.314185] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-10. [2025-10-15T18:20:31.798210] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-10-15T18:20:31.837726] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-15T18:20:32.113969] [INFO ] [REMOTE ] D: Fetching primary data for 2025-08. [2025-10-15T18:20:32.186354] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-15T18:20:32.188328] [INFO ] [REMOTE ] DAC: Full fetch complete (19353 records). [2025-10-15T18:20:32.188416] [DEBUG] [VALIDATOR ] DAC: Validating primary data. [2025-10-15T18:20:32.539381] [DEBUG] [VALIDATOR ] DAC: All expected trading days are present. [2025-10-15T18:20:32.539459] [DEBUG] [VALIDATOR ] DAC: Primary data validation passed. [2025-10-15T18:20:32.540018] [INFO ] [MAIN ] DAC: Fetched primary data is valid. [2025-10-15T18:20:32.540079] [DEBUG] [LOCAL ] DAC: Saving primary data. [2025-10-15T18:20:32.540612] [DEBUG] [LOCAL ] DAC: Trimmed 19353 records to 12616 (keeping 200 days of data) [2025-10-15T18:20:32.618006] [DEBUG] [LOCAL ] DAC: Primary data saved (12616 records). [2025-10-15T18:20:32.618156] [INFO ] [MAIN ] DAC: Full history saved. [2025-10-15T18:20:32.618228] [INFO ] [MAIN ] Update Progress: 582/2369 symbols completed. DAC took 28.0s. Estimated remaining: 4h 7m 4s. Rate: 7.2 symbols/min [2025-10-15T18:20:32.783258] [INFO ] [MAIN ] DAN: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:20:32.783421] [DEBUG] [LOCAL ] DAN: No existing data file found in primary storage. [2025-10-15T18:20:32.783470] [WARN ] [MAIN ] DAN: No existing data found, performing full refresh instead. [2025-10-15T18:20:32.783577] [INFO ] [MAIN ] DAN: Wiping existing primary data before full refresh. [2025-10-15T18:20:32.783618] [INFO ] [LOCAL ] DAN: Starting deletion of primary data. [2025-10-15T18:20:32.783697] [DEBUG] [LOCAL ] DAN: No primary data file found to delete. [2025-10-15T18:20:32.783742] [INFO ] [MAIN ] DAN: Starting full primary refresh. [2025-10-15T18:20:32.919140] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-04. [2025-10-15T18:20:33.131721] [INFO ] [REMOTE ] DAN: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:20:33.634768] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-15T18:20:33.713978] [INFO ] [REMOTE ] D: Fetching primary data for 2025-09. [2025-10-15T18:20:34.513994] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-09. [2025-10-15T18:20:35.314076] [INFO ] [REMOTE ] DAN: Fetching primary data for 2024-12. [2025-10-15T18:20:35.406378] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-04 (2.49 seconds). [2025-10-15T18:20:35.419434] [DEBUG] [REMOTE ] DAN: Error fetching primary data for 2024-12: 'API call returned an empty response.' [2025-10-15T18:20:35.420343] [WARN ] [REMOTE ] DAN: No data returned for month 2024-12 [2025-10-15T18:20:35.420446] [FATAL] [REMOTE ] DAN: API call failed - aborting fetch to avoid wasting further API calls [2025-10-15T18:20:35.420547] [FATAL] [MAIN ] DAN: Failed to fetch primary data. [2025-10-15T18:20:35.420614] [WARN ] [MAIN ] DAN: Deleting existing primary and derivative data due to fetch failure. [2025-10-15T18:20:35.420720] [INFO ] [LOCAL ] DAN: Starting deletion of primary data. [2025-10-15T18:20:35.420794] [DEBUG] [LOCAL ] DAN: No primary data file found to delete. [2025-10-15T18:20:35.420832] [INFO ] [LOCAL ] DAN: Starting deletion of derivative data. [2025-10-15T18:20:35.420871] [DEBUG] [LOCAL ] DAN: No derivative data file found to delete. [2025-10-15T18:20:35.420924] [INFO ] [MAIN ] Update Progress: 583/2369 symbols completed. DAN took 2.8s. Estimated remaining: 4h 6m 39s. Rate: 7.2 symbols/min [2025-10-15T18:20:35.592164] [INFO ] [MAIN ] DAO: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:20:35.631673] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-15T18:20:35.650721] [DEBUG] [LOCAL ] DAO: Loaded 19845 existing records from primary storage. [2025-10-15T18:20:35.651061] [INFO ] [MAIN ] DAO: Loaded 19845 existing records. [2025-10-15T18:20:35.836613] [WARN ] [MAIN ] DAO: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:20:35.836981] [INFO ] [MAIN ] DAO: Wiping existing primary data before full refresh. [2025-10-15T18:20:35.837059] [INFO ] [LOCAL ] DAO: Starting deletion of primary data. [2025-10-15T18:20:35.837396] [DEBUG] [LOCAL ] DAO: Deleted primary data file. [2025-10-15T18:20:35.837463] [INFO ] [MAIN ] DAO: Starting full primary refresh. [2025-10-15T18:20:35.965231] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-15T18:20:36.119180] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-10. [2025-10-15T18:20:36.225465] [INFO ] [REMOTE ] DAO: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:20:36.914006] [INFO ] [REMOTE ] DAO: Fetching primary data for 2024-12. [2025-10-15T18:20:37.711355] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-15T18:20:37.716801] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-05. [2025-10-15T18:20:37.718512] [INFO ] [REMOTE ] CYH: Full fetch complete (69944 records). [2025-10-15T18:20:37.718631] [DEBUG] [VALIDATOR ] CYH: Validating primary data. [2025-10-15T18:20:38.109409] [DEBUG] [VALIDATOR ] CYH: All expected trading days are present. [2025-10-15T18:20:38.109485] [DEBUG] [VALIDATOR ] CYH: Primary data validation passed. [2025-10-15T18:20:38.110356] [INFO ] [MAIN ] CYH: Fetched primary data is valid. [2025-10-15T18:20:38.110419] [DEBUG] [LOCAL ] CYH: Saving primary data. [2025-10-15T18:20:38.111704] [DEBUG] [LOCAL ] CYH: Trimmed 69944 records to 47734 (keeping 200 days of data) [2025-10-15T18:20:38.225783] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-15T18:20:38.391877] [DEBUG] [LOCAL ] CYH: Primary data saved (47734 records). [2025-10-15T18:20:38.392010] [INFO ] [MAIN ] CYH: Full history saved. [2025-10-15T18:20:38.392238] [INFO ] [MAIN ] Update Progress: 584/2369 symbols completed. CYH took 41.3s. Estimated remaining: 4h 6m 15s. Rate: 7.2 symbols/min [2025-10-15T18:20:38.527428] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-01. [2025-10-15T18:20:38.558592] [INFO ] [MAIN ] DAR: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:20:38.606595] [DEBUG] [LOCAL ] DAR: Loaded 51977 existing records from primary storage. [2025-10-15T18:20:38.606924] [INFO ] [MAIN ] DAR: Loaded 51977 existing records. [2025-10-15T18:20:38.775926] [WARN ] [MAIN ] DAR: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:20:38.776148] [INFO ] [MAIN ] DAR: Wiping existing primary data before full refresh. [2025-10-15T18:20:38.776203] [INFO ] [LOCAL ] DAR: Starting deletion of primary data. [2025-10-15T18:20:38.776993] [DEBUG] [LOCAL ] DAR: Deleted primary data file. [2025-10-15T18:20:38.777052] [INFO ] [MAIN ] DAR: Starting full primary refresh. [2025-10-15T18:20:39.119006] [INFO ] [REMOTE ] DAR: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:20:39.313956] [INFO ] [REMOTE ] DAR: Fetching primary data for 2024-12. [2025-10-15T18:20:39.552413] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-15T18:20:40.113968] [INFO ] [REMOTE ] D: Fetching primary data for 2025-10. [2025-10-15T18:20:40.156724] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-05 (2.44 seconds). [2025-10-15T18:20:40.913996] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-06. [2025-10-15T18:20:40.982437] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-15T18:20:40.988959] [INFO ] [REMOTE ] D: Full fetch complete (77812 records). [2025-10-15T18:20:40.989097] [DEBUG] [VALIDATOR ] D: Validating primary data. [2025-10-15T18:20:41.324177] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-10-15T18:20:41.428663] [DEBUG] [VALIDATOR ] D: All expected trading days are present. [2025-10-15T18:20:41.428772] [DEBUG] [VALIDATOR ] D: Primary data validation passed. [2025-10-15T18:20:41.429717] [INFO ] [MAIN ] D: Fetched primary data is valid. [2025-10-15T18:20:41.429780] [DEBUG] [LOCAL ] D: Saving primary data. [2025-10-15T18:20:41.431193] [DEBUG] [LOCAL ] D: Trimmed 77812 records to 53646 (keeping 200 days of data) [2025-10-15T18:20:41.730725] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-02. [2025-10-15T18:20:41.756215] [DEBUG] [LOCAL ] D: Primary data saved (53646 records). [2025-10-15T18:20:41.756357] [INFO ] [MAIN ] D: Full history saved. [2025-10-15T18:20:41.757478] [INFO ] [MAIN ] Update Progress: 585/2369 symbols completed. D took 40.3s. Estimated remaining: 4h 5m 51s. Rate: 7.3 symbols/min [2025-10-15T18:20:41.921634] [INFO ] [MAIN ] DAVA: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:20:41.959737] [DEBUG] [LOCAL ] DAVA: Loaded 41776 existing records from primary storage. [2025-10-15T18:20:41.960038] [INFO ] [MAIN ] DAVA: Loaded 41776 existing records. [2025-10-15T18:20:42.131698] [WARN ] [MAIN ] DAVA: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:20:42.131931] [INFO ] [MAIN ] DAVA: Wiping existing primary data before full refresh. [2025-10-15T18:20:42.131978] [INFO ] [LOCAL ] DAVA: Starting deletion of primary data. [2025-10-15T18:20:42.132692] [DEBUG] [LOCAL ] DAVA: Deleted primary data file. [2025-10-15T18:20:42.132750] [INFO ] [MAIN ] DAVA: Starting full primary refresh. [2025-10-15T18:20:42.479225] [INFO ] [REMOTE ] DAVA: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:20:42.513950] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2024-12. [2025-10-15T18:20:42.920122] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-10-15T18:20:43.019184] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-15T18:20:43.314005] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-03. [2025-10-15T18:20:43.604398] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-15T18:20:44.114047] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-01. [2025-10-15T18:20:44.388090] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-15T18:20:44.913992] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-04. [2025-10-15T18:20:45.360300] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-15T18:20:45.642981] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-15T18:20:45.713973] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-05. [2025-10-15T18:20:46.514077] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-02. [2025-10-15T18:20:47.037268] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-15T18:20:47.314002] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-06. [2025-10-15T18:20:47.968955] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-15T18:20:47.986766] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-15T18:20:48.114002] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-03. [2025-10-15T18:20:48.913989] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-07. [2025-10-15T18:20:49.270781] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-15T18:20:49.711618] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-15T18:20:49.715015] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-04. [2025-10-15T18:20:50.514014] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-01. [2025-10-15T18:20:51.008298] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-15T18:20:51.314020] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-08. [2025-10-15T18:20:52.114030] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-07. [2025-10-15T18:20:52.270778] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-15T18:20:52.347080] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-15T18:20:52.914000] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-09. [2025-10-15T18:20:53.713971] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-02. [2025-10-15T18:20:54.025083] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-15T18:20:54.498111] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-07 (2.38 seconds). [2025-10-15T18:20:54.513952] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-08. [2025-10-15T18:20:55.314005] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-05. [2025-10-15T18:20:55.356272] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-15T18:20:56.114089] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-03. [2025-10-15T18:20:56.638244] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-08 (2.12 seconds). [2025-10-15T18:20:56.913988] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-10. [2025-10-15T18:20:57.008819] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-15T18:20:57.714010] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-06. [2025-10-15T18:20:57.791785] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-15T18:20:57.825598] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-15T18:20:57.829267] [INFO ] [REMOTE ] DAO: Full fetch complete (32308 records). [2025-10-15T18:20:57.829397] [DEBUG] [VALIDATOR ] DAO: Validating primary data. [2025-10-15T18:20:58.219909] [DEBUG] [VALIDATOR ] DAO: All expected trading days are present. [2025-10-15T18:20:58.219990] [DEBUG] [VALIDATOR ] DAO: Primary data validation passed. [2025-10-15T18:20:58.220663] [INFO ] [MAIN ] DAO: Fetched primary data is valid. [2025-10-15T18:20:58.220726] [DEBUG] [LOCAL ] DAO: Saving primary data. [2025-10-15T18:20:58.221597] [DEBUG] [LOCAL ] DAO: Trimmed 32308 records to 19797 (keeping 200 days of data) [2025-10-15T18:20:58.330677] [DEBUG] [LOCAL ] DAO: Primary data saved (19797 records). [2025-10-15T18:20:58.330836] [INFO ] [MAIN ] DAO: Full history saved. [2025-10-15T18:20:58.330922] [INFO ] [MAIN ] Update Progress: 586/2369 symbols completed. DAO took 22.9s. Estimated remaining: 4h 6m 8s. Rate: 7.2 symbols/min [2025-10-15T18:20:58.512053] [INFO ] [MAIN ] DAY: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:20:58.512245] [DEBUG] [LOCAL ] DAY: No existing data file found in primary storage. [2025-10-15T18:20:58.512301] [WARN ] [MAIN ] DAY: No existing data found, performing full refresh instead. [2025-10-15T18:20:58.512422] [INFO ] [MAIN ] DAY: Wiping existing primary data before full refresh. [2025-10-15T18:20:58.512465] [INFO ] [LOCAL ] DAY: Starting deletion of primary data. [2025-10-15T18:20:58.512507] [DEBUG] [LOCAL ] DAY: No primary data file found to delete. [2025-10-15T18:20:58.512541] [INFO ] [MAIN ] DAY: Starting full primary refresh. [2025-10-15T18:20:58.524020] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-04. [2025-10-15T18:20:58.923815] [INFO ] [REMOTE ] DAY: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:20:59.245310] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-15T18:20:59.314037] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-07. [2025-10-15T18:21:00.113977] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-09. [2025-10-15T18:21:00.252878] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-15T18:21:00.506929] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-15T18:21:00.914005] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-08. [2025-10-15T18:21:01.714058] [INFO ] [REMOTE ] DAY: Fetching primary data for 2024-12. [2025-10-15T18:21:02.050255] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-15T18:21:02.145240] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-10-15T18:21:02.514017] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-05. [2025-10-15T18:21:03.314000] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-10. [2025-10-15T18:21:03.324945] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-15T18:21:04.009002] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-15T18:21:04.033636] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-15T18:21:04.041292] [INFO ] [REMOTE ] DAL: Full fetch complete (77928 records). [2025-10-15T18:21:04.041467] [DEBUG] [VALIDATOR ] DAL: Validating primary data. [2025-10-15T18:21:04.119132] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-01. [2025-10-15T18:21:04.449957] [DEBUG] [VALIDATOR ] DAL: All expected trading days are present. [2025-10-15T18:21:04.450092] [DEBUG] [VALIDATOR ] DAL: Primary data validation passed. [2025-10-15T18:21:04.451083] [INFO ] [MAIN ] DAL: Fetched primary data is valid. [2025-10-15T18:21:04.451161] [DEBUG] [LOCAL ] DAL: Saving primary data. [2025-10-15T18:21:04.452721] [DEBUG] [LOCAL ] DAL: Trimmed 77928 records to 53753 (keeping 200 days of data) [2025-10-15T18:21:04.770112] [DEBUG] [LOCAL ] DAL: Primary data saved (53753 records). [2025-10-15T18:21:04.770254] [INFO ] [MAIN ] DAL: Full history saved. [2025-10-15T18:21:04.770326] [INFO ] [MAIN ] Update Progress: 587/2369 symbols completed. DAL took 48.1s. Estimated remaining: 4h 5m 55s. Rate: 7.2 symbols/min [2025-10-15T18:21:04.919130] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-06. [2025-10-15T18:21:04.945337] [INFO ] [MAIN ] DB: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:21:04.994139] [DEBUG] [LOCAL ] DB: Loaded 52500 existing records from primary storage. [2025-10-15T18:21:04.994457] [INFO ] [MAIN ] DB: Loaded 52500 existing records. [2025-10-15T18:21:05.176498] [WARN ] [MAIN ] DB: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:21:05.176778] [INFO ] [MAIN ] DB: Wiping existing primary data before full refresh. [2025-10-15T18:21:05.176837] [INFO ] [LOCAL ] DB: Starting deletion of primary data. [2025-10-15T18:21:05.177794] [DEBUG] [LOCAL ] DB: Deleted primary data file. [2025-10-15T18:21:05.177857] [INFO ] [MAIN ] DB: Starting full primary refresh. [2025-10-15T18:21:05.552904] [INFO ] [REMOTE ] DB: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:21:05.598150] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-15T18:21:05.713994] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-02. [2025-10-15T18:21:06.287983] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-15T18:21:06.514042] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-07. [2025-10-15T18:21:06.912757] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-15T18:21:07.314027] [INFO ] [REMOTE ] DB: Fetching primary data for 2024-12. [2025-10-15T18:21:08.114044] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-09. [2025-10-15T18:21:08.263895] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-15T18:21:08.739054] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-15T18:21:08.914026] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-03. [2025-10-15T18:21:09.713990] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-08. [2025-10-15T18:21:09.994238] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-15T18:21:10.514023] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-10. [2025-10-15T18:21:10.568041] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-15T18:21:11.225169] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-15T18:21:11.313948] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-09. [2025-10-15T18:21:12.113979] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-01. [2025-10-15T18:21:12.253418] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-15T18:21:12.259124] [INFO ] [REMOTE ] DAVA: Full fetch complete (56922 records). [2025-10-15T18:21:12.259225] [DEBUG] [VALIDATOR ] DAVA: Validating primary data. [2025-10-15T18:21:12.645191] [DEBUG] [VALIDATOR ] DAVA: All expected trading days are present. [2025-10-15T18:21:12.645273] [DEBUG] [VALIDATOR ] DAVA: Primary data validation passed. [2025-10-15T18:21:12.646144] [INFO ] [MAIN ] DAVA: Fetched primary data is valid. [2025-10-15T18:21:12.646208] [DEBUG] [LOCAL ] DAVA: Saving primary data. [2025-10-15T18:21:12.650285] [DEBUG] [LOCAL ] DAVA: Trimmed 56922 records to 41847 (keeping 200 days of data) [2025-10-15T18:21:12.899576] [DEBUG] [LOCAL ] DAVA: Primary data saved (41847 records). [2025-10-15T18:21:12.899828] [INFO ] [MAIN ] DAVA: Full history saved. [2025-10-15T18:21:12.900090] [INFO ] [MAIN ] Update Progress: 588/2369 symbols completed. DAVA took 31.1s. Estimated remaining: 4h 5m 46s. Rate: 7.2 symbols/min [2025-10-15T18:21:12.936259] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-04. [2025-10-15T18:21:13.075693] [INFO ] [MAIN ] DBD: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:21:13.075948] [DEBUG] [LOCAL ] DBD: No existing data file found in primary storage. [2025-10-15T18:21:13.076040] [WARN ] [MAIN ] DBD: No existing data found, performing full refresh instead. [2025-10-15T18:21:13.076288] [INFO ] [MAIN ] DBD: Wiping existing primary data before full refresh. [2025-10-15T18:21:13.076333] [INFO ] [LOCAL ] DBD: Starting deletion of primary data. [2025-10-15T18:21:13.103796] [DEBUG] [LOCAL ] DBD: No primary data file found to delete. [2025-10-15T18:21:13.103909] [INFO ] [MAIN ] DBD: Starting full primary refresh. [2025-10-15T18:21:13.172992] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-15T18:21:13.470755] [INFO ] [REMOTE ] DBD: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:21:13.714024] [INFO ] [REMOTE ] DBD: Fetching primary data for 2024-12. [2025-10-15T18:21:13.862516] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-15T18:21:14.441199] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-10-15T18:21:14.513955] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-02. [2025-10-15T18:21:14.854062] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-15T18:21:15.313993] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-10. [2025-10-15T18:21:16.039034] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-15T18:21:16.113966] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-03. [2025-10-15T18:21:16.914051] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-05. [2025-10-15T18:21:17.171914] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-10 (1.86 seconds). [2025-10-15T18:21:17.178200] [INFO ] [REMOTE ] DAR: Full fetch complete (74918 records). [2025-10-15T18:21:17.178336] [DEBUG] [VALIDATOR ] DAR: Validating primary data. [2025-10-15T18:21:17.572915] [DEBUG] [VALIDATOR ] DAR: All expected trading days are present. [2025-10-15T18:21:17.573040] [DEBUG] [VALIDATOR ] DAR: Primary data validation passed. [2025-10-15T18:21:17.574069] [INFO ] [MAIN ] DAR: Fetched primary data is valid. [2025-10-15T18:21:17.574132] [DEBUG] [LOCAL ] DAR: Saving primary data. [2025-10-15T18:21:17.575807] [DEBUG] [LOCAL ] DAR: Trimmed 74918 records to 51991 (keeping 200 days of data) [2025-10-15T18:21:17.755592] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-01. [2025-10-15T18:21:17.826311] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-15T18:21:17.935061] [DEBUG] [LOCAL ] DAR: Primary data saved (51991 records). [2025-10-15T18:21:17.935195] [INFO ] [MAIN ] DAR: Full history saved. [2025-10-15T18:21:17.935562] [INFO ] [MAIN ] Update Progress: 589/2369 symbols completed. DAR took 39.5s. Estimated remaining: 4h 5m 28s. Rate: 7.3 symbols/min [2025-10-15T18:21:18.101190] [INFO ] [MAIN ] DBI: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:21:18.101345] [DEBUG] [LOCAL ] DBI: No existing data file found in primary storage. [2025-10-15T18:21:18.101382] [WARN ] [MAIN ] DBI: No existing data found, performing full refresh instead. [2025-10-15T18:21:18.101486] [INFO ] [MAIN ] DBI: Wiping existing primary data before full refresh. [2025-10-15T18:21:18.101527] [INFO ] [LOCAL ] DBI: Starting deletion of primary data. [2025-10-15T18:21:18.101571] [DEBUG] [LOCAL ] DBI: No primary data file found to delete. [2025-10-15T18:21:18.101603] [INFO ] [MAIN ] DBI: Starting full primary refresh. [2025-10-15T18:21:18.491931] [INFO ] [REMOTE ] DBI: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:21:18.513947] [INFO ] [REMOTE ] DBI: Fetching primary data for 2024-12. [2025-10-15T18:21:18.539304] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-15T18:21:18.626306] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-15T18:21:19.313995] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-02. [2025-10-15T18:21:20.114013] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-04. [2025-10-15T18:21:20.393529] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-10-15T18:21:20.430272] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-15T18:21:20.913991] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-06. [2025-10-15T18:21:21.714001] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-03. [2025-10-15T18:21:22.035782] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-15T18:21:22.257754] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-15T18:21:22.513996] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-05. [2025-10-15T18:21:22.803419] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-15T18:21:23.314016] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-01. [2025-10-15T18:21:24.114012] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-04. [2025-10-15T18:21:24.160698] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-15T18:21:24.876593] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-15T18:21:24.913952] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-02. [2025-10-15T18:21:24.990434] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-15T18:21:25.714017] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-05. [2025-10-15T18:21:26.445100] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-15T18:21:26.513980] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-07. [2025-10-15T18:21:26.731278] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-15T18:21:27.314008] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-06. [2025-10-15T18:21:28.114031] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-03. [2025-10-15T18:21:28.341228] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-15T18:21:28.532016] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-15T18:21:28.914041] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-07. [2025-10-15T18:21:29.487071] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-15T18:21:29.714150] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-08. [2025-10-15T18:21:29.925244] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-15T18:21:30.514045] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-08. [2025-10-15T18:21:31.122516] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-15T18:21:31.313972] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-09. [2025-10-15T18:21:31.355905] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-15T18:21:32.113996] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-09. [2025-10-15T18:21:32.914291] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-04. [2025-10-15T18:21:32.919522] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-15T18:21:33.241881] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-15T18:21:33.714011] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-10. [2025-10-15T18:21:34.276050] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-15T18:21:34.513993] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-06. [2025-10-15T18:21:34.993828] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-15T18:21:34.996906] [INFO ] [REMOTE ] DBD: Full fetch complete (31464 records). [2025-10-15T18:21:34.997023] [DEBUG] [VALIDATOR ] DBD: Validating primary data. [2025-10-15T18:21:34.997542] [FATAL] [VALIDATOR ] DBD: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T18:21:34.997666] [FATAL] [MAIN ] DBD: Fetched primary data is invalid. Refusing to save it. [2025-10-15T18:21:34.997727] [WARN ] [MAIN ] DBD: Deleting existing primary and derivative data due to validation failure. [2025-10-15T18:21:34.997798] [INFO ] [LOCAL ] DBD: Starting deletion of primary data. [2025-10-15T18:21:34.997872] [DEBUG] [LOCAL ] DBD: No primary data file found to delete. [2025-10-15T18:21:34.997933] [INFO ] [LOCAL ] DBD: Starting deletion of derivative data. [2025-10-15T18:21:34.998021] [DEBUG] [LOCAL ] DBD: No derivative data file found to delete. [2025-10-15T18:21:34.998112] [INFO ] [MAIN ] Update Progress: 590/2369 symbols completed. DBD took 22.1s. Estimated remaining: 4h 5m 46s. Rate: 7.2 symbols/min [2025-10-15T18:21:35.167141] [INFO ] [MAIN ] DBL: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:21:35.178749] [DEBUG] [LOCAL ] DBL: Loaded 9380 existing records from primary storage. [2025-10-15T18:21:35.178971] [INFO ] [MAIN ] DBL: Loaded 9380 existing records. [2025-10-15T18:21:35.319137] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-10. [2025-10-15T18:21:35.357189] [WARN ] [MAIN ] DBL: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:21:35.357440] [INFO ] [MAIN ] DBL: Wiping existing primary data before full refresh. [2025-10-15T18:21:35.357500] [INFO ] [LOCAL ] DBL: Starting deletion of primary data. [2025-10-15T18:21:35.357853] [DEBUG] [LOCAL ] DBL: Deleted primary data file. [2025-10-15T18:21:35.357910] [INFO ] [MAIN ] DBL: Starting full primary refresh. [2025-10-15T18:21:35.700910] [INFO ] [REMOTE ] DBL: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:21:36.114014] [INFO ] [REMOTE ] DBL: Fetching primary data for 2024-12. [2025-10-15T18:21:36.269423] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-15T18:21:36.850406] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-15T18:21:36.857743] [INFO ] [REMOTE ] DAY: Full fetch complete (71380 records). [2025-10-15T18:21:36.857928] [DEBUG] [VALIDATOR ] DAY: Validating primary data. [2025-10-15T18:21:36.858879] [FATAL] [VALIDATOR ] DAY: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T18:21:36.858973] [FATAL] [MAIN ] DAY: Fetched primary data is invalid. Refusing to save it. [2025-10-15T18:21:36.859017] [WARN ] [MAIN ] DAY: Deleting existing primary and derivative data due to validation failure. [2025-10-15T18:21:36.859063] [INFO ] [LOCAL ] DAY: Starting deletion of primary data. [2025-10-15T18:21:36.859156] [DEBUG] [LOCAL ] DAY: No primary data file found to delete. [2025-10-15T18:21:36.859215] [INFO ] [LOCAL ] DAY: Starting deletion of derivative data. [2025-10-15T18:21:36.859260] [DEBUG] [LOCAL ] DAY: No derivative data file found to delete. [2025-10-15T18:21:36.859320] [INFO ] [MAIN ] Update Progress: 591/2369 symbols completed. DAY took 38.5s. Estimated remaining: 4h 5m 18s. Rate: 7.2 symbols/min [2025-10-15T18:21:36.919202] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-07. [2025-10-15T18:21:36.976917] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-10-15T18:21:37.062870] [INFO ] [MAIN ] DBRG: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:21:37.111742] [DEBUG] [LOCAL ] DBRG: Loaded 49878 existing records from primary storage. [2025-10-15T18:21:37.112067] [INFO ] [MAIN ] DBRG: Loaded 49878 existing records. [2025-10-15T18:21:37.281898] [WARN ] [MAIN ] DBRG: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:21:37.282106] [INFO ] [MAIN ] DBRG: Wiping existing primary data before full refresh. [2025-10-15T18:21:37.282156] [INFO ] [LOCAL ] DBRG: Starting deletion of primary data. [2025-10-15T18:21:37.282930] [DEBUG] [LOCAL ] DBRG: Deleted primary data file. [2025-10-15T18:21:37.282987] [INFO ] [MAIN ] DBRG: Starting full primary refresh. [2025-10-15T18:21:37.641178] [INFO ] [REMOTE ] DBRG: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:21:37.714002] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-01. [2025-10-15T18:21:38.287713] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-15T18:21:38.513969] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-02. [2025-10-15T18:21:38.715749] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-15T18:21:39.306811] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-15T18:21:39.313946] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-03. [2025-10-15T18:21:39.927185] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-15T18:21:40.113988] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-08. [2025-10-15T18:21:40.914036] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-04. [2025-10-15T18:21:41.699132] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-15T18:21:41.713982] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-05. [2025-10-15T18:21:42.159425] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-08 (2.05 seconds). [2025-10-15T18:21:42.427054] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-15T18:21:42.514026] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-09. [2025-10-15T18:21:43.313968] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-06. [2025-10-15T18:21:43.917323] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-15T18:21:44.114040] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-07. [2025-10-15T18:21:44.347297] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-15T18:21:44.662388] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-10-15T18:21:44.913984] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-05. [2025-10-15T18:21:45.714001] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-10. [2025-10-15T18:21:46.269148] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-15T18:21:46.514003] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2024-12. [2025-10-15T18:21:47.314013] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-08. [2025-10-15T18:21:47.631531] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-10 (1.92 seconds). [2025-10-15T18:21:47.638086] [INFO ] [REMOTE ] DB: Full fetch complete (75295 records). [2025-10-15T18:21:47.638252] [DEBUG] [VALIDATOR ] DB: Validating primary data. [2025-10-15T18:21:48.035832] [DEBUG] [VALIDATOR ] DB: All expected trading days are present. [2025-10-15T18:21:48.036102] [DEBUG] [VALIDATOR ] DB: Primary data validation passed. [2025-10-15T18:21:48.037209] [INFO ] [MAIN ] DB: Fetched primary data is valid. [2025-10-15T18:21:48.037326] [DEBUG] [LOCAL ] DB: Saving primary data. [2025-10-15T18:21:48.039735] [DEBUG] [LOCAL ] DB: Trimmed 75295 records to 52503 (keeping 200 days of data) [2025-10-15T18:21:48.132343] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-06. [2025-10-15T18:21:48.149074] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-15T18:21:48.189603] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-15T18:21:48.451765] [DEBUG] [LOCAL ] DB: Primary data saved (52503 records). [2025-10-15T18:21:48.451919] [INFO ] [MAIN ] DB: Full history saved. [2025-10-15T18:21:48.452006] [INFO ] [MAIN ] Update Progress: 592/2369 symbols completed. DB took 43.7s. Estimated remaining: 4h 5m 20s. Rate: 7.2 symbols/min [2025-10-15T18:21:48.635848] [INFO ] [MAIN ] DCI: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:21:48.673288] [DEBUG] [LOCAL ] DCI: Loaded 37060 existing records from primary storage. [2025-10-15T18:21:48.673622] [INFO ] [MAIN ] DCI: Loaded 37060 existing records. [2025-10-15T18:21:48.923847] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-01. [2025-10-15T18:21:48.934811] [WARN ] [MAIN ] DCI: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:21:48.936665] [INFO ] [MAIN ] DCI: Wiping existing primary data before full refresh. [2025-10-15T18:21:48.936787] [INFO ] [LOCAL ] DCI: Starting deletion of primary data. [2025-10-15T18:21:48.937814] [DEBUG] [LOCAL ] DCI: Deleted primary data file. [2025-10-15T18:21:48.937897] [INFO ] [MAIN ] DCI: Starting full primary refresh. [2025-10-15T18:21:49.395198] [INFO ] [REMOTE ] DCI: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:21:49.714009] [INFO ] [REMOTE ] DCI: Fetching primary data for 2024-12. [2025-10-15T18:21:49.801738] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-15T18:21:50.312134] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-15T18:21:50.513992] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-02. [2025-10-15T18:21:51.321837] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-07. [2025-10-15T18:21:51.326746] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-15T18:21:51.778377] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-15T18:21:52.113997] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-01. [2025-10-15T18:21:52.913959] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-03. [2025-10-15T18:21:52.947932] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-15T18:21:53.025797] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-15T18:21:53.713993] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-02. [2025-10-15T18:21:54.514080] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-09. [2025-10-15T18:21:54.557728] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-15T18:21:54.864224] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-15T18:21:54.994940] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-10-15T18:21:55.314007] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-08. [2025-10-15T18:21:56.114044] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-04. [2025-10-15T18:21:56.607516] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-15T18:21:56.914070] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-10. [2025-10-15T18:21:57.558493] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-15T18:21:57.559845] [INFO ] [REMOTE ] DBL: Full fetch complete (12573 records). [2025-10-15T18:21:57.559917] [DEBUG] [VALIDATOR ] DBL: Validating primary data. [2025-10-15T18:21:57.560336] [FATAL] [VALIDATOR ] DBL: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T18:21:57.560420] [FATAL] [MAIN ] DBL: Fetched primary data is invalid. Refusing to save it. [2025-10-15T18:21:57.560480] [WARN ] [MAIN ] DBL: Deleting existing primary and derivative data due to validation failure. [2025-10-15T18:21:57.560566] [INFO ] [LOCAL ] DBL: Starting deletion of primary data. [2025-10-15T18:21:57.560667] [DEBUG] [LOCAL ] DBL: No primary data file found to delete. [2025-10-15T18:21:57.560738] [INFO ] [LOCAL ] DBL: Starting deletion of derivative data. [2025-10-15T18:21:57.560928] [DEBUG] [LOCAL ] DBL: Deleted derivative data file. [2025-10-15T18:21:57.561032] [INFO ] [MAIN ] Update Progress: 593/2369 symbols completed. DBL took 22.6s. Estimated remaining: 4h 5m 14s. Rate: 7.2 symbols/min [2025-10-15T18:21:57.720783] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-09. [2025-10-15T18:21:57.746154] [INFO ] [MAIN ] DCO: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:21:57.746494] [DEBUG] [LOCAL ] DCO: No existing data file found in primary storage. [2025-10-15T18:21:57.746627] [WARN ] [MAIN ] DCO: No existing data found, performing full refresh instead. [2025-10-15T18:21:57.746890] [INFO ] [MAIN ] DCO: Wiping existing primary data before full refresh. [2025-10-15T18:21:57.747007] [INFO ] [LOCAL ] DCO: Starting deletion of primary data. [2025-10-15T18:21:57.747108] [DEBUG] [LOCAL ] DCO: No primary data file found to delete. [2025-10-15T18:21:57.747176] [INFO ] [MAIN ] DCO: Starting full primary refresh. [2025-10-15T18:21:58.150903] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-15T18:21:58.197815] [INFO ] [REMOTE ] DCO: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:21:58.514005] [INFO ] [REMOTE ] DCO: Fetching primary data for 2024-12. [2025-10-15T18:21:59.317392] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-03. [2025-10-15T18:21:59.323921] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-15T18:21:59.377377] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-10-15T18:22:00.114030] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-01. [2025-10-15T18:22:00.914022] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-05. [2025-10-15T18:22:00.938906] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-15T18:22:00.955416] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-15T18:22:01.714051] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-02. [2025-10-15T18:22:02.451712] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-15T18:22:02.521791] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-10. [2025-10-15T18:22:02.546380] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-15T18:22:03.314005] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-04. [2025-10-15T18:22:04.114013] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-06. [2025-10-15T18:22:04.190598] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-15T18:22:04.197294] [INFO ] [REMOTE ] DBI: Full fetch complete (65273 records). [2025-10-15T18:22:04.197478] [DEBUG] [VALIDATOR ] DBI: Validating primary data. [2025-10-15T18:22:04.618114] [DEBUG] [VALIDATOR ] DBI: All expected trading days are present. [2025-10-15T18:22:04.618210] [DEBUG] [VALIDATOR ] DBI: Primary data validation passed. [2025-10-15T18:22:04.619064] [INFO ] [MAIN ] DBI: Fetched primary data is valid. [2025-10-15T18:22:04.619131] [DEBUG] [LOCAL ] DBI: Saving primary data. [2025-10-15T18:22:04.620455] [DEBUG] [LOCAL ] DBI: Trimmed 65273 records to 43916 (keeping 200 days of data) [2025-10-15T18:22:04.883819] [DEBUG] [LOCAL ] DBI: Primary data saved (43916 records). [2025-10-15T18:22:04.883954] [INFO ] [MAIN ] DBI: Full history saved. [2025-10-15T18:22:04.884029] [INFO ] [MAIN ] Update Progress: 594/2369 symbols completed. DBI took 46.9s. Estimated remaining: 4h 5m 3s. Rate: 7.2 symbols/min [2025-10-15T18:22:04.919134] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-03. [2025-10-15T18:22:05.070267] [INFO ] [MAIN ] DD: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:22:05.070484] [DEBUG] [LOCAL ] DD: No existing data file found in primary storage. [2025-10-15T18:22:05.070549] [WARN ] [MAIN ] DD: No existing data found, performing full refresh instead. [2025-10-15T18:22:05.070854] [INFO ] [MAIN ] DD: Wiping existing primary data before full refresh. [2025-10-15T18:22:05.070925] [INFO ] [LOCAL ] DD: Starting deletion of primary data. [2025-10-15T18:22:05.071013] [DEBUG] [LOCAL ] DD: No primary data file found to delete. [2025-10-15T18:22:05.071058] [INFO ] [MAIN ] DD: Starting full primary refresh. [2025-10-15T18:22:05.400417] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-10-15T18:22:05.506587] [INFO ] [REMOTE ] DD: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:22:05.713954] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-05. [2025-10-15T18:22:05.746453] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-15T18:22:05.782918] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-15T18:22:06.514009] [INFO ] [REMOTE ] DD: Fetching primary data for 2024-12. [2025-10-15T18:22:06.979561] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-15T18:22:07.314102] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-04. [2025-10-15T18:22:08.113982] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-07. [2025-10-15T18:22:08.296627] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-15T18:22:08.321613] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-15T18:22:08.914133] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-05. [2025-10-15T18:22:09.713975] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-01. [2025-10-15T18:22:09.843808] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-15T18:22:10.065471] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-15T18:22:10.514029] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-06. [2025-10-15T18:22:11.314050] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-08. [2025-10-15T18:22:11.536881] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-15T18:22:11.922002] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-15T18:22:12.114060] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-06. [2025-10-15T18:22:12.912526] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-15T18:22:12.922125] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-02. [2025-10-15T18:22:13.062099] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-15T18:22:13.714007] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-07. [2025-10-15T18:22:14.363782] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-15T18:22:14.514006] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-03. [2025-10-15T18:22:15.251968] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-15T18:22:15.314030] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-08. [2025-10-15T18:22:16.114080] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-09. [2025-10-15T18:22:16.337614] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-15T18:22:16.823063] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-15T18:22:16.913997] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-07. [2025-10-15T18:22:17.466569] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-15T18:22:17.713980] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-10. [2025-10-15T18:22:17.954943] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-15T18:22:18.513999] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-04. [2025-10-15T18:22:19.313979] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-09. [2025-10-15T18:22:19.523616] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-15T18:22:19.530008] [INFO ] [REMOTE ] DBRG: Full fetch complete (72474 records). [2025-10-15T18:22:19.530126] [DEBUG] [VALIDATOR ] DBRG: Validating primary data. [2025-10-15T18:22:19.947543] [DEBUG] [VALIDATOR ] DBRG: All expected trading days are present. [2025-10-15T18:22:19.947696] [DEBUG] [VALIDATOR ] DBRG: Primary data validation passed. [2025-10-15T18:22:19.948863] [INFO ] [MAIN ] DBRG: Fetched primary data is valid. [2025-10-15T18:22:19.948932] [DEBUG] [LOCAL ] DBRG: Saving primary data. [2025-10-15T18:22:19.950496] [DEBUG] [LOCAL ] DBRG: Trimmed 72474 records to 49905 (keeping 200 days of data) [2025-10-15T18:22:20.138171] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-08. [2025-10-15T18:22:20.299270] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-15T18:22:20.324990] [DEBUG] [LOCAL ] DBRG: Primary data saved (49905 records). [2025-10-15T18:22:20.325187] [INFO ] [MAIN ] DBRG: Full history saved. [2025-10-15T18:22:20.326121] [INFO ] [MAIN ] Update Progress: 595/2369 symbols completed. DBRG took 43.5s. Estimated remaining: 4h 5m 16s. Rate: 7.2 symbols/min [2025-10-15T18:22:20.519521] [INFO ] [MAIN ] DDD: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:22:20.519720] [DEBUG] [LOCAL ] DDD: No existing data file found in primary storage. [2025-10-15T18:22:20.519769] [WARN ] [MAIN ] DDD: No existing data found, performing full refresh instead. [2025-10-15T18:22:20.519880] [INFO ] [MAIN ] DDD: Wiping existing primary data before full refresh. [2025-10-15T18:22:20.519923] [INFO ] [LOCAL ] DDD: Starting deletion of primary data. [2025-10-15T18:22:20.519965] [DEBUG] [LOCAL ] DDD: No primary data file found to delete. [2025-10-15T18:22:20.519999] [INFO ] [MAIN ] DDD: Starting full primary refresh. [2025-10-15T18:22:20.920734] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-05. [2025-10-15T18:22:20.926721] [INFO ] [REMOTE ] DDD: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:22:20.951240] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-15T18:22:21.263470] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-15T18:22:21.713991] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-09. [2025-10-15T18:22:22.514013] [INFO ] [REMOTE ] DDD: Fetching primary data for 2024-12. [2025-10-15T18:22:22.688761] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-15T18:22:22.815596] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-15T18:22:23.314035] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-10. [2025-10-15T18:22:24.114004] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-06. [2025-10-15T18:22:24.224526] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-15T18:22:24.686283] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-15T18:22:24.690600] [INFO ] [REMOTE ] DCI: Full fetch complete (53657 records). [2025-10-15T18:22:24.690793] [DEBUG] [VALIDATOR ] DCI: Validating primary data. [2025-10-15T18:22:24.927528] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-01. [2025-10-15T18:22:25.110173] [DEBUG] [VALIDATOR ] DCI: All expected trading days are present. [2025-10-15T18:22:25.110254] [DEBUG] [VALIDATOR ] DCI: Primary data validation passed. [2025-10-15T18:22:25.111021] [INFO ] [MAIN ] DCI: Fetched primary data is valid. [2025-10-15T18:22:25.111083] [DEBUG] [LOCAL ] DCI: Saving primary data. [2025-10-15T18:22:25.112226] [DEBUG] [LOCAL ] DCI: Trimmed 53657 records to 37027 (keeping 200 days of data) [2025-10-15T18:22:25.352964] [DEBUG] [LOCAL ] DCI: Primary data saved (37027 records). [2025-10-15T18:22:25.353133] [INFO ] [MAIN ] DCI: Full history saved. [2025-10-15T18:22:25.353221] [INFO ] [MAIN ] Update Progress: 596/2369 symbols completed. DCI took 36.9s. Estimated remaining: 4h 4m 58s. Rate: 7.2 symbols/min [2025-10-15T18:22:25.525350] [INFO ] [MAIN ] DDL: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:22:25.558979] [DEBUG] [LOCAL ] DDL: Loaded 36889 existing records from primary storage. [2025-10-15T18:22:25.559305] [INFO ] [MAIN ] DDL: Loaded 36889 existing records. [2025-10-15T18:22:25.716100] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-10. [2025-10-15T18:22:25.760004] [WARN ] [MAIN ] DDL: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:22:25.760609] [INFO ] [MAIN ] DDL: Wiping existing primary data before full refresh. [2025-10-15T18:22:25.760734] [INFO ] [LOCAL ] DDL: Starting deletion of primary data. [2025-10-15T18:22:25.771053] [DEBUG] [LOCAL ] DDL: Deleted primary data file. [2025-10-15T18:22:25.788224] [INFO ] [MAIN ] DDL: Starting full primary refresh. [2025-10-15T18:22:25.822794] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-15T18:22:26.176161] [INFO ] [REMOTE ] DDL: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:22:26.354445] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-15T18:22:26.514002] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-02. [2025-10-15T18:22:27.193133] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-15T18:22:27.195631] [INFO ] [REMOTE ] DCO: Full fetch complete (19533 records). [2025-10-15T18:22:27.195727] [DEBUG] [VALIDATOR ] DCO: Validating primary data. [2025-10-15T18:22:27.319089] [INFO ] [REMOTE ] DDL: Fetching primary data for 2024-12. [2025-10-15T18:22:27.654123] [DEBUG] [VALIDATOR ] DCO: All expected trading days are present. [2025-10-15T18:22:27.654248] [DEBUG] [VALIDATOR ] DCO: Primary data validation passed. [2025-10-15T18:22:27.655072] [INFO ] [MAIN ] DCO: Fetched primary data is valid. [2025-10-15T18:22:27.655141] [DEBUG] [LOCAL ] DCO: Saving primary data. [2025-10-15T18:22:27.656011] [DEBUG] [LOCAL ] DCO: Trimmed 19533 records to 14597 (keeping 200 days of data) [2025-10-15T18:22:27.770760] [DEBUG] [LOCAL ] DCO: Primary data saved (14597 records). [2025-10-15T18:22:27.770935] [INFO ] [MAIN ] DCO: Full history saved. [2025-10-15T18:22:27.771057] [INFO ] [MAIN ] Update Progress: 597/2369 symbols completed. DCO took 30.2s. Estimated remaining: 4h 4m 32s. Rate: 7.2 symbols/min [2025-10-15T18:22:27.967278] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-15T18:22:28.114005] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-07. [2025-10-15T18:22:28.913964] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-03. [2025-10-15T18:22:28.962605] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-15T18:22:29.713969] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-01. [2025-10-15T18:22:30.048930] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-15T18:22:30.377484] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-15T18:22:30.513963] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-04. [2025-10-15T18:22:31.110506] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-15T18:22:31.314003] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-02. [2025-10-15T18:22:32.113961] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-08. [2025-10-15T18:22:32.230193] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-15T18:22:32.474194] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-15T18:22:32.914043] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-05. [2025-10-15T18:22:33.714029] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-03. [2025-10-15T18:22:33.841187] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-15T18:22:34.513962] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-09. [2025-10-15T18:22:34.591216] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-15T18:22:35.030488] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-15T18:22:35.313992] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-06. [2025-10-15T18:22:36.114078] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-04. [2025-10-15T18:22:36.332963] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-15T18:22:36.914045] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-10. [2025-10-15T18:22:37.211797] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-15T18:22:37.552027] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-15T18:22:37.713996] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-05. [2025-10-15T18:22:37.826180] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-15T18:22:37.832514] [INFO ] [REMOTE ] DD: Full fetch complete (76584 records). [2025-10-15T18:22:37.832688] [DEBUG] [VALIDATOR ] DD: Validating primary data. [2025-10-15T18:22:38.248515] [DEBUG] [VALIDATOR ] DD: All expected trading days are present. [2025-10-15T18:22:38.248590] [DEBUG] [VALIDATOR ] DD: Primary data validation passed. [2025-10-15T18:22:38.249563] [INFO ] [MAIN ] DD: Fetched primary data is valid. [2025-10-15T18:22:38.249630] [DEBUG] [LOCAL ] DD: Saving primary data. [2025-10-15T18:22:38.251054] [DEBUG] [LOCAL ] DD: Trimmed 76584 records to 52926 (keeping 200 days of data) [2025-10-15T18:22:38.527412] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-07. [2025-10-15T18:22:38.573951] [DEBUG] [LOCAL ] DD: Primary data saved (52926 records). [2025-10-15T18:22:38.574061] [INFO ] [MAIN ] DD: Full history saved. [2025-10-15T18:22:38.574145] [INFO ] [MAIN ] Update Progress: 598/2369 symbols completed. DD took 33.7s. Estimated remaining: 4h 4m 32s. Rate: 7.2 symbols/min [2025-10-15T18:22:39.384154] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-15T18:22:39.393965] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-06. [2025-10-15T18:22:40.580330] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-15T18:22:40.586559] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-07. [2025-10-15T18:22:40.624206] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-10-15T18:22:40.914009] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-08. [2025-10-15T18:22:41.836725] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-15T18:22:41.843262] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-08. [2025-10-15T18:22:42.528394] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-15T18:22:42.539483] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-09. [2025-10-15T18:22:43.086101] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-15T18:22:43.313998] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-09. [2025-10-15T18:22:44.420354] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-15T18:22:44.431813] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-10. [2025-10-15T18:22:44.886115] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-15T18:22:44.913951] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-10. [2025-10-15T18:22:46.174559] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-15T18:22:46.180598] [INFO ] [REMOTE ] DDL: Full fetch complete (53395 records). [2025-10-15T18:22:46.180752] [DEBUG] [VALIDATOR ] DDL: Validating primary data. [2025-10-15T18:22:46.587610] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-10 (2.16 seconds). [2025-10-15T18:22:46.625050] [DEBUG] [VALIDATOR ] DDL: All expected trading days are present. [2025-10-15T18:22:46.625400] [DEBUG] [VALIDATOR ] DDL: Primary data validation passed. [2025-10-15T18:22:46.626182] [INFO ] [MAIN ] DDL: Fetched primary data is valid. [2025-10-15T18:22:46.626244] [DEBUG] [LOCAL ] DDL: Saving primary data. [2025-10-15T18:22:46.627008] [INFO ] [REMOTE ] DDD: Full fetch complete (73919 records). [2025-10-15T18:22:46.627195] [DEBUG] [VALIDATOR ] DDD: Validating primary data. [2025-10-15T18:22:46.627741] [DEBUG] [LOCAL ] DDL: Trimmed 53395 records to 36922 (keeping 200 days of data) [2025-10-15T18:22:47.146235] [DEBUG] [VALIDATOR ] DDD: All expected trading days are present. [2025-10-15T18:22:47.146834] [DEBUG] [VALIDATOR ] DDD: Primary data validation passed. [2025-10-15T18:22:47.150917] [INFO ] [MAIN ] DDD: Fetched primary data is valid. [2025-10-15T18:22:47.151059] [DEBUG] [LOCAL ] DDD: Saving primary data. [2025-10-15T18:22:47.217306] [DEBUG] [LOCAL ] DDD: Trimmed 73919 records to 50928 (keeping 200 days of data) [2025-10-15T18:22:47.350939] [DEBUG] [LOCAL ] DDL: Primary data saved (36922 records). [2025-10-15T18:22:47.353108] [INFO ] [MAIN ] DDL: Full history saved. [2025-10-15T18:22:47.353503] [INFO ] [MAIN ] Update Progress: 599/2369 symbols completed. DDL took 22.0s. Estimated remaining: 4h 4m 25s. Rate: 7.2 symbols/min [2025-10-15T18:22:47.534104] [DEBUG] [LOCAL ] DDD: Primary data saved (50928 records). [2025-10-15T18:22:47.534240] [INFO ] [MAIN ] DDD: Full history saved. [2025-10-15T18:22:47.534315] [INFO ] [MAIN ] Update Progress: 600/2369 symbols completed. DDD took 27.2s. Estimated remaining: 4h 3m 53s. Rate: 7.3 symbols/min [2025-10-15T18:22:48.132673] [INFO ] [MAIN ] DDS: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:22:48.204284] [DEBUG] [LOCAL ] DDS: No existing data file found in primary storage. [2025-10-15T18:22:48.204154] [INFO ] [MAIN ] DE: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:22:48.224471] [WARN ] [MAIN ] DDS: No existing data found, performing full refresh instead. [2025-10-15T18:22:48.224293] [INFO ] [MAIN ] DDT: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:22:48.225204] [INFO ] [MAIN ] DDS: Wiping existing primary data before full refresh. [2025-10-15T18:22:48.245982] [INFO ] [MAIN ] DEA: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:22:48.246162] [INFO ] [LOCAL ] DDS: Starting deletion of primary data. [2025-10-15T18:22:48.247086] [DEBUG] [LOCAL ] DDS: No primary data file found to delete. [2025-10-15T18:22:48.247197] [INFO ] [MAIN ] DDS: Starting full primary refresh. [2025-10-15T18:22:48.262324] [DEBUG] [LOCAL ] DDT: Loaded 2089 existing records from primary storage. [2025-10-15T18:22:48.283677] [INFO ] [MAIN ] DDT: Loaded 2089 existing records. [2025-10-15T18:22:48.657188] [WARN ] [MAIN ] DDT: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:22:48.683264] [INFO ] [MAIN ] DDT: Wiping existing primary data before full refresh. [2025-10-15T18:22:48.691897] [DEBUG] [LOCAL ] DEA: Loaded 40455 existing records from primary storage. [2025-10-15T18:22:48.692019] [INFO ] [LOCAL ] DDT: Starting deletion of primary data. [2025-10-15T18:22:48.694925] [DEBUG] [LOCAL ] DE: Loaded 47686 existing records from primary storage. [2025-10-15T18:22:48.701959] [INFO ] [MAIN ] DEA: Loaded 40455 existing records. [2025-10-15T18:22:48.723288] [INFO ] [MAIN ] DE: Loaded 47686 existing records. [2025-10-15T18:22:48.797557] [DEBUG] [LOCAL ] DDT: Deleted primary data file. [2025-10-15T18:22:48.904229] [INFO ] [MAIN ] DDT: Starting full primary refresh. [2025-10-15T18:22:49.345976] [WARN ] [MAIN ] DEA: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:22:49.314627] [INFO ] [REMOTE ] DDS: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:22:49.388095] [INFO ] [REMOTE ] DDS: Fetching primary data for 2024-12. [2025-10-15T18:22:49.391161] [WARN ] [MAIN ] DE: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:22:49.428672] [INFO ] [MAIN ] DE: Wiping existing primary data before full refresh. [2025-10-15T18:22:49.429746] [INFO ] [LOCAL ] DE: Starting deletion of primary data. [2025-10-15T18:22:49.426021] [INFO ] [MAIN ] DEA: Wiping existing primary data before full refresh. [2025-10-15T18:22:49.452726] [INFO ] [LOCAL ] DEA: Starting deletion of primary data. [2025-10-15T18:22:49.463334] [DEBUG] [LOCAL ] DE: Deleted primary data file. [2025-10-15T18:22:49.480225] [INFO ] [MAIN ] DE: Starting full primary refresh. [2025-10-15T18:22:49.490586] [DEBUG] [LOCAL ] DEA: Deleted primary data file. [2025-10-15T18:22:49.501128] [INFO ] [MAIN ] DEA: Starting full primary refresh. [2025-10-15T18:22:49.913595] [INFO ] [REMOTE ] DDT: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:22:49.960189] [INFO ] [REMOTE ] DDT: Fetching primary data for 2024-12. [2025-10-15T18:22:50.429146] [INFO ] [REMOTE ] DEA: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:22:50.441390] [INFO ] [REMOTE ] DEA: Fetching primary data for 2024-12. [2025-10-15T18:22:50.530444] [INFO ] [REMOTE ] DE: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:22:50.531084] [INFO ] [REMOTE ] DE: Fetching primary data for 2024-12. [2025-10-15T18:22:50.571131] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-15T18:22:50.574799] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-01. [2025-10-15T18:22:50.729384] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-10-15T18:22:50.730525] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-01. [2025-10-15T18:22:51.072861] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-01 (0.34 seconds). [2025-10-15T18:22:51.074030] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-02. [2025-10-15T18:22:51.446591] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-15T18:22:51.450183] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-02. [2025-10-15T18:22:51.999116] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-15T18:22:52.113959] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-01. [2025-10-15T18:22:52.139781] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-15T18:22:52.913982] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-01. [2025-10-15T18:23:04.655350] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-02 (13.58 seconds). [2025-10-15T18:23:04.656421] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-03. [2025-10-15T18:23:05.763463] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-02 (14.31 seconds). [2025-10-15T18:23:05.766626] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-03. [2025-10-15T18:23:06.152499] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-15T18:23:06.153703] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-04. [2025-10-15T18:23:06.234952] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-01 (14.12 seconds). [2025-10-15T18:23:06.244221] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-02. [2025-10-15T18:23:06.870850] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-15T18:23:06.874663] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-04. [2025-10-15T18:23:07.132151] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-15T18:23:07.134029] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-01 (14.22 seconds). [2025-10-15T18:23:07.136058] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-05. [2025-10-15T18:23:07.146691] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-02. [2025-10-15T18:23:07.817408] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-15T18:23:07.821341] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-05. [2025-10-15T18:23:08.084856] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-15T18:23:08.085923] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-06. [2025-10-15T18:23:08.486027] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-02 (2.24 seconds). [2025-10-15T18:23:08.496037] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-03. [2025-10-15T18:23:08.782804] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-15T18:23:08.783927] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-07. [2025-10-15T18:23:08.798961] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-15T18:23:08.803805] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-06. [2025-10-15T18:23:09.406876] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-15T18:23:09.408505] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-08. [2025-10-15T18:23:09.466500] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-02 (2.32 seconds). [2025-10-15T18:23:09.476541] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-03. [2025-10-15T18:23:09.499527] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-15T18:23:09.504714] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-07. [2025-10-15T18:23:09.747478] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-08 (0.34 seconds). [2025-10-15T18:23:09.748685] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-09. [2025-10-15T18:23:09.940474] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-15T18:23:09.950762] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-04. [2025-10-15T18:23:10.180227] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-10-15T18:23:10.181549] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-10. [2025-10-15T18:23:10.419352] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-15T18:23:10.422775] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-08. [2025-10-15T18:23:10.630105] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-15T18:23:10.630909] [INFO ] [REMOTE ] DDT: Full fetch complete (2830 records). [2025-10-15T18:23:10.630977] [DEBUG] [VALIDATOR ] DDT: Validating primary data. [2025-10-15T18:23:10.631320] [FATAL] [VALIDATOR ] DDT: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T18:23:10.631399] [FATAL] [MAIN ] DDT: Fetched primary data is invalid. Refusing to save it. [2025-10-15T18:23:10.631461] [WARN ] [MAIN ] DDT: Deleting existing primary and derivative data due to validation failure. [2025-10-15T18:23:10.631545] [INFO ] [LOCAL ] DDT: Starting deletion of primary data. [2025-10-15T18:23:10.631620] [DEBUG] [LOCAL ] DDT: No primary data file found to delete. [2025-10-15T18:23:10.631706] [INFO ] [LOCAL ] DDT: Starting deletion of derivative data. [2025-10-15T18:23:10.631879] [DEBUG] [LOCAL ] DDT: Deleted derivative data file. [2025-10-15T18:23:10.631987] [INFO ] [MAIN ] Update Progress: 601/2369 symbols completed. DDT took 23.1s. Estimated remaining: 4h 4m 28s. Rate: 7.2 symbols/min [2025-10-15T18:23:10.801695] [INFO ] [MAIN ] DEC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:23:10.831801] [DEBUG] [LOCAL ] DEC: Loaded 30408 existing records from primary storage. [2025-10-15T18:23:10.832101] [INFO ] [MAIN ] DEC: Loaded 30408 existing records. [2025-10-15T18:23:11.027151] [WARN ] [MAIN ] DEC: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:23:11.027935] [INFO ] [MAIN ] DEC: Wiping existing primary data before full refresh. [2025-10-15T18:23:11.028174] [INFO ] [LOCAL ] DEC: Starting deletion of primary data. [2025-10-15T18:23:11.028824] [DEBUG] [LOCAL ] DEC: Deleted primary data file. [2025-10-15T18:23:11.029041] [INFO ] [MAIN ] DEC: Starting full primary refresh. [2025-10-15T18:23:11.084915] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-15T18:23:11.143444] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-09. [2025-10-15T18:23:11.465667] [INFO ] [REMOTE ] DEC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:23:11.469547] [INFO ] [REMOTE ] DEC: Fetching primary data for 2024-12. [2025-10-15T18:23:11.469256] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-15T18:23:11.481432] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-04. [2025-10-15T18:23:11.549431] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-15T18:23:11.560446] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-05. [2025-10-15T18:23:11.731169] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-15T18:23:12.114108] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-10. [2025-10-15T18:23:12.742361] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-15T18:23:12.789683] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-15T18:23:12.913955] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-06. [2025-10-15T18:23:13.005663] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-15T18:23:13.007168] [INFO ] [REMOTE ] DDS: Full fetch complete (18601 records). [2025-10-15T18:23:13.007241] [DEBUG] [VALIDATOR ] DDS: Validating primary data. [2025-10-15T18:23:13.007719] [FATAL] [VALIDATOR ] DDS: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T18:23:13.007801] [FATAL] [MAIN ] DDS: Fetched primary data is invalid. Refusing to save it. [2025-10-15T18:23:13.007843] [WARN ] [MAIN ] DDS: Deleting existing primary and derivative data due to validation failure. [2025-10-15T18:23:13.007880] [INFO ] [LOCAL ] DDS: Starting deletion of primary data. [2025-10-15T18:23:13.007934] [DEBUG] [LOCAL ] DDS: No primary data file found to delete. [2025-10-15T18:23:13.007968] [INFO ] [LOCAL ] DDS: Starting deletion of derivative data. [2025-10-15T18:23:13.008006] [DEBUG] [LOCAL ] DDS: No derivative data file found to delete. [2025-10-15T18:23:13.008056] [INFO ] [MAIN ] Update Progress: 602/2369 symbols completed. DDS took 25.5s. Estimated remaining: 4h 4m 2s. Rate: 7.2 symbols/min [2025-10-15T18:23:13.183593] [INFO ] [MAIN ] DECK: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:23:13.226387] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-15T18:23:13.274296] [DEBUG] [LOCAL ] DECK: Loaded 53293 existing records from primary storage. [2025-10-15T18:23:13.274635] [INFO ] [MAIN ] DECK: Loaded 53293 existing records. [2025-10-15T18:23:13.449897] [WARN ] [MAIN ] DECK: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:23:13.450184] [INFO ] [MAIN ] DECK: Wiping existing primary data before full refresh. [2025-10-15T18:23:13.450231] [INFO ] [LOCAL ] DECK: Starting deletion of primary data. [2025-10-15T18:23:13.450611] [DEBUG] [LOCAL ] DECK: Deleted primary data file. [2025-10-15T18:23:13.450700] [INFO ] [MAIN ] DECK: Starting full primary refresh. [2025-10-15T18:23:13.719134] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-01. [2025-10-15T18:23:13.800128] [INFO ] [REMOTE ] DECK: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:23:14.296748] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-15T18:23:14.513999] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-07. [2025-10-15T18:23:14.604512] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-15T18:23:15.314005] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-05. [2025-10-15T18:23:16.046551] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-15T18:23:16.114009] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-02. [2025-10-15T18:23:16.914005] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-08. [2025-10-15T18:23:17.086710] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-15T18:23:17.450727] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-15T18:23:17.714014] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-06. [2025-10-15T18:23:18.117197] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-15T18:23:18.514014] [INFO ] [REMOTE ] DECK: Fetching primary data for 2024-12. [2025-10-15T18:23:19.179639] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-15T18:23:19.314007] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-07. [2025-10-15T18:23:20.069346] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-15T18:23:20.113964] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-09. [2025-10-15T18:23:20.844124] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-15T18:23:20.913981] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-01. [2025-10-15T18:23:21.714085] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-08. [2025-10-15T18:23:21.986638] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-15T18:23:22.514001] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-10. [2025-10-15T18:23:22.683522] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-15T18:23:23.314029] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-03. [2025-10-15T18:23:23.830433] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-15T18:23:23.835543] [INFO ] [REMOTE ] DEA: Full fetch complete (62017 records). [2025-10-15T18:23:23.835712] [DEBUG] [VALIDATOR ] DEA: Validating primary data. [2025-10-15T18:23:24.142672] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-02. [2025-10-15T18:23:24.187549] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-08 (2.47 seconds). [2025-10-15T18:23:24.269004] [DEBUG] [VALIDATOR ] DEA: All expected trading days are present. [2025-10-15T18:23:24.269205] [DEBUG] [VALIDATOR ] DEA: Primary data validation passed. [2025-10-15T18:23:24.270332] [INFO ] [MAIN ] DEA: Fetched primary data is valid. [2025-10-15T18:23:24.270415] [DEBUG] [LOCAL ] DEA: Saving primary data. [2025-10-15T18:23:24.272161] [DEBUG] [LOCAL ] DEA: Trimmed 62017 records to 40436 (keeping 200 days of data) [2025-10-15T18:23:24.525611] [DEBUG] [LOCAL ] DEA: Primary data saved (40436 records). [2025-10-15T18:23:24.526060] [INFO ] [MAIN ] DEA: Full history saved. [2025-10-15T18:23:24.526177] [INFO ] [MAIN ] Update Progress: 603/2369 symbols completed. DEA took 37.0s. Estimated remaining: 4h 4m 3s. Rate: 7.2 symbols/min [2025-10-15T18:23:24.706775] [INFO ] [MAIN ] DEI: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:23:24.754686] [DEBUG] [LOCAL ] DEI: Loaded 48296 existing records from primary storage. [2025-10-15T18:23:24.755084] [INFO ] [MAIN ] DEI: Loaded 48296 existing records. [2025-10-15T18:23:24.921608] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-09. [2025-10-15T18:23:24.965104] [WARN ] [MAIN ] DEI: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:23:24.976271] [INFO ] [MAIN ] DEI: Wiping existing primary data before full refresh. [2025-10-15T18:23:24.976591] [INFO ] [LOCAL ] DEI: Starting deletion of primary data. [2025-10-15T18:23:24.978550] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-15T18:23:24.978601] [DEBUG] [LOCAL ] DEI: Deleted primary data file. [2025-10-15T18:23:24.978913] [INFO ] [MAIN ] DEI: Starting full primary refresh. [2025-10-15T18:23:25.339879] [INFO ] [REMOTE ] DEI: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:23:25.714022] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-04. [2025-10-15T18:23:25.926431] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-15T18:23:26.385364] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-15T18:23:26.513994] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-03. [2025-10-15T18:23:27.037971] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-15T18:23:27.314034] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-05. [2025-10-15T18:23:28.113980] [INFO ] [REMOTE ] DEI: Fetching primary data for 2024-12. [2025-10-15T18:23:28.384152] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-15T18:23:28.681459] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-15T18:23:28.914003] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-06. [2025-10-15T18:23:29.444605] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-15T18:23:29.713998] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-10. [2025-10-15T18:23:30.256663] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-15T18:23:30.514109] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-01. [2025-10-15T18:23:31.314032] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-04. [2025-10-15T18:23:31.450554] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-15T18:23:31.456297] [INFO ] [REMOTE ] DE: Full fetch complete (69786 records). [2025-10-15T18:23:31.456429] [DEBUG] [VALIDATOR ] DE: Validating primary data. [2025-10-15T18:23:31.858004] [DEBUG] [VALIDATOR ] DE: All expected trading days are present. [2025-10-15T18:23:31.858153] [DEBUG] [VALIDATOR ] DE: Primary data validation passed. [2025-10-15T18:23:31.859120] [INFO ] [MAIN ] DE: Fetched primary data is valid. [2025-10-15T18:23:31.859202] [DEBUG] [LOCAL ] DE: Saving primary data. [2025-10-15T18:23:31.860719] [DEBUG] [LOCAL ] DE: Trimmed 69786 records to 47661 (keeping 200 days of data) [2025-10-15T18:23:32.123880] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-07. [2025-10-15T18:23:32.132227] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-15T18:23:32.208325] [DEBUG] [LOCAL ] DE: Primary data saved (47661 records). [2025-10-15T18:23:32.208472] [INFO ] [MAIN ] DE: Full history saved. [2025-10-15T18:23:32.208570] [INFO ] [MAIN ] Update Progress: 604/2369 symbols completed. DE took 44.6s. Estimated remaining: 4h 3m 53s. Rate: 7.2 symbols/min [2025-10-15T18:23:32.373116] [INFO ] [MAIN ] DELL: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:23:32.424662] [DEBUG] [LOCAL ] DELL: Loaded 53736 existing records from primary storage. [2025-10-15T18:23:32.424980] [INFO ] [MAIN ] DELL: Loaded 53736 existing records. [2025-10-15T18:23:32.596696] [WARN ] [MAIN ] DELL: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:23:32.596949] [INFO ] [MAIN ] DELL: Wiping existing primary data before full refresh. [2025-10-15T18:23:32.596996] [INFO ] [LOCAL ] DELL: Starting deletion of primary data. [2025-10-15T18:23:32.597437] [DEBUG] [LOCAL ] DELL: Deleted primary data file. [2025-10-15T18:23:32.597493] [INFO ] [MAIN ] DELL: Starting full primary refresh. [2025-10-15T18:23:32.923565] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-02. [2025-10-15T18:23:32.956229] [INFO ] [REMOTE ] DELL: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:23:33.440767] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-15T18:23:33.496145] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-04 (2.18 seconds). [2025-10-15T18:23:33.714059] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-08. [2025-10-15T18:23:34.514003] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-05. [2025-10-15T18:23:34.639666] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-15T18:23:35.169587] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-15T18:23:35.314011] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-03. [2025-10-15T18:23:36.113973] [INFO ] [REMOTE ] DELL: Fetching primary data for 2024-12. [2025-10-15T18:23:36.476932] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-15T18:23:36.741098] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-15T18:23:36.913994] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-06. [2025-10-15T18:23:37.714025] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-04. [2025-10-15T18:23:37.896356] [DEBUG] [REMOTE ] DEI: Error fetching primary data for 2025-04: 'API call returned an empty response.' [2025-10-15T18:23:37.896750] [WARN ] [REMOTE ] DEI: No data returned for month 2025-04 [2025-10-15T18:23:37.896852] [FATAL] [REMOTE ] DEI: API call failed - aborting fetch to avoid wasting further API calls [2025-10-15T18:23:37.896929] [FATAL] [MAIN ] DEI: Failed to fetch primary data. [2025-10-15T18:23:37.896995] [WARN ] [MAIN ] DEI: Deleting existing primary and derivative data due to fetch failure. [2025-10-15T18:23:37.897067] [INFO ] [LOCAL ] DEI: Starting deletion of primary data. [2025-10-15T18:23:37.897129] [DEBUG] [LOCAL ] DEI: No primary data file found to delete. [2025-10-15T18:23:37.897165] [INFO ] [LOCAL ] DEI: Starting deletion of derivative data. [2025-10-15T18:23:37.897362] [DEBUG] [LOCAL ] DEI: Deleted derivative data file. [2025-10-15T18:23:37.898438] [INFO ] [MAIN ] Update Progress: 605/2369 symbols completed. DEI took 13.4s. Estimated remaining: 4h 3m 38s. Rate: 7.2 symbols/min [2025-10-15T18:23:38.089842] [INFO ] [MAIN ] DEO: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:23:38.142446] [DEBUG] [LOCAL ] DEO: Loaded 49214 existing records from primary storage. [2025-10-15T18:23:38.142820] [INFO ] [MAIN ] DEO: Loaded 49214 existing records. [2025-10-15T18:23:38.337848] [WARN ] [MAIN ] DEO: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:23:38.338040] [INFO ] [MAIN ] DEO: Wiping existing primary data before full refresh. [2025-10-15T18:23:38.338086] [INFO ] [LOCAL ] DEO: Starting deletion of primary data. [2025-10-15T18:23:38.338436] [DEBUG] [LOCAL ] DEO: Deleted primary data file. [2025-10-15T18:23:38.338475] [INFO ] [MAIN ] DEO: Starting full primary refresh. [2025-10-15T18:23:38.525480] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-09. [2025-10-15T18:23:38.729130] [INFO ] [REMOTE ] DEO: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:23:38.762661] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2024-12 (2.65 seconds). [2025-10-15T18:23:38.890074] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-10-15T18:23:39.314000] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-07. [2025-10-15T18:23:39.771539] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-15T18:23:40.114168] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-01. [2025-10-15T18:23:40.914020] [INFO ] [REMOTE ] DEO: Fetching primary data for 2024-12. [2025-10-15T18:23:41.523506] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-07 (2.21 seconds). [2025-10-15T18:23:41.713992] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-08. [2025-10-15T18:23:42.349056] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-01 (2.23 seconds). [2025-10-15T18:23:42.514003] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-02. [2025-10-15T18:23:42.802683] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-10-15T18:23:43.314017] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-10. [2025-10-15T18:23:43.382953] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-15T18:23:44.114004] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-09. [2025-10-15T18:23:44.529834] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-15T18:23:44.534620] [INFO ] [REMOTE ] DEC: Full fetch complete (44215 records). [2025-10-15T18:23:44.534735] [DEBUG] [VALIDATOR ] DEC: Validating primary data. [2025-10-15T18:23:44.874598] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-02 (2.36 seconds). [2025-10-15T18:23:44.914872] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-01. [2025-10-15T18:23:44.946885] [DEBUG] [VALIDATOR ] DEC: All expected trading days are present. [2025-10-15T18:23:44.946968] [DEBUG] [VALIDATOR ] DEC: Primary data validation passed. [2025-10-15T18:23:44.947691] [INFO ] [MAIN ] DEC: Fetched primary data is valid. [2025-10-15T18:23:44.947752] [DEBUG] [LOCAL ] DEC: Saving primary data. [2025-10-15T18:23:44.948895] [DEBUG] [LOCAL ] DEC: Trimmed 44215 records to 30346 (keeping 200 days of data) [2025-10-15T18:23:45.128728] [DEBUG] [LOCAL ] DEC: Primary data saved (30346 records). [2025-10-15T18:23:45.128914] [INFO ] [MAIN ] DEC: Full history saved. [2025-10-15T18:23:45.128995] [INFO ] [MAIN ] Update Progress: 606/2369 symbols completed. DEC took 34.5s. Estimated remaining: 4h 3m 26s. Rate: 7.2 symbols/min [2025-10-15T18:23:45.292795] [INFO ] [MAIN ] DFH: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:23:45.292990] [DEBUG] [LOCAL ] DFH: No existing data file found in primary storage. [2025-10-15T18:23:45.293026] [WARN ] [MAIN ] DFH: No existing data found, performing full refresh instead. [2025-10-15T18:23:45.293136] [INFO ] [MAIN ] DFH: Wiping existing primary data before full refresh. [2025-10-15T18:23:45.293176] [INFO ] [LOCAL ] DFH: Starting deletion of primary data. [2025-10-15T18:23:45.293215] [DEBUG] [LOCAL ] DFH: No primary data file found to delete. [2025-10-15T18:23:45.293245] [INFO ] [MAIN ] DFH: Starting full primary refresh. [2025-10-15T18:23:45.642352] [INFO ] [REMOTE ] DFH: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:23:45.713971] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-03. [2025-10-15T18:23:46.420148] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-09 (2.31 seconds). [2025-10-15T18:23:46.514031] [INFO ] [REMOTE ] DFH: Fetching primary data for 2024-12. [2025-10-15T18:23:46.698718] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-15T18:23:47.314031] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-10. [2025-10-15T18:23:48.020551] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-03 (2.31 seconds). [2025-10-15T18:23:48.114052] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-04. [2025-10-15T18:23:48.196944] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-15T18:23:48.914014] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-01. [2025-10-15T18:23:49.396283] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-10 (2.08 seconds). [2025-10-15T18:23:49.402592] [INFO ] [REMOTE ] DECK: Full fetch complete (77029 records). [2025-10-15T18:23:49.402747] [DEBUG] [VALIDATOR ] DECK: Validating primary data. [2025-10-15T18:23:49.719221] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-02. [2025-10-15T18:23:49.790981] [DEBUG] [VALIDATOR ] DECK: All expected trading days are present. [2025-10-15T18:23:49.791127] [DEBUG] [VALIDATOR ] DECK: Primary data validation passed. [2025-10-15T18:23:49.792111] [INFO ] [MAIN ] DECK: Fetched primary data is valid. [2025-10-15T18:23:49.792172] [DEBUG] [LOCAL ] DECK: Saving primary data. [2025-10-15T18:23:49.793606] [DEBUG] [LOCAL ] DECK: Trimmed 77029 records to 53297 (keeping 200 days of data) [2025-10-15T18:23:50.116356] [DEBUG] [LOCAL ] DECK: Primary data saved (53297 records). [2025-10-15T18:23:50.116492] [INFO ] [MAIN ] DECK: Full history saved. [2025-10-15T18:23:50.116568] [INFO ] [MAIN ] Update Progress: 607/2369 symbols completed. DECK took 37.1s. Estimated remaining: 4h 3m 8s. Rate: 7.2 symbols/min [2025-10-15T18:23:50.292912] [INFO ] [MAIN ] DFIN: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:23:50.322064] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-15T18:23:50.366841] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-04 (2.25 seconds). [2025-10-15T18:23:50.388277] [DEBUG] [LOCAL ] DFIN: Loaded 22636 existing records from primary storage. [2025-10-15T18:23:50.388497] [INFO ] [MAIN ] DFIN: Loaded 22636 existing records. [2025-10-15T18:23:50.527003] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-02. [2025-10-15T18:23:50.568114] [WARN ] [MAIN ] DFIN: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:23:50.568372] [INFO ] [MAIN ] DFIN: Wiping existing primary data before full refresh. [2025-10-15T18:23:50.568427] [INFO ] [LOCAL ] DFIN: Starting deletion of primary data. [2025-10-15T18:23:50.568633] [DEBUG] [LOCAL ] DFIN: Deleted primary data file. [2025-10-15T18:23:50.568741] [INFO ] [MAIN ] DFIN: Starting full primary refresh. [2025-10-15T18:23:50.922249] [INFO ] [REMOTE ] DFIN: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:23:51.314026] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2024-12. [2025-10-15T18:23:51.525103] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-15T18:23:51.957413] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-15T18:23:52.114065] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-03. [2025-10-15T18:23:52.506710] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-15T18:23:52.914122] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-03. [2025-10-15T18:23:53.714026] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-01. [2025-10-15T18:23:53.766626] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-15T18:23:54.263826] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-15T18:23:54.513968] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-04. [2025-10-15T18:23:54.730880] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-15T18:23:55.314060] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-02. [2025-10-15T18:23:56.113965] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-04. [2025-10-15T18:23:56.288022] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-15T18:23:56.342596] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-15T18:23:56.913985] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-05. [2025-10-15T18:23:57.429130] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-15T18:23:57.713993] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-05. [2025-10-15T18:23:58.521446] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-05. [2025-10-15T18:23:58.527946] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-15T18:23:59.314031] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-03. [2025-10-15T18:23:59.840414] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-15T18:23:59.966494] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-05 (2.25 seconds). [2025-10-15T18:24:00.114017] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-06. [2025-10-15T18:24:00.377866] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-15T18:24:00.914001] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-06. [2025-10-15T18:24:01.714075] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-06. [2025-10-15T18:24:01.846989] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-15T18:24:02.514030] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-07. [2025-10-15T18:24:02.866461] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-10-15T18:24:03.083450] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-15T18:24:03.314069] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-04. [2025-10-15T18:24:04.114010] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-07. [2025-10-15T18:24:04.223540] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-15T18:24:04.754761] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-15T18:24:04.914045] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-07. [2025-10-15T18:24:05.714026] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-08. [2025-10-15T18:24:06.045355] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-15T18:24:06.425470] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-15T18:24:06.513992] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-08. [2025-10-15T18:24:07.314025] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-05. [2025-10-15T18:24:07.378296] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-15T18:24:07.477606] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-15T18:24:08.114043] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-09. [2025-10-15T18:24:08.342860] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-15T18:24:08.913972] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-08. [2025-10-15T18:24:09.112317] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-15T18:24:09.714028] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-09. [2025-10-15T18:24:10.514023] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-10. [2025-10-15T18:24:11.176468] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-08 (2.26 seconds). [2025-10-15T18:24:11.314004] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-06. [2025-10-15T18:24:11.568109] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-15T18:24:11.924609] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-15T18:24:11.928596] [INFO ] [REMOTE ] DFH: Full fetch complete (48023 records). [2025-10-15T18:24:11.928761] [DEBUG] [VALIDATOR ] DFH: Validating primary data. [2025-10-15T18:24:12.118308] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-10. [2025-10-15T18:24:12.309435] [DEBUG] [VALIDATOR ] DFH: All expected trading days are present. [2025-10-15T18:24:12.314694] [DEBUG] [VALIDATOR ] DFH: Primary data validation passed. [2025-10-15T18:24:12.322369] [INFO ] [MAIN ] DFH: Fetched primary data is valid. [2025-10-15T18:24:12.323095] [DEBUG] [LOCAL ] DFH: Saving primary data. [2025-10-15T18:24:12.323604] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-15T18:24:12.329804] [DEBUG] [LOCAL ] DFH: Trimmed 48023 records to 32196 (keeping 200 days of data) [2025-10-15T18:24:12.538465] [DEBUG] [LOCAL ] DFH: Primary data saved (32196 records). [2025-10-15T18:24:12.538624] [INFO ] [MAIN ] DFH: Full history saved. [2025-10-15T18:24:12.538739] [INFO ] [MAIN ] Update Progress: 608/2369 symbols completed. DFH took 27.4s. Estimated remaining: 4h 3m 41s. Rate: 7.2 symbols/min [2025-10-15T18:24:12.735587] [INFO ] [MAIN ] DFP: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:24:12.749583] [DEBUG] [LOCAL ] DFP: Loaded 11209 existing records from primary storage. [2025-10-15T18:24:12.749843] [INFO ] [MAIN ] DFP: Loaded 11209 existing records. [2025-10-15T18:24:12.919175] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-07. [2025-10-15T18:24:12.923858] [WARN ] [MAIN ] DFP: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:24:12.924087] [INFO ] [MAIN ] DFP: Wiping existing primary data before full refresh. [2025-10-15T18:24:12.924170] [INFO ] [LOCAL ] DFP: Starting deletion of primary data. [2025-10-15T18:24:12.925002] [DEBUG] [LOCAL ] DFP: Deleted primary data file. [2025-10-15T18:24:12.925059] [INFO ] [MAIN ] DFP: Starting full primary refresh. [2025-10-15T18:24:13.268937] [INFO ] [REMOTE ] DFP: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:24:13.714011] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-09. [2025-10-15T18:24:13.887582] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-15T18:24:14.321966] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-10 (2.20 seconds). [2025-10-15T18:24:14.328427] [INFO ] [REMOTE ] DEO: Full fetch complete (71734 records). [2025-10-15T18:24:14.328572] [DEBUG] [VALIDATOR ] DEO: Validating primary data. [2025-10-15T18:24:14.520692] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-08. [2025-10-15T18:24:14.730457] [DEBUG] [VALIDATOR ] DEO: All expected trading days are present. [2025-10-15T18:24:14.730545] [DEBUG] [VALIDATOR ] DEO: Primary data validation passed. [2025-10-15T18:24:14.731439] [INFO ] [MAIN ] DEO: Fetched primary data is valid. [2025-10-15T18:24:14.731503] [DEBUG] [LOCAL ] DEO: Saving primary data. [2025-10-15T18:24:14.733065] [DEBUG] [LOCAL ] DEO: Trimmed 71734 records to 49216 (keeping 200 days of data) [2025-10-15T18:24:15.036194] [DEBUG] [LOCAL ] DEO: Primary data saved (49216 records). [2025-10-15T18:24:15.036341] [INFO ] [MAIN ] DEO: Full history saved. [2025-10-15T18:24:15.037351] [INFO ] [MAIN ] Update Progress: 609/2369 symbols completed. DEO took 37.1s. Estimated remaining: 4h 3m 16s. Rate: 7.2 symbols/min [2025-10-15T18:24:15.209299] [INFO ] [MAIN ] DG: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:24:15.266371] [DEBUG] [LOCAL ] DG: Loaded 53278 existing records from primary storage. [2025-10-15T18:24:15.266702] [INFO ] [MAIN ] DG: Loaded 53278 existing records. [2025-10-15T18:24:15.336091] [INFO ] [REMOTE ] DFP: Fetching primary data for 2024-12. [2025-10-15T18:24:15.450187] [WARN ] [MAIN ] DG: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:24:15.450414] [INFO ] [MAIN ] DG: Wiping existing primary data before full refresh. [2025-10-15T18:24:15.450488] [INFO ] [LOCAL ] DG: Starting deletion of primary data. [2025-10-15T18:24:15.450918] [DEBUG] [LOCAL ] DG: Deleted primary data file. [2025-10-15T18:24:15.450976] [INFO ] [MAIN ] DG: Starting full primary refresh. [2025-10-15T18:24:15.822175] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-15T18:24:15.861754] [INFO ] [REMOTE ] DG: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:24:16.001570] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-09 (2.29 seconds). [2025-10-15T18:24:16.020219] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-10-15T18:24:16.113974] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-01. [2025-10-15T18:24:16.760485] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-15T18:24:16.914023] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-10. [2025-10-15T18:24:17.714016] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-02. [2025-10-15T18:24:18.478870] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-15T18:24:18.513966] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-03. [2025-10-15T18:24:19.249269] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-10 (2.34 seconds). [2025-10-15T18:24:19.261044] [INFO ] [REMOTE ] DELL: Full fetch complete (77915 records). [2025-10-15T18:24:19.267921] [DEBUG] [VALIDATOR ] DELL: Validating primary data. [2025-10-15T18:24:19.268361] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-15T18:24:19.319129] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-09. [2025-10-15T18:24:19.695503] [DEBUG] [VALIDATOR ] DELL: All expected trading days are present. [2025-10-15T18:24:19.695627] [DEBUG] [VALIDATOR ] DELL: Primary data validation passed. [2025-10-15T18:24:19.696712] [INFO ] [MAIN ] DELL: Fetched primary data is valid. [2025-10-15T18:24:19.696780] [DEBUG] [LOCAL ] DELL: Saving primary data. [2025-10-15T18:24:19.698410] [DEBUG] [LOCAL ] DELL: Trimmed 77915 records to 53736 (keeping 200 days of data) [2025-10-15T18:24:20.043584] [DEBUG] [LOCAL ] DELL: Primary data saved (53736 records). [2025-10-15T18:24:20.043751] [INFO ] [MAIN ] DELL: Full history saved. [2025-10-15T18:24:20.043840] [INFO ] [MAIN ] Update Progress: 610/2369 symbols completed. DELL took 47.8s. Estimated remaining: 4h 2m 58s. Rate: 7.2 symbols/min [2025-10-15T18:24:20.119101] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-04. [2025-10-15T18:24:20.240711] [INFO ] [MAIN ] DGX: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:24:20.241057] [DEBUG] [LOCAL ] DGX: No existing data file found in primary storage. [2025-10-15T18:24:20.241112] [WARN ] [MAIN ] DGX: No existing data found, performing full refresh instead. [2025-10-15T18:24:20.241230] [INFO ] [MAIN ] DGX: Wiping existing primary data before full refresh. [2025-10-15T18:24:20.241271] [INFO ] [LOCAL ] DGX: Starting deletion of primary data. [2025-10-15T18:24:20.241312] [DEBUG] [LOCAL ] DGX: No primary data file found to delete. [2025-10-15T18:24:20.241344] [INFO ] [MAIN ] DGX: Starting full primary refresh. [2025-10-15T18:24:20.582506] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-15T18:24:20.658537] [INFO ] [REMOTE ] DGX: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:24:20.774356] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-15T18:24:20.914010] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-05. [2025-10-15T18:24:21.713299] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-15T18:24:21.714353] [INFO ] [REMOTE ] DGX: Fetching primary data for 2024-12. [2025-10-15T18:24:22.514004] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-10. [2025-10-15T18:24:23.305680] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-15T18:24:23.314058] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-06. [2025-10-15T18:24:23.578302] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-15T18:24:23.581152] [INFO ] [REMOTE ] DFIN: Full fetch complete (33412 records). [2025-10-15T18:24:23.581234] [DEBUG] [VALIDATOR ] DFIN: Validating primary data. [2025-10-15T18:24:24.017489] [DEBUG] [VALIDATOR ] DFIN: All expected trading days are present. [2025-10-15T18:24:24.017569] [DEBUG] [VALIDATOR ] DFIN: Primary data validation passed. [2025-10-15T18:24:24.018277] [INFO ] [MAIN ] DFIN: Fetched primary data is valid. [2025-10-15T18:24:24.018341] [DEBUG] [LOCAL ] DFIN: Saving primary data. [2025-10-15T18:24:24.019153] [DEBUG] [LOCAL ] DFIN: Trimmed 33412 records to 22637 (keeping 200 days of data) [2025-10-15T18:24:24.118210] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-15T18:24:24.115689] [INFO ] [REMOTE ] DG: Fetching primary data for 2024-12. [2025-10-15T18:24:24.172685] [DEBUG] [LOCAL ] DFIN: Primary data saved (22637 records). [2025-10-15T18:24:24.172803] [INFO ] [MAIN ] DFIN: Full history saved. [2025-10-15T18:24:24.172878] [INFO ] [MAIN ] Update Progress: 611/2369 symbols completed. DFIN took 34.1s. Estimated remaining: 4h 2m 38s. Rate: 7.2 symbols/min [2025-10-15T18:24:24.347587] [INFO ] [MAIN ] DHF: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:24:24.370762] [DEBUG] [LOCAL ] DHF: Loaded 21165 existing records from primary storage. [2025-10-15T18:24:24.371107] [INFO ] [MAIN ] DHF: Loaded 21165 existing records. [2025-10-15T18:24:24.547754] [WARN ] [MAIN ] DHF: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:24:24.547970] [INFO ] [MAIN ] DHF: Wiping existing primary data before full refresh. [2025-10-15T18:24:24.548020] [INFO ] [LOCAL ] DHF: Starting deletion of primary data. [2025-10-15T18:24:24.548206] [DEBUG] [LOCAL ] DHF: Deleted primary data file. [2025-10-15T18:24:24.548259] [INFO ] [MAIN ] DHF: Starting full primary refresh. [2025-10-15T18:24:24.904262] [INFO ] [REMOTE ] DHF: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:24:24.913948] [INFO ] [REMOTE ] DHF: Fetching primary data for 2024-12. [2025-10-15T18:24:25.714041] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-01. [2025-10-15T18:24:25.978361] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-10-15T18:24:26.232553] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2024-12 (2.12 seconds). [2025-10-15T18:24:26.514000] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-01. [2025-10-15T18:24:26.923303] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-15T18:24:27.313981] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-02. [2025-10-15T18:24:27.572169] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-15T18:24:28.114041] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-02. [2025-10-15T18:24:28.847151] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-15T18:24:28.913950] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-07. [2025-10-15T18:24:29.074110] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-15T18:24:29.713986] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-03. [2025-10-15T18:24:29.789168] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-15T18:24:30.514002] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-01. [2025-10-15T18:24:31.313992] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-08. [2025-10-15T18:24:31.450077] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-15T18:24:31.985009] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-10-15T18:24:32.113973] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-04. [2025-10-15T18:24:32.145793] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-15T18:24:32.913995] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-02. [2025-10-15T18:24:33.714062] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-09. [2025-10-15T18:24:33.942920] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-15T18:24:34.202134] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-10-15T18:24:34.513980] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-10. [2025-10-15T18:24:34.670801] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-15T18:24:35.161821] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-15T18:24:35.163238] [INFO ] [REMOTE ] DFP: Full fetch complete (15863 records). [2025-10-15T18:24:35.163306] [DEBUG] [VALIDATOR ] DFP: Validating primary data. [2025-10-15T18:24:35.317783] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-03. [2025-10-15T18:24:35.526414] [DEBUG] [VALIDATOR ] DFP: All expected trading days are present. [2025-10-15T18:24:35.526493] [DEBUG] [VALIDATOR ] DFP: Primary data validation passed. [2025-10-15T18:24:35.526885] [INFO ] [MAIN ] DFP: Fetched primary data is valid. [2025-10-15T18:24:35.526945] [DEBUG] [LOCAL ] DFP: Saving primary data. [2025-10-15T18:24:35.527431] [DEBUG] [LOCAL ] DFP: Trimmed 15863 records to 11194 (keeping 200 days of data) [2025-10-15T18:24:35.596951] [DEBUG] [LOCAL ] DFP: Primary data saved (11194 records). [2025-10-15T18:24:35.597102] [INFO ] [MAIN ] DFP: Full history saved. [2025-10-15T18:24:35.597184] [INFO ] [MAIN ] Update Progress: 612/2369 symbols completed. DFP took 23.1s. Estimated remaining: 4h 2m 39s. Rate: 7.2 symbols/min [2025-10-15T18:24:35.783072] [INFO ] [MAIN ] DHI: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:24:35.835462] [DEBUG] [LOCAL ] DHI: Loaded 53364 existing records from primary storage. [2025-10-15T18:24:35.835779] [INFO ] [MAIN ] DHI: Loaded 53364 existing records. [2025-10-15T18:24:36.009885] [WARN ] [MAIN ] DHI: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:24:36.010194] [INFO ] [MAIN ] DHI: Wiping existing primary data before full refresh. [2025-10-15T18:24:36.010252] [INFO ] [LOCAL ] DHI: Starting deletion of primary data. [2025-10-15T18:24:36.010694] [DEBUG] [LOCAL ] DHI: Deleted primary data file. [2025-10-15T18:24:36.010751] [INFO ] [MAIN ] DHI: Starting full primary refresh. [2025-10-15T18:24:36.119073] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-03. [2025-10-15T18:24:36.363976] [INFO ] [REMOTE ] DHI: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:24:36.657314] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-15T18:24:36.914008] [INFO ] [REMOTE ] DHI: Fetching primary data for 2024-12. [2025-10-15T18:24:37.713978] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-05. [2025-10-15T18:24:37.990981] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-15T18:24:38.514010] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-04. [2025-10-15T18:24:38.921710] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-10-15T18:24:39.248759] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-15T18:24:39.313960] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-06. [2025-10-15T18:24:39.449026] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-15T18:24:40.114009] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-05. [2025-10-15T18:24:40.839508] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-15T18:24:40.913966] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-01. [2025-10-15T18:24:41.092003] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-15T18:24:41.713977] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-06. [2025-10-15T18:24:42.514027] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-07. [2025-10-15T18:24:42.610341] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-15T18:24:42.720578] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-15T18:24:43.314003] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-04. [2025-10-15T18:24:44.113978] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-07. [2025-10-15T18:24:44.262839] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-15T18:24:44.914077] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-02. [2025-10-15T18:24:45.379837] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-15T18:24:45.383044] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-10-15T18:24:45.714020] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-05. [2025-10-15T18:24:46.431922] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-15T18:24:46.514009] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-03. [2025-10-15T18:24:47.314066] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-08. [2025-10-15T18:24:47.883091] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-05 (2.17 seconds). [2025-10-15T18:24:48.059158] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-15T18:24:48.113948] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-04. [2025-10-15T18:24:48.919116] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-08. [2025-10-15T18:24:48.932520] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-15T18:24:49.713962] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-09. [2025-10-15T18:24:50.157774] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-15T18:24:50.409484] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-15T18:24:50.513992] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-09. [2025-10-15T18:24:51.264166] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-15T18:24:51.313955] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-10. [2025-10-15T18:24:51.601853] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-15T18:24:52.114014] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-10. [2025-10-15T18:24:52.913954] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-06. [2025-10-15T18:24:52.931980] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-15T18:24:52.937557] [INFO ] [REMOTE ] DGX: Full fetch complete (65280 records). [2025-10-15T18:24:52.940879] [DEBUG] [VALIDATOR ] DGX: Validating primary data. [2025-10-15T18:24:53.224794] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-15T18:24:53.248824] [INFO ] [REMOTE ] DHF: Full fetch complete (29972 records). [2025-10-15T18:24:53.259190] [DEBUG] [VALIDATOR ] DHF: Validating primary data. [2025-10-15T18:24:53.483796] [DEBUG] [VALIDATOR ] DGX: All expected trading days are present. [2025-10-15T18:24:53.491505] [DEBUG] [VALIDATOR ] DGX: Primary data validation passed. [2025-10-15T18:24:53.493201] [INFO ] [MAIN ] DGX: Fetched primary data is valid. [2025-10-15T18:24:53.493585] [DEBUG] [LOCAL ] DGX: Saving primary data. [2025-10-15T18:24:53.616562] [DEBUG] [LOCAL ] DGX: Trimmed 65280 records to 44657 (keeping 200 days of data) [2025-10-15T18:24:53.721374] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-05. [2025-10-15T18:24:53.797173] [DEBUG] [VALIDATOR ] DHF: All expected trading days are present. [2025-10-15T18:24:53.797245] [DEBUG] [VALIDATOR ] DHF: Primary data validation passed. [2025-10-15T18:24:53.797874] [INFO ] [MAIN ] DHF: Fetched primary data is valid. [2025-10-15T18:24:53.797940] [DEBUG] [LOCAL ] DHF: Saving primary data. [2025-10-15T18:24:53.798884] [DEBUG] [LOCAL ] DHF: Trimmed 29972 records to 21070 (keeping 200 days of data) [2025-10-15T18:24:54.055918] [DEBUG] [LOCAL ] DHF: Primary data saved (21070 records). [2025-10-15T18:24:54.056527] [INFO ] [MAIN ] DHF: Full history saved. [2025-10-15T18:24:54.056876] [INFO ] [MAIN ] Update Progress: 613/2369 symbols completed. DHF took 29.9s. Estimated remaining: 4h 2m 59s. Rate: 7.2 symbols/min [2025-10-15T18:24:54.237027] [INFO ] [MAIN ] DHR: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:24:54.238173] [DEBUG] [LOCAL ] DHR: No existing data file found in primary storage. [2025-10-15T18:24:54.238462] [WARN ] [MAIN ] DHR: No existing data found, performing full refresh instead. [2025-10-15T18:24:54.238598] [INFO ] [MAIN ] DHR: Wiping existing primary data before full refresh. [2025-10-15T18:24:54.240301] [INFO ] [LOCAL ] DHR: Starting deletion of primary data. [2025-10-15T18:24:54.240670] [DEBUG] [LOCAL ] DHR: No primary data file found to delete. [2025-10-15T18:24:54.240958] [INFO ] [MAIN ] DHR: Starting full primary refresh. [2025-10-15T18:24:54.449117] [DEBUG] [LOCAL ] DGX: Primary data saved (44657 records). [2025-10-15T18:24:54.481833] [INFO ] [MAIN ] DGX: Full history saved. [2025-10-15T18:24:54.555829] [INFO ] [MAIN ] Update Progress: 614/2369 symbols completed. DGX took 34.5s. Estimated remaining: 4h 2m 29s. Rate: 7.2 symbols/min [2025-10-15T18:24:54.771589] [INFO ] [REMOTE ] DHR: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:24:54.807319] [INFO ] [REMOTE ] DHR: Fetching primary data for 2024-12. [2025-10-15T18:24:54.835297] [INFO ] [MAIN ] DHT: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:24:54.868168] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-10-15T18:24:54.916155] [DEBUG] [LOCAL ] DHT: Loaded 47891 existing records from primary storage. [2025-10-15T18:24:54.916477] [INFO ] [MAIN ] DHT: Loaded 47891 existing records. [2025-10-15T18:24:55.089489] [WARN ] [MAIN ] DHT: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:24:55.089724] [INFO ] [MAIN ] DHT: Wiping existing primary data before full refresh. [2025-10-15T18:24:55.089777] [INFO ] [LOCAL ] DHT: Starting deletion of primary data. [2025-10-15T18:24:55.090205] [DEBUG] [LOCAL ] DHT: Deleted primary data file. [2025-10-15T18:24:55.090260] [INFO ] [MAIN ] DHT: Starting full primary refresh. [2025-10-15T18:24:55.319074] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-07. [2025-10-15T18:24:55.446803] [INFO ] [REMOTE ] DHT: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:24:55.688744] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-15T18:24:56.114086] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-06. [2025-10-15T18:24:56.714927] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-10-15T18:24:56.918157] [INFO ] [REMOTE ] DHT: Fetching primary data for 2024-12. [2025-10-15T18:24:56.923856] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-15T18:24:57.713986] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-01. [2025-10-15T18:24:57.859965] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-15T18:24:58.382226] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-15T18:24:58.514002] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-07. [2025-10-15T18:24:59.313972] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-08. [2025-10-15T18:24:59.772919] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-01 (2.06 seconds). [2025-10-15T18:25:00.113975] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-02. [2025-10-15T18:25:00.571693] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-10-15T18:25:00.913988] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-01. [2025-10-15T18:25:01.315315] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-10-15T18:25:01.713998] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-08. [2025-10-15T18:25:02.035729] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-10-15T18:25:02.258372] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-15T18:25:02.514073] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-09. [2025-10-15T18:25:03.314060] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-03. [2025-10-15T18:25:03.891078] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-08 (2.18 seconds). [2025-10-15T18:25:04.114042] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-02. [2025-10-15T18:25:04.468056] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-15T18:25:04.913975] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-10. [2025-10-15T18:25:04.965387] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-15T18:25:05.714033] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-04. [2025-10-15T18:25:05.863935] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-15T18:25:06.513999] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-03. [2025-10-15T18:25:06.636046] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-15T18:25:06.641923] [INFO ] [REMOTE ] DG: Full fetch complete (76958 records). [2025-10-15T18:25:06.642040] [DEBUG] [VALIDATOR ] DG: Validating primary data. [2025-10-15T18:25:06.642868] [FATAL] [VALIDATOR ] DG: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T18:25:06.642956] [FATAL] [MAIN ] DG: Fetched primary data is invalid. Refusing to save it. [2025-10-15T18:25:06.643032] [WARN ] [MAIN ] DG: Deleting existing primary and derivative data due to validation failure. [2025-10-15T18:25:06.643104] [INFO ] [LOCAL ] DG: Starting deletion of primary data. [2025-10-15T18:25:06.643167] [DEBUG] [LOCAL ] DG: No primary data file found to delete. [2025-10-15T18:25:06.643204] [INFO ] [LOCAL ] DG: Starting deletion of derivative data. [2025-10-15T18:25:06.643372] [DEBUG] [LOCAL ] DG: Deleted derivative data file. [2025-10-15T18:25:06.644136] [INFO ] [MAIN ] Update Progress: 615/2369 symbols completed. DG took 51.6s. Estimated remaining: 4h 2m 31s. Rate: 7.2 symbols/min [2025-10-15T18:25:06.809147] [INFO ] [MAIN ] DHX: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:25:06.826299] [DEBUG] [LOCAL ] DHX: Loaded 13307 existing records from primary storage. [2025-10-15T18:25:06.826570] [INFO ] [MAIN ] DHX: Loaded 13307 existing records. [2025-10-15T18:25:06.998831] [WARN ] [MAIN ] DHX: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:25:06.999064] [INFO ] [MAIN ] DHX: Wiping existing primary data before full refresh. [2025-10-15T18:25:06.999110] [INFO ] [LOCAL ] DHX: Starting deletion of primary data. [2025-10-15T18:25:06.999272] [DEBUG] [LOCAL ] DHX: Deleted primary data file. [2025-10-15T18:25:06.999311] [INFO ] [MAIN ] DHX: Starting full primary refresh. [2025-10-15T18:25:07.317918] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-09. [2025-10-15T18:25:07.370271] [INFO ] [REMOTE ] DHX: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:25:07.721960] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-15T18:25:08.095011] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-15T18:25:08.113965] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-04. [2025-10-15T18:25:08.913970] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-05. [2025-10-15T18:25:09.600880] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-09 (2.28 seconds). [2025-10-15T18:25:09.713966] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-10. [2025-10-15T18:25:10.017445] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-15T18:25:10.513978] [INFO ] [REMOTE ] DHX: Fetching primary data for 2024-12. [2025-10-15T18:25:10.858696] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-15T18:25:11.313973] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-05. [2025-10-15T18:25:11.388880] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-15T18:25:11.394756] [INFO ] [REMOTE ] DHI: Full fetch complete (77001 records). [2025-10-15T18:25:11.394887] [DEBUG] [VALIDATOR ] DHI: Validating primary data. [2025-10-15T18:25:11.395691] [FATAL] [VALIDATOR ] DHI: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T18:25:11.395782] [FATAL] [MAIN ] DHI: Fetched primary data is invalid. Refusing to save it. [2025-10-15T18:25:11.395825] [WARN ] [MAIN ] DHI: Deleting existing primary and derivative data due to validation failure. [2025-10-15T18:25:11.395889] [INFO ] [LOCAL ] DHI: Starting deletion of primary data. [2025-10-15T18:25:11.395954] [DEBUG] [LOCAL ] DHI: No primary data file found to delete. [2025-10-15T18:25:11.395991] [INFO ] [LOCAL ] DHI: Starting deletion of derivative data. [2025-10-15T18:25:11.396104] [DEBUG] [LOCAL ] DHI: Deleted derivative data file. [2025-10-15T18:25:11.396503] [INFO ] [MAIN ] Update Progress: 616/2369 symbols completed. DHI took 35.8s. Estimated remaining: 4h 2m 13s. Rate: 7.2 symbols/min [2025-10-15T18:25:11.525756] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-10-15T18:25:11.587363] [INFO ] [MAIN ] DIAX: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:25:11.602666] [DEBUG] [LOCAL ] DIAX: Loaded 13088 existing records from primary storage. [2025-10-15T18:25:11.602914] [INFO ] [MAIN ] DIAX: Loaded 13088 existing records. [2025-10-15T18:25:11.775060] [WARN ] [MAIN ] DIAX: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:25:11.775284] [INFO ] [MAIN ] DIAX: Wiping existing primary data before full refresh. [2025-10-15T18:25:11.775331] [INFO ] [LOCAL ] DIAX: Starting deletion of primary data. [2025-10-15T18:25:11.775484] [DEBUG] [LOCAL ] DIAX: Deleted primary data file. [2025-10-15T18:25:11.775520] [INFO ] [MAIN ] DIAX: Starting full primary refresh. [2025-10-15T18:25:12.124543] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-01. [2025-10-15T18:25:12.129215] [INFO ] [REMOTE ] DIAX: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:25:12.914015] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2024-12. [2025-10-15T18:25:13.088559] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-15T18:25:13.372502] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-10-15T18:25:13.714037] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-06. [2025-10-15T18:25:13.805308] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-10-15T18:25:14.514005] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-06. [2025-10-15T18:25:15.313998] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-01. [2025-10-15T18:25:15.604058] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-15T18:25:15.951208] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-15T18:25:16.103119] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-15T18:25:16.113952] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-07. [2025-10-15T18:25:16.913989] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-02. [2025-10-15T18:25:17.500728] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-15T18:25:17.645343] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-15T18:25:17.714018] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-03. [2025-10-15T18:25:18.514038] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-02. [2025-10-15T18:25:18.551346] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-15T18:25:19.314011] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-07. [2025-10-15T18:25:19.333309] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-15T18:25:20.114007] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-04. [2025-10-15T18:25:20.913961] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-08. [2025-10-15T18:25:21.058190] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-15T18:25:21.109936] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-15T18:25:21.714003] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-05. [2025-10-15T18:25:22.440269] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-15T18:25:22.514008] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-03. [2025-10-15T18:25:22.637617] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-15T18:25:23.313970] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-06. [2025-10-15T18:25:23.544635] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-15T18:25:24.058063] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-15T18:25:24.113977] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-07. [2025-10-15T18:25:24.913980] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-09. [2025-10-15T18:25:24.958744] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-15T18:25:25.714047] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-04. [2025-10-15T18:25:26.395813] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-15T18:25:26.514157] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-08. [2025-10-15T18:25:26.719267] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-15T18:25:27.169583] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-15T18:25:27.314004] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-09. [2025-10-15T18:25:27.966511] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-15T18:25:28.114048] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-08. [2025-10-15T18:25:28.913994] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-05. [2025-10-15T18:25:29.714018] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-10. [2025-10-15T18:25:29.883638] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-15T18:25:30.031501] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-15T18:25:30.513995] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-09. [2025-10-15T18:25:31.209482] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-15T18:25:31.215497] [INFO ] [REMOTE ] DHT: Full fetch complete (70174 records). [2025-10-15T18:25:31.215614] [DEBUG] [VALIDATOR ] DHT: Validating primary data. [2025-10-15T18:25:31.318833] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-06. [2025-10-15T18:25:31.621776] [DEBUG] [VALIDATOR ] DHT: All expected trading days are present. [2025-10-15T18:25:31.622117] [DEBUG] [VALIDATOR ] DHT: Primary data validation passed. [2025-10-15T18:25:31.623171] [INFO ] [MAIN ] DHT: Fetched primary data is valid. [2025-10-15T18:25:31.623252] [DEBUG] [LOCAL ] DHT: Saving primary data. [2025-10-15T18:25:31.624813] [DEBUG] [LOCAL ] DHT: Trimmed 70174 records to 47932 (keeping 200 days of data) [2025-10-15T18:25:31.915225] [DEBUG] [LOCAL ] DHT: Primary data saved (47932 records). [2025-10-15T18:25:31.915346] [INFO ] [MAIN ] DHT: Full history saved. [2025-10-15T18:25:31.915429] [INFO ] [MAIN ] Update Progress: 617/2369 symbols completed. DHT took 37.4s. Estimated remaining: 4h 2m 39s. Rate: 7.2 symbols/min [2025-10-15T18:25:32.052983] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-15T18:25:32.110016] [INFO ] [MAIN ] DIN: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:25:32.113960] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-07. [2025-10-15T18:25:32.172413] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-15T18:25:32.171348] [DEBUG] [LOCAL ] DIN: Loaded 37391 existing records from primary storage. [2025-10-15T18:25:32.183279] [INFO ] [MAIN ] DIN: Loaded 37391 existing records. [2025-10-15T18:25:32.366006] [WARN ] [MAIN ] DIN: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:25:32.366659] [INFO ] [MAIN ] DIN: Wiping existing primary data before full refresh. [2025-10-15T18:25:32.366722] [INFO ] [LOCAL ] DIN: Starting deletion of primary data. [2025-10-15T18:25:32.367191] [DEBUG] [LOCAL ] DIN: Deleted primary data file. [2025-10-15T18:25:32.367248] [INFO ] [MAIN ] DIN: Starting full primary refresh. [2025-10-15T18:25:32.719360] [INFO ] [REMOTE ] DIN: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:25:32.727251] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-15T18:25:32.913956] [INFO ] [REMOTE ] DIN: Fetching primary data for 2024-12. [2025-10-15T18:25:33.714001] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-08. [2025-10-15T18:25:34.204876] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-15T18:25:34.300353] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-15T18:25:34.513996] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-10. [2025-10-15T18:25:35.291901] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-15T18:25:35.298481] [INFO ] [REMOTE ] DHR: Full fetch complete (77429 records). [2025-10-15T18:25:35.298688] [DEBUG] [VALIDATOR ] DHR: Validating primary data. [2025-10-15T18:25:35.319604] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-01. [2025-10-15T18:25:35.692404] [DEBUG] [VALIDATOR ] DHR: All expected trading days are present. [2025-10-15T18:25:35.692517] [DEBUG] [VALIDATOR ] DHR: Primary data validation passed. [2025-10-15T18:25:35.693462] [INFO ] [MAIN ] DHR: Fetched primary data is valid. [2025-10-15T18:25:35.693529] [DEBUG] [LOCAL ] DHR: Saving primary data. [2025-10-15T18:25:35.695494] [DEBUG] [LOCAL ] DHR: Trimmed 77429 records to 53378 (keeping 200 days of data) [2025-10-15T18:25:36.031891] [DEBUG] [LOCAL ] DHR: Primary data saved (53378 records). [2025-10-15T18:25:36.032039] [INFO ] [MAIN ] DHR: Full history saved. [2025-10-15T18:25:36.032113] [INFO ] [MAIN ] Update Progress: 618/2369 symbols completed. DHR took 42.0s. Estimated remaining: 4h 2m 19s. Rate: 7.2 symbols/min [2025-10-15T18:25:36.119089] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-10. [2025-10-15T18:25:36.209575] [INFO ] [MAIN ] DINO: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:25:36.259806] [DEBUG] [LOCAL ] DINO: Loaded 52845 existing records from primary storage. [2025-10-15T18:25:36.260139] [INFO ] [MAIN ] DINO: Loaded 52845 existing records. [2025-10-15T18:25:36.450525] [WARN ] [MAIN ] DINO: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:25:36.450758] [INFO ] [MAIN ] DINO: Wiping existing primary data before full refresh. [2025-10-15T18:25:36.450817] [INFO ] [LOCAL ] DINO: Starting deletion of primary data. [2025-10-15T18:25:36.451256] [DEBUG] [LOCAL ] DINO: Deleted primary data file. [2025-10-15T18:25:36.451314] [INFO ] [MAIN ] DINO: Starting full primary refresh. [2025-10-15T18:25:36.848402] [INFO ] [REMOTE ] DINO: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:25:36.850346] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-15T18:25:36.913951] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-02. [2025-10-15T18:25:37.174825] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-15T18:25:37.176965] [INFO ] [REMOTE ] DIAX: Full fetch complete (17722 records). [2025-10-15T18:25:37.177034] [DEBUG] [VALIDATOR ] DIAX: Validating primary data. [2025-10-15T18:25:37.544978] [DEBUG] [VALIDATOR ] DIAX: All expected trading days are present. [2025-10-15T18:25:37.545068] [DEBUG] [VALIDATOR ] DIAX: Primary data validation passed. [2025-10-15T18:25:37.545555] [INFO ] [MAIN ] DIAX: Fetched primary data is valid. [2025-10-15T18:25:37.545594] [DEBUG] [LOCAL ] DIAX: Saving primary data. [2025-10-15T18:25:37.546249] [DEBUG] [LOCAL ] DIAX: Trimmed 17722 records to 13028 (keeping 200 days of data) [2025-10-15T18:25:37.634325] [DEBUG] [LOCAL ] DIAX: Primary data saved (13028 records). [2025-10-15T18:25:37.634530] [INFO ] [MAIN ] DIAX: Full history saved. [2025-10-15T18:25:37.634675] [INFO ] [MAIN ] Update Progress: 619/2369 symbols completed. DIAX took 26.2s. Estimated remaining: 4h 1m 52s. Rate: 7.2 symbols/min [2025-10-15T18:25:37.720199] [INFO ] [REMOTE ] DINO: Fetching primary data for 2024-12. [2025-10-15T18:25:37.842534] [INFO ] [MAIN ] DIS: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:25:37.905440] [DEBUG] [LOCAL ] DIS: Loaded 53788 existing records from primary storage. [2025-10-15T18:25:37.905923] [INFO ] [MAIN ] DIS: Loaded 53788 existing records. [2025-10-15T18:25:38.152880] [WARN ] [MAIN ] DIS: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:25:38.153116] [INFO ] [MAIN ] DIS: Wiping existing primary data before full refresh. [2025-10-15T18:25:38.153236] [INFO ] [LOCAL ] DIS: Starting deletion of primary data. [2025-10-15T18:25:38.153631] [DEBUG] [LOCAL ] DIS: Deleted primary data file. [2025-10-15T18:25:38.153743] [INFO ] [MAIN ] DIS: Starting full primary refresh. [2025-10-15T18:25:38.396239] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-15T18:25:38.523244] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-03. [2025-10-15T18:25:38.675452] [INFO ] [REMOTE ] DIS: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:25:39.314008] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-09. [2025-10-15T18:25:39.395245] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-15T18:25:39.770392] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-15T18:25:40.096288] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-15T18:25:40.113967] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-04. [2025-10-15T18:25:40.913998] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-01. [2025-10-15T18:25:41.585075] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-15T18:25:41.713993] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-05. [2025-10-15T18:25:42.513975] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-10. [2025-10-15T18:25:42.610755] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-15T18:25:43.058675] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-15T18:25:43.171028] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-15T18:25:43.173544] [INFO ] [REMOTE ] DHX: Full fetch complete (21344 records). [2025-10-15T18:25:43.173617] [DEBUG] [VALIDATOR ] DHX: Validating primary data. [2025-10-15T18:25:43.319112] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-06. [2025-10-15T18:25:43.543924] [DEBUG] [VALIDATOR ] DHX: All expected trading days are present. [2025-10-15T18:25:43.543996] [DEBUG] [VALIDATOR ] DHX: Primary data validation passed. [2025-10-15T18:25:43.544427] [INFO ] [MAIN ] DHX: Fetched primary data is valid. [2025-10-15T18:25:43.544466] [DEBUG] [LOCAL ] DHX: Saving primary data. [2025-10-15T18:25:43.545030] [DEBUG] [LOCAL ] DHX: Trimmed 21344 records to 13388 (keeping 200 days of data) [2025-10-15T18:25:43.617872] [DEBUG] [LOCAL ] DHX: Primary data saved (13388 records). [2025-10-15T18:25:43.618000] [INFO ] [MAIN ] DHX: Full history saved. [2025-10-15T18:25:43.618078] [INFO ] [MAIN ] Update Progress: 620/2369 symbols completed. DHX took 37.0s. Estimated remaining: 4h 1m 37s. Rate: 7.2 symbols/min [2025-10-15T18:25:43.810340] [INFO ] [MAIN ] DIVY: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:25:43.810526] [DEBUG] [LOCAL ] DIVY: No existing data file found in primary storage. [2025-10-15T18:25:43.810564] [WARN ] [MAIN ] DIVY: No existing data found, performing full refresh instead. [2025-10-15T18:25:43.810703] [INFO ] [MAIN ] DIVY: Wiping existing primary data before full refresh. [2025-10-15T18:25:43.810754] [INFO ] [LOCAL ] DIVY: Starting deletion of primary data. [2025-10-15T18:25:43.810795] [DEBUG] [LOCAL ] DIVY: No primary data file found to delete. [2025-10-15T18:25:43.810826] [INFO ] [MAIN ] DIVY: Starting full primary refresh. [2025-10-15T18:25:44.128432] [INFO ] [REMOTE ] DIS: Fetching primary data for 2024-12. [2025-10-15T18:25:44.169959] [INFO ] [REMOTE ] DIVY: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:25:44.560868] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-15T18:25:44.913988] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2024-12. [2025-10-15T18:25:45.248491] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2024-12 (0.33 seconds). [2025-10-15T18:25:45.714049] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-07. [2025-10-15T18:25:46.379895] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2024-12 (2.25 seconds). [2025-10-15T18:25:46.513987] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-02. [2025-10-15T18:25:47.044188] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-15T18:25:47.313985] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-08. [2025-10-15T18:25:48.114092] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-01. [2025-10-15T18:25:48.232994] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-15T18:25:48.598599] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-15T18:25:48.914054] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-01. [2025-10-15T18:25:49.360420] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-10-15T18:25:49.714069] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-02. [2025-10-15T18:25:50.113247] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-10-15T18:25:50.429143] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-01 (2.32 seconds). [2025-10-15T18:25:50.513993] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-02. [2025-10-15T18:25:51.314005] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-03. [2025-10-15T18:25:52.113997] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-03. [2025-10-15T18:25:52.553002] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-10-15T18:25:52.810217] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-02 (2.30 seconds). [2025-10-15T18:25:52.914006] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-03. [2025-10-15T18:25:53.208485] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-15T18:25:53.714048] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-04. [2025-10-15T18:25:54.514009] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-09. [2025-10-15T18:25:55.156182] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-03 (2.24 seconds). [2025-10-15T18:25:55.313983] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-04. [2025-10-15T18:25:55.478272] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-15T18:25:56.113969] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-04. [2025-10-15T18:25:56.236906] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-15T18:25:56.504809] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-04 (0.39 seconds). [2025-10-15T18:25:56.914009] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-05. [2025-10-15T18:25:57.222539] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-05 (0.31 seconds). [2025-10-15T18:25:57.631875] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-04 (2.32 seconds). [2025-10-15T18:25:57.714031] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-05. [2025-10-15T18:25:58.514036] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-05. [2025-10-15T18:25:59.314008] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-06. [2025-10-15T18:25:59.454120] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-15T18:25:59.647953] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-06 (0.33 seconds). [2025-10-15T18:26:00.114039] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-06. [2025-10-15T18:26:00.914016] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-10. [2025-10-15T18:26:01.036793] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-05 (2.52 seconds). [2025-10-15T18:26:01.713991] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-06. [2025-10-15T18:26:02.282752] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-06 (2.17 seconds). [2025-10-15T18:26:02.514010] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-07. [2025-10-15T18:26:02.546011] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-15T18:26:02.550888] [INFO ] [REMOTE ] DIN: Full fetch complete (55201 records). [2025-10-15T18:26:02.551025] [DEBUG] [VALIDATOR ] DIN: Validating primary data. [2025-10-15T18:26:02.918179] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-07 (0.40 seconds). [2025-10-15T18:26:02.955634] [DEBUG] [VALIDATOR ] DIN: All expected trading days are present. [2025-10-15T18:26:02.957469] [DEBUG] [VALIDATOR ] DIN: Primary data validation passed. [2025-10-15T18:26:02.958492] [INFO ] [MAIN ] DIN: Fetched primary data is valid. [2025-10-15T18:26:02.958567] [DEBUG] [LOCAL ] DIN: Saving primary data. [2025-10-15T18:26:02.959883] [DEBUG] [LOCAL ] DIN: Trimmed 55201 records to 37272 (keeping 200 days of data) [2025-10-15T18:26:03.192451] [DEBUG] [LOCAL ] DIN: Primary data saved (37272 records). [2025-10-15T18:26:03.192602] [INFO ] [MAIN ] DIN: Full history saved. [2025-10-15T18:26:03.192728] [INFO ] [MAIN ] Update Progress: 621/2369 symbols completed. DIN took 31.3s. Estimated remaining: 4h 2m 1s. Rate: 7.2 symbols/min [2025-10-15T18:26:03.316574] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-08. [2025-10-15T18:26:03.387073] [INFO ] [MAIN ] DK: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:26:03.387314] [DEBUG] [LOCAL ] DK: No existing data file found in primary storage. [2025-10-15T18:26:03.387359] [WARN ] [MAIN ] DK: No existing data found, performing full refresh instead. [2025-10-15T18:26:03.387465] [INFO ] [MAIN ] DK: Wiping existing primary data before full refresh. [2025-10-15T18:26:03.387505] [INFO ] [LOCAL ] DK: Starting deletion of primary data. [2025-10-15T18:26:03.387545] [DEBUG] [LOCAL ] DK: No primary data file found to delete. [2025-10-15T18:26:03.387576] [INFO ] [MAIN ] DK: Starting full primary refresh. [2025-10-15T18:26:03.746516] [INFO ] [REMOTE ] DK: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:26:03.935348] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-06 (2.22 seconds). [2025-10-15T18:26:03.948550] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-15T18:26:04.113999] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-09. [2025-10-15T18:26:04.476084] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-09 (0.36 seconds). [2025-10-15T18:26:04.914015] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-10. [2025-10-15T18:26:05.449419] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-15T18:26:05.450374] [INFO ] [REMOTE ] DIVY: Full fetch complete (1704 records). [2025-10-15T18:26:05.450451] [DEBUG] [VALIDATOR ] DIVY: Validating primary data. [2025-10-15T18:26:05.641021] [WARN ] [VALIDATOR ] DIVY: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-15T18:26:05.641255] [FATAL] [MAIN ] DIVY: Fetched primary data is invalid. Refusing to save it. [2025-10-15T18:26:05.641323] [WARN ] [MAIN ] DIVY: Deleting existing primary and derivative data due to validation failure. [2025-10-15T18:26:05.641379] [INFO ] [LOCAL ] DIVY: Starting deletion of primary data. [2025-10-15T18:26:05.641436] [DEBUG] [LOCAL ] DIVY: No primary data file found to delete. [2025-10-15T18:26:05.641472] [INFO ] [LOCAL ] DIVY: Starting deletion of derivative data. [2025-10-15T18:26:05.641512] [DEBUG] [LOCAL ] DIVY: No derivative data file found to delete. [2025-10-15T18:26:05.641568] [INFO ] [MAIN ] Update Progress: 622/2369 symbols completed. DIVY took 22.0s. Estimated remaining: 4h 1m 36s. Rate: 7.2 symbols/min [2025-10-15T18:26:05.719153] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-07. [2025-10-15T18:26:05.823591] [INFO ] [MAIN ] DKL: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:26:05.844394] [DEBUG] [LOCAL ] DKL: Loaded 17667 existing records from primary storage. [2025-10-15T18:26:05.844686] [INFO ] [MAIN ] DKL: Loaded 17667 existing records. [2025-10-15T18:26:06.049967] [WARN ] [MAIN ] DKL: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:26:06.050220] [INFO ] [MAIN ] DKL: Wiping existing primary data before full refresh. [2025-10-15T18:26:06.050269] [INFO ] [LOCAL ] DKL: Starting deletion of primary data. [2025-10-15T18:26:06.050527] [DEBUG] [LOCAL ] DKL: Deleted primary data file. [2025-10-15T18:26:06.050613] [INFO ] [MAIN ] DKL: Starting full primary refresh. [2025-10-15T18:26:06.439019] [INFO ] [REMOTE ] DKL: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:26:06.513966] [INFO ] [REMOTE ] DKL: Fetching primary data for 2024-12. [2025-10-15T18:26:07.314000] [INFO ] [REMOTE ] DK: Fetching primary data for 2024-12. [2025-10-15T18:26:07.646491] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-15T18:26:08.123517] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-01. [2025-10-15T18:26:08.129153] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-07 (2.41 seconds). [2025-10-15T18:26:08.914010] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-08. [2025-10-15T18:26:09.031417] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-15T18:26:09.113624] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-15T18:26:09.713997] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-07. [2025-10-15T18:26:10.514046] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-02. [2025-10-15T18:26:11.181210] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-08 (2.27 seconds). [2025-10-15T18:26:11.281456] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-15T18:26:11.314011] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-01. [2025-10-15T18:26:11.334086] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-15T18:26:12.114033] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-09. [2025-10-15T18:26:12.859478] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-15T18:26:12.913982] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-02. [2025-10-15T18:26:13.714001] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-03. [2025-10-15T18:26:14.420874] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-15T18:26:14.480720] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-09 (2.37 seconds). [2025-10-15T18:26:14.513976] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-03. [2025-10-15T18:26:14.595899] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-15T18:26:15.314073] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-08. [2025-10-15T18:26:15.949747] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-15T18:26:16.114049] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-04. [2025-10-15T18:26:16.913987] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-04. [2025-10-15T18:26:17.353422] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-10-15T18:26:17.424426] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-15T18:26:17.714069] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-09. [2025-10-15T18:26:18.117817] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-15T18:26:18.514006] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-05. [2025-10-15T18:26:19.269446] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-15T18:26:19.313950] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-10. [2025-10-15T18:26:19.565557] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-15T18:26:20.114048] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-06. [2025-10-15T18:26:20.905122] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-15T18:26:20.912214] [INFO ] [REMOTE ] DINO: Full fetch complete (76721 records). [2025-10-15T18:26:20.912360] [DEBUG] [VALIDATOR ] DINO: Validating primary data. [2025-10-15T18:26:20.924527] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-05. [2025-10-15T18:26:21.262835] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-15T18:26:21.348040] [DEBUG] [VALIDATOR ] DINO: All expected trading days are present. [2025-10-15T18:26:21.348137] [DEBUG] [VALIDATOR ] DINO: Primary data validation passed. [2025-10-15T18:26:21.349073] [INFO ] [MAIN ] DINO: Fetched primary data is valid. [2025-10-15T18:26:21.349140] [DEBUG] [LOCAL ] DINO: Saving primary data. [2025-10-15T18:26:21.350676] [DEBUG] [LOCAL ] DINO: Trimmed 76721 records to 52842 (keeping 200 days of data) [2025-10-15T18:26:21.674668] [DEBUG] [LOCAL ] DINO: Primary data saved (52842 records). [2025-10-15T18:26:21.674803] [INFO ] [MAIN ] DINO: Full history saved. [2025-10-15T18:26:21.674881] [INFO ] [MAIN ] Update Progress: 623/2369 symbols completed. DINO took 45.6s. Estimated remaining: 4h 1m 49s. Rate: 7.2 symbols/min [2025-10-15T18:26:21.720919] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-07. [2025-10-15T18:26:21.849427] [INFO ] [MAIN ] DKS: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:26:21.899878] [DEBUG] [LOCAL ] DKS: Loaded 49710 existing records from primary storage. [2025-10-15T18:26:21.900215] [INFO ] [MAIN ] DKS: Loaded 49710 existing records. [2025-10-15T18:26:22.071941] [WARN ] [MAIN ] DKS: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:26:22.072163] [INFO ] [MAIN ] DKS: Wiping existing primary data before full refresh. [2025-10-15T18:26:22.072224] [INFO ] [LOCAL ] DKS: Starting deletion of primary data. [2025-10-15T18:26:22.072470] [DEBUG] [LOCAL ] DKS: Deleted primary data file. [2025-10-15T18:26:22.072527] [INFO ] [MAIN ] DKS: Starting full primary refresh. [2025-10-15T18:26:22.421194] [INFO ] [REMOTE ] DKS: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:26:22.513969] [INFO ] [REMOTE ] DKS: Fetching primary data for 2024-12. [2025-10-15T18:26:22.556964] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-15T18:26:22.666555] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-15T18:26:23.313992] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-10. [2025-10-15T18:26:23.930383] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-15T18:26:23.936848] [INFO ] [REMOTE ] DIS: Full fetch complete (77967 records). [2025-10-15T18:26:23.937012] [DEBUG] [VALIDATOR ] DIS: Validating primary data. [2025-10-15T18:26:24.117311] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-08. [2025-10-15T18:26:24.340506] [DEBUG] [VALIDATOR ] DIS: All expected trading days are present. [2025-10-15T18:26:24.340610] [DEBUG] [VALIDATOR ] DIS: Primary data validation passed. [2025-10-15T18:26:24.341605] [INFO ] [MAIN ] DIS: Fetched primary data is valid. [2025-10-15T18:26:24.341711] [DEBUG] [LOCAL ] DIS: Saving primary data. [2025-10-15T18:26:24.343352] [DEBUG] [LOCAL ] DIS: Trimmed 77967 records to 53788 (keeping 200 days of data) [2025-10-15T18:26:24.589062] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2024-12 (2.08 seconds). [2025-10-15T18:26:24.717579] [DEBUG] [LOCAL ] DIS: Primary data saved (53788 records). [2025-10-15T18:26:24.717789] [INFO ] [MAIN ] DIS: Full history saved. [2025-10-15T18:26:24.718146] [INFO ] [MAIN ] Update Progress: 624/2369 symbols completed. DIS took 47.1s. Estimated remaining: 4h 1m 26s. Rate: 7.2 symbols/min [2025-10-15T18:26:24.887808] [INFO ] [MAIN ] DLB: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:26:24.888017] [DEBUG] [LOCAL ] DLB: No existing data file found in primary storage. [2025-10-15T18:26:24.888054] [WARN ] [MAIN ] DLB: No existing data found, performing full refresh instead. [2025-10-15T18:26:24.888161] [INFO ] [MAIN ] DLB: Wiping existing primary data before full refresh. [2025-10-15T18:26:24.888201] [INFO ] [LOCAL ] DLB: Starting deletion of primary data. [2025-10-15T18:26:24.888241] [DEBUG] [LOCAL ] DLB: No primary data file found to delete. [2025-10-15T18:26:24.888273] [INFO ] [MAIN ] DLB: Starting full primary refresh. [2025-10-15T18:26:24.919147] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-01. [2025-10-15T18:26:25.141329] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-15T18:26:25.291144] [INFO ] [REMOTE ] DLB: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:26:25.714001] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-09. [2025-10-15T18:26:26.514016] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-06. [2025-10-15T18:26:26.644040] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-15T18:26:26.685841] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-15T18:26:27.314004] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-02. [2025-10-15T18:26:27.864554] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-15T18:26:28.114054] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-07. [2025-10-15T18:26:28.913974] [INFO ] [REMOTE ] DLB: Fetching primary data for 2024-12. [2025-10-15T18:26:28.940472] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-15T18:26:29.581216] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-15T18:26:29.713997] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-08. [2025-10-15T18:26:30.368405] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-15T18:26:30.513964] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-01. [2025-10-15T18:26:30.975818] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-15T18:26:31.314004] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-10. [2025-10-15T18:26:31.857752] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-15T18:26:32.113964] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-02. [2025-10-15T18:26:32.351842] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-15T18:26:32.353976] [INFO ] [REMOTE ] DKL: Full fetch complete (27909 records). [2025-10-15T18:26:32.354059] [DEBUG] [VALIDATOR ] DKL: Validating primary data. [2025-10-15T18:26:32.722729] [DEBUG] [VALIDATOR ] DKL: All expected trading days are present. [2025-10-15T18:26:32.722809] [DEBUG] [VALIDATOR ] DKL: Primary data validation passed. [2025-10-15T18:26:32.723342] [INFO ] [MAIN ] DKL: Fetched primary data is valid. [2025-10-15T18:26:32.723381] [DEBUG] [LOCAL ] DKL: Saving primary data. [2025-10-15T18:26:32.724016] [DEBUG] [LOCAL ] DKL: Trimmed 27909 records to 17546 (keeping 200 days of data) [2025-10-15T18:26:32.825710] [DEBUG] [LOCAL ] DKL: Primary data saved (17546 records). [2025-10-15T18:26:32.825835] [INFO ] [MAIN ] DKL: Full history saved. [2025-10-15T18:26:32.825913] [INFO ] [MAIN ] Update Progress: 625/2369 symbols completed. DKL took 27.2s. Estimated remaining: 4h 1m 17s. Rate: 7.2 symbols/min [2025-10-15T18:26:32.920379] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-09. [2025-10-15T18:26:32.992490] [INFO ] [MAIN ] DLNG: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:26:33.000197] [DEBUG] [LOCAL ] DLNG: Loaded 6189 existing records from primary storage. [2025-10-15T18:26:33.000392] [INFO ] [MAIN ] DLNG: Loaded 6189 existing records. [2025-10-15T18:26:33.180697] [WARN ] [MAIN ] DLNG: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:26:33.180994] [INFO ] [MAIN ] DLNG: Wiping existing primary data before full refresh. [2025-10-15T18:26:33.181159] [INFO ] [LOCAL ] DLNG: Starting deletion of primary data. [2025-10-15T18:26:33.181433] [DEBUG] [LOCAL ] DLNG: Deleted primary data file. [2025-10-15T18:26:33.181501] [INFO ] [MAIN ] DLNG: Starting full primary refresh. [2025-10-15T18:26:33.486302] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-15T18:26:33.573339] [INFO ] [REMOTE ] DLNG: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:26:33.714006] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-03. [2025-10-15T18:26:34.514033] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-03. [2025-10-15T18:26:34.658450] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-15T18:26:35.095476] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-15T18:26:35.313986] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-04. [2025-10-15T18:26:36.079439] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-15T18:26:36.114045] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2024-12. [2025-10-15T18:26:36.312104] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-15T18:26:36.796470] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-10-15T18:26:36.914011] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-01. [2025-10-15T18:26:37.713964] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-10. [2025-10-15T18:26:37.872717] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-15T18:26:38.514006] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-04. [2025-10-15T18:26:39.314027] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-02. [2025-10-15T18:26:39.421263] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-15T18:26:39.427294] [INFO ] [REMOTE ] DK: Full fetch complete (71020 records). [2025-10-15T18:26:39.427432] [DEBUG] [VALIDATOR ] DK: Validating primary data. [2025-10-15T18:26:39.833587] [DEBUG] [VALIDATOR ] DK: All expected trading days are present. [2025-10-15T18:26:39.833747] [DEBUG] [VALIDATOR ] DK: Primary data validation passed. [2025-10-15T18:26:39.834772] [INFO ] [MAIN ] DK: Fetched primary data is valid. [2025-10-15T18:26:39.834835] [DEBUG] [LOCAL ] DK: Saving primary data. [2025-10-15T18:26:39.836230] [DEBUG] [LOCAL ] DK: Trimmed 71020 records to 49447 (keeping 200 days of data) [2025-10-15T18:26:39.978895] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-15T18:26:40.113028] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-15T18:26:40.116202] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-05. [2025-10-15T18:26:40.184889] [DEBUG] [LOCAL ] DK: Primary data saved (49447 records). [2025-10-15T18:26:40.185036] [INFO ] [MAIN ] DK: Full history saved. [2025-10-15T18:26:40.185110] [INFO ] [MAIN ] Update Progress: 626/2369 symbols completed. DK took 37.0s. Estimated remaining: 4h 1m 7s. Rate: 7.2 symbols/min [2025-10-15T18:26:40.357375] [INFO ] [MAIN ] DLR: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:26:40.407102] [DEBUG] [LOCAL ] DLR: Loaded 50730 existing records from primary storage. [2025-10-15T18:26:40.407450] [INFO ] [MAIN ] DLR: Loaded 50730 existing records. [2025-10-15T18:26:40.579517] [WARN ] [MAIN ] DLR: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:26:40.579904] [INFO ] [MAIN ] DLR: Wiping existing primary data before full refresh. [2025-10-15T18:26:40.579962] [INFO ] [LOCAL ] DLR: Starting deletion of primary data. [2025-10-15T18:26:40.580524] [DEBUG] [LOCAL ] DLR: Deleted primary data file. [2025-10-15T18:26:40.580579] [INFO ] [MAIN ] DLR: Starting full primary refresh. [2025-10-15T18:26:40.925144] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-05. [2025-10-15T18:26:40.929724] [INFO ] [REMOTE ] DLR: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:26:41.714007] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-03. [2025-10-15T18:26:41.993733] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-15T18:26:42.468729] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-15T18:26:42.514782] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-06. [2025-10-15T18:26:42.515885] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-15T18:26:43.314220] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-06. [2025-10-15T18:26:43.791695] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-15T18:26:44.114003] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-07. [2025-10-15T18:26:44.914003] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-04. [2025-10-15T18:26:45.041245] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-15T18:26:45.380796] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-15T18:26:45.665502] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-15T18:26:45.713974] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-05. [2025-10-15T18:26:46.454245] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-15T18:26:46.514003] [INFO ] [REMOTE ] DLR: Fetching primary data for 2024-12. [2025-10-15T18:26:47.314053] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-08. [2025-10-15T18:26:48.115887] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-07. [2025-10-15T18:26:48.122581] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-15T18:26:48.660386] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-15T18:26:48.914052] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-09. [2025-10-15T18:26:49.714010] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-06. [2025-10-15T18:26:50.035093] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-15T18:26:50.145465] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-10-15T18:26:50.218758] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-15T18:26:50.514067] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-01. [2025-10-15T18:26:51.314039] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-07. [2025-10-15T18:26:51.917955] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-15T18:26:52.114059] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-10. [2025-10-15T18:26:52.570935] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-01 (2.06 seconds). [2025-10-15T18:26:52.914067] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-02. [2025-10-15T18:26:53.215434] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-15T18:26:53.220066] [INFO ] [REMOTE ] DLB: Full fetch complete (47249 records). [2025-10-15T18:26:53.220186] [DEBUG] [VALIDATOR ] DLB: Validating primary data. [2025-10-15T18:26:53.634001] [DEBUG] [VALIDATOR ] DLB: All expected trading days are present. [2025-10-15T18:26:53.634145] [DEBUG] [VALIDATOR ] DLB: Primary data validation passed. [2025-10-15T18:26:53.635394] [INFO ] [MAIN ] DLB: Fetched primary data is valid. [2025-10-15T18:26:53.635464] [DEBUG] [LOCAL ] DLB: Saving primary data. [2025-10-15T18:26:53.636963] [DEBUG] [LOCAL ] DLB: Trimmed 47249 records to 32247 (keeping 200 days of data) [2025-10-15T18:26:53.729577] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-08. [2025-10-15T18:26:53.853922] [DEBUG] [LOCAL ] DLB: Primary data saved (32247 records). [2025-10-15T18:26:53.854206] [INFO ] [MAIN ] DLB: Full history saved. [2025-10-15T18:26:53.854314] [INFO ] [MAIN ] Update Progress: 627/2369 symbols completed. DLB took 29.1s. Estimated remaining: 4h 1m 13s. Rate: 7.2 symbols/min [2025-10-15T18:26:54.044612] [INFO ] [MAIN ] DLX: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:26:54.082404] [DEBUG] [LOCAL ] DLX: Loaded 28438 existing records from primary storage. [2025-10-15T18:26:54.082825] [INFO ] [MAIN ] DLX: Loaded 28438 existing records. [2025-10-15T18:26:54.272170] [WARN ] [MAIN ] DLX: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:26:54.272398] [INFO ] [MAIN ] DLX: Wiping existing primary data before full refresh. [2025-10-15T18:26:54.272453] [INFO ] [LOCAL ] DLX: Starting deletion of primary data. [2025-10-15T18:26:54.272790] [DEBUG] [LOCAL ] DLX: Deleted primary data file. [2025-10-15T18:26:54.272849] [INFO ] [MAIN ] DLX: Starting full primary refresh. [2025-10-15T18:26:54.516702] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-08. [2025-10-15T18:26:54.544405] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-15T18:26:54.723782] [INFO ] [REMOTE ] DLX: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:26:54.751348] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-15T18:26:55.314057] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-03. [2025-10-15T18:26:56.113992] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-09. [2025-10-15T18:26:56.366581] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-15T18:26:56.710676] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-15T18:26:56.914050] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-10. [2025-10-15T18:26:57.146237] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-15T18:26:57.463156] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-15T18:26:57.465110] [INFO ] [REMOTE ] DLNG: Full fetch complete (11769 records). [2025-10-15T18:26:57.465217] [DEBUG] [VALIDATOR ] DLNG: Validating primary data. [2025-10-15T18:26:57.722935] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-09. [2025-10-15T18:26:57.848319] [DEBUG] [VALIDATOR ] DLNG: All expected trading days are present. [2025-10-15T18:26:57.848395] [DEBUG] [VALIDATOR ] DLNG: Primary data validation passed. [2025-10-15T18:26:57.848695] [INFO ] [MAIN ] DLNG: Fetched primary data is valid. [2025-10-15T18:26:57.848755] [DEBUG] [LOCAL ] DLNG: Saving primary data. [2025-10-15T18:26:57.849175] [DEBUG] [LOCAL ] DLNG: Trimmed 11769 records to 6188 (keeping 200 days of data) [2025-10-15T18:26:57.884235] [DEBUG] [LOCAL ] DLNG: Primary data saved (6188 records). [2025-10-15T18:26:57.884338] [INFO ] [MAIN ] DLNG: Full history saved. [2025-10-15T18:26:57.884418] [INFO ] [MAIN ] Update Progress: 628/2369 symbols completed. DLNG took 25.1s. Estimated remaining: 4h 0m 53s. Rate: 7.2 symbols/min [2025-10-15T18:26:58.049217] [INFO ] [MAIN ] DLY: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:26:58.070196] [DEBUG] [LOCAL ] DLY: Loaded 20477 existing records from primary storage. [2025-10-15T18:26:58.070461] [INFO ] [MAIN ] DLY: Loaded 20477 existing records. [2025-10-15T18:26:58.244800] [WARN ] [MAIN ] DLY: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:26:58.245011] [INFO ] [MAIN ] DLY: Wiping existing primary data before full refresh. [2025-10-15T18:26:58.245061] [INFO ] [LOCAL ] DLY: Starting deletion of primary data. [2025-10-15T18:26:58.245306] [DEBUG] [LOCAL ] DLY: Deleted primary data file. [2025-10-15T18:26:58.245362] [INFO ] [MAIN ] DLY: Starting full primary refresh. [2025-10-15T18:26:58.519170] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-04. [2025-10-15T18:26:58.592499] [INFO ] [REMOTE ] DLY: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:26:59.314053] [INFO ] [REMOTE ] DLX: Fetching primary data for 2024-12. [2025-10-15T18:26:59.561177] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-15T18:27:00.055048] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-15T18:27:00.114027] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-05. [2025-10-15T18:27:00.458114] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-15T18:27:00.914035] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-10. [2025-10-15T18:27:01.713988] [INFO ] [REMOTE ] DLY: Fetching primary data for 2024-12. [2025-10-15T18:27:01.875544] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-15T18:27:02.514086] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-01. [2025-10-15T18:27:02.902048] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-10 (1.99 seconds). [2025-10-15T18:27:02.908427] [INFO ] [REMOTE ] DKS: Full fetch complete (71783 records). [2025-10-15T18:27:02.908587] [DEBUG] [VALIDATOR ] DKS: Validating primary data. [2025-10-15T18:27:03.204000] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-15T18:27:03.321876] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-01. [2025-10-15T18:27:03.346514] [DEBUG] [VALIDATOR ] DKS: All expected trading days are present. [2025-10-15T18:27:03.346610] [DEBUG] [VALIDATOR ] DKS: Primary data validation passed. [2025-10-15T18:27:03.347757] [INFO ] [MAIN ] DKS: Fetched primary data is valid. [2025-10-15T18:27:03.347823] [DEBUG] [LOCAL ] DKS: Saving primary data. [2025-10-15T18:27:03.349287] [DEBUG] [LOCAL ] DKS: Trimmed 71783 records to 49719 (keeping 200 days of data) [2025-10-15T18:27:03.653462] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-15T18:27:03.702067] [DEBUG] [LOCAL ] DKS: Primary data saved (49719 records). [2025-10-15T18:27:03.702290] [INFO ] [MAIN ] DKS: Full history saved. [2025-10-15T18:27:03.702407] [INFO ] [MAIN ] Update Progress: 629/2369 symbols completed. DKS took 42.0s. Estimated remaining: 4h 0m 38s. Rate: 7.2 symbols/min [2025-10-15T18:27:03.911727] [INFO ] [MAIN ] DMA: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:27:03.919995] [DEBUG] [LOCAL ] DMA: Loaded 4725 existing records from primary storage. [2025-10-15T18:27:03.920241] [INFO ] [MAIN ] DMA: Loaded 4725 existing records. [2025-10-15T18:27:04.109405] [WARN ] [MAIN ] DMA: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:27:04.109667] [INFO ] [MAIN ] DMA: Wiping existing primary data before full refresh. [2025-10-15T18:27:04.109734] [INFO ] [LOCAL ] DMA: Starting deletion of primary data. [2025-10-15T18:27:04.110100] [DEBUG] [LOCAL ] DMA: Deleted primary data file. [2025-10-15T18:27:04.110373] [INFO ] [MAIN ] DMA: Starting full primary refresh. [2025-10-15T18:27:04.123426] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-06. [2025-10-15T18:27:04.377549] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-15T18:27:04.539991] [INFO ] [REMOTE ] DMA: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:27:04.914013] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-02. [2025-10-15T18:27:05.714014] [INFO ] [REMOTE ] DMA: Fetching primary data for 2024-12. [2025-10-15T18:27:06.019944] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-15T18:27:06.113854] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2024-12 (0.40 seconds). [2025-10-15T18:27:06.246207] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-15T18:27:06.514021] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-02. [2025-10-15T18:27:07.314041] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-01. [2025-10-15T18:27:07.425913] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-15T18:27:07.865343] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-15T18:27:08.114032] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-03. [2025-10-15T18:27:08.913975] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-02. [2025-10-15T18:27:09.122515] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-15T18:27:09.493306] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-15T18:27:09.713982] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-03. [2025-10-15T18:27:10.514028] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-03. [2025-10-15T18:27:10.929688] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-15T18:27:11.077678] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-10-15T18:27:11.314041] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-04. [2025-10-15T18:27:12.114000] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-04. [2025-10-15T18:27:12.336581] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-15T18:27:12.736771] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-10-15T18:27:12.914011] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-05. [2025-10-15T18:27:13.520472] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-15T18:27:13.713989] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-06. [2025-10-15T18:27:14.178853] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-10-15T18:27:14.514028] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-07. [2025-10-15T18:27:15.314006] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-05. [2025-10-15T18:27:16.114016] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-04. [2025-10-15T18:27:16.334549] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-15T18:27:16.536976] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-15T18:27:16.913967] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-06. [2025-10-15T18:27:17.236936] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-15T18:27:17.713994] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-07. [2025-10-15T18:27:18.214609] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-10-15T18:27:18.237098] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-15T18:27:18.514072] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-08. [2025-10-15T18:27:19.103185] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-15T18:27:19.313976] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-09. [2025-10-15T18:27:19.959971] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-15T18:27:20.114033] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-05. [2025-10-15T18:27:20.914009] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-07. [2025-10-15T18:27:21.038556] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-15T18:27:21.714071] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-08. [2025-10-15T18:27:22.252990] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-15T18:27:22.514001] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-06. [2025-10-15T18:27:23.176484] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-15T18:27:23.314051] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-09. [2025-10-15T18:27:23.508248] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-15T18:27:24.114003] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-07. [2025-10-15T18:27:24.913969] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-08. [2025-10-15T18:27:25.239929] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-15T18:27:25.276431] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-10-15T18:27:25.714000] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-08. [2025-10-15T18:27:26.208435] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-15T18:27:26.513981] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-10. [2025-10-15T18:27:26.677092] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-15T18:27:27.226824] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-15T18:27:27.232289] [INFO ] [REMOTE ] DLR: Full fetch complete (73773 records). [2025-10-15T18:27:27.232410] [DEBUG] [VALIDATOR ] DLR: Validating primary data. [2025-10-15T18:27:27.233126] [FATAL] [VALIDATOR ] DLR: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T18:27:27.233210] [FATAL] [MAIN ] DLR: Fetched primary data is invalid. Refusing to save it. [2025-10-15T18:27:27.233251] [WARN ] [MAIN ] DLR: Deleting existing primary and derivative data due to validation failure. [2025-10-15T18:27:27.233316] [INFO ] [LOCAL ] DLR: Starting deletion of primary data. [2025-10-15T18:27:27.233378] [DEBUG] [LOCAL ] DLR: No primary data file found to delete. [2025-10-15T18:27:27.233414] [INFO ] [LOCAL ] DLR: Starting deletion of derivative data. [2025-10-15T18:27:27.233567] [DEBUG] [LOCAL ] DLR: Deleted derivative data file. [2025-10-15T18:27:27.233691] [INFO ] [MAIN ] Update Progress: 630/2369 symbols completed. DLR took 47.0s. Estimated remaining: 4h 1m 12s. Rate: 7.2 symbols/min [2025-10-15T18:27:27.319134] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-09. [2025-10-15T18:27:27.406710] [INFO ] [MAIN ] DMB: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:27:27.407064] [DEBUG] [LOCAL ] DMB: No existing data file found in primary storage. [2025-10-15T18:27:27.407131] [WARN ] [MAIN ] DMB: No existing data found, performing full refresh instead. [2025-10-15T18:27:27.407256] [INFO ] [MAIN ] DMB: Wiping existing primary data before full refresh. [2025-10-15T18:27:27.407298] [INFO ] [LOCAL ] DMB: Starting deletion of primary data. [2025-10-15T18:27:27.407346] [DEBUG] [LOCAL ] DMB: No primary data file found to delete. [2025-10-15T18:27:27.407414] [INFO ] [MAIN ] DMB: Starting full primary refresh. [2025-10-15T18:27:27.783485] [INFO ] [REMOTE ] DMB: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:27:28.113967] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-09. [2025-10-15T18:27:28.351410] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-15T18:27:28.913996] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-10. [2025-10-15T18:27:29.296806] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-15T18:27:29.713990] [INFO ] [REMOTE ] DMB: Fetching primary data for 2024-12. [2025-10-15T18:27:30.011013] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-15T18:27:30.014062] [INFO ] [REMOTE ] DLX: Full fetch complete (41290 records). [2025-10-15T18:27:30.014147] [DEBUG] [VALIDATOR ] DLX: Validating primary data. [2025-10-15T18:27:30.385888] [DEBUG] [VALIDATOR ] DLX: All expected trading days are present. [2025-10-15T18:27:30.385967] [DEBUG] [VALIDATOR ] DLX: Primary data validation passed. [2025-10-15T18:27:30.386633] [INFO ] [MAIN ] DLX: Fetched primary data is valid. [2025-10-15T18:27:30.386712] [DEBUG] [LOCAL ] DLX: Saving primary data. [2025-10-15T18:27:30.387828] [DEBUG] [LOCAL ] DLX: Trimmed 41290 records to 28382 (keeping 200 days of data) [2025-10-15T18:27:30.501908] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-10-15T18:27:30.516006] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-10. [2025-10-15T18:27:30.576290] [DEBUG] [LOCAL ] DLX: Primary data saved (28382 records). [2025-10-15T18:27:30.576456] [INFO ] [MAIN ] DLX: Full history saved. [2025-10-15T18:27:30.576562] [INFO ] [MAIN ] Update Progress: 631/2369 symbols completed. DLX took 36.7s. Estimated remaining: 4h 0m 50s. Rate: 7.2 symbols/min [2025-10-15T18:27:30.744698] [INFO ] [MAIN ] DMO: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:27:30.756113] [DEBUG] [LOCAL ] DMO: Loaded 9973 existing records from primary storage. [2025-10-15T18:27:30.756306] [INFO ] [MAIN ] DMO: Loaded 9973 existing records. [2025-10-15T18:27:30.933267] [WARN ] [MAIN ] DMO: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:27:30.933492] [INFO ] [MAIN ] DMO: Wiping existing primary data before full refresh. [2025-10-15T18:27:30.933549] [INFO ] [LOCAL ] DMO: Starting deletion of primary data. [2025-10-15T18:27:30.933750] [DEBUG] [LOCAL ] DMO: Deleted primary data file. [2025-10-15T18:27:30.933806] [INFO ] [MAIN ] DMO: Starting full primary refresh. [2025-10-15T18:27:31.311733] [INFO ] [REMOTE ] DMO: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:27:31.313972] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-01. [2025-10-15T18:27:31.334630] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-15T18:27:31.335822] [INFO ] [REMOTE ] DMA: Full fetch complete (6730 records). [2025-10-15T18:27:31.335891] [DEBUG] [VALIDATOR ] DMA: Validating primary data. [2025-10-15T18:27:31.336255] [FATAL] [VALIDATOR ] DMA: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T18:27:31.336362] [FATAL] [MAIN ] DMA: Fetched primary data is invalid. Refusing to save it. [2025-10-15T18:27:31.336435] [WARN ] [MAIN ] DMA: Deleting existing primary and derivative data due to validation failure. [2025-10-15T18:27:31.336512] [INFO ] [LOCAL ] DMA: Starting deletion of primary data. [2025-10-15T18:27:31.336593] [DEBUG] [LOCAL ] DMA: No primary data file found to delete. [2025-10-15T18:27:31.336671] [INFO ] [LOCAL ] DMA: Starting deletion of derivative data. [2025-10-15T18:27:31.337258] [DEBUG] [LOCAL ] DMA: Deleted derivative data file. [2025-10-15T18:27:31.337345] [INFO ] [MAIN ] Update Progress: 632/2369 symbols completed. DMA took 27.6s. Estimated remaining: 4h 0m 20s. Rate: 7.2 symbols/min [2025-10-15T18:27:31.507334] [INFO ] [MAIN ] DNA: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:27:31.553849] [DEBUG] [LOCAL ] DNA: Loaded 48569 existing records from primary storage. [2025-10-15T18:27:31.554244] [INFO ] [MAIN ] DNA: Loaded 48569 existing records. [2025-10-15T18:27:31.729497] [WARN ] [MAIN ] DNA: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:27:31.729723] [INFO ] [MAIN ] DNA: Wiping existing primary data before full refresh. [2025-10-15T18:27:31.729778] [INFO ] [LOCAL ] DNA: Starting deletion of primary data. [2025-10-15T18:27:31.730149] [DEBUG] [LOCAL ] DNA: Deleted primary data file. [2025-10-15T18:27:31.730190] [INFO ] [MAIN ] DNA: Starting full primary refresh. [2025-10-15T18:27:32.086187] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-15T18:27:32.090507] [INFO ] [REMOTE ] DNA: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:27:32.113956] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-02. [2025-10-15T18:27:32.766459] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-15T18:27:32.913996] [INFO ] [REMOTE ] DNA: Fetching primary data for 2024-12. [2025-10-15T18:27:33.713998] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-10. [2025-10-15T18:27:34.514013] [INFO ] [REMOTE ] DMO: Fetching primary data for 2024-12. [2025-10-15T18:27:34.666752] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-15T18:27:34.704259] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-15T18:27:34.707858] [INFO ] [REMOTE ] DLY: Full fetch complete (28270 records). [2025-10-15T18:27:34.708049] [DEBUG] [VALIDATOR ] DLY: Validating primary data. [2025-10-15T18:27:34.708582] [FATAL] [VALIDATOR ] DLY: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T18:27:34.708687] [FATAL] [MAIN ] DLY: Fetched primary data is invalid. Refusing to save it. [2025-10-15T18:27:34.708770] [WARN ] [MAIN ] DLY: Deleting existing primary and derivative data due to validation failure. [2025-10-15T18:27:34.708871] [INFO ] [LOCAL ] DLY: Starting deletion of primary data. [2025-10-15T18:27:34.708949] [DEBUG] [LOCAL ] DLY: No primary data file found to delete. [2025-10-15T18:27:34.708986] [INFO ] [LOCAL ] DLY: Starting deletion of derivative data. [2025-10-15T18:27:34.709114] [DEBUG] [LOCAL ] DLY: Deleted derivative data file. [2025-10-15T18:27:34.709244] [INFO ] [MAIN ] Update Progress: 633/2369 symbols completed. DLY took 36.8s. Estimated remaining: 3h 59m 59s. Rate: 7.2 symbols/min [2025-10-15T18:27:34.887595] [INFO ] [MAIN ] DNOW: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:27:34.931154] [DEBUG] [LOCAL ] DNOW: Loaded 43649 existing records from primary storage. [2025-10-15T18:27:34.931467] [INFO ] [MAIN ] DNOW: Loaded 43649 existing records. [2025-10-15T18:27:35.107270] [WARN ] [MAIN ] DNOW: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:27:35.107737] [INFO ] [MAIN ] DNOW: Wiping existing primary data before full refresh. [2025-10-15T18:27:35.107877] [INFO ] [LOCAL ] DNOW: Starting deletion of primary data. [2025-10-15T18:27:35.114873] [DEBUG] [LOCAL ] DNOW: Deleted primary data file. [2025-10-15T18:27:35.114956] [INFO ] [MAIN ] DNOW: Starting full primary refresh. [2025-10-15T18:27:35.158694] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-10-15T18:27:35.319130] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-01. [2025-10-15T18:27:35.480390] [INFO ] [REMOTE ] DNOW: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:27:36.113994] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-03. [2025-10-15T18:27:36.913971] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-01. [2025-10-15T18:27:36.965353] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-15T18:27:37.126244] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-15T18:27:37.693132] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-15T18:27:37.713953] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-02. [2025-10-15T18:27:38.305667] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-15T18:27:38.514008] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-03. [2025-10-15T18:27:39.096524] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-15T18:27:39.313999] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-04. [2025-10-15T18:27:40.005554] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-15T18:27:40.114007] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2024-12. [2025-10-15T18:27:40.913999] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-02. [2025-10-15T18:27:41.603343] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-15T18:27:41.713971] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-01. [2025-10-15T18:27:42.514075] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-05. [2025-10-15T18:27:42.886435] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-10-15T18:27:42.959156] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-15T18:27:43.313990] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-03. [2025-10-15T18:27:43.323926] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-15T18:27:44.114010] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-02. [2025-10-15T18:27:44.855000] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-15T18:27:44.913962] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-04. [2025-10-15T18:27:45.518311] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-15T18:27:45.714008] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-04. [2025-10-15T18:27:46.369228] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-15T18:27:46.405987] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-15T18:27:46.513956] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-05. [2025-10-15T18:27:47.239726] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-15T18:27:47.314012] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-06. [2025-10-15T18:27:48.030039] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-15T18:27:48.114010] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-03. [2025-10-15T18:27:48.914006] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-06. [2025-10-15T18:27:49.368724] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-15T18:27:49.669058] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-15T18:27:49.713972] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-07. [2025-10-15T18:27:50.246798] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-10-15T18:27:50.513996] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-07. [2025-10-15T18:27:51.277496] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-15T18:27:51.313969] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-08. [2025-10-15T18:27:52.088214] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-15T18:27:52.113974] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-09. [2025-10-15T18:27:52.914028] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-08. [2025-10-15T18:27:52.931418] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-15T18:27:53.688583] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-15T18:27:53.713960] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-09. [2025-10-15T18:27:54.360605] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-15T18:27:54.514038] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-10. [2025-10-15T18:27:55.314025] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-05. [2025-10-15T18:27:55.376275] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-15T18:27:55.377896] [INFO ] [REMOTE ] DMO: Full fetch complete (14554 records). [2025-10-15T18:27:55.377964] [DEBUG] [VALIDATOR ] DMO: Validating primary data. [2025-10-15T18:27:55.730465] [DEBUG] [VALIDATOR ] DMO: All expected trading days are present. [2025-10-15T18:27:55.730536] [DEBUG] [VALIDATOR ] DMO: Primary data validation passed. [2025-10-15T18:27:55.730871] [INFO ] [MAIN ] DMO: Fetched primary data is valid. [2025-10-15T18:27:55.730930] [DEBUG] [LOCAL ] DMO: Saving primary data. [2025-10-15T18:27:55.731392] [DEBUG] [LOCAL ] DMO: Trimmed 14554 records to 9967 (keeping 200 days of data) [2025-10-15T18:27:55.794473] [DEBUG] [LOCAL ] DMO: Primary data saved (9967 records). [2025-10-15T18:27:55.794616] [INFO ] [MAIN ] DMO: Full history saved. [2025-10-15T18:27:55.794820] [INFO ] [MAIN ] Update Progress: 634/2369 symbols completed. DMO took 25.2s. Estimated remaining: 4h 0m 25s. Rate: 7.2 symbols/min [2025-10-15T18:27:55.960892] [INFO ] [MAIN ] DNP: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:27:55.992418] [DEBUG] [LOCAL ] DNP: Loaded 33224 existing records from primary storage. [2025-10-15T18:27:55.992859] [INFO ] [MAIN ] DNP: Loaded 33224 existing records. [2025-10-15T18:27:56.128610] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-10. [2025-10-15T18:27:56.168374] [WARN ] [MAIN ] DNP: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:27:56.168577] [INFO ] [MAIN ] DNP: Wiping existing primary data before full refresh. [2025-10-15T18:27:56.168627] [INFO ] [LOCAL ] DNP: Starting deletion of primary data. [2025-10-15T18:27:56.168964] [DEBUG] [LOCAL ] DNP: Deleted primary data file. [2025-10-15T18:27:56.169016] [INFO ] [MAIN ] DNP: Starting full primary refresh. [2025-10-15T18:27:56.517897] [INFO ] [REMOTE ] DNP: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:27:56.913964] [INFO ] [REMOTE ] DNP: Fetching primary data for 2024-12. [2025-10-15T18:27:57.032968] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-15T18:27:57.034667] [INFO ] [REMOTE ] DMB: Full fetch complete (14776 records). [2025-10-15T18:27:57.034741] [DEBUG] [VALIDATOR ] DMB: Validating primary data. [2025-10-15T18:27:57.336622] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-10-15T18:27:57.440784] [DEBUG] [VALIDATOR ] DMB: All expected trading days are present. [2025-10-15T18:27:57.440896] [DEBUG] [VALIDATOR ] DMB: Primary data validation passed. [2025-10-15T18:27:57.441286] [INFO ] [MAIN ] DMB: Fetched primary data is valid. [2025-10-15T18:27:57.441330] [DEBUG] [LOCAL ] DMB: Saving primary data. [2025-10-15T18:27:57.441966] [DEBUG] [LOCAL ] DMB: Trimmed 14776 records to 10304 (keeping 200 days of data) [2025-10-15T18:27:57.509615] [DEBUG] [LOCAL ] DMB: Primary data saved (10304 records). [2025-10-15T18:27:57.509838] [INFO ] [MAIN ] DMB: Full history saved. [2025-10-15T18:27:57.509953] [INFO ] [MAIN ] Update Progress: 635/2369 symbols completed. DMB took 30.3s. Estimated remaining: 3h 59m 59s. Rate: 7.2 symbols/min [2025-10-15T18:27:57.677724] [INFO ] [MAIN ] DOC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:27:57.714137] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-06. [2025-10-15T18:27:57.730989] [DEBUG] [LOCAL ] DOC: Loaded 53552 existing records from primary storage. [2025-10-15T18:27:57.731270] [INFO ] [MAIN ] DOC: Loaded 53552 existing records. [2025-10-15T18:27:57.911836] [WARN ] [MAIN ] DOC: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:27:57.912075] [INFO ] [MAIN ] DOC: Wiping existing primary data before full refresh. [2025-10-15T18:27:57.912145] [INFO ] [LOCAL ] DOC: Starting deletion of primary data. [2025-10-15T18:27:57.912452] [DEBUG] [LOCAL ] DOC: Deleted primary data file. [2025-10-15T18:27:57.912531] [INFO ] [MAIN ] DOC: Starting full primary refresh. [2025-10-15T18:27:58.288880] [INFO ] [REMOTE ] DOC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:27:58.310541] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-15T18:27:58.514035] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-01. [2025-10-15T18:27:59.314013] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-04. [2025-10-15T18:27:59.427470] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-15T18:27:59.590601] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-15T18:28:00.114034] [INFO ] [REMOTE ] DOC: Fetching primary data for 2024-12. [2025-10-15T18:28:00.914033] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-07. [2025-10-15T18:28:01.189506] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-15T18:28:01.714027] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-05. [2025-10-15T18:28:02.411488] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2024-12 (2.30 seconds). [2025-10-15T18:28:02.514024] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-01. [2025-10-15T18:28:02.676168] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-15T18:28:02.852836] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-15T18:28:03.314051] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-02. [2025-10-15T18:28:04.113972] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-08. [2025-10-15T18:28:04.227209] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-15T18:28:04.664351] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-15T18:28:04.914051] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-02. [2025-10-15T18:28:05.714005] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-06. [2025-10-15T18:28:05.980665] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-15T18:28:06.514000] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-03. [2025-10-15T18:28:06.605168] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-15T18:28:06.684009] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-15T18:28:07.314029] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-07. [2025-10-15T18:28:07.612618] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-15T18:28:08.114043] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-04. [2025-10-15T18:28:08.551090] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-15T18:28:08.914045] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-03. [2025-10-15T18:28:09.657387] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-15T18:28:09.713952] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-05. [2025-10-15T18:28:10.392876] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-15T18:28:10.514039] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-09. [2025-10-15T18:28:11.185691] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-15T18:28:11.314072] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-06. [2025-10-15T18:28:12.113998] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-08. [2025-10-15T18:28:12.348072] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-15T18:28:12.619997] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-15T18:28:12.914042] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-04. [2025-10-15T18:28:13.715490] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-10. [2025-10-15T18:28:13.717805] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-15T18:28:14.514018] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-09. [2025-10-15T18:28:14.928327] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-15T18:28:15.314058] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-05. [2025-10-15T18:28:15.780397] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-10 (2.06 seconds). [2025-10-15T18:28:15.786251] [INFO ] [REMOTE ] DNA: Full fetch complete (70858 records). [2025-10-15T18:28:15.786358] [DEBUG] [VALIDATOR ] DNA: Validating primary data. [2025-10-15T18:28:15.787276] [FATAL] [VALIDATOR ] DNA: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T18:28:15.787360] [FATAL] [MAIN ] DNA: Fetched primary data is invalid. Refusing to save it. [2025-10-15T18:28:15.787426] [WARN ] [MAIN ] DNA: Deleting existing primary and derivative data due to validation failure. [2025-10-15T18:28:15.787499] [INFO ] [LOCAL ] DNA: Starting deletion of primary data. [2025-10-15T18:28:15.787562] [DEBUG] [LOCAL ] DNA: No primary data file found to delete. [2025-10-15T18:28:15.787598] [INFO ] [LOCAL ] DNA: Starting deletion of derivative data. [2025-10-15T18:28:15.787768] [DEBUG] [LOCAL ] DNA: Deleted derivative data file. [2025-10-15T18:28:15.787867] [INFO ] [MAIN ] Update Progress: 636/2369 symbols completed. DNA took 44.5s. Estimated remaining: 4h 0m 18s. Rate: 7.2 symbols/min [2025-10-15T18:28:15.962617] [INFO ] [MAIN ] DOCN: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:28:15.994712] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-15T18:28:16.045570] [DEBUG] [LOCAL ] DOCN: Loaded 50992 existing records from primary storage. [2025-10-15T18:28:16.045916] [INFO ] [MAIN ] DOCN: Loaded 50992 existing records. [2025-10-15T18:28:16.119172] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-10. [2025-10-15T18:28:16.233104] [WARN ] [MAIN ] DOCN: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:28:16.233264] [INFO ] [MAIN ] DOCN: Wiping existing primary data before full refresh. [2025-10-15T18:28:16.233310] [INFO ] [LOCAL ] DOCN: Starting deletion of primary data. [2025-10-15T18:28:16.233684] [DEBUG] [LOCAL ] DOCN: Deleted primary data file. [2025-10-15T18:28:16.233739] [INFO ] [MAIN ] DOCN: Starting full primary refresh. [2025-10-15T18:28:16.579302] [INFO ] [REMOTE ] DOCN: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:28:16.914053] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-07. [2025-10-15T18:28:17.321876] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-10-15T18:28:17.713975] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-06. [2025-10-15T18:28:17.798507] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-15T18:28:17.804101] [INFO ] [REMOTE ] DNOW: Full fetch complete (63186 records). [2025-10-15T18:28:17.804257] [DEBUG] [VALIDATOR ] DNOW: Validating primary data. [2025-10-15T18:28:18.213904] [DEBUG] [VALIDATOR ] DNOW: All expected trading days are present. [2025-10-15T18:28:18.214013] [DEBUG] [VALIDATOR ] DNOW: Primary data validation passed. [2025-10-15T18:28:18.214931] [INFO ] [MAIN ] DNOW: Fetched primary data is valid. [2025-10-15T18:28:18.215012] [DEBUG] [LOCAL ] DNOW: Saving primary data. [2025-10-15T18:28:18.226709] [DEBUG] [LOCAL ] DNOW: Trimmed 63186 records to 43750 (keeping 200 days of data) [2025-10-15T18:28:18.247171] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-15T18:28:18.502300] [DEBUG] [LOCAL ] DNOW: Primary data saved (43750 records). [2025-10-15T18:28:18.502424] [INFO ] [MAIN ] DNOW: Full history saved. [2025-10-15T18:28:18.502499] [INFO ] [MAIN ] Update Progress: 637/2369 symbols completed. DNOW took 43.8s. Estimated remaining: 3h 59m 54s. Rate: 7.2 symbols/min [2025-10-15T18:28:18.513962] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2024-12. [2025-10-15T18:28:19.235272] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-15T18:28:19.313995] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-07. [2025-10-15T18:28:20.119149] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-08. [2025-10-15T18:28:20.122362] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-15T18:28:20.913975] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-01. [2025-10-15T18:28:21.220976] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-15T18:28:21.252969] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-15T18:28:21.714000] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-08. [2025-10-15T18:28:22.482247] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-15T18:28:22.514021] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-09. [2025-10-15T18:28:23.314064] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-02. [2025-10-15T18:28:23.525253] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-15T18:28:23.813808] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-15T18:28:24.114059] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-10. [2025-10-15T18:28:24.617059] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-15T18:28:24.914054] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-03. [2025-10-15T18:28:25.149570] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-15T18:28:25.153445] [INFO ] [REMOTE ] DNP: Full fetch complete (48879 records). [2025-10-15T18:28:25.153526] [DEBUG] [VALIDATOR ] DNP: Validating primary data. [2025-10-15T18:28:25.549869] [DEBUG] [VALIDATOR ] DNP: All expected trading days are present. [2025-10-15T18:28:25.549972] [DEBUG] [VALIDATOR ] DNP: Primary data validation passed. [2025-10-15T18:28:25.551402] [INFO ] [MAIN ] DNP: Fetched primary data is valid. [2025-10-15T18:28:25.551470] [DEBUG] [LOCAL ] DNP: Saving primary data. [2025-10-15T18:28:25.552481] [DEBUG] [LOCAL ] DNP: Trimmed 48879 records to 33232 (keeping 200 days of data) [2025-10-15T18:28:25.724570] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-09. [2025-10-15T18:28:25.748826] [DEBUG] [LOCAL ] DNP: Primary data saved (33232 records). [2025-10-15T18:28:25.748967] [INFO ] [MAIN ] DNP: Full history saved. [2025-10-15T18:28:25.749322] [INFO ] [MAIN ] Update Progress: 638/2369 symbols completed. DNP took 30.0s. Estimated remaining: 3h 59m 43s. Rate: 7.2 symbols/min [2025-10-15T18:28:26.311055] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-15T18:28:26.513993] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-04. [2025-10-15T18:28:27.763511] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-10-15T18:28:27.775095] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-10. [2025-10-15T18:28:28.159253] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-15T18:28:28.169780] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-05. [2025-10-15T18:28:29.541799] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-15T18:28:29.548376] [INFO ] [REMOTE ] DOC: Full fetch complete (77562 records). [2025-10-15T18:28:29.548527] [DEBUG] [VALIDATOR ] DOC: Validating primary data. [2025-10-15T18:28:29.968528] [DEBUG] [VALIDATOR ] DOC: All expected trading days are present. [2025-10-15T18:28:29.968669] [DEBUG] [VALIDATOR ] DOC: Primary data validation passed. [2025-10-15T18:28:29.969839] [INFO ] [MAIN ] DOC: Fetched primary data is valid. [2025-10-15T18:28:29.970007] [DEBUG] [LOCAL ] DOC: Saving primary data. [2025-10-15T18:28:29.971638] [DEBUG] [LOCAL ] DOC: Trimmed 77562 records to 53554 (keeping 200 days of data) [2025-10-15T18:28:30.119686] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-15T18:28:30.135703] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-06. [2025-10-15T18:28:30.355729] [DEBUG] [LOCAL ] DOC: Primary data saved (53554 records). [2025-10-15T18:28:30.355872] [INFO ] [MAIN ] DOC: Full history saved. [2025-10-15T18:28:30.355952] [INFO ] [MAIN ] Update Progress: 639/2369 symbols completed. DOC took 32.8s. Estimated remaining: 3h 59m 25s. Rate: 7.2 symbols/min [2025-10-15T18:28:31.832495] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-15T18:28:31.842902] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-07. [2025-10-15T18:28:33.588801] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-15T18:28:33.606251] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-08. [2025-10-15T18:28:35.643097] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-10-15T18:28:35.656290] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-09. [2025-10-15T18:28:37.443179] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-15T18:28:37.455587] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-10. [2025-10-15T18:28:39.179966] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-15T18:28:39.186360] [INFO ] [REMOTE ] DOCN: Full fetch complete (72193 records). [2025-10-15T18:28:39.186566] [DEBUG] [VALIDATOR ] DOCN: Validating primary data. [2025-10-15T18:28:39.187627] [FATAL] [VALIDATOR ] DOCN: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T18:28:39.187810] [FATAL] [MAIN ] DOCN: Fetched primary data is invalid. Refusing to save it. [2025-10-15T18:28:39.187854] [WARN ] [MAIN ] DOCN: Deleting existing primary and derivative data due to validation failure. [2025-10-15T18:28:39.187910] [INFO ] [LOCAL ] DOCN: Starting deletion of primary data. [2025-10-15T18:28:39.187999] [DEBUG] [LOCAL ] DOCN: No primary data file found to delete. [2025-10-15T18:28:39.188039] [INFO ] [LOCAL ] DOCN: Starting deletion of derivative data. [2025-10-15T18:28:39.188186] [DEBUG] [LOCAL ] DOCN: Deleted derivative data file. [2025-10-15T18:28:39.188271] [INFO ] [MAIN ] Update Progress: 640/2369 symbols completed. DOCN took 23.4s. Estimated remaining: 3h 59m 18s. Rate: 7.2 symbols/min [2025-10-15T18:28:39.826792] [INFO ] [MAIN ] DOCS: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:28:39.931815] [INFO ] [MAIN ] DOUG: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:28:39.979294] [INFO ] [MAIN ] DOV: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:28:39.972518] [INFO ] [MAIN ] DOLE: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:28:40.041439] [DEBUG] [LOCAL ] DOUG: Loaded 34291 existing records from primary storage. [2025-10-15T18:28:40.042018] [INFO ] [MAIN ] DOUG: Loaded 34291 existing records. [2025-10-15T18:28:40.138622] [DEBUG] [LOCAL ] DOLE: Loaded 39166 existing records from primary storage. [2025-10-15T18:28:40.172160] [INFO ] [MAIN ] DOLE: Loaded 39166 existing records. [2025-10-15T18:28:40.179094] [DEBUG] [LOCAL ] DOCS: Loaded 50810 existing records from primary storage. [2025-10-15T18:28:40.210978] [INFO ] [MAIN ] DOCS: Loaded 50810 existing records. [2025-10-15T18:28:40.318241] [DEBUG] [LOCAL ] DOV: Loaded 45600 existing records from primary storage. [2025-10-15T18:28:40.410711] [INFO ] [MAIN ] DOV: Loaded 45600 existing records. [2025-10-15T18:28:40.584007] [WARN ] [MAIN ] DOUG: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:28:40.790772] [INFO ] [MAIN ] DOUG: Wiping existing primary data before full refresh. [2025-10-15T18:28:40.803567] [WARN ] [MAIN ] DOLE: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:28:40.845788] [WARN ] [MAIN ] DOCS: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:28:40.836425] [INFO ] [LOCAL ] DOUG: Starting deletion of primary data. [2025-10-15T18:28:40.872630] [INFO ] [MAIN ] DOCS: Wiping existing primary data before full refresh. [2025-10-15T18:28:40.867177] [INFO ] [MAIN ] DOLE: Wiping existing primary data before full refresh. [2025-10-15T18:28:40.887789] [INFO ] [LOCAL ] DOCS: Starting deletion of primary data. [2025-10-15T18:28:40.908260] [DEBUG] [LOCAL ] DOCS: Deleted primary data file. [2025-10-15T18:28:40.911901] [INFO ] [MAIN ] DOCS: Starting full primary refresh. [2025-10-15T18:28:40.911526] [WARN ] [MAIN ] DOV: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:28:40.924276] [DEBUG] [LOCAL ] DOUG: Deleted primary data file. [2025-10-15T18:28:40.912039] [INFO ] [LOCAL ] DOLE: Starting deletion of primary data. [2025-10-15T18:28:40.944096] [INFO ] [MAIN ] DOV: Wiping existing primary data before full refresh. [2025-10-15T18:28:40.924465] [INFO ] [MAIN ] DOUG: Starting full primary refresh. [2025-10-15T18:28:40.949692] [DEBUG] [LOCAL ] DOLE: Deleted primary data file. [2025-10-15T18:28:41.002874] [INFO ] [MAIN ] DOLE: Starting full primary refresh. [2025-10-15T18:28:40.997595] [INFO ] [LOCAL ] DOV: Starting deletion of primary data. [2025-10-15T18:28:41.051732] [DEBUG] [LOCAL ] DOV: Deleted primary data file. [2025-10-15T18:28:41.075693] [INFO ] [MAIN ] DOV: Starting full primary refresh. [2025-10-15T18:28:42.282780] [INFO ] [REMOTE ] DOUG: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:28:42.272325] [INFO ] [REMOTE ] DOCS: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:28:42.303747] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2024-12. [2025-10-15T18:28:42.314369] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2024-12. [2025-10-15T18:28:42.415533] [INFO ] [REMOTE ] DOLE: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:28:42.434892] [INFO ] [REMOTE ] DOV: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:28:42.435131] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2024-12. [2025-10-15T18:28:42.435371] [INFO ] [REMOTE ] DOV: Fetching primary data for 2024-12. [2025-10-15T18:28:43.728151] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-15T18:28:43.736506] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-01. [2025-10-15T18:28:43.825596] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-15T18:28:43.832468] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-01. [2025-10-15T18:28:43.996768] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-15T18:28:44.005301] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-01. [2025-10-15T18:28:44.276054] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-10-15T18:28:44.286337] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-01. [2025-10-15T18:28:45.074849] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-15T18:28:45.083063] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-02. [2025-10-15T18:28:45.117133] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-15T18:28:45.127152] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-02. [2025-10-15T18:28:45.241128] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-15T18:28:45.248445] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-02. [2025-10-15T18:28:45.598978] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-15T18:28:45.608602] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-02. [2025-10-15T18:28:46.012383] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-15T18:28:46.019833] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-03. [2025-10-15T18:28:46.200803] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-15T18:28:46.209493] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-03. [2025-10-15T18:28:46.515083] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-15T18:28:46.521382] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-03. [2025-10-15T18:28:46.952631] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-15T18:28:46.960390] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-04. [2025-10-15T18:28:47.407410] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-15T18:28:47.417300] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-03. [2025-10-15T18:28:47.841297] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-15T18:28:47.851106] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-04. [2025-10-15T18:28:47.917739] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-15T18:28:47.925010] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-05. [2025-10-15T18:28:47.958431] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-15T18:28:48.114012] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-04. [2025-10-15T18:28:49.345268] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-15T18:28:49.365287] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-05. [2025-10-15T18:28:49.449392] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-15T18:28:49.543981] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-03 (2.13 seconds). [2025-10-15T18:28:49.577229] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-15T18:28:49.713954] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-05. [2025-10-15T18:28:50.514048] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-04. [2025-10-15T18:28:50.788098] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-15T18:28:51.314051] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-06. [2025-10-15T18:28:51.360178] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-15T18:28:52.045232] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-15T18:28:52.113961] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-05. [2025-10-15T18:28:52.231435] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-15T18:28:52.914042] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-07. [2025-10-15T18:28:53.714022] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-06. [2025-10-15T18:28:54.007577] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-15T18:28:54.108639] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-15T18:28:54.514040] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-06. [2025-10-15T18:28:55.320423] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-06. [2025-10-15T18:28:55.322950] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-15T18:28:56.076778] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-15T18:28:56.114003] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-07. [2025-10-15T18:28:56.704348] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-15T18:28:56.914112] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-08. [2025-10-15T18:28:57.630910] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-15T18:28:57.713964] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-08. [2025-10-15T18:28:58.289076] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-15T18:28:58.513970] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-07. [2025-10-15T18:28:59.313996] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-09. [2025-10-15T18:28:59.368755] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-15T18:28:59.971840] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-15T18:29:00.113999] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-08. [2025-10-15T18:29:00.646603] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-15T18:29:00.914029] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-10. [2025-10-15T18:29:01.714040] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-09. [2025-10-15T18:29:01.859194] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-15T18:29:02.262576] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-15T18:29:02.267016] [INFO ] [REMOTE ] DOUG: Full fetch complete (50576 records). [2025-10-15T18:29:02.267210] [DEBUG] [VALIDATOR ] DOUG: Validating primary data. [2025-10-15T18:29:02.519341] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-09. [2025-10-15T18:29:02.690616] [DEBUG] [VALIDATOR ] DOUG: All expected trading days are present. [2025-10-15T18:29:02.690725] [DEBUG] [VALIDATOR ] DOUG: Primary data validation passed. [2025-10-15T18:29:02.691513] [INFO ] [MAIN ] DOUG: Fetched primary data is valid. [2025-10-15T18:29:02.691576] [DEBUG] [LOCAL ] DOUG: Saving primary data. [2025-10-15T18:29:02.692594] [DEBUG] [LOCAL ] DOUG: Trimmed 50576 records to 34244 (keeping 200 days of data) [2025-10-15T18:29:02.879124] [DEBUG] [LOCAL ] DOUG: Primary data saved (34244 records). [2025-10-15T18:29:02.879284] [INFO ] [MAIN ] DOUG: Full history saved. [2025-10-15T18:29:02.879370] [INFO ] [MAIN ] Update Progress: 641/2369 symbols completed. DOUG took 23.7s. Estimated remaining: 3h 59m 51s. Rate: 7.2 symbols/min [2025-10-15T18:29:03.063705] [INFO ] [MAIN ] DOW: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:29:03.117315] [DEBUG] [LOCAL ] DOW: Loaded 53733 existing records from primary storage. [2025-10-15T18:29:03.117739] [INFO ] [MAIN ] DOW: Loaded 53733 existing records. [2025-10-15T18:29:03.305516] [WARN ] [MAIN ] DOW: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:29:03.305943] [INFO ] [MAIN ] DOW: Wiping existing primary data before full refresh. [2025-10-15T18:29:03.306083] [INFO ] [LOCAL ] DOW: Starting deletion of primary data. [2025-10-15T18:29:03.306507] [DEBUG] [LOCAL ] DOW: Deleted primary data file. [2025-10-15T18:29:03.306570] [INFO ] [MAIN ] DOW: Starting full primary refresh. [2025-10-15T18:29:03.319807] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-07. [2025-10-15T18:29:03.518701] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-15T18:29:03.727841] [INFO ] [REMOTE ] DOW: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:29:03.770865] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-15T18:29:04.113999] [INFO ] [REMOTE ] DOW: Fetching primary data for 2024-12. [2025-10-15T18:29:04.658467] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-15T18:29:04.913984] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-08. [2025-10-15T18:29:05.713966] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-10. [2025-10-15T18:29:06.132495] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2024-12 (2.02 seconds). [2025-10-15T18:29:06.375223] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-15T18:29:06.513979] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-09. [2025-10-15T18:29:07.169687] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-15T18:29:07.175089] [INFO ] [REMOTE ] DOV: Full fetch complete (65710 records). [2025-10-15T18:29:07.175198] [DEBUG] [VALIDATOR ] DOV: Validating primary data. [2025-10-15T18:29:07.319121] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-01. [2025-10-15T18:29:07.570731] [DEBUG] [VALIDATOR ] DOV: All expected trading days are present. [2025-10-15T18:29:07.570815] [DEBUG] [VALIDATOR ] DOV: Primary data validation passed. [2025-10-15T18:29:07.571634] [INFO ] [MAIN ] DOV: Fetched primary data is valid. [2025-10-15T18:29:07.571716] [DEBUG] [LOCAL ] DOV: Saving primary data. [2025-10-15T18:29:07.572965] [DEBUG] [LOCAL ] DOV: Trimmed 65710 records to 45611 (keeping 200 days of data) [2025-10-15T18:29:07.856306] [DEBUG] [LOCAL ] DOV: Primary data saved (45611 records). [2025-10-15T18:29:07.856437] [INFO ] [MAIN ] DOV: Full history saved. [2025-10-15T18:29:07.856518] [INFO ] [MAIN ] Update Progress: 642/2369 symbols completed. DOV took 28.6s. Estimated remaining: 3h 59m 34s. Rate: 7.2 symbols/min [2025-10-15T18:29:08.029826] [INFO ] [MAIN ] DPG: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:29:08.045181] [DEBUG] [LOCAL ] DPG: Loaded 13595 existing records from primary storage. [2025-10-15T18:29:08.045398] [INFO ] [MAIN ] DPG: Loaded 13595 existing records. [2025-10-15T18:29:08.119109] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-10. [2025-10-15T18:29:08.228528] [WARN ] [MAIN ] DPG: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:29:08.229056] [INFO ] [MAIN ] DPG: Wiping existing primary data before full refresh. [2025-10-15T18:29:08.229198] [INFO ] [LOCAL ] DPG: Starting deletion of primary data. [2025-10-15T18:29:08.229561] [DEBUG] [LOCAL ] DPG: Deleted primary data file. [2025-10-15T18:29:08.229786] [INFO ] [MAIN ] DPG: Starting full primary refresh. [2025-10-15T18:29:08.382700] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-15T18:29:08.669801] [INFO ] [REMOTE ] DPG: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:29:08.913984] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-10. [2025-10-15T18:29:09.505896] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-01 (2.19 seconds). [2025-10-15T18:29:09.714007] [INFO ] [REMOTE ] DPG: Fetching primary data for 2024-12. [2025-10-15T18:29:10.082508] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-10 (1.96 seconds). [2025-10-15T18:29:10.091176] [INFO ] [REMOTE ] DOCS: Full fetch complete (74059 records). [2025-10-15T18:29:10.091351] [DEBUG] [VALIDATOR ] DOCS: Validating primary data. [2025-10-15T18:29:10.517913] [DEBUG] [VALIDATOR ] DOCS: All expected trading days are present. [2025-10-15T18:29:10.522220] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-02. [2025-10-15T18:29:10.525296] [DEBUG] [VALIDATOR ] DOCS: Primary data validation passed. [2025-10-15T18:29:10.528894] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-15T18:29:10.527431] [INFO ] [MAIN ] DOCS: Fetched primary data is valid. [2025-10-15T18:29:10.529159] [DEBUG] [LOCAL ] DOCS: Saving primary data. [2025-10-15T18:29:10.535408] [INFO ] [REMOTE ] DOLE: Full fetch complete (54641 records). [2025-10-15T18:29:10.535575] [DEBUG] [VALIDATOR ] DOLE: Validating primary data. [2025-10-15T18:29:10.548034] [DEBUG] [LOCAL ] DOCS: Trimmed 74059 records to 50742 (keeping 200 days of data) [2025-10-15T18:29:10.820616] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-15T18:29:11.052900] [DEBUG] [VALIDATOR ] DOLE: All expected trading days are present. [2025-10-15T18:29:11.053558] [DEBUG] [VALIDATOR ] DOLE: Primary data validation passed. [2025-10-15T18:29:11.055400] [INFO ] [MAIN ] DOLE: Fetched primary data is valid. [2025-10-15T18:29:11.055487] [DEBUG] [LOCAL ] DOLE: Saving primary data. [2025-10-15T18:29:11.064192] [DEBUG] [LOCAL ] DOLE: Trimmed 54641 records to 39209 (keeping 200 days of data) [2025-10-15T18:29:11.345976] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-01. [2025-10-15T18:29:11.483803] [DEBUG] [LOCAL ] DOLE: Primary data saved (39209 records). [2025-10-15T18:29:11.484821] [INFO ] [MAIN ] DOLE: Full history saved. [2025-10-15T18:29:11.485244] [INFO ] [MAIN ] Update Progress: 643/2369 symbols completed. DOLE took 32.3s. Estimated remaining: 3h 59m 13s. Rate: 7.2 symbols/min [2025-10-15T18:29:11.616904] [DEBUG] [LOCAL ] DOCS: Primary data saved (50742 records). [2025-10-15T18:29:11.635921] [INFO ] [MAIN ] DOCS: Full history saved. [2025-10-15T18:29:11.636036] [INFO ] [MAIN ] Update Progress: 644/2369 symbols completed. DOCS took 32.4s. Estimated remaining: 3h 58m 43s. Rate: 7.2 symbols/min [2025-10-15T18:29:11.743918] [INFO ] [MAIN ] DQ: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:29:11.843522] [INFO ] [MAIN ] DRD: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:29:11.887620] [DEBUG] [LOCAL ] DQ: Loaded 43704 existing records from primary storage. [2025-10-15T18:29:11.887976] [INFO ] [MAIN ] DQ: Loaded 43704 existing records. [2025-10-15T18:29:12.010953] [DEBUG] [LOCAL ] DRD: Loaded 37699 existing records from primary storage. [2025-10-15T18:29:12.026984] [INFO ] [MAIN ] DRD: Loaded 37699 existing records. [2025-10-15T18:29:12.166695] [WARN ] [MAIN ] DQ: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:29:12.205880] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-15T18:29:12.205277] [INFO ] [MAIN ] DQ: Wiping existing primary data before full refresh. [2025-10-15T18:29:12.215278] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-02. [2025-10-15T18:29:12.261372] [INFO ] [LOCAL ] DQ: Starting deletion of primary data. [2025-10-15T18:29:12.284414] [DEBUG] [LOCAL ] DQ: Deleted primary data file. [2025-10-15T18:29:12.286270] [INFO ] [MAIN ] DQ: Starting full primary refresh. [2025-10-15T18:29:12.290151] [WARN ] [MAIN ] DRD: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:29:12.343960] [INFO ] [MAIN ] DRD: Wiping existing primary data before full refresh. [2025-10-15T18:29:12.363864] [INFO ] [LOCAL ] DRD: Starting deletion of primary data. [2025-10-15T18:29:12.389464] [DEBUG] [LOCAL ] DRD: Deleted primary data file. [2025-10-15T18:29:12.389720] [INFO ] [MAIN ] DRD: Starting full primary refresh. [2025-10-15T18:29:12.883847] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-02 (2.36 seconds). [2025-10-15T18:29:12.984092] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-03. [2025-10-15T18:29:12.973485] [INFO ] [REMOTE ] DQ: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:29:13.066325] [INFO ] [REMOTE ] DRD: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:29:13.074443] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-15T18:29:13.714003] [INFO ] [REMOTE ] DQ: Fetching primary data for 2024-12. [2025-10-15T18:29:14.514002] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-03. [2025-10-15T18:29:15.142760] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-03 (2.16 seconds). [2025-10-15T18:29:15.313963] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-04. [2025-10-15T18:29:15.418271] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-15T18:29:15.509936] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-15T18:29:16.114011] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-01. [2025-10-15T18:29:16.914008] [INFO ] [REMOTE ] DRD: Fetching primary data for 2024-12. [2025-10-15T18:29:17.520682] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-04 (2.21 seconds). [2025-10-15T18:29:17.554713] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-15T18:29:17.714061] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-02. [2025-10-15T18:29:18.203846] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-15T18:29:18.514066] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-05. [2025-10-15T18:29:19.103143] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-15T18:29:19.314064] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-01. [2025-10-15T18:29:20.113966] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-04. [2025-10-15T18:29:20.256380] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-15T18:29:20.647469] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-05 (2.13 seconds). [2025-10-15T18:29:20.914036] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-06. [2025-10-15T18:29:21.194601] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-15T18:29:21.714049] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-02. [2025-10-15T18:29:22.514020] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-03. [2025-10-15T18:29:22.803257] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-15T18:29:22.996303] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-15T18:29:23.314015] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-03. [2025-10-15T18:29:23.705504] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-15T18:29:24.113982] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-04. [2025-10-15T18:29:24.874352] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-15T18:29:24.913956] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-04. [2025-10-15T18:29:25.713960] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-07. [2025-10-15T18:29:25.850274] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-15T18:29:26.513983] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-05. [2025-10-15T18:29:26.636785] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-15T18:29:27.314025] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-05. [2025-10-15T18:29:28.114004] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-05. [2025-10-15T18:29:28.185387] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-07 (2.47 seconds). [2025-10-15T18:29:28.187040] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-15T18:29:28.762877] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-15T18:29:28.914028] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-08. [2025-10-15T18:29:29.064614] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-15T18:29:29.714041] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-06. [2025-10-15T18:29:30.513962] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-06. [2025-10-15T18:29:31.066261] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-15T18:29:31.093855] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-08 (2.18 seconds). [2025-10-15T18:29:31.313988] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-09. [2025-10-15T18:29:31.398575] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-15T18:29:32.113990] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-06. [2025-10-15T18:29:32.913979] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-07. [2025-10-15T18:29:33.027797] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-15T18:29:33.547070] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-15T18:29:33.714000] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-07. [2025-10-15T18:29:34.449874] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-15T18:29:34.514024] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-10. [2025-10-15T18:29:34.683500] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-15T18:29:35.314010] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-08. [2025-10-15T18:29:36.020678] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-15T18:29:36.113982] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-09. [2025-10-15T18:29:36.685262] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-10 (2.17 seconds). [2025-10-15T18:29:36.691853] [INFO ] [REMOTE ] DOW: Full fetch complete (77910 records). [2025-10-15T18:29:36.691996] [DEBUG] [VALIDATOR ] DOW: Validating primary data. [2025-10-15T18:29:36.919128] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-07. [2025-10-15T18:29:37.072480] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-15T18:29:37.115034] [DEBUG] [VALIDATOR ] DOW: All expected trading days are present. [2025-10-15T18:29:37.115110] [DEBUG] [VALIDATOR ] DOW: Primary data validation passed. [2025-10-15T18:29:37.116022] [INFO ] [MAIN ] DOW: Fetched primary data is valid. [2025-10-15T18:29:37.116104] [DEBUG] [LOCAL ] DOW: Saving primary data. [2025-10-15T18:29:37.117448] [DEBUG] [LOCAL ] DOW: Trimmed 77910 records to 53733 (keeping 200 days of data) [2025-10-15T18:29:37.444565] [DEBUG] [LOCAL ] DOW: Primary data saved (53733 records). [2025-10-15T18:29:37.444749] [INFO ] [MAIN ] DOW: Full history saved. [2025-10-15T18:29:37.444840] [INFO ] [MAIN ] Update Progress: 645/2369 symbols completed. DOW took 34.6s. Estimated remaining: 3h 59m 21s. Rate: 7.2 symbols/min [2025-10-15T18:29:37.611538] [INFO ] [MAIN ] DRH: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:29:37.655827] [DEBUG] [LOCAL ] DRH: Loaded 50409 existing records from primary storage. [2025-10-15T18:29:37.656122] [INFO ] [MAIN ] DRH: Loaded 50409 existing records. [2025-10-15T18:29:37.719066] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-10. [2025-10-15T18:29:37.831937] [WARN ] [MAIN ] DRH: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:29:37.832133] [INFO ] [MAIN ] DRH: Wiping existing primary data before full refresh. [2025-10-15T18:29:37.832204] [INFO ] [LOCAL ] DRH: Starting deletion of primary data. [2025-10-15T18:29:37.832571] [DEBUG] [LOCAL ] DRH: Deleted primary data file. [2025-10-15T18:29:37.832626] [INFO ] [MAIN ] DRH: Starting full primary refresh. [2025-10-15T18:29:38.207360] [INFO ] [REMOTE ] DRH: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:29:38.209029] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-15T18:29:38.440889] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-15T18:29:38.442969] [INFO ] [REMOTE ] DPG: Full fetch complete (19030 records). [2025-10-15T18:29:38.443038] [DEBUG] [VALIDATOR ] DPG: Validating primary data. [2025-10-15T18:29:38.519123] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-08. [2025-10-15T18:29:38.793177] [DEBUG] [VALIDATOR ] DPG: All expected trading days are present. [2025-10-15T18:29:38.793246] [DEBUG] [VALIDATOR ] DPG: Primary data validation passed. [2025-10-15T18:29:38.793529] [INFO ] [MAIN ] DPG: Fetched primary data is valid. [2025-10-15T18:29:38.793567] [DEBUG] [LOCAL ] DPG: Saving primary data. [2025-10-15T18:29:38.794128] [DEBUG] [LOCAL ] DPG: Trimmed 19030 records to 13576 (keeping 200 days of data) [2025-10-15T18:29:38.872882] [DEBUG] [LOCAL ] DPG: Primary data saved (13576 records). [2025-10-15T18:29:38.873003] [INFO ] [MAIN ] DPG: Full history saved. [2025-10-15T18:29:38.873078] [INFO ] [MAIN ] Update Progress: 646/2369 symbols completed. DPG took 31.0s. Estimated remaining: 3h 58m 54s. Rate: 7.2 symbols/min [2025-10-15T18:29:39.035545] [INFO ] [MAIN ] DRI: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:29:39.035692] [DEBUG] [LOCAL ] DRI: No existing data file found in primary storage. [2025-10-15T18:29:39.035742] [WARN ] [MAIN ] DRI: No existing data found, performing full refresh instead. [2025-10-15T18:29:39.035844] [INFO ] [MAIN ] DRI: Wiping existing primary data before full refresh. [2025-10-15T18:29:39.035885] [INFO ] [LOCAL ] DRI: Starting deletion of primary data. [2025-10-15T18:29:39.035926] [DEBUG] [LOCAL ] DRI: No primary data file found to delete. [2025-10-15T18:29:39.035957] [INFO ] [MAIN ] DRI: Starting full primary refresh. [2025-10-15T18:29:39.319111] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-08. [2025-10-15T18:29:39.379994] [INFO ] [REMOTE ] DRI: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:29:40.114021] [INFO ] [REMOTE ] DRI: Fetching primary data for 2024-12. [2025-10-15T18:29:40.181009] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-15T18:29:40.901505] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-15T18:29:40.913949] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-09. [2025-10-15T18:29:41.481314] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-15T18:29:41.713979] [INFO ] [REMOTE ] DRH: Fetching primary data for 2024-12. [2025-10-15T18:29:42.514001] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-09. [2025-10-15T18:29:42.571474] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-15T18:29:43.314045] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-01. [2025-10-15T18:29:43.390430] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-15T18:29:44.046796] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-15T18:29:44.113963] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-10. [2025-10-15T18:29:44.839964] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-15T18:29:44.913977] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-02. [2025-10-15T18:29:45.557385] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-15T18:29:45.563014] [INFO ] [REMOTE ] DQ: Full fetch complete (63544 records). [2025-10-15T18:29:45.563121] [DEBUG] [VALIDATOR ] DQ: Validating primary data. [2025-10-15T18:29:45.714025] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-10. [2025-10-15T18:29:45.937742] [DEBUG] [VALIDATOR ] DQ: All expected trading days are present. [2025-10-15T18:29:45.937839] [DEBUG] [VALIDATOR ] DQ: Primary data validation passed. [2025-10-15T18:29:45.938703] [INFO ] [MAIN ] DQ: Fetched primary data is valid. [2025-10-15T18:29:45.938764] [DEBUG] [LOCAL ] DQ: Saving primary data. [2025-10-15T18:29:45.940155] [DEBUG] [LOCAL ] DQ: Trimmed 63544 records to 43738 (keeping 200 days of data) [2025-10-15T18:29:46.190172] [DEBUG] [LOCAL ] DQ: Primary data saved (43738 records). [2025-10-15T18:29:46.190299] [INFO ] [MAIN ] DQ: Full history saved. [2025-10-15T18:29:46.190775] [INFO ] [MAIN ] Update Progress: 647/2369 symbols completed. DQ took 34.7s. Estimated remaining: 3h 58m 43s. Rate: 7.2 symbols/min [2025-10-15T18:29:46.357534] [INFO ] [MAIN ] DRLL: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:29:46.369670] [DEBUG] [LOCAL ] DRLL: Loaded 9185 existing records from primary storage. [2025-10-15T18:29:46.369891] [INFO ] [MAIN ] DRLL: Loaded 9185 existing records. [2025-10-15T18:29:46.515498] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-01. [2025-10-15T18:29:46.544358] [WARN ] [MAIN ] DRLL: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:29:46.545395] [INFO ] [MAIN ] DRLL: Wiping existing primary data before full refresh. [2025-10-15T18:29:46.545609] [INFO ] [LOCAL ] DRLL: Starting deletion of primary data. [2025-10-15T18:29:46.546058] [DEBUG] [LOCAL ] DRLL: Deleted primary data file. [2025-10-15T18:29:46.546168] [INFO ] [MAIN ] DRLL: Starting full primary refresh. [2025-10-15T18:29:46.721342] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-15T18:29:46.947914] [INFO ] [REMOTE ] DRLL: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:29:47.183990] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-15T18:29:47.189264] [INFO ] [REMOTE ] DRD: Full fetch complete (51246 records). [2025-10-15T18:29:47.189348] [DEBUG] [VALIDATOR ] DRD: Validating primary data. [2025-10-15T18:29:47.325123] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-03. [2025-10-15T18:29:47.564586] [DEBUG] [VALIDATOR ] DRD: All expected trading days are present. [2025-10-15T18:29:47.564714] [DEBUG] [VALIDATOR ] DRD: Primary data validation passed. [2025-10-15T18:29:47.565497] [INFO ] [MAIN ] DRD: Fetched primary data is valid. [2025-10-15T18:29:47.565560] [DEBUG] [LOCAL ] DRD: Saving primary data. [2025-10-15T18:29:47.567617] [DEBUG] [LOCAL ] DRD: Trimmed 51246 records to 37717 (keeping 200 days of data) [2025-10-15T18:29:47.794075] [DEBUG] [LOCAL ] DRD: Primary data saved (37717 records). [2025-10-15T18:29:47.794214] [INFO ] [MAIN ] DRD: Full history saved. [2025-10-15T18:29:47.794292] [INFO ] [MAIN ] Update Progress: 648/2369 symbols completed. DRD took 36.2s. Estimated remaining: 3h 58m 17s. Rate: 7.2 symbols/min [2025-10-15T18:29:47.998446] [INFO ] [MAIN ] DSL: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:29:48.030582] [DEBUG] [LOCAL ] DSL: Loaded 28774 existing records from primary storage. [2025-10-15T18:29:48.030964] [INFO ] [MAIN ] DSL: Loaded 28774 existing records. [2025-10-15T18:29:48.119192] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2024-12. [2025-10-15T18:29:48.221760] [WARN ] [MAIN ] DSL: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:29:48.231745] [INFO ] [MAIN ] DSL: Wiping existing primary data before full refresh. [2025-10-15T18:29:48.236948] [INFO ] [LOCAL ] DSL: Starting deletion of primary data. [2025-10-15T18:29:48.247487] [DEBUG] [LOCAL ] DSL: Deleted primary data file. [2025-10-15T18:29:48.247625] [INFO ] [MAIN ] DSL: Starting full primary refresh. [2025-10-15T18:29:48.325288] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-15T18:29:48.609313] [INFO ] [REMOTE ] DSL: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:29:48.913975] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-02. [2025-10-15T18:29:48.946928] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-10-15T18:29:49.053350] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-15T18:29:49.714060] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-01. [2025-10-15T18:29:50.430548] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-15T18:29:50.513964] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-03. [2025-10-15T18:29:50.589311] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-15T18:29:51.313993] [INFO ] [REMOTE ] DSL: Fetching primary data for 2024-12. [2025-10-15T18:29:52.114034] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-04. [2025-10-15T18:29:52.264740] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-15T18:29:52.690147] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-15T18:29:52.914005] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-04. [2025-10-15T18:29:53.692906] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-15T18:29:53.713981] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-05. [2025-10-15T18:29:54.423486] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-15T18:29:54.514038] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-01. [2025-10-15T18:29:55.054743] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-15T18:29:55.314020] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-05. [2025-10-15T18:29:55.506578] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-15T18:29:56.113993] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-02. [2025-10-15T18:29:56.770093] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-15T18:29:56.913999] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-06. [2025-10-15T18:29:57.261368] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-15T18:29:57.713996] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-03. [2025-10-15T18:29:58.352184] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-15T18:29:58.514031] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-07. [2025-10-15T18:29:59.006344] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-15T18:29:59.314014] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-02. [2025-10-15T18:30:00.069940] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-15T18:30:00.114061] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-04. [2025-10-15T18:30:00.170520] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-15T18:30:00.914003] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-06. [2025-10-15T18:30:01.313849] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-15T18:30:01.714000] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-05. [2025-10-15T18:30:02.513994] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-08. [2025-10-15T18:30:02.774432] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-15T18:30:03.069092] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-15T18:30:03.314025] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-06. [2025-10-15T18:30:04.030233] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-15T18:30:04.114002] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-09. [2025-10-15T18:30:04.303983] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-15T18:30:04.913976] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-07. [2025-10-15T18:30:05.714005] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-07. [2025-10-15T18:30:06.030708] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-15T18:30:06.514026] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-03. [2025-10-15T18:30:06.718697] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-15T18:30:06.756333] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-15T18:30:07.254891] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-15T18:30:07.313993] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-10. [2025-10-15T18:30:08.113982] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-04. [2025-10-15T18:30:08.914013] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-08. [2025-10-15T18:30:08.989238] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-15T18:30:09.003521] [INFO ] [REMOTE ] DRH: Full fetch complete (72089 records). [2025-10-15T18:30:09.003860] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-15T18:30:09.006866] [DEBUG] [VALIDATOR ] DRH: Validating primary data. [2025-10-15T18:30:09.393541] [DEBUG] [VALIDATOR ] DRH: All expected trading days are present. [2025-10-15T18:30:09.393673] [DEBUG] [VALIDATOR ] DRH: Primary data validation passed. [2025-10-15T18:30:09.394770] [INFO ] [MAIN ] DRH: Fetched primary data is valid. [2025-10-15T18:30:09.394846] [DEBUG] [LOCAL ] DRH: Saving primary data. [2025-10-15T18:30:09.396327] [DEBUG] [LOCAL ] DRH: Trimmed 72089 records to 50410 (keeping 200 days of data) [2025-10-15T18:30:09.690394] [DEBUG] [LOCAL ] DRH: Primary data saved (50410 records). [2025-10-15T18:30:09.690524] [INFO ] [MAIN ] DRH: Full history saved. [2025-10-15T18:30:09.690635] [INFO ] [MAIN ] Update Progress: 649/2369 symbols completed. DRH took 32.2s. Estimated remaining: 3h 58m 45s. Rate: 7.2 symbols/min [2025-10-15T18:30:09.719357] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-05. [2025-10-15T18:30:09.863409] [INFO ] [MAIN ] DSM: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:30:09.879242] [DEBUG] [LOCAL ] DSM: Loaded 14198 existing records from primary storage. [2025-10-15T18:30:09.879475] [INFO ] [MAIN ] DSM: Loaded 14198 existing records. [2025-10-15T18:30:10.084461] [WARN ] [MAIN ] DSM: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:30:10.084708] [INFO ] [MAIN ] DSM: Wiping existing primary data before full refresh. [2025-10-15T18:30:10.084796] [INFO ] [LOCAL ] DSM: Starting deletion of primary data. [2025-10-15T18:30:10.084985] [DEBUG] [LOCAL ] DSM: Deleted primary data file. [2025-10-15T18:30:10.085055] [INFO ] [MAIN ] DSM: Starting full primary refresh. [2025-10-15T18:30:10.476173] [INFO ] [REMOTE ] DSM: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:30:10.505149] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-15T18:30:10.514035] [INFO ] [REMOTE ] DSM: Fetching primary data for 2024-12. [2025-10-15T18:30:10.641570] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-15T18:30:11.314017] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-06. [2025-10-15T18:30:11.341012] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-10-15T18:30:12.084460] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-15T18:30:12.113995] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-09. [2025-10-15T18:30:12.914008] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-08. [2025-10-15T18:30:13.452055] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-15T18:30:13.714057] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-01. [2025-10-15T18:30:14.251023] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-15T18:30:14.514036] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-09. [2025-10-15T18:30:14.526160] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-15T18:30:15.314034] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-07. [2025-10-15T18:30:15.838744] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-15T18:30:16.114029] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-02. [2025-10-15T18:30:16.150468] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-15T18:30:16.913981] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-08. [2025-10-15T18:30:17.308720] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-15T18:30:17.410432] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-10-15T18:30:17.713996] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-10. [2025-10-15T18:30:18.514053] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-09. [2025-10-15T18:30:18.829694] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-15T18:30:18.833796] [INFO ] [REMOTE ] DSL: Full fetch complete (41650 records). [2025-10-15T18:30:18.833917] [DEBUG] [VALIDATOR ] DSL: Validating primary data. [2025-10-15T18:30:19.215569] [DEBUG] [VALIDATOR ] DSL: All expected trading days are present. [2025-10-15T18:30:19.215713] [DEBUG] [VALIDATOR ] DSL: Primary data validation passed. [2025-10-15T18:30:19.216370] [INFO ] [MAIN ] DSL: Fetched primary data is valid. [2025-10-15T18:30:19.216413] [DEBUG] [LOCAL ] DSL: Saving primary data. [2025-10-15T18:30:19.217352] [DEBUG] [LOCAL ] DSL: Trimmed 41650 records to 28822 (keeping 200 days of data) [2025-10-15T18:30:19.314207] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-03. [2025-10-15T18:30:19.317618] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-15T18:30:19.408136] [DEBUG] [LOCAL ] DSL: Primary data saved (28822 records). [2025-10-15T18:30:19.408283] [INFO ] [MAIN ] DSL: Full history saved. [2025-10-15T18:30:19.408370] [INFO ] [MAIN ] Update Progress: 650/2369 symbols completed. DSL took 31.6s. Estimated remaining: 3h 58m 40s. Rate: 7.2 symbols/min [2025-10-15T18:30:19.574262] [INFO ] [MAIN ] DSMC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:30:19.574421] [DEBUG] [LOCAL ] DSMC: No existing data file found in primary storage. [2025-10-15T18:30:19.574458] [WARN ] [MAIN ] DSMC: No existing data found, performing full refresh instead. [2025-10-15T18:30:19.574565] [INFO ] [MAIN ] DSMC: Wiping existing primary data before full refresh. [2025-10-15T18:30:19.574606] [INFO ] [LOCAL ] DSMC: Starting deletion of primary data. [2025-10-15T18:30:19.574672] [DEBUG] [LOCAL ] DSMC: No primary data file found to delete. [2025-10-15T18:30:19.574724] [INFO ] [MAIN ] DSMC: Starting full primary refresh. [2025-10-15T18:30:19.930674] [INFO ] [REMOTE ] DSMC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:30:20.114006] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2024-12. [2025-10-15T18:30:20.456117] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-15T18:30:20.567399] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2024-12 (0.45 seconds). [2025-10-15T18:30:20.914000] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-10. [2025-10-15T18:30:21.675179] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-15T18:30:21.681103] [INFO ] [REMOTE ] DRI: Full fetch complete (69501 records). [2025-10-15T18:30:21.681240] [DEBUG] [VALIDATOR ] DRI: Validating primary data. [2025-10-15T18:30:21.719115] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-10. [2025-10-15T18:30:22.078580] [DEBUG] [VALIDATOR ] DRI: All expected trading days are present. [2025-10-15T18:30:22.078680] [DEBUG] [VALIDATOR ] DRI: Primary data validation passed. [2025-10-15T18:30:22.079574] [INFO ] [MAIN ] DRI: Fetched primary data is valid. [2025-10-15T18:30:22.079616] [DEBUG] [LOCAL ] DRI: Saving primary data. [2025-10-15T18:30:22.081316] [DEBUG] [LOCAL ] DRI: Trimmed 69501 records to 47693 (keeping 200 days of data) [2025-10-15T18:30:22.389138] [DEBUG] [LOCAL ] DRI: Primary data saved (47693 records). [2025-10-15T18:30:22.389283] [INFO ] [MAIN ] DRI: Full history saved. [2025-10-15T18:30:22.389382] [INFO ] [MAIN ] Update Progress: 651/2369 symbols completed. DRI took 43.5s. Estimated remaining: 3h 58m 18s. Rate: 7.2 symbols/min [2025-10-15T18:30:22.514771] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-01. [2025-10-15T18:30:22.514698] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-15T18:30:22.571390] [INFO ] [MAIN ] DSU: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:30:22.573120] [INFO ] [REMOTE ] DRLL: Full fetch complete (14806 records). [2025-10-15T18:30:22.573064] [DEBUG] [LOCAL ] DSU: No existing data file found in primary storage. [2025-10-15T18:30:22.573327] [DEBUG] [VALIDATOR ] DRLL: Validating primary data. [2025-10-15T18:30:22.573237] [WARN ] [MAIN ] DSU: No existing data found, performing full refresh instead. [2025-10-15T18:30:22.573719] [INFO ] [MAIN ] DSU: Wiping existing primary data before full refresh. [2025-10-15T18:30:22.585960] [INFO ] [LOCAL ] DSU: Starting deletion of primary data. [2025-10-15T18:30:22.607561] [DEBUG] [LOCAL ] DSU: No primary data file found to delete. [2025-10-15T18:30:22.619106] [INFO ] [MAIN ] DSU: Starting full primary refresh. [2025-10-15T18:30:23.074473] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-15T18:30:23.313567] [DEBUG] [VALIDATOR ] DRLL: All expected trading days are present. [2025-10-15T18:30:23.313414] [INFO ] [REMOTE ] DSU: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:30:23.313702] [DEBUG] [VALIDATOR ] DRLL: Primary data validation passed. [2025-10-15T18:30:23.314048] [INFO ] [REMOTE ] DSU: Fetching primary data for 2024-12. [2025-10-15T18:30:23.314509] [INFO ] [MAIN ] DRLL: Fetched primary data is valid. [2025-10-15T18:30:23.315414] [DEBUG] [LOCAL ] DRLL: Saving primary data. [2025-10-15T18:30:23.315968] [DEBUG] [LOCAL ] DRLL: Trimmed 14806 records to 9148 (keeping 200 days of data) [2025-10-15T18:30:23.375332] [DEBUG] [LOCAL ] DRLL: Primary data saved (9148 records). [2025-10-15T18:30:23.375447] [INFO ] [MAIN ] DRLL: Full history saved. [2025-10-15T18:30:23.375521] [INFO ] [MAIN ] Update Progress: 652/2369 symbols completed. DRLL took 37.2s. Estimated remaining: 3h 57m 50s. Rate: 7.2 symbols/min [2025-10-15T18:30:23.583100] [INFO ] [MAIN ] DSX: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:30:23.583270] [DEBUG] [LOCAL ] DSX: No existing data file found in primary storage. [2025-10-15T18:30:23.583326] [WARN ] [MAIN ] DSX: No existing data found, performing full refresh instead. [2025-10-15T18:30:23.583438] [INFO ] [MAIN ] DSX: Wiping existing primary data before full refresh. [2025-10-15T18:30:23.583493] [INFO ] [LOCAL ] DSX: Starting deletion of primary data. [2025-10-15T18:30:23.583560] [DEBUG] [LOCAL ] DSX: No primary data file found to delete. [2025-10-15T18:30:23.583596] [INFO ] [MAIN ] DSX: Starting full primary refresh. [2025-10-15T18:30:23.932953] [INFO ] [REMOTE ] DSX: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:30:24.113962] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-04. [2025-10-15T18:30:24.521788] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-15T18:30:24.913969] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-01. [2025-10-15T18:30:25.007802] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-15T18:30:25.713981] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-05. [2025-10-15T18:30:26.085750] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-15T18:30:26.195938] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-10-15T18:30:26.514007] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-02. [2025-10-15T18:30:27.313995] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-02. [2025-10-15T18:30:27.537816] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-15T18:30:27.768373] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-15T18:30:28.114028] [INFO ] [REMOTE ] DSX: Fetching primary data for 2024-12. [2025-10-15T18:30:28.914043] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-06. [2025-10-15T18:30:29.624181] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-15T18:30:29.713989] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-01. [2025-10-15T18:30:29.871786] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-15T18:30:30.514014] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-03. [2025-10-15T18:30:30.878507] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-15T18:30:31.109483] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-15T18:30:31.314005] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-04. [2025-10-15T18:30:31.856682] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-10-15T18:30:32.114003] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-05. [2025-10-15T18:30:32.554068] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-10-15T18:30:32.914007] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-03. [2025-10-15T18:30:33.713974] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-07. [2025-10-15T18:30:33.806422] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-15T18:30:34.507533] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-15T18:30:34.513945] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-08. [2025-10-15T18:30:35.313970] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-02. [2025-10-15T18:30:35.422454] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-15T18:30:36.114012] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-06. [2025-10-15T18:30:36.264058] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-15T18:30:36.449731] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-10-15T18:30:36.914016] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-03. [2025-10-15T18:30:37.714014] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-07. [2025-10-15T18:30:38.117719] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-07 (0.40 seconds). [2025-10-15T18:30:38.254540] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-15T18:30:38.514046] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-08. [2025-10-15T18:30:38.960858] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-15T18:30:39.314047] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-09. [2025-10-15T18:30:39.812679] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-10-15T18:30:40.114034] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-09. [2025-10-15T18:30:40.839457] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-15T18:30:40.914013] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-10. [2025-10-15T18:30:41.713979] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-10. [2025-10-15T18:30:41.779367] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-15T18:30:41.781146] [INFO ] [REMOTE ] DSM: Full fetch complete (23919 records). [2025-10-15T18:30:41.781216] [DEBUG] [VALIDATOR ] DSM: Validating primary data. [2025-10-15T18:30:42.147551] [DEBUG] [VALIDATOR ] DSM: All expected trading days are present. [2025-10-15T18:30:42.147661] [DEBUG] [VALIDATOR ] DSM: Primary data validation passed. [2025-10-15T18:30:42.148173] [INFO ] [MAIN ] DSM: Fetched primary data is valid. [2025-10-15T18:30:42.148214] [DEBUG] [LOCAL ] DSM: Saving primary data. [2025-10-15T18:30:42.148851] [DEBUG] [LOCAL ] DSM: Trimmed 23919 records to 14125 (keeping 200 days of data) [2025-10-15T18:30:42.230476] [DEBUG] [LOCAL ] DSM: Primary data saved (14125 records). [2025-10-15T18:30:42.230605] [INFO ] [MAIN ] DSM: Full history saved. [2025-10-15T18:30:42.230707] [INFO ] [MAIN ] Update Progress: 653/2369 symbols completed. DSM took 32.5s. Estimated remaining: 3h 58m 10s. Rate: 7.2 symbols/min [2025-10-15T18:30:42.374755] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-15T18:30:42.400284] [INFO ] [REMOTE ] DSMC: Full fetch complete (2855 records). [2025-10-15T18:30:42.407683] [DEBUG] [VALIDATOR ] DSMC: Validating primary data. [2025-10-15T18:30:42.531329] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-04. [2025-10-15T18:30:42.471861] [INFO ] [MAIN ] DT: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:30:42.551961] [DEBUG] [LOCAL ] DT: No existing data file found in primary storage. [2025-10-15T18:30:42.557344] [WARN ] [MAIN ] DT: No existing data found, performing full refresh instead. [2025-10-15T18:30:42.568086] [INFO ] [MAIN ] DT: Wiping existing primary data before full refresh. [2025-10-15T18:30:42.579296] [INFO ] [LOCAL ] DT: Starting deletion of primary data. [2025-10-15T18:30:42.592672] [DEBUG] [LOCAL ] DT: No primary data file found to delete. [2025-10-15T18:30:42.598440] [INFO ] [MAIN ] DT: Starting full primary refresh. [2025-10-15T18:30:43.207714] [DEBUG] [VALIDATOR ] DSMC: All expected trading days are present. [2025-10-15T18:30:43.211221] [DEBUG] [VALIDATOR ] DSMC: Primary data validation passed. [2025-10-15T18:30:43.231395] [INFO ] [MAIN ] DSMC: Fetched primary data is valid. [2025-10-15T18:30:43.231207] [INFO ] [REMOTE ] DT: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:30:43.231544] [DEBUG] [LOCAL ] DSMC: Saving primary data. [2025-10-15T18:30:43.232071] [DEBUG] [LOCAL ] DSMC: Trimmed 2855 records to 1837 (keeping 200 days of data) [2025-10-15T18:30:43.243968] [DEBUG] [LOCAL ] DSMC: Primary data saved (1837 records). [2025-10-15T18:30:43.244080] [INFO ] [MAIN ] DSMC: Full history saved. [2025-10-15T18:30:43.244151] [INFO ] [MAIN ] Update Progress: 654/2369 symbols completed. DSMC took 23.8s. Estimated remaining: 3h 57m 42s. Rate: 7.2 symbols/min [2025-10-15T18:30:43.319120] [INFO ] [REMOTE ] DT: Fetching primary data for 2024-12. [2025-10-15T18:30:43.437343] [INFO ] [MAIN ] DTB: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:30:43.437498] [DEBUG] [LOCAL ] DTB: No existing data file found in primary storage. [2025-10-15T18:30:43.437535] [WARN ] [MAIN ] DTB: No existing data found, performing full refresh instead. [2025-10-15T18:30:43.437696] [INFO ] [MAIN ] DTB: Wiping existing primary data before full refresh. [2025-10-15T18:30:43.437749] [INFO ] [LOCAL ] DTB: Starting deletion of primary data. [2025-10-15T18:30:43.437792] [DEBUG] [LOCAL ] DTB: No primary data file found to delete. [2025-10-15T18:30:43.437823] [INFO ] [MAIN ] DTB: Starting full primary refresh. [2025-10-15T18:30:43.832732] [INFO ] [REMOTE ] DTB: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:30:43.835936] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-15T18:30:44.114068] [INFO ] [REMOTE ] DTB: Fetching primary data for 2024-12. [2025-10-15T18:30:44.856791] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-10-15T18:30:44.913953] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-01. [2025-10-15T18:30:45.172037] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-15T18:30:45.461328] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-15T18:30:45.714047] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-02. [2025-10-15T18:30:46.246815] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-15T18:30:46.513998] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-01. [2025-10-15T18:30:47.314029] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-03. [2025-10-15T18:30:47.705073] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-03 (0.39 seconds). [2025-10-15T18:30:47.926669] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-15T18:30:48.113992] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-02. [2025-10-15T18:30:48.914036] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-05. [2025-10-15T18:30:49.713995] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-04. [2025-10-15T18:30:49.798839] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-15T18:30:49.899014] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-15T18:30:50.513979] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-04. [2025-10-15T18:30:50.622127] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-15T18:30:51.062285] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-10-15T18:30:51.314034] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-03. [2025-10-15T18:30:52.113986] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-06. [2025-10-15T18:30:52.914049] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-05. [2025-10-15T18:30:53.147541] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-15T18:30:53.171730] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-15T18:30:53.607952] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-15T18:30:53.713962] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-06. [2025-10-15T18:30:54.514016] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-05. [2025-10-15T18:30:54.769435] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-15T18:30:55.183678] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-15T18:30:55.313994] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-06. [2025-10-15T18:30:55.929954] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-15T18:30:56.114076] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-07. [2025-10-15T18:30:56.914045] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-07. [2025-10-15T18:30:57.338911] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-15T18:30:57.713966] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-04. [2025-10-15T18:30:58.004620] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-15T18:30:58.514016] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-08. [2025-10-15T18:30:59.268031] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-15T18:30:59.313961] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-05. [2025-10-15T18:30:59.611848] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-15T18:31:00.113994] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-08. [2025-10-15T18:31:00.913972] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-07. [2025-10-15T18:31:01.250900] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-15T18:31:01.292985] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-10-15T18:31:01.346157] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-10-15T18:31:01.714072] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-09. [2025-10-15T18:31:02.514006] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-06. [2025-10-15T18:31:03.069607] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-15T18:31:03.314016] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-08. [2025-10-15T18:31:03.906044] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-15T18:31:04.113977] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-10. [2025-10-15T18:31:04.625532] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-06 (2.11 seconds). [2025-10-15T18:31:04.914026] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-09. [2025-10-15T18:31:05.309389] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-15T18:31:05.312813] [INFO ] [REMOTE ] DSX: Full fetch complete (35821 records). [2025-10-15T18:31:05.312942] [DEBUG] [VALIDATOR ] DSX: Validating primary data. [2025-10-15T18:31:05.683271] [DEBUG] [VALIDATOR ] DSX: All expected trading days are present. [2025-10-15T18:31:05.683347] [DEBUG] [VALIDATOR ] DSX: Primary data validation passed. [2025-10-15T18:31:05.683973] [INFO ] [MAIN ] DSX: Fetched primary data is valid. [2025-10-15T18:31:05.684034] [DEBUG] [LOCAL ] DSX: Saving primary data. [2025-10-15T18:31:05.684796] [DEBUG] [LOCAL ] DSX: Trimmed 35821 records to 23924 (keeping 200 days of data) [2025-10-15T18:31:05.730873] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-09. [2025-10-15T18:31:05.822067] [DEBUG] [LOCAL ] DSX: Primary data saved (23924 records). [2025-10-15T18:31:05.822191] [INFO ] [MAIN ] DSX: Full history saved. [2025-10-15T18:31:05.822260] [INFO ] [MAIN ] Update Progress: 655/2369 symbols completed. DSX took 42.4s. Estimated remaining: 3h 58m 11s. Rate: 7.2 symbols/min [2025-10-15T18:31:05.988697] [INFO ] [MAIN ] DTE: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:31:06.041082] [DEBUG] [LOCAL ] DTE: Loaded 47472 existing records from primary storage. [2025-10-15T18:31:06.041369] [INFO ] [MAIN ] DTE: Loaded 47472 existing records. [2025-10-15T18:31:06.226410] [WARN ] [MAIN ] DTE: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:31:06.242279] [INFO ] [MAIN ] DTE: Wiping existing primary data before full refresh. [2025-10-15T18:31:06.242422] [INFO ] [LOCAL ] DTE: Starting deletion of primary data. [2025-10-15T18:31:06.243907] [DEBUG] [LOCAL ] DTE: Deleted primary data file. [2025-10-15T18:31:06.243845] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-15T18:31:06.244102] [INFO ] [MAIN ] DTE: Starting full primary refresh. [2025-10-15T18:31:06.363358] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-15T18:31:06.519259] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-10. [2025-10-15T18:31:06.611537] [INFO ] [REMOTE ] DTE: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:31:07.218003] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-15T18:31:07.219572] [INFO ] [REMOTE ] DTB: Full fetch complete (6690 records). [2025-10-15T18:31:07.219697] [DEBUG] [VALIDATOR ] DTB: Validating primary data. [2025-10-15T18:31:07.323082] [INFO ] [REMOTE ] DTE: Fetching primary data for 2024-12. [2025-10-15T18:31:07.592206] [DEBUG] [VALIDATOR ] DTB: All expected trading days are present. [2025-10-15T18:31:07.592291] [DEBUG] [VALIDATOR ] DTB: Primary data validation passed. [2025-10-15T18:31:07.592490] [INFO ] [MAIN ] DTB: Fetched primary data is valid. [2025-10-15T18:31:07.592552] [DEBUG] [LOCAL ] DTB: Saving primary data. [2025-10-15T18:31:07.593041] [DEBUG] [LOCAL ] DTB: Trimmed 6690 records to 5012 (keeping 200 days of data) [2025-10-15T18:31:07.624274] [DEBUG] [LOCAL ] DTB: Primary data saved (5012 records). [2025-10-15T18:31:07.624387] [INFO ] [MAIN ] DTB: Full history saved. [2025-10-15T18:31:07.624456] [INFO ] [MAIN ] Update Progress: 656/2369 symbols completed. DTB took 24.4s. Estimated remaining: 3h 57m 46s. Rate: 7.2 symbols/min [2025-10-15T18:31:07.794715] [INFO ] [MAIN ] DTF: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:31:07.794879] [DEBUG] [LOCAL ] DTF: No existing data file found in primary storage. [2025-10-15T18:31:07.794917] [WARN ] [MAIN ] DTF: No existing data found, performing full refresh instead. [2025-10-15T18:31:07.795024] [INFO ] [MAIN ] DTF: Wiping existing primary data before full refresh. [2025-10-15T18:31:07.795067] [INFO ] [LOCAL ] DTF: Starting deletion of primary data. [2025-10-15T18:31:07.795108] [DEBUG] [LOCAL ] DTF: No primary data file found to delete. [2025-10-15T18:31:07.795141] [INFO ] [MAIN ] DTF: Starting full primary refresh. [2025-10-15T18:31:08.121867] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-10. [2025-10-15T18:31:08.156527] [INFO ] [REMOTE ] DTF: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:31:08.913994] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-07. [2025-10-15T18:31:09.199362] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-10-15T18:31:09.240794] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-15T18:31:09.243946] [INFO ] [REMOTE ] DSU: Full fetch complete (33044 records). [2025-10-15T18:31:09.244039] [DEBUG] [VALIDATOR ] DSU: Validating primary data. [2025-10-15T18:31:09.604265] [DEBUG] [VALIDATOR ] DSU: All expected trading days are present. [2025-10-15T18:31:09.604358] [DEBUG] [VALIDATOR ] DSU: Primary data validation passed. [2025-10-15T18:31:09.604982] [INFO ] [MAIN ] DSU: Fetched primary data is valid. [2025-10-15T18:31:09.605046] [DEBUG] [LOCAL ] DSU: Saving primary data. [2025-10-15T18:31:09.605992] [DEBUG] [LOCAL ] DSU: Trimmed 33044 records to 23007 (keeping 200 days of data) [2025-10-15T18:31:09.713984] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-01. [2025-10-15T18:31:09.745482] [DEBUG] [LOCAL ] DSU: Primary data saved (23007 records). [2025-10-15T18:31:09.745597] [INFO ] [MAIN ] DSU: Full history saved. [2025-10-15T18:31:09.745688] [INFO ] [MAIN ] Update Progress: 657/2369 symbols completed. DSU took 47.4s. Estimated remaining: 3h 57m 21s. Rate: 7.2 symbols/min [2025-10-15T18:31:09.912511] [INFO ] [MAIN ] DTG: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:31:09.920818] [DEBUG] [LOCAL ] DTG: Loaded 5793 existing records from primary storage. [2025-10-15T18:31:09.921044] [INFO ] [MAIN ] DTG: Loaded 5793 existing records. [2025-10-15T18:31:10.091890] [WARN ] [MAIN ] DTG: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:31:10.092081] [INFO ] [MAIN ] DTG: Wiping existing primary data before full refresh. [2025-10-15T18:31:10.092152] [INFO ] [LOCAL ] DTG: Starting deletion of primary data. [2025-10-15T18:31:10.092381] [DEBUG] [LOCAL ] DTG: Deleted primary data file. [2025-10-15T18:31:10.092438] [INFO ] [MAIN ] DTG: Starting full primary refresh. [2025-10-15T18:31:10.440737] [INFO ] [REMOTE ] DTG: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:31:10.513956] [INFO ] [REMOTE ] DTG: Fetching primary data for 2024-12. [2025-10-15T18:31:10.832250] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-15T18:31:10.889548] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-15T18:31:11.225329] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-10-15T18:31:11.313979] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-02. [2025-10-15T18:31:12.113995] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-01. [2025-10-15T18:31:12.594420] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-15T18:31:12.708809] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-15T18:31:12.914039] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-03. [2025-10-15T18:31:13.714049] [INFO ] [REMOTE ] DTF: Fetching primary data for 2024-12. [2025-10-15T18:31:14.514007] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-08. [2025-10-15T18:31:14.693316] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-15T18:31:14.712287] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-10-15T18:31:15.314043] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-04. [2025-10-15T18:31:15.957547] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-15T18:31:16.113992] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-09. [2025-10-15T18:31:16.913972] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-01. [2025-10-15T18:31:17.098777] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-15T18:31:17.290797] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-01 (0.38 seconds). [2025-10-15T18:31:17.714007] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-02. [2025-10-15T18:31:17.907916] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-15T18:31:18.052182] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-10-15T18:31:18.514024] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-02. [2025-10-15T18:31:18.960499] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-15T18:31:19.314005] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-03. [2025-10-15T18:31:20.006813] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-15T18:31:20.114054] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-03. [2025-10-15T18:31:20.582492] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-10-15T18:31:20.914021] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-10. [2025-10-15T18:31:21.714010] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-04. [2025-10-15T18:31:22.403789] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-15T18:31:22.514078] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-05. [2025-10-15T18:31:22.716766] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-15T18:31:22.722634] [INFO ] [REMOTE ] DT: Full fetch complete (76453 records). [2025-10-15T18:31:22.722803] [DEBUG] [VALIDATOR ] DT: Validating primary data. [2025-10-15T18:31:22.723588] [FATAL] [VALIDATOR ] DT: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T18:31:22.723703] [FATAL] [MAIN ] DT: Fetched primary data is invalid. Refusing to save it. [2025-10-15T18:31:22.723750] [WARN ] [MAIN ] DT: Deleting existing primary and derivative data due to validation failure. [2025-10-15T18:31:22.723791] [INFO ] [LOCAL ] DT: Starting deletion of primary data. [2025-10-15T18:31:22.723849] [DEBUG] [LOCAL ] DT: No primary data file found to delete. [2025-10-15T18:31:22.723884] [INFO ] [LOCAL ] DT: Starting deletion of derivative data. [2025-10-15T18:31:22.723924] [DEBUG] [LOCAL ] DT: No derivative data file found to delete. [2025-10-15T18:31:22.723980] [INFO ] [MAIN ] Update Progress: 658/2369 symbols completed. DT took 40.5s. Estimated remaining: 3h 57m 25s. Rate: 7.2 symbols/min [2025-10-15T18:31:22.888986] [INFO ] [MAIN ] DTK: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:31:22.889176] [DEBUG] [LOCAL ] DTK: No existing data file found in primary storage. [2025-10-15T18:31:22.889214] [WARN ] [MAIN ] DTK: No existing data found, performing full refresh instead. [2025-10-15T18:31:22.889325] [INFO ] [MAIN ] DTK: Wiping existing primary data before full refresh. [2025-10-15T18:31:22.889365] [INFO ] [LOCAL ] DTK: Starting deletion of primary data. [2025-10-15T18:31:22.889405] [DEBUG] [LOCAL ] DTK: No primary data file found to delete. [2025-10-15T18:31:22.889440] [INFO ] [MAIN ] DTK: Starting full primary refresh. [2025-10-15T18:31:23.273504] [INFO ] [REMOTE ] DTK: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:31:23.313977] [INFO ] [REMOTE ] DTK: Fetching primary data for 2024-12. [2025-10-15T18:31:23.507461] [DEBUG] [REMOTE ] DTK: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-15T18:31:23.507887] [WARN ] [REMOTE ] DTK: No data returned for month 2024-12 [2025-10-15T18:31:23.507977] [FATAL] [REMOTE ] DTK: API call failed - aborting fetch to avoid wasting further API calls [2025-10-15T18:31:23.508089] [FATAL] [MAIN ] DTK: Failed to fetch primary data. [2025-10-15T18:31:23.508158] [WARN ] [MAIN ] DTK: Deleting existing primary and derivative data due to fetch failure. [2025-10-15T18:31:23.508231] [INFO ] [LOCAL ] DTK: Starting deletion of primary data. [2025-10-15T18:31:23.508311] [DEBUG] [LOCAL ] DTK: No primary data file found to delete. [2025-10-15T18:31:23.508365] [INFO ] [LOCAL ] DTK: Starting deletion of derivative data. [2025-10-15T18:31:23.508408] [DEBUG] [LOCAL ] DTK: No derivative data file found to delete. [2025-10-15T18:31:23.508456] [INFO ] [MAIN ] Update Progress: 659/2369 symbols completed. DTK took 0.8s. Estimated remaining: 3h 56m 57s. Rate: 7.2 symbols/min [2025-10-15T18:31:23.680092] [INFO ] [MAIN ] DTM: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:31:23.680281] [DEBUG] [LOCAL ] DTM: No existing data file found in primary storage. [2025-10-15T18:31:23.680318] [WARN ] [MAIN ] DTM: No existing data found, performing full refresh instead. [2025-10-15T18:31:23.680427] [INFO ] [MAIN ] DTM: Wiping existing primary data before full refresh. [2025-10-15T18:31:23.680467] [INFO ] [LOCAL ] DTM: Starting deletion of primary data. [2025-10-15T18:31:23.680508] [DEBUG] [LOCAL ] DTM: No primary data file found to delete. [2025-10-15T18:31:23.680539] [INFO ] [MAIN ] DTM: Starting full primary refresh. [2025-10-15T18:31:24.053216] [INFO ] [REMOTE ] DTM: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:31:24.113995] [INFO ] [REMOTE ] DTM: Fetching primary data for 2024-12. [2025-10-15T18:31:24.340950] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-15T18:31:24.914003] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-05. [2025-10-15T18:31:25.574738] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-15T18:31:25.634732] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-15T18:31:25.713991] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-06. [2025-10-15T18:31:26.299040] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-15T18:31:26.514011] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-06. [2025-10-15T18:31:27.314022] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-04. [2025-10-15T18:31:27.942320] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-10-15T18:31:28.010706] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-15T18:31:28.114007] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-01. [2025-10-15T18:31:28.914038] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-05. [2025-10-15T18:31:29.342972] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-10-15T18:31:29.694721] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-15T18:31:29.714026] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-06. [2025-10-15T18:31:30.074586] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-10-15T18:31:30.513994] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-02. [2025-10-15T18:31:31.314005] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-07. [2025-10-15T18:31:31.698093] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-07 (0.38 seconds). [2025-10-15T18:31:32.113977] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-07. [2025-10-15T18:31:32.325893] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-15T18:31:32.913989] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-07. [2025-10-15T18:31:33.570012] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-15T18:31:33.713991] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-08. [2025-10-15T18:31:33.842147] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-15T18:31:34.200716] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-10-15T18:31:34.514062] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-08. [2025-10-15T18:31:35.314023] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-03. [2025-10-15T18:31:35.982712] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-15T18:31:36.114038] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-08. [2025-10-15T18:31:36.773133] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-15T18:31:36.913982] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-09. [2025-10-15T18:31:37.095802] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-15T18:31:37.430540] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-10-15T18:31:37.714012] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-09. [2025-10-15T18:31:38.514020] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-09. [2025-10-15T18:31:39.268186] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-15T18:31:39.303284] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-15T18:31:39.313958] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-10. [2025-10-15T18:31:39.731308] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-10 (0.42 seconds). [2025-10-15T18:31:39.736792] [INFO ] [REMOTE ] DTE: Full fetch complete (68693 records). [2025-10-15T18:31:39.736947] [DEBUG] [VALIDATOR ] DTE: Validating primary data. [2025-10-15T18:31:39.737814] [FATAL] [VALIDATOR ] DTE: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T18:31:39.737909] [FATAL] [MAIN ] DTE: Fetched primary data is invalid. Refusing to save it. [2025-10-15T18:31:39.737951] [WARN ] [MAIN ] DTE: Deleting existing primary and derivative data due to validation failure. [2025-10-15T18:31:39.737991] [INFO ] [LOCAL ] DTE: Starting deletion of primary data. [2025-10-15T18:31:39.738046] [DEBUG] [LOCAL ] DTE: No primary data file found to delete. [2025-10-15T18:31:39.738080] [INFO ] [LOCAL ] DTE: Starting deletion of derivative data. [2025-10-15T18:31:39.738225] [DEBUG] [LOCAL ] DTE: Deleted derivative data file. [2025-10-15T18:31:39.738851] [INFO ] [MAIN ] Update Progress: 660/2369 symbols completed. DTE took 33.9s. Estimated remaining: 3h 57m 9s. Rate: 7.2 symbols/min [2025-10-15T18:31:39.916493] [INFO ] [MAIN ] DTW: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:31:39.925323] [DEBUG] [LOCAL ] DTW: Loaded 4895 existing records from primary storage. [2025-10-15T18:31:39.925543] [INFO ] [MAIN ] DTW: Loaded 4895 existing records. [2025-10-15T18:31:40.098210] [WARN ] [MAIN ] DTW: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:31:40.098448] [INFO ] [MAIN ] DTW: Wiping existing primary data before full refresh. [2025-10-15T18:31:40.098501] [INFO ] [LOCAL ] DTW: Starting deletion of primary data. [2025-10-15T18:31:40.098677] [DEBUG] [LOCAL ] DTW: Deleted primary data file. [2025-10-15T18:31:40.098733] [INFO ] [MAIN ] DTW: Starting full primary refresh. [2025-10-15T18:31:40.119173] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-04. [2025-10-15T18:31:40.459065] [INFO ] [REMOTE ] DTW: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:31:40.914050] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-10. [2025-10-15T18:31:41.408894] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-15T18:31:41.409622] [INFO ] [REMOTE ] DTF: Full fetch complete (1805 records). [2025-10-15T18:31:41.409717] [DEBUG] [VALIDATOR ] DTF: Validating primary data. [2025-10-15T18:31:41.586396] [WARN ] [VALIDATOR ] DTF: Validation failed - insufficient historical data. Have 197 unique days, need 200 days [2025-10-15T18:31:41.586580] [FATAL] [MAIN ] DTF: Fetched primary data is invalid. Refusing to save it. [2025-10-15T18:31:41.586687] [WARN ] [MAIN ] DTF: Deleting existing primary and derivative data due to validation failure. [2025-10-15T18:31:41.586775] [INFO ] [LOCAL ] DTF: Starting deletion of primary data. [2025-10-15T18:31:41.586852] [DEBUG] [LOCAL ] DTF: No primary data file found to delete. [2025-10-15T18:31:41.586900] [INFO ] [LOCAL ] DTF: Starting deletion of derivative data. [2025-10-15T18:31:41.586954] [DEBUG] [LOCAL ] DTF: No derivative data file found to delete. [2025-10-15T18:31:41.587026] [INFO ] [MAIN ] Update Progress: 661/2369 symbols completed. DTF took 34.0s. Estimated remaining: 3h 56m 44s. Rate: 7.2 symbols/min [2025-10-15T18:31:41.726446] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-10. [2025-10-15T18:31:41.759955] [INFO ] [MAIN ] DUK: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:31:41.760341] [DEBUG] [LOCAL ] DUK: No existing data file found in primary storage. [2025-10-15T18:31:41.760459] [WARN ] [MAIN ] DUK: No existing data found, performing full refresh instead. [2025-10-15T18:31:41.760583] [INFO ] [MAIN ] DUK: Wiping existing primary data before full refresh. [2025-10-15T18:31:41.760679] [INFO ] [LOCAL ] DUK: Starting deletion of primary data. [2025-10-15T18:31:41.760755] [DEBUG] [LOCAL ] DUK: No primary data file found to delete. [2025-10-15T18:31:41.760803] [INFO ] [MAIN ] DUK: Starting full primary refresh. [2025-10-15T18:31:42.148971] [INFO ] [REMOTE ] DUK: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:31:42.186921] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-10-15T18:31:42.251288] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-15T18:31:42.252811] [INFO ] [REMOTE ] DTG: Full fetch complete (8768 records). [2025-10-15T18:31:42.252883] [DEBUG] [VALIDATOR ] DTG: Validating primary data. [2025-10-15T18:31:42.523710] [INFO ] [REMOTE ] DUK: Fetching primary data for 2024-12. [2025-10-15T18:31:42.649386] [DEBUG] [VALIDATOR ] DTG: All expected trading days are present. [2025-10-15T18:31:42.649457] [DEBUG] [VALIDATOR ] DTG: Primary data validation passed. [2025-10-15T18:31:42.649696] [INFO ] [MAIN ] DTG: Fetched primary data is valid. [2025-10-15T18:31:42.649755] [DEBUG] [LOCAL ] DTG: Saving primary data. [2025-10-15T18:31:42.650144] [DEBUG] [LOCAL ] DTG: Trimmed 8768 records to 5805 (keeping 200 days of data) [2025-10-15T18:31:42.684368] [DEBUG] [LOCAL ] DTG: Primary data saved (5805 records). [2025-10-15T18:31:42.684489] [INFO ] [MAIN ] DTG: Full history saved. [2025-10-15T18:31:42.684568] [INFO ] [MAIN ] Update Progress: 662/2369 symbols completed. DTG took 32.9s. Estimated remaining: 3h 56m 17s. Rate: 7.2 symbols/min [2025-10-15T18:31:42.851250] [INFO ] [MAIN ] DUKB: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:31:42.859737] [DEBUG] [LOCAL ] DUKB: Loaded 6297 existing records from primary storage. [2025-10-15T18:31:42.859951] [INFO ] [MAIN ] DUKB: Loaded 6297 existing records. [2025-10-15T18:31:43.033171] [WARN ] [MAIN ] DUKB: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:31:43.033391] [INFO ] [MAIN ] DUKB: Wiping existing primary data before full refresh. [2025-10-15T18:31:43.033446] [INFO ] [LOCAL ] DUKB: Starting deletion of primary data. [2025-10-15T18:31:43.033610] [DEBUG] [LOCAL ] DUKB: Deleted primary data file. [2025-10-15T18:31:43.033700] [INFO ] [MAIN ] DUKB: Starting full primary refresh. [2025-10-15T18:31:43.319167] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-05. [2025-10-15T18:31:43.388345] [INFO ] [REMOTE ] DUKB: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:31:44.114089] [INFO ] [REMOTE ] DTW: Fetching primary data for 2024-12. [2025-10-15T18:31:44.478988] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-10-15T18:31:44.854695] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-10-15T18:31:44.914192] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-01. [2025-10-15T18:31:44.970634] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-15T18:31:45.714013] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-06. [2025-10-15T18:31:46.513994] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-01. [2025-10-15T18:31:46.632441] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-15T18:31:47.062576] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-15T18:31:47.313985] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-02. [2025-10-15T18:31:47.479851] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-15T18:31:47.825315] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-10-15T18:31:48.114020] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-03. [2025-10-15T18:31:48.770014] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-10-15T18:31:48.914004] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-07. [2025-10-15T18:31:49.714049] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2024-12. [2025-10-15T18:31:50.451262] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-15T18:31:50.513993] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-08. [2025-10-15T18:31:50.612178] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-10-15T18:31:51.314010] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-02. [2025-10-15T18:31:52.058058] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-15T18:31:52.114005] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-09. [2025-10-15T18:31:52.632878] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-15T18:31:52.914006] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-01. [2025-10-15T18:31:53.347479] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-15T18:31:53.676295] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-15T18:31:53.714020] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-02. [2025-10-15T18:31:54.341110] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-15T18:31:54.513998] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-10. [2025-10-15T18:31:55.314026] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-03. [2025-10-15T18:31:55.932087] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-15T18:31:56.114014] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-04. [2025-10-15T18:31:56.362763] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-10 (1.85 seconds). [2025-10-15T18:31:56.368432] [INFO ] [REMOTE ] DTM: Full fetch complete (64996 records). [2025-10-15T18:31:56.368585] [DEBUG] [VALIDATOR ] DTM: Validating primary data. [2025-10-15T18:31:56.755954] [DEBUG] [VALIDATOR ] DTM: All expected trading days are present. [2025-10-15T18:31:56.756036] [DEBUG] [VALIDATOR ] DTM: Primary data validation passed. [2025-10-15T18:31:56.756979] [INFO ] [MAIN ] DTM: Fetched primary data is valid. [2025-10-15T18:31:56.757044] [DEBUG] [LOCAL ] DTM: Saving primary data. [2025-10-15T18:31:56.758351] [DEBUG] [LOCAL ] DTM: Trimmed 64996 records to 43930 (keeping 200 days of data) [2025-10-15T18:31:56.935456] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-04. [2025-10-15T18:31:57.037013] [DEBUG] [LOCAL ] DTM: Primary data saved (43930 records). [2025-10-15T18:31:57.037160] [INFO ] [MAIN ] DTM: Full history saved. [2025-10-15T18:31:57.037232] [INFO ] [MAIN ] Update Progress: 663/2369 symbols completed. DTM took 33.5s. Estimated remaining: 3h 56m 25s. Rate: 7.2 symbols/min [2025-10-15T18:31:57.207324] [INFO ] [MAIN ] DV: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:31:57.259223] [DEBUG] [LOCAL ] DV: Loaded 51304 existing records from primary storage. [2025-10-15T18:31:57.259571] [INFO ] [MAIN ] DV: Loaded 51304 existing records. [2025-10-15T18:31:57.437950] [WARN ] [MAIN ] DV: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:31:57.438173] [INFO ] [MAIN ] DV: Wiping existing primary data before full refresh. [2025-10-15T18:31:57.438220] [INFO ] [LOCAL ] DV: Starting deletion of primary data. [2025-10-15T18:31:57.438593] [DEBUG] [LOCAL ] DV: Deleted primary data file. [2025-10-15T18:31:57.438687] [INFO ] [MAIN ] DV: Starting full primary refresh. [2025-10-15T18:31:57.716290] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-03. [2025-10-15T18:31:57.803539] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-15T18:31:57.823043] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-15T18:31:57.845903] [INFO ] [REMOTE ] DV: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:31:58.514020] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-05. [2025-10-15T18:31:58.961171] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-10-15T18:31:59.313976] [INFO ] [REMOTE ] DV: Fetching primary data for 2024-12. [2025-10-15T18:31:59.723330] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-10-15T18:32:00.114000] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-04. [2025-10-15T18:32:00.913986] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-05. [2025-10-15T18:32:01.000197] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-15T18:32:01.702421] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-15T18:32:01.713962] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-06. [2025-10-15T18:32:02.131791] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-10-15T18:32:02.255198] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-10-15T18:32:02.514034] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-01. [2025-10-15T18:32:03.314019] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-07. [2025-10-15T18:32:03.966891] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-15T18:32:04.114036] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-05. [2025-10-15T18:32:04.477000] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-10-15T18:32:04.914012] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-08. [2025-10-15T18:32:05.359100] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-15T18:32:05.713974] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-02. [2025-10-15T18:32:06.117215] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-10-15T18:32:06.513982] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-06. [2025-10-15T18:32:07.094364] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-15T18:32:07.282687] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-15T18:32:07.313974] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-03. [2025-10-15T18:32:08.114002] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-09. [2025-10-15T18:32:08.821748] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-15T18:32:08.913972] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-07. [2025-10-15T18:32:09.044616] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-15T18:32:09.430462] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-10-15T18:32:09.714068] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-10. [2025-10-15T18:32:10.310528] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-15T18:32:10.311504] [INFO ] [REMOTE ] DUKB: Full fetch complete (9266 records). [2025-10-15T18:32:10.311572] [DEBUG] [VALIDATOR ] DUKB: Validating primary data. [2025-10-15T18:32:10.311979] [FATAL] [VALIDATOR ] DUKB: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T18:32:10.312060] [FATAL] [MAIN ] DUKB: Fetched primary data is invalid. Refusing to save it. [2025-10-15T18:32:10.312103] [WARN ] [MAIN ] DUKB: Deleting existing primary and derivative data due to validation failure. [2025-10-15T18:32:10.312140] [INFO ] [LOCAL ] DUKB: Starting deletion of primary data. [2025-10-15T18:32:10.312214] [DEBUG] [LOCAL ] DUKB: No primary data file found to delete. [2025-10-15T18:32:10.312267] [INFO ] [LOCAL ] DUKB: Starting deletion of derivative data. [2025-10-15T18:32:10.312590] [DEBUG] [LOCAL ] DUKB: Deleted derivative data file. [2025-10-15T18:32:10.312720] [INFO ] [MAIN ] Update Progress: 664/2369 symbols completed. DUKB took 27.6s. Estimated remaining: 3h 56m 29s. Rate: 7.2 symbols/min [2025-10-15T18:32:10.479706] [INFO ] [MAIN ] DVA: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:32:10.519101] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-06. [2025-10-15T18:32:10.521706] [DEBUG] [LOCAL ] DVA: Loaded 40980 existing records from primary storage. [2025-10-15T18:32:10.522063] [INFO ] [MAIN ] DVA: Loaded 40980 existing records. [2025-10-15T18:32:10.697970] [WARN ] [MAIN ] DVA: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:32:10.698173] [INFO ] [MAIN ] DVA: Wiping existing primary data before full refresh. [2025-10-15T18:32:10.698221] [INFO ] [LOCAL ] DVA: Starting deletion of primary data. [2025-10-15T18:32:10.698489] [DEBUG] [LOCAL ] DVA: Deleted primary data file. [2025-10-15T18:32:10.698545] [INFO ] [MAIN ] DVA: Starting full primary refresh. [2025-10-15T18:32:11.050620] [INFO ] [REMOTE ] DVA: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:32:11.313991] [INFO ] [REMOTE ] DVA: Fetching primary data for 2024-12. [2025-10-15T18:32:12.113969] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-04. [2025-10-15T18:32:12.171412] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-15T18:32:12.914058] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-08. [2025-10-15T18:32:13.075963] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-15T18:32:13.488683] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-15T18:32:13.503334] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-15T18:32:13.714017] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-05. [2025-10-15T18:32:14.514014] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-09. [2025-10-15T18:32:15.087898] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-15T18:32:15.313966] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-10. [2025-10-15T18:32:15.412958] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-15T18:32:15.928166] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-15T18:32:15.929250] [INFO ] [REMOTE ] DTW: Full fetch complete (7265 records). [2025-10-15T18:32:15.929317] [DEBUG] [VALIDATOR ] DTW: Validating primary data. [2025-10-15T18:32:16.121822] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-01. [2025-10-15T18:32:16.293461] [DEBUG] [VALIDATOR ] DTW: All expected trading days are present. [2025-10-15T18:32:16.293534] [DEBUG] [VALIDATOR ] DTW: Primary data validation passed. [2025-10-15T18:32:16.293745] [INFO ] [MAIN ] DTW: Fetched primary data is valid. [2025-10-15T18:32:16.293813] [DEBUG] [LOCAL ] DTW: Saving primary data. [2025-10-15T18:32:16.294197] [DEBUG] [LOCAL ] DTW: Trimmed 7265 records to 4821 (keeping 200 days of data) [2025-10-15T18:32:16.322482] [DEBUG] [LOCAL ] DTW: Primary data saved (4821 records). [2025-10-15T18:32:16.322556] [INFO ] [MAIN ] DTW: Full history saved. [2025-10-15T18:32:16.322639] [INFO ] [MAIN ] Update Progress: 665/2369 symbols completed. DTW took 36.6s. Estimated remaining: 3h 56m 15s. Rate: 7.2 symbols/min [2025-10-15T18:32:16.485257] [INFO ] [MAIN ] DVN: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:32:16.485416] [DEBUG] [LOCAL ] DVN: No existing data file found in primary storage. [2025-10-15T18:32:16.485453] [WARN ] [MAIN ] DVN: No existing data found, performing full refresh instead. [2025-10-15T18:32:16.485559] [INFO ] [MAIN ] DVN: Wiping existing primary data before full refresh. [2025-10-15T18:32:16.485603] [INFO ] [LOCAL ] DVN: Starting deletion of primary data. [2025-10-15T18:32:16.485667] [DEBUG] [LOCAL ] DVN: No primary data file found to delete. [2025-10-15T18:32:16.485721] [INFO ] [MAIN ] DVN: Starting full primary refresh. [2025-10-15T18:32:16.830748] [INFO ] [REMOTE ] DVN: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:32:16.913958] [INFO ] [REMOTE ] DVN: Fetching primary data for 2024-12. [2025-10-15T18:32:17.690201] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-15T18:32:17.713963] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-02. [2025-10-15T18:32:18.513991] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-07. [2025-10-15T18:32:18.869096] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-15T18:32:19.046989] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2024-12 (2.13 seconds). [2025-10-15T18:32:19.314024] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-01. [2025-10-15T18:32:19.906614] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-15T18:32:20.114001] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-03. [2025-10-15T18:32:20.914011] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-06. [2025-10-15T18:32:21.397229] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-01 (2.08 seconds). [2025-10-15T18:32:21.487046] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-15T18:32:21.714061] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-02. [2025-10-15T18:32:22.437283] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-15T18:32:22.514075] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-08. [2025-10-15T18:32:23.313975] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-07. [2025-10-15T18:32:23.837478] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-02 (2.12 seconds). [2025-10-15T18:32:24.114044] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-03. [2025-10-15T18:32:24.523133] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-10-15T18:32:24.913981] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-04. [2025-10-15T18:32:25.098958] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-15T18:32:25.714041] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-09. [2025-10-15T18:32:26.155357] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-10-15T18:32:26.476484] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-15T18:32:26.513974] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-04. [2025-10-15T18:32:27.301103] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-15T18:32:27.313953] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-10. [2025-10-15T18:32:27.985873] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-15T18:32:27.992711] [INFO ] [REMOTE ] DUK: Full fetch complete (77565 records). [2025-10-15T18:32:27.992916] [DEBUG] [VALIDATOR ] DUK: Validating primary data. [2025-10-15T18:32:28.119107] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-08. [2025-10-15T18:32:28.422901] [DEBUG] [VALIDATOR ] DUK: All expected trading days are present. [2025-10-15T18:32:28.423101] [DEBUG] [VALIDATOR ] DUK: Primary data validation passed. [2025-10-15T18:32:28.424216] [INFO ] [MAIN ] DUK: Fetched primary data is valid. [2025-10-15T18:32:28.424328] [DEBUG] [LOCAL ] DUK: Saving primary data. [2025-10-15T18:32:28.426280] [DEBUG] [LOCAL ] DUK: Trimmed 77565 records to 53437 (keeping 200 days of data) [2025-10-15T18:32:28.577546] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-10-15T18:32:28.815048] [DEBUG] [LOCAL ] DUK: Primary data saved (53437 records). [2025-10-15T18:32:28.815200] [INFO ] [MAIN ] DUK: Full history saved. [2025-10-15T18:32:28.815307] [INFO ] [MAIN ] Update Progress: 666/2369 symbols completed. DUK took 47.2s. Estimated remaining: 3h 56m 17s. Rate: 7.2 symbols/min [2025-10-15T18:32:28.920032] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-05. [2025-10-15T18:32:28.995761] [INFO ] [MAIN ] DX: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:32:29.047689] [DEBUG] [LOCAL ] DX: Loaded 52505 existing records from primary storage. [2025-10-15T18:32:29.048060] [INFO ] [MAIN ] DX: Loaded 52505 existing records. [2025-10-15T18:32:29.231030] [WARN ] [MAIN ] DX: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:32:29.231259] [INFO ] [MAIN ] DX: Wiping existing primary data before full refresh. [2025-10-15T18:32:29.231310] [INFO ] [LOCAL ] DX: Starting deletion of primary data. [2025-10-15T18:32:29.231525] [DEBUG] [LOCAL ] DX: Deleted primary data file. [2025-10-15T18:32:29.231584] [INFO ] [MAIN ] DX: Starting full primary refresh. [2025-10-15T18:32:29.586845] [INFO ] [REMOTE ] DX: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:32:29.713986] [INFO ] [REMOTE ] DX: Fetching primary data for 2024-12. [2025-10-15T18:32:29.977433] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-15T18:32:30.513978] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-09. [2025-10-15T18:32:30.573396] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-15T18:32:31.313995] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-06. [2025-10-15T18:32:31.853369] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2024-12 (2.14 seconds). [2025-10-15T18:32:32.113974] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-05. [2025-10-15T18:32:32.914075] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-01. [2025-10-15T18:32:33.266353] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-09 (2.75 seconds). [2025-10-15T18:32:33.714057] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-10. [2025-10-15T18:32:33.864146] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-06 (2.55 seconds). [2025-10-15T18:32:34.330588] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-05 (2.22 seconds). [2025-10-15T18:32:34.514034] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-07. [2025-10-15T18:32:34.642148] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-15T18:32:35.313996] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-06. [2025-10-15T18:32:35.703594] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-10 (1.99 seconds). [2025-10-15T18:32:35.710020] [INFO ] [REMOTE ] DV: Full fetch complete (73839 records). [2025-10-15T18:32:35.710152] [DEBUG] [VALIDATOR ] DV: Validating primary data. [2025-10-15T18:32:36.103225] [DEBUG] [VALIDATOR ] DV: All expected trading days are present. [2025-10-15T18:32:36.118426] [DEBUG] [VALIDATOR ] DV: Primary data validation passed. [2025-10-15T18:32:36.128498] [INFO ] [MAIN ] DV: Fetched primary data is valid. [2025-10-15T18:32:36.118280] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-02. [2025-10-15T18:32:36.129882] [DEBUG] [LOCAL ] DV: Saving primary data. [2025-10-15T18:32:36.131555] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-15T18:32:36.141888] [DEBUG] [LOCAL ] DV: Trimmed 73839 records to 51301 (keeping 200 days of data) [2025-10-15T18:32:36.455451] [DEBUG] [LOCAL ] DV: Primary data saved (51301 records). [2025-10-15T18:32:36.455549] [INFO ] [MAIN ] DV: Full history saved. [2025-10-15T18:32:36.455627] [INFO ] [MAIN ] Update Progress: 667/2369 symbols completed. DV took 39.4s. Estimated remaining: 3h 56m 7s. Rate: 7.2 symbols/min [2025-10-15T18:32:36.621230] [INFO ] [MAIN ] DXC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:32:36.621394] [DEBUG] [LOCAL ] DXC: No existing data file found in primary storage. [2025-10-15T18:32:36.621430] [WARN ] [MAIN ] DXC: No existing data found, performing full refresh instead. [2025-10-15T18:32:36.621535] [INFO ] [MAIN ] DXC: Wiping existing primary data before full refresh. [2025-10-15T18:32:36.621577] [INFO ] [LOCAL ] DXC: Starting deletion of primary data. [2025-10-15T18:32:36.621617] [DEBUG] [LOCAL ] DXC: No primary data file found to delete. [2025-10-15T18:32:36.621675] [INFO ] [MAIN ] DXC: Starting full primary refresh. [2025-10-15T18:32:36.915554] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-08. [2025-10-15T18:32:37.004566] [INFO ] [REMOTE ] DXC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:32:37.038477] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-15T18:32:37.714004] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-07. [2025-10-15T18:32:37.787965] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-15T18:32:38.513992] [INFO ] [REMOTE ] DXC: Fetching primary data for 2024-12. [2025-10-15T18:32:38.627453] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-15T18:32:39.314046] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-03. [2025-10-15T18:32:39.692709] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-15T18:32:40.002609] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-15T18:32:40.114055] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-01. [2025-10-15T18:32:40.909252] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-15T18:32:40.919312] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-08. [2025-10-15T18:32:41.714027] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-04. [2025-10-15T18:32:41.747386] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-15T18:32:42.513958] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-02. [2025-10-15T18:32:42.961289] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-10-15T18:32:43.313972] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-09. [2025-10-15T18:32:43.792106] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-10-15T18:32:43.995528] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-15T18:32:44.114034] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-03. [2025-10-15T18:32:44.745850] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-15T18:32:44.914004] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-09. [2025-10-15T18:32:45.413134] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-15T18:32:45.713982] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-10. [2025-10-15T18:32:46.514016] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-05. [2025-10-15T18:32:46.784908] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-15T18:32:47.314052] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-10. [2025-10-15T18:32:47.825283] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-10 (2.11 seconds). [2025-10-15T18:32:47.831439] [INFO ] [REMOTE ] DVA: Full fetch complete (59775 records). [2025-10-15T18:32:47.831555] [DEBUG] [VALIDATOR ] DVA: Validating primary data. [2025-10-15T18:32:48.115383] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-04. [2025-10-15T18:32:48.220229] [DEBUG] [VALIDATOR ] DVA: All expected trading days are present. [2025-10-15T18:32:48.220326] [DEBUG] [VALIDATOR ] DVA: Primary data validation passed. [2025-10-15T18:32:48.221137] [INFO ] [MAIN ] DVA: Fetched primary data is valid. [2025-10-15T18:32:48.221216] [DEBUG] [LOCAL ] DVA: Saving primary data. [2025-10-15T18:32:48.222543] [DEBUG] [LOCAL ] DVA: Trimmed 59775 records to 41059 (keeping 200 days of data) [2025-10-15T18:32:48.346498] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-15T18:32:48.355900] [INFO ] [REMOTE ] DVN: Full fetch complete (77489 records). [2025-10-15T18:32:48.356782] [DEBUG] [VALIDATOR ] DVN: Validating primary data. [2025-10-15T18:32:48.359991] [FATAL] [VALIDATOR ] DVN: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T18:32:48.361884] [FATAL] [MAIN ] DVN: Fetched primary data is invalid. Refusing to save it. [2025-10-15T18:32:48.362233] [WARN ] [MAIN ] DVN: Deleting existing primary and derivative data due to validation failure. [2025-10-15T18:32:48.363059] [INFO ] [LOCAL ] DVN: Starting deletion of primary data. [2025-10-15T18:32:48.363681] [DEBUG] [LOCAL ] DVN: No primary data file found to delete. [2025-10-15T18:32:48.364243] [INFO ] [LOCAL ] DVN: Starting deletion of derivative data. [2025-10-15T18:32:48.365123] [DEBUG] [LOCAL ] DVN: No derivative data file found to delete. [2025-10-15T18:32:48.365444] [INFO ] [MAIN ] Update Progress: 668/2369 symbols completed. DVN took 32.0s. Estimated remaining: 3h 56m 8s. Rate: 7.2 symbols/min [2025-10-15T18:32:48.550574] [INFO ] [MAIN ] DXYZ: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:32:48.676837] [DEBUG] [LOCAL ] DXYZ: Loaded 37165 existing records from primary storage. [2025-10-15T18:32:48.679226] [INFO ] [MAIN ] DXYZ: Loaded 37165 existing records. [2025-10-15T18:32:48.878354] [WARN ] [MAIN ] DXYZ: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:32:48.882591] [INFO ] [MAIN ] DXYZ: Wiping existing primary data before full refresh. [2025-10-15T18:32:48.883032] [INFO ] [LOCAL ] DXYZ: Starting deletion of primary data. [2025-10-15T18:32:48.884483] [DEBUG] [LOCAL ] DXYZ: Deleted primary data file. [2025-10-15T18:32:48.884619] [INFO ] [MAIN ] DXYZ: Starting full primary refresh. [2025-10-15T18:32:49.023408] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-05 (2.51 seconds). [2025-10-15T18:32:49.049071] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-06. [2025-10-15T18:32:49.137191] [DEBUG] [LOCAL ] DVA: Primary data saved (41059 records). [2025-10-15T18:32:49.188839] [INFO ] [MAIN ] DVA: Full history saved. [2025-10-15T18:32:49.216167] [INFO ] [MAIN ] Update Progress: 669/2369 symbols completed. DVA took 38.9s. Estimated remaining: 3h 55m 40s. Rate: 7.2 symbols/min [2025-10-15T18:32:49.471526] [INFO ] [REMOTE ] DXYZ: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:32:49.504184] [INFO ] [MAIN ] DY: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:32:49.533078] [DEBUG] [LOCAL ] DY: Loaded 28437 existing records from primary storage. [2025-10-15T18:32:49.533342] [INFO ] [MAIN ] DY: Loaded 28437 existing records. [2025-10-15T18:32:49.710690] [WARN ] [MAIN ] DY: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:32:49.710923] [INFO ] [MAIN ] DY: Wiping existing primary data before full refresh. [2025-10-15T18:32:49.710979] [INFO ] [LOCAL ] DY: Starting deletion of primary data. [2025-10-15T18:32:49.711209] [DEBUG] [LOCAL ] DY: Deleted primary data file. [2025-10-15T18:32:49.711249] [INFO ] [MAIN ] DY: Starting full primary refresh. [2025-10-15T18:32:49.724535] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2024-12. [2025-10-15T18:32:50.078117] [INFO ] [REMOTE ] DY: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:32:50.104827] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-15T18:32:50.513988] [INFO ] [REMOTE ] DY: Fetching primary data for 2024-12. [2025-10-15T18:32:51.314032] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-05. [2025-10-15T18:32:52.286130] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-15T18:32:52.298122] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-01. [2025-10-15T18:32:52.491246] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2024-12 (2.77 seconds). [2025-10-15T18:32:52.554944] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-06 (3.51 seconds). [2025-10-15T18:32:52.633691] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-15T18:32:52.913996] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-01. [2025-10-15T18:32:53.324406] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-15T18:32:53.714041] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-06. [2025-10-15T18:32:54.514000] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-02. [2025-10-15T18:32:54.817585] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-10-15T18:32:55.314008] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-02. [2025-10-15T18:32:55.441166] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-15T18:32:55.946014] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-15T18:32:56.114016] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-03. [2025-10-15T18:32:56.914084] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-07. [2025-10-15T18:32:57.234418] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-10-15T18:32:57.314119] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-15T18:32:57.714005] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-04. [2025-10-15T18:32:58.513974] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-07. [2025-10-15T18:32:58.676467] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-15T18:32:58.928375] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-15T18:32:59.314004] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-08. [2025-10-15T18:33:00.113968] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-03. [2025-10-15T18:33:00.528261] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-10-15T18:33:00.913976] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-08. [2025-10-15T18:33:01.036373] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-15T18:33:01.714058] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-05. [2025-10-15T18:33:01.951697] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-15T18:33:02.514011] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-04. [2025-10-15T18:33:02.782486] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-15T18:33:02.965270] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-15T18:33:03.314019] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-06. [2025-10-15T18:33:04.114058] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-09. [2025-10-15T18:33:04.455494] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-15T18:33:04.514119] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-15T18:33:04.914029] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-09. [2025-10-15T18:33:05.713983] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-07. [2025-10-15T18:33:05.856078] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-15T18:33:06.513969] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-10. [2025-10-15T18:33:06.734381] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-15T18:33:06.843047] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-15T18:33:07.314018] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-08. [2025-10-15T18:33:08.114047] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-10. [2025-10-15T18:33:08.460927] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-10 (1.95 seconds). [2025-10-15T18:33:08.467481] [INFO ] [REMOTE ] DX: Full fetch complete (75762 records). [2025-10-15T18:33:08.467686] [DEBUG] [VALIDATOR ] DX: Validating primary data. [2025-10-15T18:33:08.835978] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-15T18:33:08.889540] [DEBUG] [VALIDATOR ] DX: All expected trading days are present. [2025-10-15T18:33:08.889621] [DEBUG] [VALIDATOR ] DX: Primary data validation passed. [2025-10-15T18:33:08.890854] [INFO ] [MAIN ] DX: Fetched primary data is valid. [2025-10-15T18:33:08.890916] [DEBUG] [LOCAL ] DX: Saving primary data. [2025-10-15T18:33:08.892253] [DEBUG] [LOCAL ] DX: Trimmed 75762 records to 52502 (keeping 200 days of data) [2025-10-15T18:33:08.945879] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-05. [2025-10-15T18:33:09.210326] [DEBUG] [LOCAL ] DX: Primary data saved (52502 records). [2025-10-15T18:33:09.210457] [INFO ] [MAIN ] DX: Full history saved. [2025-10-15T18:33:09.211400] [INFO ] [MAIN ] Update Progress: 670/2369 symbols completed. DX took 40.4s. Estimated remaining: 3h 56m 2s. Rate: 7.2 symbols/min [2025-10-15T18:33:09.376462] [INFO ] [MAIN ] E: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:33:09.410982] [DEBUG] [LOCAL ] E: Loaded 33236 existing records from primary storage. [2025-10-15T18:33:09.411262] [INFO ] [MAIN ] E: Loaded 33236 existing records. [2025-10-15T18:33:09.592476] [WARN ] [MAIN ] E: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:33:09.592799] [INFO ] [MAIN ] E: Wiping existing primary data before full refresh. [2025-10-15T18:33:09.592871] [INFO ] [LOCAL ] E: Starting deletion of primary data. [2025-10-15T18:33:09.593171] [DEBUG] [LOCAL ] E: Deleted primary data file. [2025-10-15T18:33:09.593228] [INFO ] [MAIN ] E: Starting full primary refresh. [2025-10-15T18:33:09.720805] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-09. [2025-10-15T18:33:09.903419] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-15T18:33:09.956880] [INFO ] [REMOTE ] DXC: Full fetch complete (69974 records). [2025-10-15T18:33:09.972352] [DEBUG] [VALIDATOR ] DXC: Validating primary data. [2025-10-15T18:33:09.977152] [INFO ] [REMOTE ] E: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:33:10.357594] [DEBUG] [VALIDATOR ] DXC: All expected trading days are present. [2025-10-15T18:33:10.357705] [DEBUG] [VALIDATOR ] DXC: Primary data validation passed. [2025-10-15T18:33:10.358589] [INFO ] [MAIN ] DXC: Fetched primary data is valid. [2025-10-15T18:33:10.358631] [DEBUG] [LOCAL ] DXC: Saving primary data. [2025-10-15T18:33:10.359928] [DEBUG] [LOCAL ] DXC: Trimmed 69974 records to 49875 (keeping 200 days of data) [2025-10-15T18:33:10.525559] [INFO ] [REMOTE ] E: Fetching primary data for 2024-12. [2025-10-15T18:33:10.659635] [DEBUG] [LOCAL ] DXC: Primary data saved (49875 records). [2025-10-15T18:33:10.659830] [INFO ] [MAIN ] DXC: Full history saved. [2025-10-15T18:33:10.659918] [INFO ] [MAIN ] Update Progress: 671/2369 symbols completed. DXC took 34.2s. Estimated remaining: 3h 55m 36s. Rate: 7.2 symbols/min [2025-10-15T18:33:10.824445] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-15T18:33:10.864445] [INFO ] [MAIN ] EAF: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:33:10.906325] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-15T18:33:10.926832] [DEBUG] [LOCAL ] EAF: Loaded 41759 existing records from primary storage. [2025-10-15T18:33:10.927133] [INFO ] [MAIN ] EAF: Loaded 41759 existing records. [2025-10-15T18:33:11.103861] [WARN ] [MAIN ] EAF: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:33:11.104110] [INFO ] [MAIN ] EAF: Wiping existing primary data before full refresh. [2025-10-15T18:33:11.104159] [INFO ] [LOCAL ] EAF: Starting deletion of primary data. [2025-10-15T18:33:11.104346] [DEBUG] [LOCAL ] EAF: Deleted primary data file. [2025-10-15T18:33:11.104383] [INFO ] [MAIN ] EAF: Starting full primary refresh. [2025-10-15T18:33:11.319698] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-06. [2025-10-15T18:33:11.459515] [INFO ] [REMOTE ] EAF: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:33:12.078063] [INFO ] [REMOTE ] E: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-15T18:33:12.113987] [INFO ] [REMOTE ] E: Fetching primary data for 2025-01. [2025-10-15T18:33:12.881395] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-15T18:33:12.913962] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-07. [2025-10-15T18:33:13.475735] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-15T18:33:13.713994] [INFO ] [REMOTE ] E: Fetching primary data for 2025-02. [2025-10-15T18:33:14.514042] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-10. [2025-10-15T18:33:14.743333] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-15T18:33:14.873799] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-15T18:33:15.314064] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-08. [2025-10-15T18:33:15.854579] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-15T18:33:15.859087] [INFO ] [REMOTE ] DY: Full fetch complete (43553 records). [2025-10-15T18:33:15.859272] [DEBUG] [VALIDATOR ] DY: Validating primary data. [2025-10-15T18:33:16.119147] [INFO ] [REMOTE ] EAF: Fetching primary data for 2024-12. [2025-10-15T18:33:16.271138] [DEBUG] [VALIDATOR ] DY: All expected trading days are present. [2025-10-15T18:33:16.271211] [DEBUG] [VALIDATOR ] DY: Primary data validation passed. [2025-10-15T18:33:16.271881] [INFO ] [MAIN ] DY: Fetched primary data is valid. [2025-10-15T18:33:16.271941] [DEBUG] [LOCAL ] DY: Saving primary data. [2025-10-15T18:33:16.272792] [DEBUG] [LOCAL ] DY: Trimmed 43553 records to 28456 (keeping 200 days of data) [2025-10-15T18:33:16.443130] [DEBUG] [LOCAL ] DY: Primary data saved (28456 records). [2025-10-15T18:33:16.443281] [INFO ] [MAIN ] DY: Full history saved. [2025-10-15T18:33:16.443373] [INFO ] [MAIN ] Update Progress: 672/2369 symbols completed. DY took 27.2s. Estimated remaining: 3h 55m 21s. Rate: 7.2 symbols/min [2025-10-15T18:33:16.608848] [INFO ] [MAIN ] EAI: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:33:16.615119] [DEBUG] [LOCAL ] EAI: Loaded 3991 existing records from primary storage. [2025-10-15T18:33:16.615287] [INFO ] [MAIN ] EAI: Loaded 3991 existing records. [2025-10-15T18:33:16.788120] [WARN ] [MAIN ] EAI: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:33:16.788292] [INFO ] [MAIN ] EAI: Wiping existing primary data before full refresh. [2025-10-15T18:33:16.788343] [INFO ] [LOCAL ] EAI: Starting deletion of primary data. [2025-10-15T18:33:16.788483] [DEBUG] [LOCAL ] EAI: Deleted primary data file. [2025-10-15T18:33:16.788537] [INFO ] [MAIN ] EAI: Starting full primary refresh. [2025-10-15T18:33:16.923984] [INFO ] [REMOTE ] E: Fetching primary data for 2025-03. [2025-10-15T18:33:17.143079] [INFO ] [REMOTE ] EAI: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:33:17.195669] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-15T18:33:17.713985] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-09. [2025-10-15T18:33:17.992433] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-10-15T18:33:18.062294] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-15T18:33:18.514075] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-01. [2025-10-15T18:33:19.313977] [INFO ] [REMOTE ] E: Fetching primary data for 2025-04. [2025-10-15T18:33:19.344139] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-15T18:33:19.941124] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-15T18:33:20.114002] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-02. [2025-10-15T18:33:20.914015] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-10. [2025-10-15T18:33:20.995154] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-15T18:33:21.654454] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-15T18:33:21.713970] [INFO ] [REMOTE ] EAI: Fetching primary data for 2024-12. [2025-10-15T18:33:22.445843] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-10-15T18:33:22.513984] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-01. [2025-10-15T18:33:23.023549] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-10-15T18:33:23.166601] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-10 (2.25 seconds). [2025-10-15T18:33:23.171885] [INFO ] [REMOTE ] DXYZ: Full fetch complete (57242 records). [2025-10-15T18:33:23.171987] [DEBUG] [VALIDATOR ] DXYZ: Validating primary data. [2025-10-15T18:33:23.319138] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-03. [2025-10-15T18:33:23.547028] [DEBUG] [VALIDATOR ] DXYZ: All expected trading days are present. [2025-10-15T18:33:23.547107] [DEBUG] [VALIDATOR ] DXYZ: Primary data validation passed. [2025-10-15T18:33:23.547934] [INFO ] [MAIN ] DXYZ: Fetched primary data is valid. [2025-10-15T18:33:23.547998] [DEBUG] [LOCAL ] DXYZ: Saving primary data. [2025-10-15T18:33:23.549190] [DEBUG] [LOCAL ] DXYZ: Trimmed 57242 records to 37126 (keeping 200 days of data) [2025-10-15T18:33:23.763791] [DEBUG] [LOCAL ] DXYZ: Primary data saved (37126 records). [2025-10-15T18:33:23.763936] [INFO ] [MAIN ] DXYZ: Full history saved. [2025-10-15T18:33:23.764288] [INFO ] [MAIN ] Update Progress: 673/2369 symbols completed. DXYZ took 35.4s. Estimated remaining: 3h 55m 10s. Rate: 7.2 symbols/min [2025-10-15T18:33:23.931803] [INFO ] [MAIN ] EARN: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:33:23.959745] [DEBUG] [LOCAL ] EARN: Loaded 28749 existing records from primary storage. [2025-10-15T18:33:23.960005] [INFO ] [MAIN ] EARN: Loaded 28749 existing records. [2025-10-15T18:33:24.115489] [INFO ] [REMOTE ] E: Fetching primary data for 2025-05. [2025-10-15T18:33:24.138129] [WARN ] [MAIN ] EARN: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:33:24.139115] [INFO ] [MAIN ] EARN: Wiping existing primary data before full refresh. [2025-10-15T18:33:24.139187] [INFO ] [LOCAL ] EARN: Starting deletion of primary data. [2025-10-15T18:33:24.139471] [DEBUG] [LOCAL ] EARN: Deleted primary data file. [2025-10-15T18:33:24.139532] [INFO ] [MAIN ] EARN: Starting full primary refresh. [2025-10-15T18:33:24.506419] [INFO ] [REMOTE ] EARN: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:33:24.913975] [INFO ] [REMOTE ] EARN: Fetching primary data for 2024-12. [2025-10-15T18:33:24.978596] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-15T18:33:25.714024] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-04. [2025-10-15T18:33:25.734881] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-15T18:33:25.962784] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-15T18:33:26.514047] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-01. [2025-10-15T18:33:27.314006] [INFO ] [REMOTE ] E: Fetching primary data for 2025-06. [2025-10-15T18:33:27.370665] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-15T18:33:27.528459] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-15T18:33:28.114015] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-02. [2025-10-15T18:33:28.765702] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-15T18:33:28.914009] [INFO ] [REMOTE ] E: Fetching primary data for 2025-07. [2025-10-15T18:33:29.566685] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-15T18:33:29.713975] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-03. [2025-10-15T18:33:30.371746] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-15T18:33:30.513993] [INFO ] [REMOTE ] E: Fetching primary data for 2025-08. [2025-10-15T18:33:31.303443] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-15T18:33:31.313970] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-04. [2025-10-15T18:33:32.096270] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-15T18:33:32.113957] [INFO ] [REMOTE ] E: Fetching primary data for 2025-09. [2025-10-15T18:33:32.820542] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-15T18:33:32.913970] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-05. [2025-10-15T18:33:33.488511] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-15T18:33:33.713998] [INFO ] [REMOTE ] E: Fetching primary data for 2025-10. [2025-10-15T18:33:34.416526] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-15T18:33:34.514009] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-02. [2025-10-15T18:33:35.119243] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-15T18:33:35.123400] [INFO ] [REMOTE ] E: Full fetch complete (47890 records). [2025-10-15T18:33:35.123542] [DEBUG] [VALIDATOR ] E: Validating primary data. [2025-10-15T18:33:35.231006] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-15T18:33:35.321758] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-05. [2025-10-15T18:33:35.553464] [DEBUG] [VALIDATOR ] E: All expected trading days are present. [2025-10-15T18:33:35.553562] [DEBUG] [VALIDATOR ] E: Primary data validation passed. [2025-10-15T18:33:35.554360] [INFO ] [MAIN ] E: Fetched primary data is valid. [2025-10-15T18:33:35.554426] [DEBUG] [LOCAL ] E: Saving primary data. [2025-10-15T18:33:35.555630] [DEBUG] [LOCAL ] E: Trimmed 47890 records to 33280 (keeping 200 days of data) [2025-10-15T18:33:35.763505] [DEBUG] [LOCAL ] E: Primary data saved (33280 records). [2025-10-15T18:33:35.763673] [INFO ] [MAIN ] E: Full history saved. [2025-10-15T18:33:35.763780] [INFO ] [MAIN ] Update Progress: 674/2369 symbols completed. E took 26.6s. Estimated remaining: 3h 55m 11s. Rate: 7.2 symbols/min [2025-10-15T18:33:35.931447] [INFO ] [MAIN ] EAT: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:33:35.979669] [DEBUG] [LOCAL ] EAT: Loaded 49892 existing records from primary storage. [2025-10-15T18:33:35.980002] [INFO ] [MAIN ] EAT: Loaded 49892 existing records. [2025-10-15T18:33:36.121827] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-03. [2025-10-15T18:33:36.162945] [WARN ] [MAIN ] EAT: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:33:36.163149] [INFO ] [MAIN ] EAT: Wiping existing primary data before full refresh. [2025-10-15T18:33:36.163195] [INFO ] [LOCAL ] EAT: Starting deletion of primary data. [2025-10-15T18:33:36.163382] [DEBUG] [LOCAL ] EAT: Deleted primary data file. [2025-10-15T18:33:36.163419] [INFO ] [MAIN ] EAT: Starting full primary refresh. [2025-10-15T18:33:36.526960] [INFO ] [REMOTE ] EAT: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:33:36.902392] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-15T18:33:36.907395] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-15T18:33:36.914093] [INFO ] [REMOTE ] EAT: Fetching primary data for 2024-12. [2025-10-15T18:33:37.714048] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-06. [2025-10-15T18:33:38.514055] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-06. [2025-10-15T18:33:38.630331] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-15T18:33:38.795608] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-15T18:33:39.313999] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-07. [2025-10-15T18:33:40.113968] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-04. [2025-10-15T18:33:40.185606] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-15T18:33:40.245353] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-15T18:33:40.685775] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-15T18:33:40.914012] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-08. [2025-10-15T18:33:41.714048] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-07. [2025-10-15T18:33:42.133799] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-15T18:33:42.514079] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-09. [2025-10-15T18:33:43.313987] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-05. [2025-10-15T18:33:43.426098] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-15T18:33:43.628735] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-15T18:33:43.822254] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-10-15T18:33:44.114057] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-01. [2025-10-15T18:33:44.914049] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-10. [2025-10-15T18:33:45.713993] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-06. [2025-10-15T18:33:45.942190] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-15T18:33:46.491775] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-15T18:33:46.495417] [INFO ] [REMOTE ] EARN: Full fetch complete (45618 records). [2025-10-15T18:33:46.495505] [DEBUG] [VALIDATOR ] EARN: Validating primary data. [2025-10-15T18:33:46.524339] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-08. [2025-10-15T18:33:46.618408] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-15T18:33:46.897914] [DEBUG] [VALIDATOR ] EARN: All expected trading days are present. [2025-10-15T18:33:46.897988] [DEBUG] [VALIDATOR ] EARN: Primary data validation passed. [2025-10-15T18:33:46.898736] [INFO ] [MAIN ] EARN: Fetched primary data is valid. [2025-10-15T18:33:46.898809] [DEBUG] [LOCAL ] EARN: Saving primary data. [2025-10-15T18:33:46.899748] [DEBUG] [LOCAL ] EARN: Trimmed 45618 records to 28609 (keeping 200 days of data) [2025-10-15T18:33:47.058493] [DEBUG] [LOCAL ] EARN: Primary data saved (28609 records). [2025-10-15T18:33:47.058626] [INFO ] [MAIN ] EARN: Full history saved. [2025-10-15T18:33:47.058740] [INFO ] [MAIN ] Update Progress: 675/2369 symbols completed. EARN took 23.3s. Estimated remaining: 3h 55m 10s. Rate: 7.2 symbols/min [2025-10-15T18:33:47.225093] [INFO ] [MAIN ] EB: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:33:47.258455] [DEBUG] [LOCAL ] EB: Loaded 36591 existing records from primary storage. [2025-10-15T18:33:47.258759] [INFO ] [MAIN ] EB: Loaded 36591 existing records. [2025-10-15T18:33:47.321042] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-02. [2025-10-15T18:33:47.440832] [WARN ] [MAIN ] EB: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:33:47.441049] [INFO ] [MAIN ] EB: Wiping existing primary data before full refresh. [2025-10-15T18:33:47.441096] [INFO ] [LOCAL ] EB: Starting deletion of primary data. [2025-10-15T18:33:47.441396] [DEBUG] [LOCAL ] EB: Deleted primary data file. [2025-10-15T18:33:47.441452] [INFO ] [MAIN ] EB: Starting full primary refresh. [2025-10-15T18:33:47.807277] [INFO ] [REMOTE ] EB: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:33:48.114011] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-07. [2025-10-15T18:33:48.245396] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-15T18:33:48.677317] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-15T18:33:48.913977] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-08. [2025-10-15T18:33:49.308336] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-08 (0.39 seconds). [2025-10-15T18:33:49.351030] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-02 (2.03 seconds). [2025-10-15T18:33:49.714002] [INFO ] [REMOTE ] EB: Fetching primary data for 2024-12. [2025-10-15T18:33:50.514002] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-09. [2025-10-15T18:33:50.964850] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-10-15T18:33:51.313968] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-09. [2025-10-15T18:33:51.394724] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-15T18:33:52.113990] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-01. [2025-10-15T18:33:52.330986] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-15T18:33:52.913995] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-10. [2025-10-15T18:33:53.615613] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-15T18:33:53.713976] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-02. [2025-10-15T18:33:54.091156] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-15T18:33:54.095992] [INFO ] [REMOTE ] EAF: Full fetch complete (62794 records). [2025-10-15T18:33:54.096140] [DEBUG] [VALIDATOR ] EAF: Validating primary data. [2025-10-15T18:33:54.519099] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-10. [2025-10-15T18:33:54.520619] [DEBUG] [VALIDATOR ] EAF: All expected trading days are present. [2025-10-15T18:33:54.520709] [DEBUG] [VALIDATOR ] EAF: Primary data validation passed. [2025-10-15T18:33:54.521533] [INFO ] [MAIN ] EAF: Fetched primary data is valid. [2025-10-15T18:33:54.521674] [DEBUG] [LOCAL ] EAF: Saving primary data. [2025-10-15T18:33:54.522989] [DEBUG] [LOCAL ] EAF: Trimmed 62794 records to 41701 (keeping 200 days of data) [2025-10-15T18:33:54.760004] [DEBUG] [LOCAL ] EAF: Primary data saved (41701 records). [2025-10-15T18:33:54.760131] [INFO ] [MAIN ] EAF: Full history saved. [2025-10-15T18:33:54.760211] [INFO ] [MAIN ] Update Progress: 676/2369 symbols completed. EAF took 44.1s. Estimated remaining: 3h 55m 1s. Rate: 7.2 symbols/min [2025-10-15T18:33:54.930482] [INFO ] [MAIN ] EBF: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:33:54.949830] [DEBUG] [LOCAL ] EBF: Loaded 18912 existing records from primary storage. [2025-10-15T18:33:54.950058] [INFO ] [MAIN ] EBF: Loaded 18912 existing records. [2025-10-15T18:33:55.077255] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-15T18:33:55.125746] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-15T18:33:55.162514] [INFO ] [REMOTE ] EAI: Full fetch complete (6013 records). [2025-10-15T18:33:55.165960] [WARN ] [MAIN ] EBF: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:33:55.166063] [DEBUG] [VALIDATOR ] EAI: Validating primary data. [2025-10-15T18:33:55.166759] [INFO ] [MAIN ] EBF: Wiping existing primary data before full refresh. [2025-10-15T18:33:55.166602] [FATAL] [VALIDATOR ] EAI: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T18:33:55.166860] [FATAL] [MAIN ] EAI: Fetched primary data is invalid. Refusing to save it. [2025-10-15T18:33:55.166959] [INFO ] [LOCAL ] EBF: Starting deletion of primary data. [2025-10-15T18:33:55.167076] [WARN ] [MAIN ] EAI: Deleting existing primary and derivative data due to validation failure. [2025-10-15T18:33:55.167168] [INFO ] [LOCAL ] EAI: Starting deletion of primary data. [2025-10-15T18:33:55.167239] [DEBUG] [LOCAL ] EBF: Deleted primary data file. [2025-10-15T18:33:55.167381] [INFO ] [MAIN ] EBF: Starting full primary refresh. [2025-10-15T18:33:55.167346] [DEBUG] [LOCAL ] EAI: No primary data file found to delete. [2025-10-15T18:33:55.229440] [INFO ] [LOCAL ] EAI: Starting deletion of derivative data. [2025-10-15T18:33:55.263536] [DEBUG] [LOCAL ] EAI: Deleted derivative data file. [2025-10-15T18:33:55.265793] [INFO ] [MAIN ] Update Progress: 677/2369 symbols completed. EAI took 38.8s. Estimated remaining: 3h 54m 33s. Rate: 7.2 symbols/min [2025-10-15T18:33:55.337987] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-03. [2025-10-15T18:33:55.521278] [INFO ] [REMOTE ] EBF: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:33:56.114079] [INFO ] [REMOTE ] EBF: Fetching primary data for 2024-12. [2025-10-15T18:33:56.663679] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-15T18:33:56.914044] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-04. [2025-10-15T18:33:57.446385] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-15T18:33:57.714018] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-01. [2025-10-15T18:33:58.059730] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-15T18:33:58.514105] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-03. [2025-10-15T18:33:58.734445] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-15T18:33:59.314094] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-02. [2025-10-15T18:34:00.067197] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-15T18:34:00.113970] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-03. [2025-10-15T18:34:00.474295] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-15T18:34:00.913994] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-05. [2025-10-15T18:34:01.099156] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-15T18:34:01.714092] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-04. [2025-10-15T18:34:02.514078] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-04. [2025-10-15T18:34:02.762353] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-15T18:34:03.315019] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-06. [2025-10-15T18:34:03.316359] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-15T18:34:03.358038] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-15T18:34:04.113994] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-05. [2025-10-15T18:34:04.660485] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-15T18:34:04.914044] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-07. [2025-10-15T18:34:05.263700] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-15T18:34:05.714046] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-06. [2025-10-15T18:34:06.380233] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-15T18:34:06.412850] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-15T18:34:06.514027] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-05. [2025-10-15T18:34:07.314021] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-08. [2025-10-15T18:34:08.113984] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-07. [2025-10-15T18:34:08.264063] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-15T18:34:08.758715] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-15T18:34:08.913960] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-06. [2025-10-15T18:34:09.147100] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-15T18:34:09.714003] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-09. [2025-10-15T18:34:10.514051] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-08. [2025-10-15T18:34:10.644927] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-15T18:34:10.829051] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-15T18:34:11.313962] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-07. [2025-10-15T18:34:11.519023] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-15T18:34:12.113993] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-10. [2025-10-15T18:34:12.914034] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-09. [2025-10-15T18:34:13.165252] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-15T18:34:13.491972] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-15T18:34:13.496085] [INFO ] [REMOTE ] EB: Full fetch complete (55422 records). [2025-10-15T18:34:13.496176] [DEBUG] [VALIDATOR ] EB: Validating primary data. [2025-10-15T18:34:13.687768] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-15T18:34:13.719459] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-08. [2025-10-15T18:34:13.896365] [DEBUG] [VALIDATOR ] EB: All expected trading days are present. [2025-10-15T18:34:13.896440] [DEBUG] [VALIDATOR ] EB: Primary data validation passed. [2025-10-15T18:34:13.897197] [INFO ] [MAIN ] EB: Fetched primary data is valid. [2025-10-15T18:34:13.897257] [DEBUG] [LOCAL ] EB: Saving primary data. [2025-10-15T18:34:13.898336] [DEBUG] [LOCAL ] EB: Trimmed 55422 records to 36538 (keeping 200 days of data) [2025-10-15T18:34:14.104045] [DEBUG] [LOCAL ] EB: Primary data saved (36538 records). [2025-10-15T18:34:14.104218] [INFO ] [MAIN ] EB: Full history saved. [2025-10-15T18:34:14.104631] [INFO ] [MAIN ] Update Progress: 678/2369 symbols completed. EB took 27.0s. Estimated remaining: 3h 54m 51s. Rate: 7.2 symbols/min [2025-10-15T18:34:14.513998] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-10. [2025-10-15T18:34:15.580483] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-15T18:34:15.583200] [INFO ] [REMOTE ] EBF: Full fetch complete (27657 records). [2025-10-15T18:34:15.583284] [DEBUG] [VALIDATOR ] EBF: Validating primary data. [2025-10-15T18:34:15.583786] [FATAL] [VALIDATOR ] EBF: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T18:34:15.583866] [FATAL] [MAIN ] EBF: Fetched primary data is invalid. Refusing to save it. [2025-10-15T18:34:15.583908] [WARN ] [MAIN ] EBF: Deleting existing primary and derivative data due to validation failure. [2025-10-15T18:34:15.583947] [INFO ] [LOCAL ] EBF: Starting deletion of primary data. [2025-10-15T18:34:15.584001] [DEBUG] [LOCAL ] EBF: No primary data file found to delete. [2025-10-15T18:34:15.584035] [INFO ] [LOCAL ] EBF: Starting deletion of derivative data. [2025-10-15T18:34:15.584180] [DEBUG] [LOCAL ] EBF: Deleted derivative data file. [2025-10-15T18:34:15.584264] [INFO ] [MAIN ] Update Progress: 679/2369 symbols completed. EBF took 20.8s. Estimated remaining: 3h 54m 25s. Rate: 7.2 symbols/min [2025-10-15T18:34:15.687458] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-10-15T18:34:15.702811] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-09. [2025-10-15T18:34:17.525175] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-15T18:34:17.536116] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-10. [2025-10-15T18:34:19.111407] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-15T18:34:19.116870] [INFO ] [REMOTE ] EAT: Full fetch complete (72058 records). [2025-10-15T18:34:19.116997] [DEBUG] [VALIDATOR ] EAT: Validating primary data. [2025-10-15T18:34:19.117789] [FATAL] [VALIDATOR ] EAT: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T18:34:19.117876] [FATAL] [MAIN ] EAT: Fetched primary data is invalid. Refusing to save it. [2025-10-15T18:34:19.117918] [WARN ] [MAIN ] EAT: Deleting existing primary and derivative data due to validation failure. [2025-10-15T18:34:19.117954] [INFO ] [LOCAL ] EAT: Starting deletion of primary data. [2025-10-15T18:34:19.118007] [DEBUG] [LOCAL ] EAT: No primary data file found to delete. [2025-10-15T18:34:19.118042] [INFO ] [LOCAL ] EAT: Starting deletion of derivative data. [2025-10-15T18:34:19.118191] [DEBUG] [LOCAL ] EAT: Deleted derivative data file. [2025-10-15T18:34:19.118849] [INFO ] [MAIN ] Update Progress: 680/2369 symbols completed. EAT took 43.4s. Estimated remaining: 3h 54m 5s. Rate: 7.2 symbols/min [2025-10-15T18:34:19.855914] [INFO ] [MAIN ] EBR: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:34:19.847179] [INFO ] [MAIN ] EC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:34:19.797893] [INFO ] [MAIN ] ECAT: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:34:19.855006] [INFO ] [MAIN ] EBS: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:34:19.967146] [DEBUG] [LOCAL ] EBR: Loaded 43246 existing records from primary storage. [2025-10-15T18:34:19.964982] [DEBUG] [LOCAL ] ECAT: Loaded 29496 existing records from primary storage. [2025-10-15T18:34:19.966285] [DEBUG] [LOCAL ] EBS: Loaded 46752 existing records from primary storage. [2025-10-15T18:34:19.967963] [INFO ] [MAIN ] ECAT: Loaded 29496 existing records. [2025-10-15T18:34:19.968194] [INFO ] [MAIN ] EBS: Loaded 46752 existing records. [2025-10-15T18:34:19.968428] [INFO ] [MAIN ] EBR: Loaded 43246 existing records. [2025-10-15T18:34:20.048338] [DEBUG] [LOCAL ] EC: Loaded 49029 existing records from primary storage. [2025-10-15T18:34:20.134723] [INFO ] [MAIN ] EC: Loaded 49029 existing records. [2025-10-15T18:34:20.640425] [WARN ] [MAIN ] EBR: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:34:20.678017] [WARN ] [MAIN ] ECAT: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:34:20.717083] [INFO ] [MAIN ] ECAT: Wiping existing primary data before full refresh. [2025-10-15T18:34:20.730361] [WARN ] [MAIN ] EC: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:34:20.726957] [INFO ] [LOCAL ] ECAT: Starting deletion of primary data. [2025-10-15T18:34:20.709333] [INFO ] [MAIN ] EBR: Wiping existing primary data before full refresh. [2025-10-15T18:34:20.723529] [WARN ] [MAIN ] EBS: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:34:20.730949] [INFO ] [LOCAL ] EBR: Starting deletion of primary data. [2025-10-15T18:34:20.731098] [INFO ] [MAIN ] EC: Wiping existing primary data before full refresh. [2025-10-15T18:34:20.731203] [INFO ] [MAIN ] EBS: Wiping existing primary data before full refresh. [2025-10-15T18:34:20.731446] [DEBUG] [LOCAL ] ECAT: Deleted primary data file. [2025-10-15T18:34:20.731333] [INFO ] [LOCAL ] EC: Starting deletion of primary data. [2025-10-15T18:34:20.732070] [DEBUG] [LOCAL ] EC: Deleted primary data file. [2025-10-15T18:34:20.731577] [INFO ] [LOCAL ] EBS: Starting deletion of primary data. [2025-10-15T18:34:20.732139] [INFO ] [MAIN ] EC: Starting full primary refresh. [2025-10-15T18:34:20.732166] [DEBUG] [LOCAL ] EBR: Deleted primary data file. [2025-10-15T18:34:20.737837] [INFO ] [MAIN ] ECAT: Starting full primary refresh. [2025-10-15T18:34:20.743794] [DEBUG] [LOCAL ] EBS: Deleted primary data file. [2025-10-15T18:34:20.749250] [INFO ] [MAIN ] EBR: Starting full primary refresh. [2025-10-15T18:34:20.830699] [INFO ] [MAIN ] EBS: Starting full primary refresh. [2025-10-15T18:34:22.037859] [INFO ] [REMOTE ] EC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:34:22.213295] [INFO ] [REMOTE ] ECAT: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:34:22.159814] [INFO ] [REMOTE ] EC: Fetching primary data for 2024-12. [2025-10-15T18:34:22.237837] [INFO ] [REMOTE ] EBS: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:34:22.242144] [INFO ] [REMOTE ] EBR: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:34:22.243095] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2024-12. [2025-10-15T18:34:22.242599] [INFO ] [REMOTE ] EBS: Fetching primary data for 2024-12. [2025-10-15T18:34:22.244179] [INFO ] [REMOTE ] EBR: Fetching primary data for 2024-12. [2025-10-15T18:34:23.466864] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-15T18:34:23.472234] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-01. [2025-10-15T18:34:24.145480] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-10-15T18:34:24.157823] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-01. [2025-10-15T18:34:24.225394] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-10-15T18:34:24.236465] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-01. [2025-10-15T18:34:24.272943] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2024-12 (2.11 seconds). [2025-10-15T18:34:24.283437] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-01. [2025-10-15T18:34:24.369426] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-15T18:34:24.376740] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-02. [2025-10-15T18:34:25.469101] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-15T18:34:25.475791] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-03. [2025-10-15T18:34:25.512668] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-15T18:34:25.533794] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-02. [2025-10-15T18:34:25.556953] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-15T18:34:25.624405] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-15T18:34:25.714011] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-02. [2025-10-15T18:34:26.514058] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-02. [2025-10-15T18:34:26.885820] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-15T18:34:26.938835] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-15T18:34:27.090602] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-15T18:34:27.313991] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-03. [2025-10-15T18:34:28.001610] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-15T18:34:28.114003] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-03. [2025-10-15T18:34:28.772115] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-15T18:34:28.913983] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-04. [2025-10-15T18:34:29.713966] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-03. [2025-10-15T18:34:29.920725] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-15T18:34:30.392731] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-15T18:34:30.514014] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-04. [2025-10-15T18:34:31.314027] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-05. [2025-10-15T18:34:31.364068] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-15T18:34:32.084421] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-15T18:34:32.113957] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-05. [2025-10-15T18:34:32.789249] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-15T18:34:32.913996] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-04. [2025-10-15T18:34:33.714014] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-06. [2025-10-15T18:34:33.783497] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-15T18:34:34.273300] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-15T18:34:34.513985] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-06. [2025-10-15T18:34:35.314007] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-05. [2025-10-15T18:34:35.701566] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-10-15T18:34:36.114004] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-04. [2025-10-15T18:34:36.158442] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-15T18:34:36.483204] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-15T18:34:36.914005] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-06. [2025-10-15T18:34:37.713967] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-07. [2025-10-15T18:34:37.765090] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-15T18:34:38.154864] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-15T18:34:38.514044] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-07. [2025-10-15T18:34:39.314041] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-05. [2025-10-15T18:34:39.394708] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-15T18:34:39.873980] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-15T18:34:40.114011] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-07. [2025-10-15T18:34:40.804594] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-15T18:34:40.913962] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-06. [2025-10-15T18:34:41.714034] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-08. [2025-10-15T18:34:41.768825] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-15T18:34:42.432494] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-15T18:34:42.513999] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-07. [2025-10-15T18:34:42.927629] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-15T18:34:43.314047] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-08. [2025-10-15T18:34:43.916381] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-15T18:34:44.114022] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-09. [2025-10-15T18:34:44.914027] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-08. [2025-10-15T18:34:44.975136] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-15T18:34:45.539504] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-15T18:34:45.714060] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-10. [2025-10-15T18:34:46.403448] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-15T18:34:46.513967] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-09. [2025-10-15T18:34:46.958521] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-15T18:34:46.962136] [INFO ] [REMOTE ] ECAT: Full fetch complete (43054 records). [2025-10-15T18:34:46.962217] [DEBUG] [VALIDATOR ] ECAT: Validating primary data. [2025-10-15T18:34:47.319180] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-09. [2025-10-15T18:34:47.365806] [DEBUG] [VALIDATOR ] ECAT: All expected trading days are present. [2025-10-15T18:34:47.365878] [DEBUG] [VALIDATOR ] ECAT: Primary data validation passed. [2025-10-15T18:34:47.366531] [INFO ] [MAIN ] ECAT: Fetched primary data is valid. [2025-10-15T18:34:47.366573] [DEBUG] [LOCAL ] ECAT: Saving primary data. [2025-10-15T18:34:47.367454] [DEBUG] [LOCAL ] ECAT: Trimmed 43054 records to 29496 (keeping 200 days of data) [2025-10-15T18:34:47.550687] [DEBUG] [LOCAL ] ECAT: Primary data saved (29496 records). [2025-10-15T18:34:47.550832] [INFO ] [MAIN ] ECAT: Full history saved. [2025-10-15T18:34:47.550930] [INFO ] [MAIN ] Update Progress: 681/2369 symbols completed. ECAT took 28.4s. Estimated remaining: 3h 54m 47s. Rate: 7.2 symbols/min [2025-10-15T18:34:47.736879] [INFO ] [MAIN ] ECC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:34:47.776160] [DEBUG] [LOCAL ] ECC: Loaded 43220 existing records from primary storage. [2025-10-15T18:34:47.776443] [INFO ] [MAIN ] ECC: Loaded 43220 existing records. [2025-10-15T18:34:47.967126] [WARN ] [MAIN ] ECC: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:34:47.967568] [INFO ] [MAIN ] ECC: Wiping existing primary data before full refresh. [2025-10-15T18:34:47.967726] [INFO ] [LOCAL ] ECC: Starting deletion of primary data. [2025-10-15T18:34:47.968025] [DEBUG] [LOCAL ] ECC: Deleted primary data file. [2025-10-15T18:34:47.968085] [INFO ] [MAIN ] ECC: Starting full primary refresh. [2025-10-15T18:34:48.093716] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-15T18:34:48.119082] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-08. [2025-10-15T18:34:48.353155] [INFO ] [REMOTE ] ECC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:34:48.913964] [INFO ] [REMOTE ] ECC: Fetching primary data for 2024-12. [2025-10-15T18:34:49.078776] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-15T18:34:49.714033] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-10. [2025-10-15T18:34:49.750433] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-15T18:34:50.513963] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-10. [2025-10-15T18:34:50.554577] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-15T18:34:51.283450] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-15T18:34:51.291515] [INFO ] [REMOTE ] EBS: Full fetch complete (67445 records). [2025-10-15T18:34:51.291712] [DEBUG] [VALIDATOR ] EBS: Validating primary data. [2025-10-15T18:34:51.320906] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-09. [2025-10-15T18:34:51.684849] [DEBUG] [VALIDATOR ] EBS: All expected trading days are present. [2025-10-15T18:34:51.684928] [DEBUG] [VALIDATOR ] EBS: Primary data validation passed. [2025-10-15T18:34:51.685820] [INFO ] [MAIN ] EBS: Fetched primary data is valid. [2025-10-15T18:34:51.685881] [DEBUG] [LOCAL ] EBS: Saving primary data. [2025-10-15T18:34:51.687078] [DEBUG] [LOCAL ] EBS: Trimmed 67445 records to 46759 (keeping 200 days of data) [2025-10-15T18:34:51.970459] [DEBUG] [LOCAL ] EBS: Primary data saved (46759 records). [2025-10-15T18:34:51.970579] [INFO ] [MAIN ] EBS: Full history saved. [2025-10-15T18:34:51.970967] [INFO ] [MAIN ] Update Progress: 682/2369 symbols completed. EBS took 32.9s. Estimated remaining: 3h 54m 29s. Rate: 7.2 symbols/min [2025-10-15T18:34:52.122372] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-01. [2025-10-15T18:34:52.139438] [INFO ] [MAIN ] ECCC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:34:52.139616] [DEBUG] [LOCAL ] ECCC: No existing data file found in primary storage. [2025-10-15T18:34:52.140397] [WARN ] [MAIN ] ECCC: No existing data found, performing full refresh instead. [2025-10-15T18:34:52.140525] [INFO ] [MAIN ] ECCC: Wiping existing primary data before full refresh. [2025-10-15T18:34:52.140718] [INFO ] [LOCAL ] ECCC: Starting deletion of primary data. [2025-10-15T18:34:52.140783] [DEBUG] [LOCAL ] ECCC: No primary data file found to delete. [2025-10-15T18:34:52.140826] [INFO ] [MAIN ] ECCC: Starting full primary refresh. [2025-10-15T18:34:52.364620] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-10 (1.85 seconds). [2025-10-15T18:34:52.462164] [INFO ] [REMOTE ] EC: Full fetch complete (71944 records). [2025-10-15T18:34:52.464449] [DEBUG] [VALIDATOR ] EC: Validating primary data. [2025-10-15T18:34:52.635547] [INFO ] [REMOTE ] ECCC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:34:52.923726] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2024-12. [2025-10-15T18:34:52.947013] [DEBUG] [VALIDATOR ] EC: All expected trading days are present. [2025-10-15T18:34:52.947105] [DEBUG] [VALIDATOR ] EC: Primary data validation passed. [2025-10-15T18:34:52.948307] [INFO ] [MAIN ] EC: Fetched primary data is valid. [2025-10-15T18:34:52.948520] [DEBUG] [LOCAL ] EC: Saving primary data. [2025-10-15T18:34:52.976333] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-15T18:34:52.975133] [DEBUG] [LOCAL ] EC: Trimmed 71944 records to 49000 (keeping 200 days of data) [2025-10-15T18:34:53.266038] [DEBUG] [LOCAL ] EC: Primary data saved (49000 records). [2025-10-15T18:34:53.266162] [INFO ] [MAIN ] EC: Full history saved. [2025-10-15T18:34:53.266249] [INFO ] [MAIN ] Update Progress: 683/2369 symbols completed. EC took 34.1s. Estimated remaining: 3h 54m 3s. Rate: 7.2 symbols/min [2025-10-15T18:34:53.435810] [INFO ] [MAIN ] ECCU: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:34:53.440433] [DEBUG] [LOCAL ] ECCU: Loaded 2215 existing records from primary storage. [2025-10-15T18:34:53.440640] [INFO ] [MAIN ] ECCU: Loaded 2215 existing records. [2025-10-15T18:34:53.618603] [WARN ] [MAIN ] ECCU: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:34:53.618854] [INFO ] [MAIN ] ECCU: Wiping existing primary data before full refresh. [2025-10-15T18:34:53.619078] [INFO ] [LOCAL ] ECCU: Starting deletion of primary data. [2025-10-15T18:34:53.619247] [DEBUG] [LOCAL ] ECCU: Deleted primary data file. [2025-10-15T18:34:53.619332] [INFO ] [MAIN ] ECCU: Starting full primary refresh. [2025-10-15T18:34:53.690041] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-10-15T18:34:53.714076] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-10. [2025-10-15T18:34:53.801866] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-15T18:34:54.043506] [INFO ] [REMOTE ] ECCU: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:34:54.514006] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2024-12. [2025-10-15T18:34:55.058330] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2024-12 (0.54 seconds). [2025-10-15T18:34:55.314024] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-02. [2025-10-15T18:34:55.400547] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-15T18:34:55.407463] [INFO ] [REMOTE ] EBR: Full fetch complete (62619 records). [2025-10-15T18:34:55.407564] [DEBUG] [VALIDATOR ] EBR: Validating primary data. [2025-10-15T18:34:55.806771] [DEBUG] [VALIDATOR ] EBR: All expected trading days are present. [2025-10-15T18:34:55.806845] [DEBUG] [VALIDATOR ] EBR: Primary data validation passed. [2025-10-15T18:34:55.807632] [INFO ] [MAIN ] EBR: Fetched primary data is valid. [2025-10-15T18:34:55.807740] [DEBUG] [LOCAL ] EBR: Saving primary data. [2025-10-15T18:34:55.808959] [DEBUG] [LOCAL ] EBR: Trimmed 62619 records to 43297 (keeping 200 days of data) [2025-10-15T18:34:56.077469] [DEBUG] [LOCAL ] EBR: Primary data saved (43297 records). [2025-10-15T18:34:56.077610] [INFO ] [MAIN ] EBR: Full history saved. [2025-10-15T18:34:56.077747] [INFO ] [MAIN ] Update Progress: 684/2369 symbols completed. EBR took 37.0s. Estimated remaining: 3h 53m 41s. Rate: 7.2 symbols/min [2025-10-15T18:34:56.119113] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-01. [2025-10-15T18:34:56.261204] [INFO ] [MAIN ] ECCW: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:34:56.261396] [DEBUG] [LOCAL ] ECCW: No existing data file found in primary storage. [2025-10-15T18:34:56.261433] [WARN ] [MAIN ] ECCW: No existing data found, performing full refresh instead. [2025-10-15T18:34:56.261541] [INFO ] [MAIN ] ECCW: Wiping existing primary data before full refresh. [2025-10-15T18:34:56.261582] [INFO ] [LOCAL ] ECCW: Starting deletion of primary data. [2025-10-15T18:34:56.261623] [DEBUG] [LOCAL ] ECCW: No primary data file found to delete. [2025-10-15T18:34:56.261686] [INFO ] [MAIN ] ECCW: Starting full primary refresh. [2025-10-15T18:34:56.642541] [INFO ] [REMOTE ] ECCW: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:34:56.759943] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-15T18:34:56.866455] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-15T18:34:56.913957] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-03. [2025-10-15T18:34:57.714007] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2024-12. [2025-10-15T18:34:58.153592] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2024-12 (0.44 seconds). [2025-10-15T18:34:58.497547] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-15T18:34:58.513959] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-04. [2025-10-15T18:34:59.314014] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-01. [2025-10-15T18:34:59.653141] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-01 (0.34 seconds). [2025-10-15T18:35:00.113991] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-02. [2025-10-15T18:35:00.198695] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-15T18:35:00.451833] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-10-15T18:35:00.914056] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-01. [2025-10-15T18:35:01.337067] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-10-15T18:35:01.714009] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-02. [2025-10-15T18:35:02.018590] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-02 (0.30 seconds). [2025-10-15T18:35:02.514003] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-03. [2025-10-15T18:35:02.892658] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-03 (0.38 seconds). [2025-10-15T18:35:03.313991] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-04. [2025-10-15T18:35:03.691638] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-04 (0.38 seconds). [2025-10-15T18:35:04.114025] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-05. [2025-10-15T18:35:04.686773] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-15T18:35:04.913989] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-03. [2025-10-15T18:35:05.414357] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-10-15T18:35:05.714001] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-06. [2025-10-15T18:35:05.999719] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-06 (0.29 seconds). [2025-10-15T18:35:06.513993] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-07. [2025-10-15T18:35:06.992219] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-15T18:35:07.314004] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-05. [2025-10-15T18:35:08.114114] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-08. [2025-10-15T18:35:08.594587] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-10-15T18:35:08.914028] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-09. [2025-10-15T18:35:09.031699] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-15T18:35:09.249812] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-09 (0.34 seconds). [2025-10-15T18:35:09.714029] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-10. [2025-10-15T18:35:10.267956] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-15T18:35:10.268691] [INFO ] [REMOTE ] ECCW: Full fetch complete (1413 records). [2025-10-15T18:35:10.268759] [DEBUG] [VALIDATOR ] ECCW: Validating primary data. [2025-10-15T18:35:10.269153] [FATAL] [VALIDATOR ] ECCW: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T18:35:10.269232] [FATAL] [MAIN ] ECCW: Fetched primary data is invalid. Refusing to save it. [2025-10-15T18:35:10.269273] [WARN ] [MAIN ] ECCW: Deleting existing primary and derivative data due to validation failure. [2025-10-15T18:35:10.269323] [INFO ] [LOCAL ] ECCW: Starting deletion of primary data. [2025-10-15T18:35:10.269399] [DEBUG] [LOCAL ] ECCW: No primary data file found to delete. [2025-10-15T18:35:10.269434] [INFO ] [LOCAL ] ECCW: Starting deletion of derivative data. [2025-10-15T18:35:10.269472] [DEBUG] [LOCAL ] ECCW: No derivative data file found to delete. [2025-10-15T18:35:10.269522] [INFO ] [MAIN ] Update Progress: 685/2369 symbols completed. ECCW took 14.2s. Estimated remaining: 3h 53m 47s. Rate: 7.2 symbols/min [2025-10-15T18:35:10.431822] [INFO ] [MAIN ] ECCX: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:35:10.431999] [DEBUG] [LOCAL ] ECCX: No existing data file found in primary storage. [2025-10-15T18:35:10.432053] [WARN ] [MAIN ] ECCX: No existing data found, performing full refresh instead. [2025-10-15T18:35:10.432162] [INFO ] [MAIN ] ECCX: Wiping existing primary data before full refresh. [2025-10-15T18:35:10.432203] [INFO ] [LOCAL ] ECCX: Starting deletion of primary data. [2025-10-15T18:35:10.432242] [DEBUG] [LOCAL ] ECCX: No primary data file found to delete. [2025-10-15T18:35:10.432274] [INFO ] [MAIN ] ECCX: Starting full primary refresh. [2025-10-15T18:35:10.519125] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-06. [2025-10-15T18:35:10.777959] [INFO ] [REMOTE ] ECCX: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:35:11.314045] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-04. [2025-10-15T18:35:11.646223] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-04 (0.33 seconds). [2025-10-15T18:35:12.029331] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-15T18:35:12.113949] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-07. [2025-10-15T18:35:12.914018] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-05. [2025-10-15T18:35:13.679015] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-15T18:35:13.713989] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-06. [2025-10-15T18:35:14.205567] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-10-15T18:35:14.256458] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-10-15T18:35:14.513990] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-07. [2025-10-15T18:35:14.869052] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-07 (0.36 seconds). [2025-10-15T18:35:15.314003] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-08. [2025-10-15T18:35:16.113996] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-08. [2025-10-15T18:35:16.552933] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-10-15T18:35:16.914081] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2024-12. [2025-10-15T18:35:17.061786] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-15T18:35:17.492269] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2024-12 (0.58 seconds). [2025-10-15T18:35:17.714025] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-09. [2025-10-15T18:35:18.514001] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-02. [2025-10-15T18:35:19.119954] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-15T18:35:19.313979] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-09. [2025-10-15T18:35:19.422940] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-15T18:35:19.604093] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-09 (0.29 seconds). [2025-10-15T18:35:20.113990] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-10. [2025-10-15T18:35:20.631785] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-15T18:35:20.632502] [INFO ] [REMOTE ] ECCC: Full fetch complete (1302 records). [2025-10-15T18:35:20.632570] [DEBUG] [VALIDATOR ] ECCC: Validating primary data. [2025-10-15T18:35:20.632929] [FATAL] [VALIDATOR ] ECCC: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T18:35:20.633008] [FATAL] [MAIN ] ECCC: Fetched primary data is invalid. Refusing to save it. [2025-10-15T18:35:20.633050] [WARN ] [MAIN ] ECCC: Deleting existing primary and derivative data due to validation failure. [2025-10-15T18:35:20.633087] [INFO ] [LOCAL ] ECCC: Starting deletion of primary data. [2025-10-15T18:35:20.633139] [DEBUG] [LOCAL ] ECCC: No primary data file found to delete. [2025-10-15T18:35:20.633173] [INFO ] [LOCAL ] ECCC: Starting deletion of derivative data. [2025-10-15T18:35:20.633210] [DEBUG] [LOCAL ] ECCC: No derivative data file found to delete. [2025-10-15T18:35:20.633261] [INFO ] [MAIN ] Update Progress: 686/2369 symbols completed. ECCC took 28.7s. Estimated remaining: 3h 53m 44s. Rate: 7.2 symbols/min [2025-10-15T18:35:20.803542] [INFO ] [MAIN ] ECG: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:35:20.835614] [DEBUG] [LOCAL ] ECG: Loaded 33259 existing records from primary storage. [2025-10-15T18:35:20.835907] [INFO ] [MAIN ] ECG: Loaded 33259 existing records. [2025-10-15T18:35:20.919111] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-03. [2025-10-15T18:35:21.026323] [WARN ] [MAIN ] ECG: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:35:21.026526] [INFO ] [MAIN ] ECG: Wiping existing primary data before full refresh. [2025-10-15T18:35:21.026574] [INFO ] [LOCAL ] ECG: Starting deletion of primary data. [2025-10-15T18:35:21.027235] [DEBUG] [LOCAL ] ECG: Deleted primary data file. [2025-10-15T18:35:21.027312] [INFO ] [MAIN ] ECG: Starting full primary refresh. [2025-10-15T18:35:21.437691] [INFO ] [REMOTE ] ECG: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:35:21.589388] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-15T18:35:21.713994] [INFO ] [REMOTE ] ECG: Fetching primary data for 2024-12. [2025-10-15T18:35:22.514045] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-04. [2025-10-15T18:35:22.941002] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-10-15T18:35:23.314036] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-10. [2025-10-15T18:35:23.338539] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-15T18:35:24.113985] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-01. [2025-10-15T18:35:24.917688] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-05. [2025-10-15T18:35:24.919435] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-15T18:35:24.924873] [INFO ] [REMOTE ] ECC: Full fetch complete (61004 records). [2025-10-15T18:35:24.924963] [DEBUG] [VALIDATOR ] ECC: Validating primary data. [2025-10-15T18:35:24.925665] [FATAL] [VALIDATOR ] ECC: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T18:35:24.925744] [FATAL] [MAIN ] ECC: Fetched primary data is invalid. Refusing to save it. [2025-10-15T18:35:24.925786] [WARN ] [MAIN ] ECC: Deleting existing primary and derivative data due to validation failure. [2025-10-15T18:35:24.925825] [INFO ] [LOCAL ] ECC: Starting deletion of primary data. [2025-10-15T18:35:24.925905] [DEBUG] [LOCAL ] ECC: No primary data file found to delete. [2025-10-15T18:35:24.926153] [INFO ] [LOCAL ] ECC: Starting deletion of derivative data. [2025-10-15T18:35:24.926299] [DEBUG] [LOCAL ] ECC: Deleted derivative data file. [2025-10-15T18:35:24.927189] [INFO ] [MAIN ] Update Progress: 687/2369 symbols completed. ECC took 37.4s. Estimated remaining: 3h 53m 25s. Rate: 7.2 symbols/min [2025-10-15T18:35:25.102635] [INFO ] [MAIN ] ECL: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:35:25.155033] [DEBUG] [LOCAL ] ECL: Loaded 46660 existing records from primary storage. [2025-10-15T18:35:25.155384] [INFO ] [MAIN ] ECL: Loaded 46660 existing records. [2025-10-15T18:35:25.331959] [WARN ] [MAIN ] ECL: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:35:25.332174] [INFO ] [MAIN ] ECL: Wiping existing primary data before full refresh. [2025-10-15T18:35:25.332231] [INFO ] [LOCAL ] ECL: Starting deletion of primary data. [2025-10-15T18:35:25.332621] [DEBUG] [LOCAL ] ECL: Deleted primary data file. [2025-10-15T18:35:25.332712] [INFO ] [MAIN ] ECL: Starting full primary refresh. [2025-10-15T18:35:25.433367] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-10-15T18:35:25.720067] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-15T18:35:25.715944] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-01. [2025-10-15T18:35:25.730888] [INFO ] [REMOTE ] ECL: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:35:25.981254] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-01 (0.27 seconds). [2025-10-15T18:35:26.514001] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-06. [2025-10-15T18:35:26.917427] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-10-15T18:35:27.313997] [INFO ] [REMOTE ] ECL: Fetching primary data for 2024-12. [2025-10-15T18:35:28.113993] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-02. [2025-10-15T18:35:28.509624] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-10-15T18:35:28.913990] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-03. [2025-10-15T18:35:28.956507] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-15T18:35:29.343091] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-10-15T18:35:29.714030] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-04. [2025-10-15T18:35:30.098758] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-04 (0.38 seconds). [2025-10-15T18:35:30.514049] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-01. [2025-10-15T18:35:31.313994] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-02. [2025-10-15T18:35:31.951359] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-15T18:35:32.114024] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-07. [2025-10-15T18:35:32.501524] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-15T18:35:32.735805] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-15T18:35:32.913992] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-08. [2025-10-15T18:35:33.341560] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-10-15T18:35:33.714082] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-02. [2025-10-15T18:35:34.514017] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-09. [2025-10-15T18:35:34.997707] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-10-15T18:35:35.035756] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-15T18:35:35.314048] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-05. [2025-10-15T18:35:35.638941] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-05 (0.32 seconds). [2025-10-15T18:35:36.114022] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-03. [2025-10-15T18:35:36.914076] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-03. [2025-10-15T18:35:37.682727] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-15T18:35:37.713950] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-04. [2025-10-15T18:35:38.513983] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-06. [2025-10-15T18:35:38.692099] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-15T18:35:38.934166] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-10-15T18:35:39.314017] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-07. [2025-10-15T18:35:39.568736] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-15T18:35:39.752534] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-10-15T18:35:40.114026] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-10. [2025-10-15T18:35:40.607353] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-15T18:35:40.608160] [INFO ] [REMOTE ] ECCU: Full fetch complete (4374 records). [2025-10-15T18:35:40.608228] [DEBUG] [VALIDATOR ] ECCU: Validating primary data. [2025-10-15T18:35:40.922384] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-04. [2025-10-15T18:35:40.965486] [DEBUG] [VALIDATOR ] ECCU: All expected trading days are present. [2025-10-15T18:35:40.965575] [DEBUG] [VALIDATOR ] ECCU: Primary data validation passed. [2025-10-15T18:35:40.965784] [INFO ] [MAIN ] ECCU: Fetched primary data is valid. [2025-10-15T18:35:40.965846] [DEBUG] [LOCAL ] ECCU: Saving primary data. [2025-10-15T18:35:40.966295] [DEBUG] [LOCAL ] ECCU: Trimmed 4374 records to 2218 (keeping 200 days of data) [2025-10-15T18:35:40.980432] [DEBUG] [LOCAL ] ECCU: Primary data saved (2218 records). [2025-10-15T18:35:40.980491] [INFO ] [MAIN ] ECCU: Full history saved. [2025-10-15T18:35:40.980561] [INFO ] [MAIN ] Update Progress: 688/2369 symbols completed. ECCU took 47.7s. Estimated remaining: 3h 53m 36s. Rate: 7.2 symbols/min [2025-10-15T18:35:41.150959] [INFO ] [MAIN ] ECO: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:35:41.170598] [DEBUG] [LOCAL ] ECO: Loaded 18316 existing records from primary storage. [2025-10-15T18:35:41.170931] [INFO ] [MAIN ] ECO: Loaded 18316 existing records. [2025-10-15T18:35:41.340424] [WARN ] [MAIN ] ECO: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:35:41.340596] [INFO ] [MAIN ] ECO: Wiping existing primary data before full refresh. [2025-10-15T18:35:41.340660] [INFO ] [LOCAL ] ECO: Starting deletion of primary data. [2025-10-15T18:35:41.340843] [DEBUG] [LOCAL ] ECO: Deleted primary data file. [2025-10-15T18:35:41.340881] [INFO ] [MAIN ] ECO: Starting full primary refresh. [2025-10-15T18:35:41.684032] [INFO ] [REMOTE ] ECO: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:35:41.714013] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-08. [2025-10-15T18:35:42.388892] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-10-15T18:35:42.419042] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-15T18:35:42.514036] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-09. [2025-10-15T18:35:42.932582] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-10-15T18:35:43.314000] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-10. [2025-10-15T18:35:43.749963] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-10 (0.44 seconds). [2025-10-15T18:35:43.750749] [INFO ] [REMOTE ] ECCX: Full fetch complete (1455 records). [2025-10-15T18:35:43.750819] [DEBUG] [VALIDATOR ] ECCX: Validating primary data. [2025-10-15T18:35:43.958346] [WARN ] [VALIDATOR ] ECCX: Validation failed - insufficient historical data. Have 195 unique days, need 200 days [2025-10-15T18:35:43.958625] [FATAL] [MAIN ] ECCX: Fetched primary data is invalid. Refusing to save it. [2025-10-15T18:35:43.958722] [WARN ] [MAIN ] ECCX: Deleting existing primary and derivative data due to validation failure. [2025-10-15T18:35:43.958794] [INFO ] [LOCAL ] ECCX: Starting deletion of primary data. [2025-10-15T18:35:43.958877] [DEBUG] [LOCAL ] ECCX: No primary data file found to delete. [2025-10-15T18:35:43.958935] [INFO ] [LOCAL ] ECCX: Starting deletion of derivative data. [2025-10-15T18:35:43.958980] [DEBUG] [LOCAL ] ECCX: No derivative data file found to delete. [2025-10-15T18:35:43.959037] [INFO ] [MAIN ] Update Progress: 689/2369 symbols completed. ECCX took 33.7s. Estimated remaining: 3h 53m 15s. Rate: 7.2 symbols/min [2025-10-15T18:35:44.126860] [INFO ] [REMOTE ] ECO: Fetching primary data for 2024-12. [2025-10-15T18:35:44.130324] [INFO ] [MAIN ] ECVT: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:35:44.171510] [DEBUG] [LOCAL ] ECVT: Loaded 43323 existing records from primary storage. [2025-10-15T18:35:44.171869] [INFO ] [MAIN ] ECVT: Loaded 43323 existing records. [2025-10-15T18:35:44.354961] [WARN ] [MAIN ] ECVT: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:35:44.355232] [INFO ] [MAIN ] ECVT: Wiping existing primary data before full refresh. [2025-10-15T18:35:44.355281] [INFO ] [LOCAL ] ECVT: Starting deletion of primary data. [2025-10-15T18:35:44.355488] [DEBUG] [LOCAL ] ECVT: Deleted primary data file. [2025-10-15T18:35:44.355549] [INFO ] [MAIN ] ECVT: Starting full primary refresh. [2025-10-15T18:35:44.712726] [INFO ] [REMOTE ] ECVT: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:35:44.914003] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2024-12. [2025-10-15T18:35:45.454373] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-15T18:35:45.713998] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-05. [2025-10-15T18:35:46.513979] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-01. [2025-10-15T18:35:46.628847] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-15T18:35:47.313972] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-05. [2025-10-15T18:35:47.406553] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-15T18:35:47.773523] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-15T18:35:48.114052] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-06. [2025-10-15T18:35:48.896454] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-15T18:35:48.913940] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-06. [2025-10-15T18:35:49.714020] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-01. [2025-10-15T18:35:49.894801] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-15T18:35:49.950209] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-15T18:35:50.514004] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-07. [2025-10-15T18:35:50.929048] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-15T18:35:51.314028] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-02. [2025-10-15T18:35:51.868220] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-15T18:35:52.114007] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-07. [2025-10-15T18:35:52.384911] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-15T18:35:52.913974] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-03. [2025-10-15T18:35:53.690249] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-15T18:35:53.713950] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-08. [2025-10-15T18:35:54.296409] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-15T18:35:54.514047] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-02. [2025-10-15T18:35:54.936320] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-15T18:35:55.314009] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-09. [2025-10-15T18:35:55.935168] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-15T18:35:56.114007] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-03. [2025-10-15T18:35:56.525699] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-15T18:35:56.919145] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-08. [2025-10-15T18:35:56.925969] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-15T18:35:57.714006] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-04. [2025-10-15T18:35:58.513993] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-10. [2025-10-15T18:35:58.587018] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-15T18:35:58.758887] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-15T18:35:59.314029] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-04. [2025-10-15T18:35:59.687414] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-15T18:35:59.691398] [INFO ] [REMOTE ] ECG: Full fetch complete (50981 records). [2025-10-15T18:35:59.691503] [DEBUG] [VALIDATOR ] ECG: Validating primary data. [2025-10-15T18:36:00.060671] [DEBUG] [VALIDATOR ] ECG: All expected trading days are present. [2025-10-15T18:36:00.060766] [DEBUG] [VALIDATOR ] ECG: Primary data validation passed. [2025-10-15T18:36:00.061488] [INFO ] [MAIN ] ECG: Fetched primary data is valid. [2025-10-15T18:36:00.061530] [DEBUG] [LOCAL ] ECG: Saving primary data. [2025-10-15T18:36:00.062629] [DEBUG] [LOCAL ] ECG: Trimmed 50981 records to 33179 (keeping 200 days of data) [2025-10-15T18:36:00.119131] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-05. [2025-10-15T18:36:00.258337] [DEBUG] [LOCAL ] ECG: Primary data saved (33179 records). [2025-10-15T18:36:00.258488] [INFO ] [MAIN ] ECG: Full history saved. [2025-10-15T18:36:00.258816] [INFO ] [MAIN ] Update Progress: 690/2369 symbols completed. ECG took 39.6s. Estimated remaining: 3h 53m 26s. Rate: 7.2 symbols/min [2025-10-15T18:36:00.421594] [INFO ] [MAIN ] ED: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:36:00.472001] [DEBUG] [LOCAL ] ED: Loaded 52685 existing records from primary storage. [2025-10-15T18:36:00.472301] [INFO ] [MAIN ] ED: Loaded 52685 existing records. [2025-10-15T18:36:00.649439] [WARN ] [MAIN ] ED: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:36:00.649684] [INFO ] [MAIN ] ED: Wiping existing primary data before full refresh. [2025-10-15T18:36:00.649740] [INFO ] [LOCAL ] ED: Starting deletion of primary data. [2025-10-15T18:36:00.649953] [DEBUG] [LOCAL ] ED: Deleted primary data file. [2025-10-15T18:36:00.650007] [INFO ] [MAIN ] ED: Starting full primary refresh. [2025-10-15T18:36:00.919099] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-09. [2025-10-15T18:36:01.003017] [INFO ] [REMOTE ] ED: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:36:01.029524] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-15T18:36:01.415048] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-15T18:36:01.714026] [INFO ] [REMOTE ] ED: Fetching primary data for 2024-12. [2025-10-15T18:36:02.514013] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-06. [2025-10-15T18:36:02.750993] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-15T18:36:03.268752] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-15T18:36:03.313960] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-07. [2025-10-15T18:36:04.012613] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2024-12 (2.30 seconds). [2025-10-15T18:36:04.034113] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-15T18:36:04.113971] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-01. [2025-10-15T18:36:04.914007] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-10. [2025-10-15T18:36:05.714013] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-05. [2025-10-15T18:36:05.774934] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-15T18:36:06.218568] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-15T18:36:06.224696] [INFO ] [REMOTE ] ECL: Full fetch complete (68201 records). [2025-10-15T18:36:06.224814] [DEBUG] [VALIDATOR ] ECL: Validating primary data. [2025-10-15T18:36:06.519829] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-02. [2025-10-15T18:36:06.621153] [DEBUG] [VALIDATOR ] ECL: All expected trading days are present. [2025-10-15T18:36:06.621230] [DEBUG] [VALIDATOR ] ECL: Primary data validation passed. [2025-10-15T18:36:06.622106] [INFO ] [MAIN ] ECL: Fetched primary data is valid. [2025-10-15T18:36:06.622169] [DEBUG] [LOCAL ] ECL: Saving primary data. [2025-10-15T18:36:06.623498] [DEBUG] [LOCAL ] ECL: Trimmed 68201 records to 46668 (keeping 200 days of data) [2025-10-15T18:36:06.965703] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-15T18:36:06.976005] [DEBUG] [LOCAL ] ECL: Primary data saved (46668 records). [2025-10-15T18:36:06.976218] [INFO ] [MAIN ] ECL: Full history saved. [2025-10-15T18:36:06.977159] [INFO ] [MAIN ] Update Progress: 691/2369 symbols completed. ECL took 42.0s. Estimated remaining: 3h 53m 13s. Rate: 7.2 symbols/min [2025-10-15T18:36:07.143554] [INFO ] [MAIN ] EDD: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:36:07.170054] [DEBUG] [LOCAL ] EDD: Loaded 26812 existing records from primary storage. [2025-10-15T18:36:07.170323] [INFO ] [MAIN ] EDD: Loaded 26812 existing records. [2025-10-15T18:36:07.315105] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-08. [2025-10-15T18:36:07.352504] [WARN ] [MAIN ] EDD: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:36:07.352697] [INFO ] [MAIN ] EDD: Wiping existing primary data before full refresh. [2025-10-15T18:36:07.352754] [INFO ] [LOCAL ] EDD: Starting deletion of primary data. [2025-10-15T18:36:07.353041] [DEBUG] [LOCAL ] EDD: Deleted primary data file. [2025-10-15T18:36:07.353099] [INFO ] [MAIN ] EDD: Starting full primary refresh. [2025-10-15T18:36:07.705219] [INFO ] [REMOTE ] EDD: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:36:07.900924] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-15T18:36:08.113980] [INFO ] [REMOTE ] EDD: Fetching primary data for 2024-12. [2025-10-15T18:36:08.554584] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-15T18:36:08.914068] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-06. [2025-10-15T18:36:09.472179] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-15T18:36:09.714084] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-09. [2025-10-15T18:36:10.427210] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-15T18:36:10.514009] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-07. [2025-10-15T18:36:10.807920] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-15T18:36:11.314002] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-01. [2025-10-15T18:36:12.115228] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-10. [2025-10-15T18:36:12.133739] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-15T18:36:12.135805] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-15T18:36:12.913999] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-03. [2025-10-15T18:36:13.104021] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-15T18:36:13.106381] [INFO ] [REMOTE ] ECO: Full fetch complete (28374 records). [2025-10-15T18:36:13.106463] [DEBUG] [VALIDATOR ] ECO: Validating primary data. [2025-10-15T18:36:13.106936] [FATAL] [VALIDATOR ] ECO: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T18:36:13.107017] [FATAL] [MAIN ] ECO: Fetched primary data is invalid. Refusing to save it. [2025-10-15T18:36:13.107059] [WARN ] [MAIN ] ECO: Deleting existing primary and derivative data due to validation failure. [2025-10-15T18:36:13.107116] [INFO ] [LOCAL ] ECO: Starting deletion of primary data. [2025-10-15T18:36:13.107170] [DEBUG] [LOCAL ] ECO: No primary data file found to delete. [2025-10-15T18:36:13.107204] [INFO ] [LOCAL ] ECO: Starting deletion of derivative data. [2025-10-15T18:36:13.107378] [DEBUG] [LOCAL ] ECO: Deleted derivative data file. [2025-10-15T18:36:13.107464] [INFO ] [MAIN ] Update Progress: 692/2369 symbols completed. ECO took 32.1s. Estimated remaining: 3h 52m 60s. Rate: 7.2 symbols/min [2025-10-15T18:36:13.278129] [INFO ] [MAIN ] EDF: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:36:13.292063] [DEBUG] [LOCAL ] EDF: Loaded 13096 existing records from primary storage. [2025-10-15T18:36:13.292281] [INFO ] [MAIN ] EDF: Loaded 13096 existing records. [2025-10-15T18:36:13.491033] [WARN ] [MAIN ] EDF: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:36:13.491227] [INFO ] [MAIN ] EDF: Wiping existing primary data before full refresh. [2025-10-15T18:36:13.491272] [INFO ] [LOCAL ] EDF: Starting deletion of primary data. [2025-10-15T18:36:13.491449] [DEBUG] [LOCAL ] EDF: Deleted primary data file. [2025-10-15T18:36:13.491504] [INFO ] [MAIN ] EDF: Starting full primary refresh. [2025-10-15T18:36:13.720540] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-02. [2025-10-15T18:36:13.846520] [INFO ] [REMOTE ] EDF: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:36:14.513984] [INFO ] [REMOTE ] EDF: Fetching primary data for 2024-12. [2025-10-15T18:36:14.941989] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-15T18:36:14.979063] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-10-15T18:36:15.313992] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-04. [2025-10-15T18:36:15.717181] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-15T18:36:16.113994] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-03. [2025-10-15T18:36:16.914001] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-08. [2025-10-15T18:36:17.192333] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-15T18:36:17.349213] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-15T18:36:17.714017] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-05. [2025-10-15T18:36:18.416514] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-15T18:36:18.514050] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-09. [2025-10-15T18:36:19.313995] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-04. [2025-10-15T18:36:19.448881] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-15T18:36:19.874319] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-15T18:36:20.113965] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-01. [2025-10-15T18:36:20.498291] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-15T18:36:20.714464] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-15T18:36:20.913983] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-05. [2025-10-15T18:36:21.713973] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-06. [2025-10-15T18:36:22.253148] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-15T18:36:22.514120] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-10. [2025-10-15T18:36:23.313969] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-06. [2025-10-15T18:36:23.540184] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-15T18:36:24.113963] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-07. [2025-10-15T18:36:24.149248] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-15T18:36:24.167211] [INFO ] [REMOTE ] ECVT: Full fetch complete (60199 records). [2025-10-15T18:36:24.170262] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-15T18:36:24.169700] [DEBUG] [VALIDATOR ] ECVT: Validating primary data. [2025-10-15T18:36:24.557475] [DEBUG] [VALIDATOR ] ECVT: All expected trading days are present. [2025-10-15T18:36:24.557564] [DEBUG] [VALIDATOR ] ECVT: Primary data validation passed. [2025-10-15T18:36:24.558392] [INFO ] [MAIN ] ECVT: Fetched primary data is valid. [2025-10-15T18:36:24.558453] [DEBUG] [LOCAL ] ECVT: Saving primary data. [2025-10-15T18:36:24.559620] [DEBUG] [LOCAL ] ECVT: Trimmed 60199 records to 43302 (keeping 200 days of data) [2025-10-15T18:36:24.796551] [DEBUG] [LOCAL ] ECVT: Primary data saved (43302 records). [2025-10-15T18:36:24.796698] [INFO ] [MAIN ] ECVT: Full history saved. [2025-10-15T18:36:24.796788] [INFO ] [MAIN ] Update Progress: 693/2369 symbols completed. ECVT took 40.8s. Estimated remaining: 3h 52m 59s. Rate: 7.2 symbols/min [2025-10-15T18:36:24.919091] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-02. [2025-10-15T18:36:24.963599] [INFO ] [MAIN ] EDN: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:36:24.981778] [DEBUG] [LOCAL ] EDN: Loaded 18885 existing records from primary storage. [2025-10-15T18:36:24.982004] [INFO ] [MAIN ] EDN: Loaded 18885 existing records. [2025-10-15T18:36:25.152958] [WARN ] [MAIN ] EDN: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:36:25.153177] [INFO ] [MAIN ] EDN: Wiping existing primary data before full refresh. [2025-10-15T18:36:25.153223] [INFO ] [LOCAL ] EDN: Starting deletion of primary data. [2025-10-15T18:36:25.153369] [DEBUG] [LOCAL ] EDN: Deleted primary data file. [2025-10-15T18:36:25.153405] [INFO ] [MAIN ] EDN: Starting full primary refresh. [2025-10-15T18:36:25.511561] [INFO ] [REMOTE ] EDN: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:36:25.713968] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-07. [2025-10-15T18:36:25.728748] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-15T18:36:26.183440] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-10-15T18:36:26.513987] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-08. [2025-10-15T18:36:27.117412] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-15T18:36:27.313958] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-08. [2025-10-15T18:36:28.113949] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-03. [2025-10-15T18:36:28.219722] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-15T18:36:28.307314] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-15T18:36:28.914020] [INFO ] [REMOTE ] EDN: Fetching primary data for 2024-12. [2025-10-15T18:36:29.115820] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-15T18:36:29.714050] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-09. [2025-10-15T18:36:30.513988] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-04. [2025-10-15T18:36:30.570802] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-15T18:36:31.240871] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-15T18:36:31.314016] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-01. [2025-10-15T18:36:31.487168] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-15T18:36:32.114032] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-05. [2025-10-15T18:36:32.690806] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-15T18:36:32.913994] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-02. [2025-10-15T18:36:33.095206] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-15T18:36:33.714006] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-10. [2025-10-15T18:36:34.052185] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-15T18:36:34.514074] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-06. [2025-10-15T18:36:35.313959] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-03. [2025-10-15T18:36:35.347020] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-15T18:36:35.420127] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-15T18:36:35.425925] [INFO ] [REMOTE ] ED: Full fetch complete (76057 records). [2025-10-15T18:36:35.426048] [DEBUG] [VALIDATOR ] ED: Validating primary data. [2025-10-15T18:36:35.426880] [FATAL] [VALIDATOR ] ED: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T18:36:35.426982] [FATAL] [MAIN ] ED: Fetched primary data is invalid. Refusing to save it. [2025-10-15T18:36:35.427030] [WARN ] [MAIN ] ED: Deleting existing primary and derivative data due to validation failure. [2025-10-15T18:36:35.427076] [INFO ] [LOCAL ] ED: Starting deletion of primary data. [2025-10-15T18:36:35.427132] [DEBUG] [LOCAL ] ED: No primary data file found to delete. [2025-10-15T18:36:35.427166] [INFO ] [LOCAL ] ED: Starting deletion of derivative data. [2025-10-15T18:36:35.427342] [DEBUG] [LOCAL ] ED: Deleted derivative data file. [2025-10-15T18:36:35.427694] [INFO ] [MAIN ] Update Progress: 694/2369 symbols completed. ED took 35.2s. Estimated remaining: 3h 52m 57s. Rate: 7.2 symbols/min [2025-10-15T18:36:35.602350] [INFO ] [MAIN ] EDU: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:36:35.643450] [DEBUG] [LOCAL ] EDU: Loaded 44755 existing records from primary storage. [2025-10-15T18:36:35.643758] [INFO ] [MAIN ] EDU: Loaded 44755 existing records. [2025-10-15T18:36:35.817075] [WARN ] [MAIN ] EDU: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:36:35.817272] [INFO ] [MAIN ] EDU: Wiping existing primary data before full refresh. [2025-10-15T18:36:35.817320] [INFO ] [LOCAL ] EDU: Starting deletion of primary data. [2025-10-15T18:36:35.817637] [DEBUG] [LOCAL ] EDU: Deleted primary data file. [2025-10-15T18:36:35.817741] [INFO ] [MAIN ] EDU: Starting full primary refresh. [2025-10-15T18:36:36.117557] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-09. [2025-10-15T18:36:36.182295] [INFO ] [REMOTE ] EDU: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:36:36.193470] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-15T18:36:36.914009] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-04. [2025-10-15T18:36:37.474014] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-15T18:36:37.554814] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-10-15T18:36:37.714046] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-10. [2025-10-15T18:36:38.514040] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-05. [2025-10-15T18:36:38.846237] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-15T18:36:38.850108] [INFO ] [REMOTE ] EDD: Full fetch complete (38562 records). [2025-10-15T18:36:38.850236] [DEBUG] [VALIDATOR ] EDD: Validating primary data. [2025-10-15T18:36:39.266174] [DEBUG] [VALIDATOR ] EDD: All expected trading days are present. [2025-10-15T18:36:39.266305] [DEBUG] [VALIDATOR ] EDD: Primary data validation passed. [2025-10-15T18:36:39.267384] [INFO ] [MAIN ] EDD: Fetched primary data is valid. [2025-10-15T18:36:39.267489] [DEBUG] [LOCAL ] EDD: Saving primary data. [2025-10-15T18:36:39.268546] [DEBUG] [LOCAL ] EDD: Trimmed 38562 records to 26779 (keeping 200 days of data) [2025-10-15T18:36:39.330988] [INFO ] [REMOTE ] EDU: Fetching primary data for 2024-12. [2025-10-15T18:36:39.470150] [DEBUG] [LOCAL ] EDD: Primary data saved (26779 records). [2025-10-15T18:36:39.470313] [INFO ] [MAIN ] EDD: Full history saved. [2025-10-15T18:36:39.470415] [INFO ] [MAIN ] Update Progress: 695/2369 symbols completed. EDD took 32.5s. Estimated remaining: 3h 52m 38s. Rate: 7.2 symbols/min [2025-10-15T18:36:39.604985] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-15T18:36:39.686469] [INFO ] [MAIN ] EE: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:36:39.717414] [DEBUG] [LOCAL ] EE: Loaded 32960 existing records from primary storage. [2025-10-15T18:36:39.717736] [INFO ] [MAIN ] EE: Loaded 32960 existing records. [2025-10-15T18:36:39.891263] [WARN ] [MAIN ] EE: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:36:39.891474] [INFO ] [MAIN ] EE: Wiping existing primary data before full refresh. [2025-10-15T18:36:39.891520] [INFO ] [LOCAL ] EE: Starting deletion of primary data. [2025-10-15T18:36:39.892108] [DEBUG] [LOCAL ] EE: Deleted primary data file. [2025-10-15T18:36:39.892165] [INFO ] [MAIN ] EE: Starting full primary refresh. [2025-10-15T18:36:40.125777] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-06. [2025-10-15T18:36:40.247800] [INFO ] [REMOTE ] EE: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:36:40.914075] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-07. [2025-10-15T18:36:41.189864] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-10-15T18:36:41.190508] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-15T18:36:41.650833] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-15T18:36:41.713970] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-08. [2025-10-15T18:36:42.504183] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-15T18:36:42.513995] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-07. [2025-10-15T18:36:43.315173] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-09. [2025-10-15T18:36:43.317415] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-15T18:36:44.114051] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-01. [2025-10-15T18:36:44.194257] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-15T18:36:44.914051] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-10. [2025-10-15T18:36:45.713982] [INFO ] [REMOTE ] EE: Fetching primary data for 2024-12. [2025-10-15T18:36:45.732910] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-15T18:36:45.734669] [INFO ] [REMOTE ] EDF: Full fetch complete (20418 records). [2025-10-15T18:36:45.734742] [DEBUG] [VALIDATOR ] EDF: Validating primary data. [2025-10-15T18:36:45.990180] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-15T18:36:46.140796] [DEBUG] [VALIDATOR ] EDF: All expected trading days are present. [2025-10-15T18:36:46.140888] [DEBUG] [VALIDATOR ] EDF: Primary data validation passed. [2025-10-15T18:36:46.141397] [INFO ] [MAIN ] EDF: Fetched primary data is valid. [2025-10-15T18:36:46.141458] [DEBUG] [LOCAL ] EDF: Saving primary data. [2025-10-15T18:36:46.142052] [DEBUG] [LOCAL ] EDF: Trimmed 20418 records to 13052 (keeping 200 days of data) [2025-10-15T18:36:46.216294] [DEBUG] [LOCAL ] EDF: Primary data saved (13052 records). [2025-10-15T18:36:46.216420] [INFO ] [MAIN ] EDF: Full history saved. [2025-10-15T18:36:46.216497] [INFO ] [MAIN ] Update Progress: 696/2369 symbols completed. EDF took 33.1s. Estimated remaining: 3h 52m 26s. Rate: 7.2 symbols/min [2025-10-15T18:36:46.383055] [INFO ] [MAIN ] EEA: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:36:46.383241] [DEBUG] [LOCAL ] EEA: No existing data file found in primary storage. [2025-10-15T18:36:46.383279] [WARN ] [MAIN ] EEA: No existing data found, performing full refresh instead. [2025-10-15T18:36:46.383411] [INFO ] [MAIN ] EEA: Wiping existing primary data before full refresh. [2025-10-15T18:36:46.383451] [INFO ] [LOCAL ] EEA: Starting deletion of primary data. [2025-10-15T18:36:46.383492] [DEBUG] [LOCAL ] EEA: No primary data file found to delete. [2025-10-15T18:36:46.383523] [INFO ] [MAIN ] EEA: Starting full primary refresh. [2025-10-15T18:36:46.519739] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-08. [2025-10-15T18:36:46.742799] [INFO ] [REMOTE ] EEA: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:36:46.883936] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-15T18:36:47.313961] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-01. [2025-10-15T18:36:47.602900] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-15T18:36:48.110012] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-15T18:36:48.114506] [INFO ] [REMOTE ] EEA: Fetching primary data for 2024-12. [2025-10-15T18:36:48.664553] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2024-12 (0.55 seconds). [2025-10-15T18:36:48.913998] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-02. [2025-10-15T18:36:49.714004] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-09. [2025-10-15T18:36:49.914875] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-15T18:36:50.513999] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-01. [2025-10-15T18:36:50.545522] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-15T18:36:51.175294] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-10-15T18:36:51.314101] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-02. [2025-10-15T18:36:51.593023] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-02 (0.28 seconds). [2025-10-15T18:36:52.114090] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-10. [2025-10-15T18:36:52.914034] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-02. [2025-10-15T18:36:53.376788] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-15T18:36:53.380200] [INFO ] [REMOTE ] EDN: Full fetch complete (30041 records). [2025-10-15T18:36:53.380294] [DEBUG] [VALIDATOR ] EDN: Validating primary data. [2025-10-15T18:36:53.714741] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-03. [2025-10-15T18:36:53.764227] [DEBUG] [VALIDATOR ] EDN: All expected trading days are present. [2025-10-15T18:36:53.764361] [DEBUG] [VALIDATOR ] EDN: Primary data validation passed. [2025-10-15T18:36:53.765095] [INFO ] [MAIN ] EDN: Fetched primary data is valid. [2025-10-15T18:36:53.765160] [DEBUG] [LOCAL ] EDN: Saving primary data. [2025-10-15T18:36:53.766143] [DEBUG] [LOCAL ] EDN: Trimmed 30041 records to 19013 (keeping 200 days of data) [2025-10-15T18:36:53.882539] [DEBUG] [LOCAL ] EDN: Primary data saved (19013 records). [2025-10-15T18:36:53.882715] [INFO ] [MAIN ] EDN: Full history saved. [2025-10-15T18:36:53.882841] [INFO ] [MAIN ] Update Progress: 697/2369 symbols completed. EDN took 29.1s. Estimated remaining: 3h 52m 16s. Rate: 7.2 symbols/min [2025-10-15T18:36:54.060081] [INFO ] [MAIN ] EEX: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:36:54.071696] [DEBUG] [LOCAL ] EEX: Loaded 10260 existing records from primary storage. [2025-10-15T18:36:54.072002] [INFO ] [MAIN ] EEX: Loaded 10260 existing records. [2025-10-15T18:36:54.247763] [WARN ] [MAIN ] EEX: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:36:54.247973] [INFO ] [MAIN ] EEX: Wiping existing primary data before full refresh. [2025-10-15T18:36:54.248019] [INFO ] [LOCAL ] EEX: Starting deletion of primary data. [2025-10-15T18:36:54.248327] [DEBUG] [LOCAL ] EEX: Deleted primary data file. [2025-10-15T18:36:54.248385] [INFO ] [MAIN ] EEX: Starting full primary refresh. [2025-10-15T18:36:54.515775] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-03. [2025-10-15T18:36:54.607226] [INFO ] [REMOTE ] EEX: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:36:54.709575] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-15T18:36:54.831966] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-15T18:36:55.063798] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-10-15T18:36:55.314008] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-04. [2025-10-15T18:36:56.113998] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-03. [2025-10-15T18:36:56.716027] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-15T18:36:56.914059] [INFO ] [REMOTE ] EEX: Fetching primary data for 2024-12. [2025-10-15T18:36:57.713979] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-04. [2025-10-15T18:36:57.870209] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-15T18:36:57.962785] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-15T18:36:58.298369] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-15T18:36:58.513982] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-04. [2025-10-15T18:36:59.314038] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-05. [2025-10-15T18:37:00.114022] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-05. [2025-10-15T18:37:00.264006] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-15T18:37:00.720703] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-15T18:37:00.842207] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-15T18:37:00.913964] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-06. [2025-10-15T18:37:01.714049] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-05. [2025-10-15T18:37:02.287816] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-15T18:37:02.514062] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-06. [2025-10-15T18:37:02.984666] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-10-15T18:37:03.314061] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-01. [2025-10-15T18:37:03.405585] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-15T18:37:04.114012] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-06. [2025-10-15T18:37:04.344266] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-15T18:37:04.914010] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-02. [2025-10-15T18:37:05.714084] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-07. [2025-10-15T18:37:05.768369] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-15T18:37:05.883836] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-15T18:37:06.514035] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-03. [2025-10-15T18:37:06.863266] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-15T18:37:07.244120] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-15T18:37:07.314005] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-07. [2025-10-15T18:37:07.788526] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-10-15T18:37:08.114029] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-04. [2025-10-15T18:37:08.914008] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-07. [2025-10-15T18:37:09.207177] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-15T18:37:09.714079] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-08. [2025-10-15T18:37:10.181531] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-10-15T18:37:10.514022] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-08. [2025-10-15T18:37:10.624670] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-15T18:37:11.314055] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-05. [2025-10-15T18:37:11.937236] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-15T18:37:12.012157] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-15T18:37:12.114045] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-09. [2025-10-15T18:37:12.914041] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-08. [2025-10-15T18:37:13.357245] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-15T18:37:13.714001] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-10. [2025-10-15T18:37:14.479513] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-15T18:37:14.513988] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-06. [2025-10-15T18:37:14.982361] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-15T18:37:14.989590] [INFO ] [REMOTE ] EE: Full fetch complete (44117 records). [2025-10-15T18:37:14.989862] [DEBUG] [VALIDATOR ] EE: Validating primary data. [2025-10-15T18:37:15.266241] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-15T18:37:15.319157] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-09. [2025-10-15T18:37:15.388799] [DEBUG] [VALIDATOR ] EE: All expected trading days are present. [2025-10-15T18:37:15.388890] [DEBUG] [VALIDATOR ] EE: Primary data validation passed. [2025-10-15T18:37:15.389719] [INFO ] [MAIN ] EE: Fetched primary data is valid. [2025-10-15T18:37:15.389782] [DEBUG] [LOCAL ] EE: Saving primary data. [2025-10-15T18:37:15.390926] [DEBUG] [LOCAL ] EE: Trimmed 44117 records to 32990 (keeping 200 days of data) [2025-10-15T18:37:15.592733] [DEBUG] [LOCAL ] EE: Primary data saved (32990 records). [2025-10-15T18:37:15.592898] [INFO ] [MAIN ] EE: Full history saved. [2025-10-15T18:37:15.593022] [INFO ] [MAIN ] Update Progress: 698/2369 symbols completed. EE took 36.1s. Estimated remaining: 3h 52m 39s. Rate: 7.2 symbols/min [2025-10-15T18:37:15.760737] [INFO ] [MAIN ] EFC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:37:15.760897] [DEBUG] [LOCAL ] EFC: No existing data file found in primary storage. [2025-10-15T18:37:15.760935] [WARN ] [MAIN ] EFC: No existing data found, performing full refresh instead. [2025-10-15T18:37:15.761044] [INFO ] [MAIN ] EFC: Wiping existing primary data before full refresh. [2025-10-15T18:37:15.761084] [INFO ] [LOCAL ] EFC: Starting deletion of primary data. [2025-10-15T18:37:15.761124] [DEBUG] [LOCAL ] EFC: No primary data file found to delete. [2025-10-15T18:37:15.761199] [INFO ] [MAIN ] EFC: Starting full primary refresh. [2025-10-15T18:37:16.024149] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-15T18:37:16.122617] [INFO ] [REMOTE ] EFC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:37:16.122756] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-07. [2025-10-15T18:37:16.914027] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-09. [2025-10-15T18:37:16.940105] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-15T18:37:17.714038] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-10. [2025-10-15T18:37:18.155235] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-10 (0.44 seconds). [2025-10-15T18:37:18.155993] [INFO ] [REMOTE ] EEA: Full fetch complete (3807 records). [2025-10-15T18:37:18.156061] [DEBUG] [VALIDATOR ] EEA: Validating primary data. [2025-10-15T18:37:18.346032] [WARN ] [VALIDATOR ] EEA: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-15T18:37:18.346391] [FATAL] [MAIN ] EEA: Fetched primary data is invalid. Refusing to save it. [2025-10-15T18:37:18.346476] [WARN ] [MAIN ] EEA: Deleting existing primary and derivative data due to validation failure. [2025-10-15T18:37:18.346568] [INFO ] [LOCAL ] EEA: Starting deletion of primary data. [2025-10-15T18:37:18.346680] [DEBUG] [LOCAL ] EEA: No primary data file found to delete. [2025-10-15T18:37:18.346753] [INFO ] [LOCAL ] EEA: Starting deletion of derivative data. [2025-10-15T18:37:18.346811] [DEBUG] [LOCAL ] EEA: No derivative data file found to delete. [2025-10-15T18:37:18.346871] [INFO ] [MAIN ] Update Progress: 699/2369 symbols completed. EEA took 32.1s. Estimated remaining: 3h 52m 18s. Rate: 7.2 symbols/min [2025-10-15T18:37:18.527967] [INFO ] [REMOTE ] EFC: Fetching primary data for 2024-12. [2025-10-15T18:37:18.531611] [INFO ] [MAIN ] EFR: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:37:18.549263] [DEBUG] [LOCAL ] EFR: Loaded 15055 existing records from primary storage. [2025-10-15T18:37:18.549520] [INFO ] [MAIN ] EFR: Loaded 15055 existing records. [2025-10-15T18:37:18.759306] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-15T18:37:18.781445] [WARN ] [MAIN ] EFR: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:37:18.782216] [INFO ] [MAIN ] EFR: Wiping existing primary data before full refresh. [2025-10-15T18:37:18.782273] [INFO ] [LOCAL ] EFR: Starting deletion of primary data. [2025-10-15T18:37:18.782691] [DEBUG] [LOCAL ] EFR: Deleted primary data file. [2025-10-15T18:37:18.782755] [INFO ] [MAIN ] EFR: Starting full primary refresh. [2025-10-15T18:37:19.132532] [INFO ] [REMOTE ] EFR: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:37:19.313986] [INFO ] [REMOTE ] EFR: Fetching primary data for 2024-12. [2025-10-15T18:37:20.114005] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-10. [2025-10-15T18:37:20.287318] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-15T18:37:20.520830] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-15T18:37:20.914025] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-01. [2025-10-15T18:37:21.501376] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-15T18:37:21.514737] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-15T18:37:21.514858] [INFO ] [REMOTE ] EDU: Full fetch complete (66910 records). [2025-10-15T18:37:21.517915] [DEBUG] [VALIDATOR ] EDU: Validating primary data. [2025-10-15T18:37:21.719096] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-01. [2025-10-15T18:37:21.914871] [DEBUG] [VALIDATOR ] EDU: All expected trading days are present. [2025-10-15T18:37:21.914948] [DEBUG] [VALIDATOR ] EDU: Primary data validation passed. [2025-10-15T18:37:21.915796] [INFO ] [MAIN ] EDU: Fetched primary data is valid. [2025-10-15T18:37:21.915857] [DEBUG] [LOCAL ] EDU: Saving primary data. [2025-10-15T18:37:21.917090] [DEBUG] [LOCAL ] EDU: Trimmed 66910 records to 44813 (keeping 200 days of data) [2025-10-15T18:37:22.175285] [DEBUG] [LOCAL ] EDU: Primary data saved (44813 records). [2025-10-15T18:37:22.175428] [INFO ] [MAIN ] EDU: Full history saved. [2025-10-15T18:37:22.175817] [INFO ] [MAIN ] Update Progress: 700/2369 symbols completed. EDU took 46.7s. Estimated remaining: 3h 51m 59s. Rate: 7.2 symbols/min [2025-10-15T18:37:22.351895] [INFO ] [MAIN ] EFT: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:37:22.366592] [DEBUG] [LOCAL ] EFT: Loaded 13142 existing records from primary storage. [2025-10-15T18:37:22.366887] [INFO ] [MAIN ] EFT: Loaded 13142 existing records. [2025-10-15T18:37:22.521438] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-08. [2025-10-15T18:37:22.543364] [WARN ] [MAIN ] EFT: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:37:22.543873] [INFO ] [MAIN ] EFT: Wiping existing primary data before full refresh. [2025-10-15T18:37:22.543972] [INFO ] [LOCAL ] EFT: Starting deletion of primary data. [2025-10-15T18:37:22.544342] [DEBUG] [LOCAL ] EFT: Deleted primary data file. [2025-10-15T18:37:22.544399] [INFO ] [MAIN ] EFT: Starting full primary refresh. [2025-10-15T18:37:22.904452] [INFO ] [REMOTE ] EFT: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:37:23.314007] [INFO ] [REMOTE ] EFT: Fetching primary data for 2024-12. [2025-10-15T18:37:23.371628] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-15T18:37:23.486548] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-15T18:37:24.113990] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-09. [2025-10-15T18:37:24.475591] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-15T18:37:24.822472] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-15T18:37:24.913975] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-10. [2025-10-15T18:37:25.666621] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-15T18:37:25.668068] [INFO ] [REMOTE ] EEX: Full fetch complete (18629 records). [2025-10-15T18:37:25.668138] [DEBUG] [VALIDATOR ] EEX: Validating primary data. [2025-10-15T18:37:25.720702] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-01. [2025-10-15T18:37:26.024353] [DEBUG] [VALIDATOR ] EEX: All expected trading days are present. [2025-10-15T18:37:26.024428] [DEBUG] [VALIDATOR ] EEX: Primary data validation passed. [2025-10-15T18:37:26.024779] [INFO ] [MAIN ] EEX: Fetched primary data is valid. [2025-10-15T18:37:26.024866] [DEBUG] [LOCAL ] EEX: Saving primary data. [2025-10-15T18:37:26.025355] [DEBUG] [LOCAL ] EEX: Trimmed 18629 records to 10208 (keeping 200 days of data) [2025-10-15T18:37:26.085348] [DEBUG] [LOCAL ] EEX: Primary data saved (10208 records). [2025-10-15T18:37:26.085462] [INFO ] [MAIN ] EEX: Full history saved. [2025-10-15T18:37:26.085542] [INFO ] [MAIN ] Update Progress: 701/2369 symbols completed. EEX took 32.2s. Estimated remaining: 3h 51m 40s. Rate: 7.2 symbols/min [2025-10-15T18:37:26.249578] [INFO ] [MAIN ] EFX: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:37:26.290846] [DEBUG] [LOCAL ] EFX: Loaded 44621 existing records from primary storage. [2025-10-15T18:37:26.291130] [INFO ] [MAIN ] EFX: Loaded 44621 existing records. [2025-10-15T18:37:26.470627] [WARN ] [MAIN ] EFX: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:37:26.471119] [INFO ] [MAIN ] EFX: Wiping existing primary data before full refresh. [2025-10-15T18:37:26.471267] [INFO ] [LOCAL ] EFX: Starting deletion of primary data. [2025-10-15T18:37:26.472229] [DEBUG] [LOCAL ] EFX: Deleted primary data file. [2025-10-15T18:37:26.472286] [INFO ] [MAIN ] EFX: Starting full primary refresh. [2025-10-15T18:37:26.525940] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-02. [2025-10-15T18:37:26.765448] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-15T18:37:26.864263] [INFO ] [REMOTE ] EFX: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:37:27.314025] [INFO ] [REMOTE ] EFX: Fetching primary data for 2024-12. [2025-10-15T18:37:28.114018] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-02. [2025-10-15T18:37:28.181375] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-15T18:37:28.655611] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-10-15T18:37:28.914034] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-03. [2025-10-15T18:37:29.051817] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-15T18:37:29.649791] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-15T18:37:29.714009] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-03. [2025-10-15T18:37:30.514052] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-04. [2025-10-15T18:37:31.314044] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-01. [2025-10-15T18:37:31.501277] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-15T18:37:31.503074] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-15T18:37:32.114036] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-05. [2025-10-15T18:37:32.914055] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-02. [2025-10-15T18:37:33.025582] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-15T18:37:33.042013] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-15T18:37:33.684499] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-15T18:37:33.714007] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-06. [2025-10-15T18:37:34.513968] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-03. [2025-10-15T18:37:34.647295] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-15T18:37:35.314068] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-04. [2025-10-15T18:37:35.371369] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-15T18:37:36.114014] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-07. [2025-10-15T18:37:36.913974] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-02. [2025-10-15T18:37:36.939536] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-15T18:37:37.232753] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-15T18:37:37.714023] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-08. [2025-10-15T18:37:38.475421] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-15T18:37:38.509169] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-15T18:37:38.515197] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-04. [2025-10-15T18:37:39.313970] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-09. [2025-10-15T18:37:39.447251] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-15T18:37:40.114057] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-05. [2025-10-15T18:37:40.256592] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-15T18:37:40.914028] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-10. [2025-10-15T18:37:41.713973] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-05. [2025-10-15T18:37:41.854066] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-15T18:37:41.981956] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-15T18:37:41.984673] [INFO ] [REMOTE ] EFR: Full fetch complete (19402 records). [2025-10-15T18:37:41.984764] [DEBUG] [VALIDATOR ] EFR: Validating primary data. [2025-10-15T18:37:42.393307] [DEBUG] [VALIDATOR ] EFR: All expected trading days are present. [2025-10-15T18:37:42.393445] [DEBUG] [VALIDATOR ] EFR: Primary data validation passed. [2025-10-15T18:37:42.394385] [INFO ] [MAIN ] EFR: Fetched primary data is valid. [2025-10-15T18:37:42.394452] [DEBUG] [LOCAL ] EFR: Saving primary data. [2025-10-15T18:37:42.395159] [DEBUG] [LOCAL ] EFR: Trimmed 19402 records to 15060 (keeping 200 days of data) [2025-10-15T18:37:42.498105] [DEBUG] [LOCAL ] EFR: Primary data saved (15060 records). [2025-10-15T18:37:42.498305] [INFO ] [MAIN ] EFR: Full history saved. [2025-10-15T18:37:42.498405] [INFO ] [MAIN ] Update Progress: 702/2369 symbols completed. EFR took 24.2s. Estimated remaining: 3h 51m 51s. Rate: 7.2 symbols/min [2025-10-15T18:37:42.526492] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-06. [2025-10-15T18:37:42.630442] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-15T18:37:42.709121] [INFO ] [MAIN ] EFXT: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:37:42.746304] [DEBUG] [LOCAL ] EFXT: Loaded 29628 existing records from primary storage. [2025-10-15T18:37:42.746805] [INFO ] [MAIN ] EFXT: Loaded 29628 existing records. [2025-10-15T18:37:42.936907] [WARN ] [MAIN ] EFXT: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:37:42.937286] [INFO ] [MAIN ] EFXT: Wiping existing primary data before full refresh. [2025-10-15T18:37:42.937363] [INFO ] [LOCAL ] EFXT: Starting deletion of primary data. [2025-10-15T18:37:42.938115] [DEBUG] [LOCAL ] EFXT: Deleted primary data file. [2025-10-15T18:37:42.938180] [INFO ] [MAIN ] EFXT: Starting full primary refresh. [2025-10-15T18:37:43.303182] [INFO ] [REMOTE ] EFXT: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:37:43.313967] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2024-12. [2025-10-15T18:37:44.114026] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-03. [2025-10-15T18:37:44.228016] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-15T18:37:44.914003] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-07. [2025-10-15T18:37:44.994122] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-15T18:37:45.713981] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-06. [2025-10-15T18:37:45.781096] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-15T18:37:46.312090] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-15T18:37:46.514049] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-08. [2025-10-15T18:37:46.687045] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-15T18:37:47.314103] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-01. [2025-10-15T18:37:48.114192] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-07. [2025-10-15T18:37:48.114056] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-15T18:37:48.406836] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-15T18:37:48.913984] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-09. [2025-10-15T18:37:48.985382] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-15T18:37:49.713989] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-04. [2025-10-15T18:37:50.513966] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-02. [2025-10-15T18:37:50.705579] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-15T18:37:51.313971] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-10. [2025-10-15T18:37:51.617099] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-15T18:37:51.733456] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-15T18:37:52.114030] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-05. [2025-10-15T18:37:52.914027] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-03. [2025-10-15T18:37:53.271918] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-10 (1.96 seconds). [2025-10-15T18:37:53.277679] [INFO ] [REMOTE ] EFC: Full fetch complete (66784 records). [2025-10-15T18:37:53.277790] [DEBUG] [VALIDATOR ] EFC: Validating primary data. [2025-10-15T18:37:53.705811] [DEBUG] [VALIDATOR ] EFC: All expected trading days are present. [2025-10-15T18:37:53.705930] [DEBUG] [VALIDATOR ] EFC: Primary data validation passed. [2025-10-15T18:37:53.706833] [INFO ] [MAIN ] EFC: Fetched primary data is valid. [2025-10-15T18:37:53.706982] [DEBUG] [LOCAL ] EFC: Saving primary data. [2025-10-15T18:37:53.721673] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-08. [2025-10-15T18:37:53.733147] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-15T18:37:53.733405] [DEBUG] [LOCAL ] EFC: Trimmed 66784 records to 46431 (keeping 200 days of data) [2025-10-15T18:37:54.024252] [DEBUG] [LOCAL ] EFC: Primary data saved (46431 records). [2025-10-15T18:37:54.024385] [INFO ] [MAIN ] EFC: Full history saved. [2025-10-15T18:37:54.024457] [INFO ] [MAIN ] Update Progress: 703/2369 symbols completed. EFC took 38.4s. Estimated remaining: 3h 51m 50s. Rate: 7.2 symbols/min [2025-10-15T18:37:54.192112] [INFO ] [MAIN ] EG: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:37:54.211126] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-15T18:37:54.242125] [DEBUG] [LOCAL ] EG: Loaded 27796 existing records from primary storage. [2025-10-15T18:37:54.243064] [INFO ] [MAIN ] EG: Loaded 27796 existing records. [2025-10-15T18:37:54.448251] [WARN ] [MAIN ] EG: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:37:54.448468] [INFO ] [MAIN ] EG: Wiping existing primary data before full refresh. [2025-10-15T18:37:54.448515] [INFO ] [LOCAL ] EG: Starting deletion of primary data. [2025-10-15T18:37:54.449103] [DEBUG] [LOCAL ] EG: Deleted primary data file. [2025-10-15T18:37:54.449161] [INFO ] [MAIN ] EG: Starting full primary refresh. [2025-10-15T18:37:54.517456] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-04. [2025-10-15T18:37:54.580506] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-15T18:37:54.841797] [INFO ] [REMOTE ] EG: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:37:55.314070] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-06. [2025-10-15T18:37:56.100354] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-15T18:37:56.113943] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-05. [2025-10-15T18:37:56.913998] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-09. [2025-10-15T18:37:56.996123] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-15T18:37:57.005703] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-15T18:37:57.697437] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-15T18:37:57.713950] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-10. [2025-10-15T18:37:58.513998] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-06. [2025-10-15T18:37:58.604457] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-15T18:37:58.606688] [INFO ] [REMOTE ] EFT: Full fetch complete (17973 records). [2025-10-15T18:37:58.606767] [DEBUG] [VALIDATOR ] EFT: Validating primary data. [2025-10-15T18:37:58.965424] [DEBUG] [VALIDATOR ] EFT: All expected trading days are present. [2025-10-15T18:37:58.965500] [DEBUG] [VALIDATOR ] EFT: Primary data validation passed. [2025-10-15T18:37:58.965844] [INFO ] [MAIN ] EFT: Fetched primary data is valid. [2025-10-15T18:37:58.965905] [DEBUG] [LOCAL ] EFT: Saving primary data. [2025-10-15T18:37:58.966404] [DEBUG] [LOCAL ] EFT: Trimmed 17973 records to 13087 (keeping 200 days of data) [2025-10-15T18:37:59.043766] [DEBUG] [LOCAL ] EFT: Primary data saved (13087 records). [2025-10-15T18:37:59.043902] [INFO ] [MAIN ] EFT: Full history saved. [2025-10-15T18:37:59.043985] [INFO ] [MAIN ] Update Progress: 704/2369 symbols completed. EFT took 36.9s. Estimated remaining: 3h 51m 34s. Rate: 7.2 symbols/min [2025-10-15T18:37:59.207766] [INFO ] [MAIN ] EGO: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:37:59.254730] [DEBUG] [LOCAL ] EGO: Loaded 51710 existing records from primary storage. [2025-10-15T18:37:59.255043] [INFO ] [MAIN ] EGO: Loaded 51710 existing records. [2025-10-15T18:37:59.316427] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-07. [2025-10-15T18:37:59.438107] [WARN ] [MAIN ] EGO: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:37:59.438483] [INFO ] [MAIN ] EGO: Wiping existing primary data before full refresh. [2025-10-15T18:37:59.438588] [INFO ] [LOCAL ] EGO: Starting deletion of primary data. [2025-10-15T18:37:59.444678] [DEBUG] [LOCAL ] EGO: Deleted primary data file. [2025-10-15T18:37:59.453291] [INFO ] [MAIN ] EGO: Starting full primary refresh. [2025-10-15T18:37:59.496618] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-15T18:37:59.802760] [INFO ] [REMOTE ] EGO: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:38:00.113989] [INFO ] [REMOTE ] EG: Fetching primary data for 2024-12. [2025-10-15T18:38:00.914059] [INFO ] [REMOTE ] EGO: Fetching primary data for 2024-12. [2025-10-15T18:38:01.121391] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-15T18:38:01.603194] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-15T18:38:01.713962] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-01. [2025-10-15T18:38:02.513991] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-08. [2025-10-15T18:38:02.923628] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-10-15T18:38:03.094864] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-15T18:38:03.314021] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-02. [2025-10-15T18:38:03.739793] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-15T18:38:04.114001] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-07. [2025-10-15T18:38:04.914022] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-09. [2025-10-15T18:38:05.060295] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-15T18:38:05.714054] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-03. [2025-10-15T18:38:06.186546] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-10-15T18:38:06.514025] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-08. [2025-10-15T18:38:06.667782] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-15T18:38:07.314022] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-10. [2025-10-15T18:38:07.543478] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-15T18:38:08.114009] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-04. [2025-10-15T18:38:08.614822] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-10-15T18:38:08.913989] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-09. [2025-10-15T18:38:09.465084] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-15T18:38:09.713962] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-01. [2025-10-15T18:38:09.783043] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-10 (2.47 seconds). [2025-10-15T18:38:09.788838] [INFO ] [REMOTE ] EFX: Full fetch complete (64835 records). [2025-10-15T18:38:09.788949] [DEBUG] [VALIDATOR ] EFX: Validating primary data. [2025-10-15T18:38:10.165566] [DEBUG] [VALIDATOR ] EFX: All expected trading days are present. [2025-10-15T18:38:10.165732] [DEBUG] [VALIDATOR ] EFX: Primary data validation passed. [2025-10-15T18:38:10.166572] [INFO ] [MAIN ] EFX: Fetched primary data is valid. [2025-10-15T18:38:10.166669] [DEBUG] [LOCAL ] EFX: Saving primary data. [2025-10-15T18:38:10.168038] [DEBUG] [LOCAL ] EFX: Trimmed 64835 records to 44637 (keeping 200 days of data) [2025-10-15T18:38:10.276427] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-15T18:38:10.465741] [DEBUG] [LOCAL ] EFX: Primary data saved (44637 records). [2025-10-15T18:38:10.465874] [INFO ] [MAIN ] EFX: Full history saved. [2025-10-15T18:38:10.465955] [INFO ] [MAIN ] Update Progress: 705/2369 symbols completed. EFX took 44.4s. Estimated remaining: 3h 51m 32s. Rate: 7.2 symbols/min [2025-10-15T18:38:10.519099] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-10. [2025-10-15T18:38:10.633306] [INFO ] [MAIN ] EGP: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:38:10.662474] [DEBUG] [LOCAL ] EGP: Loaded 30391 existing records from primary storage. [2025-10-15T18:38:10.662750] [INFO ] [MAIN ] EGP: Loaded 30391 existing records. [2025-10-15T18:38:10.834431] [WARN ] [MAIN ] EGP: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:38:10.834662] [INFO ] [MAIN ] EGP: Wiping existing primary data before full refresh. [2025-10-15T18:38:10.834722] [INFO ] [LOCAL ] EGP: Starting deletion of primary data. [2025-10-15T18:38:10.835310] [DEBUG] [LOCAL ] EGP: Deleted primary data file. [2025-10-15T18:38:10.835367] [INFO ] [MAIN ] EGP: Starting full primary refresh. [2025-10-15T18:38:11.183022] [INFO ] [REMOTE ] EGP: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:38:11.256299] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-15T18:38:11.313960] [INFO ] [REMOTE ] EGP: Fetching primary data for 2024-12. [2025-10-15T18:38:11.743064] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-15T18:38:11.747261] [INFO ] [REMOTE ] EFXT: Full fetch complete (44286 records). [2025-10-15T18:38:11.747346] [DEBUG] [VALIDATOR ] EFXT: Validating primary data. [2025-10-15T18:38:12.109988] [DEBUG] [VALIDATOR ] EFXT: All expected trading days are present. [2025-10-15T18:38:12.110067] [DEBUG] [VALIDATOR ] EFXT: Primary data validation passed. [2025-10-15T18:38:12.110763] [INFO ] [MAIN ] EFXT: Fetched primary data is valid. [2025-10-15T18:38:12.110826] [DEBUG] [LOCAL ] EFXT: Saving primary data. [2025-10-15T18:38:12.111815] [DEBUG] [LOCAL ] EFXT: Trimmed 44286 records to 29684 (keeping 200 days of data) [2025-10-15T18:38:12.114037] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-05. [2025-10-15T18:38:12.284943] [DEBUG] [LOCAL ] EFXT: Primary data saved (29684 records). [2025-10-15T18:38:12.285093] [INFO ] [MAIN ] EFXT: Full history saved. [2025-10-15T18:38:12.285177] [INFO ] [MAIN ] Update Progress: 706/2369 symbols completed. EFXT took 29.8s. Estimated remaining: 3h 51m 9s. Rate: 7.2 symbols/min [2025-10-15T18:38:12.453136] [INFO ] [MAIN ] EGY: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:38:12.489006] [DEBUG] [LOCAL ] EGY: Loaded 41537 existing records from primary storage. [2025-10-15T18:38:12.489339] [INFO ] [MAIN ] EGY: Loaded 41537 existing records. [2025-10-15T18:38:12.670226] [WARN ] [MAIN ] EGY: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:38:12.670489] [INFO ] [MAIN ] EGY: Wiping existing primary data before full refresh. [2025-10-15T18:38:12.670661] [INFO ] [LOCAL ] EGY: Starting deletion of primary data. [2025-10-15T18:38:12.676509] [DEBUG] [LOCAL ] EGY: Deleted primary data file. [2025-10-15T18:38:12.685736] [INFO ] [MAIN ] EGY: Starting full primary refresh. [2025-10-15T18:38:12.719933] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-15T18:38:12.919173] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-01. [2025-10-15T18:38:13.048538] [INFO ] [REMOTE ] EGY: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:38:13.714028] [INFO ] [REMOTE ] EGY: Fetching primary data for 2024-12. [2025-10-15T18:38:13.765117] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-15T18:38:14.223623] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-15T18:38:14.514042] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-02. [2025-10-15T18:38:15.313997] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-06. [2025-10-15T18:38:15.435675] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-15T18:38:15.789632] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-15T18:38:16.113981] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-03. [2025-10-15T18:38:16.577316] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-15T18:38:16.913990] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-07. [2025-10-15T18:38:17.555305] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-15T18:38:17.713992] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-04. [2025-10-15T18:38:18.273266] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-15T18:38:18.514011] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-01. [2025-10-15T18:38:19.314021] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-08. [2025-10-15T18:38:19.446674] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-15T18:38:20.080966] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-15T18:38:20.113985] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-05. [2025-10-15T18:38:20.527857] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-15T18:38:20.913969] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-02. [2025-10-15T18:38:21.353326] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-15T18:38:21.714003] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-09. [2025-10-15T18:38:22.426742] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-15T18:38:22.513993] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-03. [2025-10-15T18:38:22.746308] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-15T18:38:23.314058] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-02. [2025-10-15T18:38:24.114015] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-10. [2025-10-15T18:38:24.244112] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-15T18:38:24.914003] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-04. [2025-10-15T18:38:24.994239] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-15T18:38:25.124732] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-15T18:38:25.127909] [INFO ] [REMOTE ] EG: Full fetch complete (43188 records). [2025-10-15T18:38:25.127984] [DEBUG] [VALIDATOR ] EG: Validating primary data. [2025-10-15T18:38:25.488491] [DEBUG] [VALIDATOR ] EG: All expected trading days are present. [2025-10-15T18:38:25.488563] [DEBUG] [VALIDATOR ] EG: Primary data validation passed. [2025-10-15T18:38:25.489246] [INFO ] [MAIN ] EG: Fetched primary data is valid. [2025-10-15T18:38:25.489329] [DEBUG] [LOCAL ] EG: Saving primary data. [2025-10-15T18:38:25.490187] [DEBUG] [LOCAL ] EG: Trimmed 43188 records to 27797 (keeping 200 days of data) [2025-10-15T18:38:25.657761] [DEBUG] [LOCAL ] EG: Primary data saved (27797 records). [2025-10-15T18:38:25.657885] [INFO ] [MAIN ] EG: Full history saved. [2025-10-15T18:38:25.657962] [INFO ] [MAIN ] Update Progress: 707/2369 symbols completed. EG took 31.6s. Estimated remaining: 3h 51m 12s. Rate: 7.2 symbols/min [2025-10-15T18:38:25.721024] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-06. [2025-10-15T18:38:25.833248] [INFO ] [MAIN ] EHAB: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:38:25.860922] [DEBUG] [LOCAL ] EHAB: Loaded 29326 existing records from primary storage. [2025-10-15T18:38:25.861174] [INFO ] [MAIN ] EHAB: Loaded 29326 existing records. [2025-10-15T18:38:26.031136] [WARN ] [MAIN ] EHAB: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:38:26.031350] [INFO ] [MAIN ] EHAB: Wiping existing primary data before full refresh. [2025-10-15T18:38:26.031404] [INFO ] [LOCAL ] EHAB: Starting deletion of primary data. [2025-10-15T18:38:26.031732] [DEBUG] [LOCAL ] EHAB: Deleted primary data file. [2025-10-15T18:38:26.031790] [INFO ] [MAIN ] EHAB: Starting full primary refresh. [2025-10-15T18:38:26.374397] [INFO ] [REMOTE ] EHAB: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:38:26.513955] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2024-12. [2025-10-15T18:38:26.775445] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-15T18:38:27.066467] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-15T18:38:27.314008] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-05. [2025-10-15T18:38:27.645324] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-15T18:38:28.114019] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-03. [2025-10-15T18:38:28.614948] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-15T18:38:28.914076] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-06. [2025-10-15T18:38:29.714010] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-01. [2025-10-15T18:38:29.947738] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-15T18:38:30.380328] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-15T18:38:30.513963] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-04. [2025-10-15T18:38:30.894999] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-15T18:38:31.313992] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-07. [2025-10-15T18:38:31.980495] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-15T18:38:32.113981] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-05. [2025-10-15T18:38:32.778385] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-15T18:38:32.914002] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-08. [2025-10-15T18:38:33.386185] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-15T18:38:33.714062] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-07. [2025-10-15T18:38:34.189151] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-15T18:38:34.514021] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-06. [2025-10-15T18:38:35.107598] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-15T18:38:35.314073] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-02. [2025-10-15T18:38:36.113993] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-09. [2025-10-15T18:38:36.137263] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-15T18:38:36.378803] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-15T18:38:36.914078] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-03. [2025-10-15T18:38:37.150166] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-15T18:38:37.714053] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-10. [2025-10-15T18:38:38.240343] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-15T18:38:38.514008] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-08. [2025-10-15T18:38:38.979025] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-15T18:38:38.982847] [INFO ] [REMOTE ] EGP: Full fetch complete (45568 records). [2025-10-15T18:38:38.982974] [DEBUG] [VALIDATOR ] EGP: Validating primary data. [2025-10-15T18:38:39.323764] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-07. [2025-10-15T18:38:39.376570] [DEBUG] [VALIDATOR ] EGP: All expected trading days are present. [2025-10-15T18:38:39.376799] [DEBUG] [VALIDATOR ] EGP: Primary data validation passed. [2025-10-15T18:38:39.377498] [INFO ] [MAIN ] EGP: Fetched primary data is valid. [2025-10-15T18:38:39.377541] [DEBUG] [LOCAL ] EGP: Saving primary data. [2025-10-15T18:38:39.378676] [DEBUG] [LOCAL ] EGP: Trimmed 45568 records to 30418 (keeping 200 days of data) [2025-10-15T18:38:39.579461] [DEBUG] [LOCAL ] EGP: Primary data saved (30418 records). [2025-10-15T18:38:39.579711] [INFO ] [MAIN ] EGP: Full history saved. [2025-10-15T18:38:39.579817] [INFO ] [MAIN ] Update Progress: 708/2369 symbols completed. EGP took 29.1s. Estimated remaining: 3h 51m 17s. Rate: 7.2 symbols/min [2025-10-15T18:38:39.760391] [INFO ] [MAIN ] EHC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:38:39.801010] [DEBUG] [LOCAL ] EHC: Loaded 40988 existing records from primary storage. [2025-10-15T18:38:39.801308] [INFO ] [MAIN ] EHC: Loaded 40988 existing records. [2025-10-15T18:38:39.996772] [WARN ] [MAIN ] EHC: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:38:39.997023] [INFO ] [MAIN ] EHC: Wiping existing primary data before full refresh. [2025-10-15T18:38:39.997071] [INFO ] [LOCAL ] EHC: Starting deletion of primary data. [2025-10-15T18:38:39.997437] [DEBUG] [LOCAL ] EHC: Deleted primary data file. [2025-10-15T18:38:39.997507] [INFO ] [MAIN ] EHC: Starting full primary refresh. [2025-10-15T18:38:40.115563] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-04. [2025-10-15T18:38:40.169157] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-15T18:38:40.379101] [INFO ] [REMOTE ] EHC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:38:40.811513] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-15T18:38:40.913996] [INFO ] [REMOTE ] EHC: Fetching primary data for 2024-12. [2025-10-15T18:38:41.156989] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-15T18:38:41.714028] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-05. [2025-10-15T18:38:42.513986] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-08. [2025-10-15T18:38:42.710793] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-15T18:38:42.940697] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-15T18:38:43.314118] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-06. [2025-10-15T18:38:44.114015] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-01. [2025-10-15T18:38:44.417747] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-15T18:38:44.544006] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-15T18:38:44.914023] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-09. [2025-10-15T18:38:45.156746] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-15T18:38:45.713999] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-07. [2025-10-15T18:38:46.514041] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-09. [2025-10-15T18:38:46.726235] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-15T18:38:47.125984] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-15T18:38:47.314087] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-02. [2025-10-15T18:38:47.741777] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-15T18:38:48.113974] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-10. [2025-10-15T18:38:48.802542] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-15T18:38:48.914016] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-03. [2025-10-15T18:38:49.628566] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-15T18:38:49.633481] [INFO ] [REMOTE ] EGY: Full fetch complete (61085 records). [2025-10-15T18:38:49.633571] [DEBUG] [VALIDATOR ] EGY: Validating primary data. [2025-10-15T18:38:49.723446] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-10. [2025-10-15T18:38:50.017892] [DEBUG] [VALIDATOR ] EGY: All expected trading days are present. [2025-10-15T18:38:50.017975] [DEBUG] [VALIDATOR ] EGY: Primary data validation passed. [2025-10-15T18:38:50.019166] [INFO ] [MAIN ] EGY: Fetched primary data is valid. [2025-10-15T18:38:50.019243] [DEBUG] [LOCAL ] EGY: Saving primary data. [2025-10-15T18:38:50.020475] [DEBUG] [LOCAL ] EGY: Trimmed 61085 records to 41558 (keeping 200 days of data) [2025-10-15T18:38:50.259409] [DEBUG] [LOCAL ] EGY: Primary data saved (41558 records). [2025-10-15T18:38:50.259543] [INFO ] [MAIN ] EGY: Full history saved. [2025-10-15T18:38:50.259623] [INFO ] [MAIN ] Update Progress: 709/2369 symbols completed. EGY took 38.0s. Estimated remaining: 3h 51m 14s. Rate: 7.2 symbols/min [2025-10-15T18:38:50.436555] [INFO ] [MAIN ] EHI: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:38:50.448886] [DEBUG] [LOCAL ] EHI: Loaded 10642 existing records from primary storage. [2025-10-15T18:38:50.449150] [INFO ] [MAIN ] EHI: Loaded 10642 existing records. [2025-10-15T18:38:50.514172] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-08. [2025-10-15T18:38:50.667938] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-15T18:38:50.672177] [WARN ] [MAIN ] EHI: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:38:50.680871] [INFO ] [MAIN ] EHI: Wiping existing primary data before full refresh. [2025-10-15T18:38:50.681456] [INFO ] [LOCAL ] EHI: Starting deletion of primary data. [2025-10-15T18:38:50.682444] [DEBUG] [LOCAL ] EHI: Deleted primary data file. [2025-10-15T18:38:50.682509] [INFO ] [MAIN ] EHI: Starting full primary refresh. [2025-10-15T18:38:51.041904] [INFO ] [REMOTE ] EHI: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:38:51.314045] [INFO ] [REMOTE ] EHI: Fetching primary data for 2024-12. [2025-10-15T18:38:51.588632] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-10 (1.87 seconds). [2025-10-15T18:38:51.595226] [INFO ] [REMOTE ] EGO: Full fetch complete (74323 records). [2025-10-15T18:38:51.595373] [DEBUG] [VALIDATOR ] EGO: Validating primary data. [2025-10-15T18:38:51.987262] [DEBUG] [VALIDATOR ] EGO: All expected trading days are present. [2025-10-15T18:38:51.987554] [DEBUG] [VALIDATOR ] EGO: Primary data validation passed. [2025-10-15T18:38:51.988660] [INFO ] [MAIN ] EGO: Fetched primary data is valid. [2025-10-15T18:38:51.988824] [DEBUG] [LOCAL ] EGO: Saving primary data. [2025-10-15T18:38:52.010303] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-15T18:38:52.017278] [DEBUG] [LOCAL ] EGO: Trimmed 74323 records to 51726 (keeping 200 days of data) [2025-10-15T18:38:52.114191] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-04. [2025-10-15T18:38:52.341631] [DEBUG] [LOCAL ] EGO: Primary data saved (51726 records). [2025-10-15T18:38:52.341791] [INFO ] [MAIN ] EGO: Full history saved. [2025-10-15T18:38:52.342272] [INFO ] [MAIN ] Update Progress: 710/2369 symbols completed. EGO took 53.3s. Estimated remaining: 3h 50m 51s. Rate: 7.2 symbols/min [2025-10-15T18:38:52.522582] [INFO ] [MAIN ] EIC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:38:52.546785] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-10-15T18:38:52.558813] [DEBUG] [LOCAL ] EIC: Loaded 22893 existing records from primary storage. [2025-10-15T18:38:52.559069] [INFO ] [MAIN ] EIC: Loaded 22893 existing records. [2025-10-15T18:38:52.733271] [WARN ] [MAIN ] EIC: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:38:52.733514] [INFO ] [MAIN ] EIC: Wiping existing primary data before full refresh. [2025-10-15T18:38:52.733563] [INFO ] [LOCAL ] EIC: Starting deletion of primary data. [2025-10-15T18:38:52.733924] [DEBUG] [LOCAL ] EIC: Deleted primary data file. [2025-10-15T18:38:52.733991] [INFO ] [MAIN ] EIC: Starting full primary refresh. [2025-10-15T18:38:52.918009] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-01. [2025-10-15T18:38:53.097108] [INFO ] [REMOTE ] EIC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:38:53.714002] [INFO ] [REMOTE ] EIC: Fetching primary data for 2024-12. [2025-10-15T18:38:53.856278] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-15T18:38:54.012704] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-15T18:38:54.513998] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-05. [2025-10-15T18:38:54.964722] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-15T18:38:55.314065] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-09. [2025-10-15T18:38:56.080355] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-15T18:38:56.114000] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-06. [2025-10-15T18:38:56.454594] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-15T18:38:56.913991] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-10. [2025-10-15T18:38:57.481780] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-15T18:38:57.714023] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-07. [2025-10-15T18:38:57.997716] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-15T18:38:58.000839] [INFO ] [REMOTE ] EHAB: Full fetch complete (40989 records). [2025-10-15T18:38:58.000916] [DEBUG] [VALIDATOR ] EHAB: Validating primary data. [2025-10-15T18:38:58.367285] [DEBUG] [VALIDATOR ] EHAB: All expected trading days are present. [2025-10-15T18:38:58.367381] [DEBUG] [VALIDATOR ] EHAB: Primary data validation passed. [2025-10-15T18:38:58.368093] [INFO ] [MAIN ] EHAB: Fetched primary data is valid. [2025-10-15T18:38:58.368154] [DEBUG] [LOCAL ] EHAB: Saving primary data. [2025-10-15T18:38:58.369061] [DEBUG] [LOCAL ] EHAB: Trimmed 40989 records to 29337 (keeping 200 days of data) [2025-10-15T18:38:58.515083] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-01. [2025-10-15T18:38:58.531196] [DEBUG] [LOCAL ] EHAB: Primary data saved (29337 records). [2025-10-15T18:38:58.531287] [INFO ] [MAIN ] EHAB: Full history saved. [2025-10-15T18:38:58.531358] [INFO ] [MAIN ] Update Progress: 711/2369 symbols completed. EHAB took 32.9s. Estimated remaining: 3h 50m 38s. Rate: 7.2 symbols/min [2025-10-15T18:38:58.717829] [INFO ] [MAIN ] EICA: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:38:58.717992] [DEBUG] [LOCAL ] EICA: No existing data file found in primary storage. [2025-10-15T18:38:58.718028] [WARN ] [MAIN ] EICA: No existing data found, performing full refresh instead. [2025-10-15T18:38:58.718164] [INFO ] [MAIN ] EICA: Wiping existing primary data before full refresh. [2025-10-15T18:38:58.718235] [INFO ] [LOCAL ] EICA: Starting deletion of primary data. [2025-10-15T18:38:58.718303] [DEBUG] [LOCAL ] EICA: No primary data file found to delete. [2025-10-15T18:38:58.718343] [INFO ] [MAIN ] EICA: Starting full primary refresh. [2025-10-15T18:38:59.082862] [INFO ] [REMOTE ] EICA: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:38:59.160954] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-15T18:38:59.267464] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-15T18:38:59.313956] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-02. [2025-10-15T18:39:00.114022] [INFO ] [REMOTE ] EICA: Fetching primary data for 2024-12. [2025-10-15T18:39:00.418731] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-15T18:39:00.568765] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2024-12 (0.45 seconds). [2025-10-15T18:39:00.914043] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-03. [2025-10-15T18:39:01.714058] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-01. [2025-10-15T18:39:02.143805] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-15T18:39:02.244621] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-10-15T18:39:02.513994] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-02. [2025-10-15T18:39:02.770567] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-02 (0.26 seconds). [2025-10-15T18:39:03.314004] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-02. [2025-10-15T18:39:04.114000] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-03. [2025-10-15T18:39:04.436945] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-03 (0.32 seconds). [2025-10-15T18:39:04.475538] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-15T18:39:04.914008] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-03. [2025-10-15T18:39:05.696859] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-15T18:39:05.713983] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-04. [2025-10-15T18:39:06.487705] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-15T18:39:06.514020] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-05. [2025-10-15T18:39:07.314039] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-04. [2025-10-15T18:39:07.352085] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-15T18:39:08.114021] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-08. [2025-10-15T18:39:08.478209] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-15T18:39:08.914069] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-04. [2025-10-15T18:39:09.260311] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-04 (0.35 seconds). [2025-10-15T18:39:09.714016] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-05. [2025-10-15T18:39:09.746545] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-15T18:39:10.068438] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-10-15T18:39:10.514029] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-09. [2025-10-15T18:39:11.313999] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-05. [2025-10-15T18:39:12.001143] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-15T18:39:12.114031] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-06. [2025-10-15T18:39:12.380182] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-15T18:39:12.533395] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-10-15T18:39:12.914004] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-10. [2025-10-15T18:39:13.713996] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-07. [2025-10-15T18:39:14.277504] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-15T18:39:14.290935] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-15T18:39:14.296942] [INFO ] [REMOTE ] EHC: Full fetch complete (58563 records). [2025-10-15T18:39:14.297088] [DEBUG] [VALIDATOR ] EHC: Validating primary data. [2025-10-15T18:39:14.298045] [FATAL] [VALIDATOR ] EHC: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T18:39:14.298165] [FATAL] [MAIN ] EHC: Fetched primary data is invalid. Refusing to save it. [2025-10-15T18:39:14.298237] [WARN ] [MAIN ] EHC: Deleting existing primary and derivative data due to validation failure. [2025-10-15T18:39:14.298303] [INFO ] [LOCAL ] EHC: Starting deletion of primary data. [2025-10-15T18:39:14.298387] [DEBUG] [LOCAL ] EHC: No primary data file found to delete. [2025-10-15T18:39:14.298427] [INFO ] [LOCAL ] EHC: Starting deletion of derivative data. [2025-10-15T18:39:14.298628] [DEBUG] [LOCAL ] EHC: Deleted derivative data file. [2025-10-15T18:39:14.298792] [INFO ] [MAIN ] Update Progress: 712/2369 symbols completed. EHC took 34.7s. Estimated remaining: 3h 50m 47s. Rate: 7.2 symbols/min [2025-10-15T18:39:14.494402] [INFO ] [MAIN ] EICB: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:39:14.494579] [DEBUG] [LOCAL ] EICB: No existing data file found in primary storage. [2025-10-15T18:39:14.494618] [WARN ] [MAIN ] EICB: No existing data found, performing full refresh instead. [2025-10-15T18:39:14.494803] [INFO ] [MAIN ] EICB: Wiping existing primary data before full refresh. [2025-10-15T18:39:14.494852] [INFO ] [LOCAL ] EICB: Starting deletion of primary data. [2025-10-15T18:39:14.494895] [DEBUG] [LOCAL ] EICB: No primary data file found to delete. [2025-10-15T18:39:14.494926] [INFO ] [MAIN ] EICB: Starting full primary refresh. [2025-10-15T18:39:14.519069] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-06. [2025-10-15T18:39:14.853629] [INFO ] [REMOTE ] EICB: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:39:15.313987] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-08. [2025-10-15T18:39:15.791424] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-10-15T18:39:15.810114] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-15T18:39:16.113994] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-09. [2025-10-15T18:39:16.439668] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-09 (0.33 seconds). [2025-10-15T18:39:16.913994] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-10. [2025-10-15T18:39:17.308432] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-10 (0.39 seconds). [2025-10-15T18:39:17.309250] [INFO ] [REMOTE ] EICA: Full fetch complete (1283 records). [2025-10-15T18:39:17.309320] [DEBUG] [VALIDATOR ] EICA: Validating primary data. [2025-10-15T18:39:17.485866] [WARN ] [VALIDATOR ] EICA: Validation failed - insufficient historical data. Have 193 unique days, need 200 days [2025-10-15T18:39:17.486033] [FATAL] [MAIN ] EICA: Fetched primary data is invalid. Refusing to save it. [2025-10-15T18:39:17.486079] [WARN ] [MAIN ] EICA: Deleting existing primary and derivative data due to validation failure. [2025-10-15T18:39:17.486120] [INFO ] [LOCAL ] EICA: Starting deletion of primary data. [2025-10-15T18:39:17.486176] [DEBUG] [LOCAL ] EICA: No primary data file found to delete. [2025-10-15T18:39:17.486211] [INFO ] [LOCAL ] EICA: Starting deletion of derivative data. [2025-10-15T18:39:17.486250] [DEBUG] [LOCAL ] EICA: No derivative data file found to delete. [2025-10-15T18:39:17.486304] [INFO ] [MAIN ] Update Progress: 713/2369 symbols completed. EICA took 19.0s. Estimated remaining: 3h 50m 26s. Rate: 7.2 symbols/min [2025-10-15T18:39:17.659148] [INFO ] [MAIN ] EICC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:39:17.659346] [DEBUG] [LOCAL ] EICC: No existing data file found in primary storage. [2025-10-15T18:39:17.659392] [WARN ] [MAIN ] EICC: No existing data found, performing full refresh instead. [2025-10-15T18:39:17.659502] [INFO ] [MAIN ] EICC: Wiping existing primary data before full refresh. [2025-10-15T18:39:17.659541] [INFO ] [LOCAL ] EICC: Starting deletion of primary data. [2025-10-15T18:39:17.659581] [DEBUG] [LOCAL ] EICC: No primary data file found to delete. [2025-10-15T18:39:17.659611] [INFO ] [MAIN ] EICC: Starting full primary refresh. [2025-10-15T18:39:17.721051] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-06. [2025-10-15T18:39:18.018749] [INFO ] [REMOTE ] EICC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:39:18.513996] [INFO ] [REMOTE ] EICC: Fetching primary data for 2024-12. [2025-10-15T18:39:18.759926] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-15T18:39:18.956140] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2024-12 (0.44 seconds). [2025-10-15T18:39:19.314025] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-01. [2025-10-15T18:39:19.858714] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-10-15T18:39:20.113990] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-02. [2025-10-15T18:39:20.601202] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-15T18:39:20.914073] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-07. [2025-10-15T18:39:21.556833] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-10-15T18:39:21.714007] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-08. [2025-10-15T18:39:22.504142] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-15T18:39:22.513948] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-09. [2025-10-15T18:39:23.276350] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-15T18:39:23.313969] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-10. [2025-10-15T18:39:24.086918] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-15T18:39:24.089951] [INFO ] [REMOTE ] EHI: Full fetch complete (16104 records). [2025-10-15T18:39:24.090050] [DEBUG] [VALIDATOR ] EHI: Validating primary data. [2025-10-15T18:39:24.121007] [INFO ] [REMOTE ] EICB: Fetching primary data for 2024-12. [2025-10-15T18:39:24.493194] [DEBUG] [VALIDATOR ] EHI: All expected trading days are present. [2025-10-15T18:39:24.493279] [DEBUG] [VALIDATOR ] EHI: Primary data validation passed. [2025-10-15T18:39:24.493688] [INFO ] [MAIN ] EHI: Fetched primary data is valid. [2025-10-15T18:39:24.493749] [DEBUG] [LOCAL ] EHI: Saving primary data. [2025-10-15T18:39:24.494273] [DEBUG] [LOCAL ] EHI: Trimmed 16104 records to 10605 (keeping 200 days of data) [2025-10-15T18:39:24.553295] [DEBUG] [LOCAL ] EHI: Primary data saved (10605 records). [2025-10-15T18:39:24.553425] [INFO ] [MAIN ] EHI: Full history saved. [2025-10-15T18:39:24.553504] [INFO ] [MAIN ] Update Progress: 714/2369 symbols completed. EHI took 34.3s. Estimated remaining: 3h 50m 15s. Rate: 7.2 symbols/min [2025-10-15T18:39:24.719020] [INFO ] [MAIN ] EIG: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:39:24.739466] [DEBUG] [LOCAL ] EIG: Loaded 20149 existing records from primary storage. [2025-10-15T18:39:24.739754] [INFO ] [MAIN ] EIG: Loaded 20149 existing records. [2025-10-15T18:39:24.843384] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-10-15T18:39:24.916813] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-03. [2025-10-15T18:39:24.921375] [WARN ] [MAIN ] EIG: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:39:24.921665] [INFO ] [MAIN ] EIG: Wiping existing primary data before full refresh. [2025-10-15T18:39:24.921725] [INFO ] [LOCAL ] EIG: Starting deletion of primary data. [2025-10-15T18:39:24.921993] [DEBUG] [LOCAL ] EIG: Deleted primary data file. [2025-10-15T18:39:24.922031] [INFO ] [MAIN ] EIG: Starting full primary refresh. [2025-10-15T18:39:25.270863] [INFO ] [REMOTE ] EIG: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:39:25.570988] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-15T18:39:25.713986] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-04. [2025-10-15T18:39:26.398072] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-10-15T18:39:26.514023] [INFO ] [REMOTE ] EIG: Fetching primary data for 2024-12. [2025-10-15T18:39:27.314029] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-07. [2025-10-15T18:39:27.905691] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-15T18:39:28.114009] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-01. [2025-10-15T18:39:28.455995] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-15T18:39:28.914008] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-08. [2025-10-15T18:39:29.123002] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-15T18:39:29.714070] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-05. [2025-10-15T18:39:30.051761] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-15T18:39:30.134393] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-10-15T18:39:30.514012] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-06. [2025-10-15T18:39:31.092943] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-15T18:39:31.314100] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-01. [2025-10-15T18:39:31.753767] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-10-15T18:39:32.114008] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-02. [2025-10-15T18:39:32.463730] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-10-15T18:39:32.914066] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-09. [2025-10-15T18:39:33.713997] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-07. [2025-10-15T18:39:33.835679] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-15T18:39:34.470001] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-15T18:39:34.514028] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-10. [2025-10-15T18:39:35.313970] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-02. [2025-10-15T18:39:35.476458] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-15T18:39:35.479170] [INFO ] [REMOTE ] EIC: Full fetch complete (34403 records). [2025-10-15T18:39:35.479264] [DEBUG] [VALIDATOR ] EIC: Validating primary data. [2025-10-15T18:39:35.843724] [DEBUG] [VALIDATOR ] EIC: All expected trading days are present. [2025-10-15T18:39:35.843804] [DEBUG] [VALIDATOR ] EIC: Primary data validation passed. [2025-10-15T18:39:35.844393] [INFO ] [MAIN ] EIC: Fetched primary data is valid. [2025-10-15T18:39:35.844432] [DEBUG] [LOCAL ] EIC: Saving primary data. [2025-10-15T18:39:35.845175] [DEBUG] [LOCAL ] EIC: Trimmed 34403 records to 22908 (keeping 200 days of data) [2025-10-15T18:39:35.988042] [DEBUG] [LOCAL ] EIC: Primary data saved (22908 records). [2025-10-15T18:39:35.988193] [INFO ] [MAIN ] EIC: Full history saved. [2025-10-15T18:39:35.988286] [INFO ] [MAIN ] Update Progress: 715/2369 symbols completed. EIC took 43.6s. Estimated remaining: 3h 50m 14s. Rate: 7.2 symbols/min [2025-10-15T18:39:36.118936] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-03. [2025-10-15T18:39:36.164553] [INFO ] [MAIN ] EIX: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:39:36.213924] [DEBUG] [LOCAL ] EIX: Loaded 53370 existing records from primary storage. [2025-10-15T18:39:36.214310] [INFO ] [MAIN ] EIX: Loaded 53370 existing records. [2025-10-15T18:39:36.330123] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-15T18:39:36.414540] [WARN ] [MAIN ] EIX: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:39:36.414810] [INFO ] [MAIN ] EIX: Wiping existing primary data before full refresh. [2025-10-15T18:39:36.414864] [INFO ] [LOCAL ] EIX: Starting deletion of primary data. [2025-10-15T18:39:36.415189] [DEBUG] [LOCAL ] EIX: Deleted primary data file. [2025-10-15T18:39:36.415251] [INFO ] [MAIN ] EIX: Starting full primary refresh. [2025-10-15T18:39:36.772922] [INFO ] [REMOTE ] EIX: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:39:36.799815] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-15T18:39:36.913983] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-04. [2025-10-15T18:39:37.343025] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-10-15T18:39:37.714049] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-05. [2025-10-15T18:39:38.195665] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-10-15T18:39:38.514015] [INFO ] [REMOTE ] EIX: Fetching primary data for 2024-12. [2025-10-15T18:39:39.314014] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-08. [2025-10-15T18:39:39.911696] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-15T18:39:40.114067] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-09. [2025-10-15T18:39:40.337031] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-15T18:39:40.815210] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-15T18:39:40.913982] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-10. [2025-10-15T18:39:41.560587] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-15T18:39:41.561982] [INFO ] [REMOTE ] EICC: Full fetch complete (8459 records). [2025-10-15T18:39:41.562050] [DEBUG] [VALIDATOR ] EICC: Validating primary data. [2025-10-15T18:39:41.562514] [FATAL] [VALIDATOR ] EICC: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T18:39:41.562594] [FATAL] [MAIN ] EICC: Fetched primary data is invalid. Refusing to save it. [2025-10-15T18:39:41.562635] [WARN ] [MAIN ] EICC: Deleting existing primary and derivative data due to validation failure. [2025-10-15T18:39:41.562724] [INFO ] [LOCAL ] EICC: Starting deletion of primary data. [2025-10-15T18:39:41.562784] [DEBUG] [LOCAL ] EICC: No primary data file found to delete. [2025-10-15T18:39:41.562817] [INFO ] [LOCAL ] EICC: Starting deletion of derivative data. [2025-10-15T18:39:41.562855] [DEBUG] [LOCAL ] EICC: No derivative data file found to delete. [2025-10-15T18:39:41.562905] [INFO ] [MAIN ] Update Progress: 716/2369 symbols completed. EICC took 24.1s. Estimated remaining: 3h 49m 59s. Rate: 7.2 symbols/min [2025-10-15T18:39:41.719985] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-03. [2025-10-15T18:39:41.746173] [INFO ] [MAIN ] EL: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:39:41.819865] [DEBUG] [LOCAL ] EL: Loaded 53376 existing records from primary storage. [2025-10-15T18:39:41.820453] [INFO ] [MAIN ] EL: Loaded 53376 existing records. [2025-10-15T18:39:42.015734] [WARN ] [MAIN ] EL: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:39:42.016045] [INFO ] [MAIN ] EL: Wiping existing primary data before full refresh. [2025-10-15T18:39:42.016106] [INFO ] [LOCAL ] EL: Starting deletion of primary data. [2025-10-15T18:39:42.016503] [DEBUG] [LOCAL ] EL: Deleted primary data file. [2025-10-15T18:39:42.016560] [INFO ] [MAIN ] EL: Starting full primary refresh. [2025-10-15T18:39:42.381321] [INFO ] [REMOTE ] EL: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:39:42.513979] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-06. [2025-10-15T18:39:42.804551] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-06 (0.29 seconds). [2025-10-15T18:39:42.837901] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-15T18:39:43.314005] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-01. [2025-10-15T18:39:44.114000] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-07. [2025-10-15T18:39:44.565069] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-10-15T18:39:44.913973] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-08. [2025-10-15T18:39:45.103500] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-15T18:39:45.358334] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-10-15T18:39:45.714031] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-02. [2025-10-15T18:39:46.514009] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-09. [2025-10-15T18:39:47.030606] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-10-15T18:39:47.314039] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-10. [2025-10-15T18:39:47.532355] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-15T18:39:47.803478] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-15T18:39:47.804527] [INFO ] [REMOTE ] EICB: Full fetch complete (2737 records). [2025-10-15T18:39:47.804595] [DEBUG] [VALIDATOR ] EICB: Validating primary data. [2025-10-15T18:39:47.985894] [WARN ] [VALIDATOR ] EICB: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-15T18:39:47.986091] [FATAL] [MAIN ] EICB: Fetched primary data is invalid. Refusing to save it. [2025-10-15T18:39:47.986136] [WARN ] [MAIN ] EICB: Deleting existing primary and derivative data due to validation failure. [2025-10-15T18:39:47.986200] [INFO ] [LOCAL ] EICB: Starting deletion of primary data. [2025-10-15T18:39:47.986279] [DEBUG] [LOCAL ] EICB: No primary data file found to delete. [2025-10-15T18:39:47.986314] [INFO ] [LOCAL ] EICB: Starting deletion of derivative data. [2025-10-15T18:39:47.986353] [DEBUG] [LOCAL ] EICB: No derivative data file found to delete. [2025-10-15T18:39:47.986408] [INFO ] [MAIN ] Update Progress: 717/2369 symbols completed. EICB took 33.7s. Estimated remaining: 3h 49m 46s. Rate: 7.2 symbols/min [2025-10-15T18:39:48.114032] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-04. [2025-10-15T18:39:48.913969] [INFO ] [REMOTE ] EL: Fetching primary data for 2024-12. [2025-10-15T18:39:49.189209] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-15T18:39:49.714058] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-05. [2025-10-15T18:39:50.514079] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-03. [2025-10-15T18:39:50.550742] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-15T18:39:50.913436] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2024-12 (2.00 seconds). [2025-10-15T18:39:51.314035] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-06. [2025-10-15T18:39:52.114076] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-01. [2025-10-15T18:39:52.336159] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-15T18:39:52.407420] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-15T18:39:52.914016] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-04. [2025-10-15T18:39:53.714046] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-07. [2025-10-15T18:39:54.073113] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-10-15T18:39:54.513956] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-02. [2025-10-15T18:39:54.902523] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-15T18:39:54.927698] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-15T18:39:55.314063] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-08. [2025-10-15T18:39:56.114058] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-05. [2025-10-15T18:39:56.522211] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-02 (2.01 seconds). [2025-10-15T18:39:56.606175] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-15T18:39:56.914001] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-09. [2025-10-15T18:39:57.713968] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-03. [2025-10-15T18:39:57.898436] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-15T18:39:57.931250] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-15T18:39:58.514050] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-06. [2025-10-15T18:39:59.314049] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-10. [2025-10-15T18:39:59.918414] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-03 (2.20 seconds). [2025-10-15T18:40:00.116434] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-04. [2025-10-15T18:40:00.120929] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-15T18:40:00.123964] [INFO ] [REMOTE ] EIG: Full fetch complete (27124 records). [2025-10-15T18:40:00.124087] [DEBUG] [VALIDATOR ] EIG: Validating primary data. [2025-10-15T18:40:00.600448] [DEBUG] [VALIDATOR ] EIG: All expected trading days are present. [2025-10-15T18:40:00.600563] [DEBUG] [VALIDATOR ] EIG: Primary data validation passed. [2025-10-15T18:40:00.601287] [INFO ] [MAIN ] EIG: Fetched primary data is valid. [2025-10-15T18:40:00.601389] [DEBUG] [LOCAL ] EIG: Saving primary data. [2025-10-15T18:40:00.602365] [DEBUG] [LOCAL ] EIG: Trimmed 27124 records to 20221 (keeping 200 days of data) [2025-10-15T18:40:00.754096] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-06 (2.24 seconds). [2025-10-15T18:40:00.781223] [DEBUG] [LOCAL ] EIG: Primary data saved (20221 records). [2025-10-15T18:40:00.781364] [INFO ] [MAIN ] EIG: Full history saved. [2025-10-15T18:40:00.781447] [INFO ] [MAIN ] Update Progress: 718/2369 symbols completed. EIG took 36.2s. Estimated remaining: 3h 49m 48s. Rate: 7.2 symbols/min [2025-10-15T18:40:00.914020] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-07. [2025-10-15T18:40:02.325563] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-04 (2.21 seconds). [2025-10-15T18:40:02.337085] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-05. [2025-10-15T18:40:03.304335] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-07 (2.39 seconds). [2025-10-15T18:40:03.318450] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-08. [2025-10-15T18:40:04.165332] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-15T18:40:04.176301] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-06. [2025-10-15T18:40:05.176357] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-15T18:40:05.187831] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-09. [2025-10-15T18:40:06.284541] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-06 (2.11 seconds). [2025-10-15T18:40:06.295376] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-07. [2025-10-15T18:40:06.761945] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-15T18:40:06.774905] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-10. [2025-10-15T18:40:07.450250] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-15T18:40:07.456589] [INFO ] [REMOTE ] EIX: Full fetch complete (77401 records). [2025-10-15T18:40:07.456744] [DEBUG] [VALIDATOR ] EIX: Validating primary data. [2025-10-15T18:40:07.841360] [DEBUG] [VALIDATOR ] EIX: All expected trading days are present. [2025-10-15T18:40:07.841446] [DEBUG] [VALIDATOR ] EIX: Primary data validation passed. [2025-10-15T18:40:07.842408] [INFO ] [MAIN ] EIX: Fetched primary data is valid. [2025-10-15T18:40:07.842473] [DEBUG] [LOCAL ] EIX: Saving primary data. [2025-10-15T18:40:07.843914] [DEBUG] [LOCAL ] EIX: Trimmed 77401 records to 53375 (keeping 200 days of data) [2025-10-15T18:40:08.197715] [DEBUG] [LOCAL ] EIX: Primary data saved (53375 records). [2025-10-15T18:40:08.197938] [INFO ] [MAIN ] EIX: Full history saved. [2025-10-15T18:40:08.198342] [INFO ] [MAIN ] Update Progress: 719/2369 symbols completed. EIX took 32.2s. Estimated remaining: 3h 49m 38s. Rate: 7.2 symbols/min [2025-10-15T18:40:08.556695] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-07 (2.26 seconds). [2025-10-15T18:40:08.568425] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-08. [2025-10-15T18:40:10.490299] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-15T18:40:10.501808] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-09. [2025-10-15T18:40:12.571836] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-09 (2.07 seconds). [2025-10-15T18:40:12.583465] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-10. [2025-10-15T18:40:13.466319] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-15T18:40:13.472665] [INFO ] [REMOTE ] EL: Full fetch complete (77433 records). [2025-10-15T18:40:13.472781] [DEBUG] [VALIDATOR ] EL: Validating primary data. [2025-10-15T18:40:13.856434] [DEBUG] [VALIDATOR ] EL: All expected trading days are present. [2025-10-15T18:40:13.856535] [DEBUG] [VALIDATOR ] EL: Primary data validation passed. [2025-10-15T18:40:13.857490] [INFO ] [MAIN ] EL: Fetched primary data is valid. [2025-10-15T18:40:13.857580] [DEBUG] [LOCAL ] EL: Saving primary data. [2025-10-15T18:40:13.859755] [DEBUG] [LOCAL ] EL: Trimmed 77433 records to 53376 (keeping 200 days of data) [2025-10-15T18:40:14.175191] [DEBUG] [LOCAL ] EL: Primary data saved (53376 records). [2025-10-15T18:40:14.175321] [INFO ] [MAIN ] EL: Full history saved. [2025-10-15T18:40:14.176179] [INFO ] [MAIN ] Update Progress: 720/2369 symbols completed. EL took 32.6s. Estimated remaining: 3h 49m 24s. Rate: 7.2 symbols/min [2025-10-15T18:40:14.835324] [INFO ] [MAIN ] ELAN: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:40:14.875758] [INFO ] [MAIN ] ELF: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:40:14.879882] [DEBUG] [LOCAL ] ELAN: No existing data file found in primary storage. [2025-10-15T18:40:14.879713] [INFO ] [MAIN ] ELC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:40:14.823841] [INFO ] [MAIN ] ELME: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:40:14.880744] [WARN ] [MAIN ] ELAN: No existing data found, performing full refresh instead. [2025-10-15T18:40:14.880983] [INFO ] [MAIN ] ELAN: Wiping existing primary data before full refresh. [2025-10-15T18:40:14.881119] [INFO ] [LOCAL ] ELAN: Starting deletion of primary data. [2025-10-15T18:40:14.881176] [DEBUG] [LOCAL ] ELAN: No primary data file found to delete. [2025-10-15T18:40:14.881210] [INFO ] [MAIN ] ELAN: Starting full primary refresh. [2025-10-15T18:40:14.949341] [DEBUG] [LOCAL ] ELC: Loaded 3486 existing records from primary storage. [2025-10-15T18:40:14.970503] [INFO ] [MAIN ] ELC: Loaded 3486 existing records. [2025-10-15T18:40:15.387419] [DEBUG] [LOCAL ] ELME: Loaded 39385 existing records from primary storage. [2025-10-15T18:40:15.380871] [WARN ] [MAIN ] ELC: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:40:15.403794] [INFO ] [MAIN ] ELME: Loaded 39385 existing records. [2025-10-15T18:40:15.445661] [INFO ] [MAIN ] ELC: Wiping existing primary data before full refresh. [2025-10-15T18:40:15.436177] [DEBUG] [LOCAL ] ELF: Loaded 52038 existing records from primary storage. [2025-10-15T18:40:15.486183] [INFO ] [LOCAL ] ELC: Starting deletion of primary data. [2025-10-15T18:40:15.522488] [DEBUG] [LOCAL ] ELC: Deleted primary data file. [2025-10-15T18:40:15.540908] [INFO ] [MAIN ] ELC: Starting full primary refresh. [2025-10-15T18:40:15.503264] [INFO ] [MAIN ] ELF: Loaded 52038 existing records. [2025-10-15T18:40:15.635624] [INFO ] [REMOTE ] ELAN: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:40:15.674556] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2024-12. [2025-10-15T18:40:15.934160] [WARN ] [MAIN ] ELME: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:40:15.979391] [INFO ] [MAIN ] ELME: Wiping existing primary data before full refresh. [2025-10-15T18:40:16.043689] [INFO ] [LOCAL ] ELME: Starting deletion of primary data. [2025-10-15T18:40:16.101323] [WARN ] [MAIN ] ELF: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:40:16.113853] [DEBUG] [LOCAL ] ELME: Deleted primary data file. [2025-10-15T18:40:16.114086] [INFO ] [MAIN ] ELME: Starting full primary refresh. [2025-10-15T18:40:16.128048] [INFO ] [MAIN ] ELF: Wiping existing primary data before full refresh. [2025-10-15T18:40:16.155126] [INFO ] [LOCAL ] ELF: Starting deletion of primary data. [2025-10-15T18:40:16.260272] [DEBUG] [LOCAL ] ELF: Deleted primary data file. [2025-10-15T18:40:16.263696] [INFO ] [MAIN ] ELF: Starting full primary refresh. [2025-10-15T18:40:16.429250] [INFO ] [REMOTE ] ELC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:40:16.467992] [INFO ] [REMOTE ] ELC: Fetching primary data for 2024-12. [2025-10-15T18:40:16.930595] [INFO ] [REMOTE ] ELME: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:40:16.941338] [INFO ] [REMOTE ] ELME: Fetching primary data for 2024-12. [2025-10-15T18:40:17.008750] [INFO ] [REMOTE ] ELF: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:40:17.009014] [INFO ] [REMOTE ] ELF: Fetching primary data for 2024-12. [2025-10-15T18:40:17.486119] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-15T18:40:17.487775] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-01. [2025-10-15T18:40:18.055265] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-15T18:40:18.056988] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-02. [2025-10-15T18:40:18.391963] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-10-15T18:40:18.393341] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-03. [2025-10-15T18:40:18.536769] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-15T18:40:18.545278] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-01. [2025-10-15T18:40:18.922751] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-10-15T18:40:18.924149] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-04. [2025-10-15T18:40:19.171069] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2024-12 (2.16 seconds). [2025-10-15T18:40:19.181293] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-01. [2025-10-15T18:40:19.275022] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2024-12 (3.60 seconds). [2025-10-15T18:40:19.285764] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-01. [2025-10-15T18:40:19.385716] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-10-15T18:40:19.387200] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-05. [2025-10-15T18:40:19.635579] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-15T18:40:19.642331] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-02. [2025-10-15T18:40:19.949421] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-15T18:40:19.950919] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-06. [2025-10-15T18:40:20.515133] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-15T18:40:20.517038] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-07. [2025-10-15T18:40:20.815364] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-15T18:40:20.879105] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-15T18:40:20.913985] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-03. [2025-10-15T18:40:21.027779] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-10-15T18:40:21.091612] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-15T18:40:21.714027] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-02. [2025-10-15T18:40:22.138168] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-15T18:40:22.513996] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-08. [2025-10-15T18:40:22.917632] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-10-15T18:40:22.967887] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-15T18:40:23.314040] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-04. [2025-10-15T18:40:24.113988] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-03. [2025-10-15T18:40:24.911327] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-15T18:40:24.921722] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-09. [2025-10-15T18:40:25.362997] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-15T18:40:25.684428] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-15T18:40:25.713955] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-10. [2025-10-15T18:40:26.199939] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-15T18:40:26.200893] [INFO ] [REMOTE ] ELC: Full fetch complete (5029 records). [2025-10-15T18:40:26.200961] [DEBUG] [VALIDATOR ] ELC: Validating primary data. [2025-10-15T18:40:26.519119] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-04. [2025-10-15T18:40:26.558587] [DEBUG] [VALIDATOR ] ELC: All expected trading days are present. [2025-10-15T18:40:26.558751] [DEBUG] [VALIDATOR ] ELC: Primary data validation passed. [2025-10-15T18:40:26.558927] [INFO ] [MAIN ] ELC: Fetched primary data is valid. [2025-10-15T18:40:26.558969] [DEBUG] [LOCAL ] ELC: Saving primary data. [2025-10-15T18:40:26.559317] [DEBUG] [LOCAL ] ELC: Trimmed 5029 records to 3506 (keeping 200 days of data) [2025-10-15T18:40:26.580609] [DEBUG] [LOCAL ] ELC: Primary data saved (3506 records). [2025-10-15T18:40:26.580721] [INFO ] [MAIN ] ELC: Full history saved. [2025-10-15T18:40:26.580804] [INFO ] [MAIN ] Update Progress: 721/2369 symbols completed. ELC took 12.4s. Estimated remaining: 3h 49m 25s. Rate: 7.2 symbols/min [2025-10-15T18:40:26.744987] [INFO ] [MAIN ] ELP: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:40:26.768917] [DEBUG] [LOCAL ] ELP: Loaded 25653 existing records from primary storage. [2025-10-15T18:40:26.769227] [INFO ] [MAIN ] ELP: Loaded 25653 existing records. [2025-10-15T18:40:26.946683] [WARN ] [MAIN ] ELP: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:40:26.946937] [INFO ] [MAIN ] ELP: Wiping existing primary data before full refresh. [2025-10-15T18:40:26.947015] [INFO ] [LOCAL ] ELP: Starting deletion of primary data. [2025-10-15T18:40:26.947221] [DEBUG] [LOCAL ] ELP: Deleted primary data file. [2025-10-15T18:40:26.947280] [INFO ] [MAIN ] ELP: Starting full primary refresh. [2025-10-15T18:40:27.320409] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-05. [2025-10-15T18:40:27.325113] [INFO ] [REMOTE ] ELP: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:40:28.113997] [INFO ] [REMOTE ] ELP: Fetching primary data for 2024-12. [2025-10-15T18:40:28.260464] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-15T18:40:28.925941] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-02. [2025-10-15T18:40:28.927517] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-15T18:40:29.713999] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-05. [2025-10-15T18:40:29.745126] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-15T18:40:30.514032] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-06. [2025-10-15T18:40:31.206203] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-02 (2.28 seconds). [2025-10-15T18:40:31.290422] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-15T18:40:31.313972] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-03. [2025-10-15T18:40:31.947587] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-15T18:40:32.113976] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-06. [2025-10-15T18:40:32.914020] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-01. [2025-10-15T18:40:33.298926] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-10-15T18:40:33.714026] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-07. [2025-10-15T18:40:33.744709] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-15T18:40:34.006261] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-15T18:40:34.514008] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-02. [2025-10-15T18:40:34.786489] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-15T18:40:35.314008] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-07. [2025-10-15T18:40:35.611193] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-15T18:40:36.114006] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-04. [2025-10-15T18:40:36.842107] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-15T18:40:36.913964] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-08. [2025-10-15T18:40:37.714017] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-08. [2025-10-15T18:40:38.316732] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-04 (2.20 seconds). [2025-10-15T18:40:38.513980] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-05. [2025-10-15T18:40:38.640692] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-15T18:40:39.037854] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-15T18:40:39.313995] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-09. [2025-10-15T18:40:40.114005] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-03. [2025-10-15T18:40:40.588201] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-10-15T18:40:40.913964] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-06. [2025-10-15T18:40:41.108465] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-15T18:40:41.286520] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-15T18:40:41.714170] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-04. [2025-10-15T18:40:42.514013] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-10. [2025-10-15T18:40:42.646829] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-15T18:40:42.748100] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-15T18:40:43.314020] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-05. [2025-10-15T18:40:44.073323] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-15T18:40:44.079819] [INFO ] [REMOTE ] ELAN: Full fetch complete (77057 records). [2025-10-15T18:40:44.079967] [DEBUG] [VALIDATOR ] ELAN: Validating primary data. [2025-10-15T18:40:44.123412] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-09. [2025-10-15T18:40:44.473705] [DEBUG] [VALIDATOR ] ELAN: All expected trading days are present. [2025-10-15T18:40:44.473971] [DEBUG] [VALIDATOR ] ELAN: Primary data validation passed. [2025-10-15T18:40:44.474927] [INFO ] [MAIN ] ELAN: Fetched primary data is valid. [2025-10-15T18:40:44.475048] [DEBUG] [LOCAL ] ELAN: Saving primary data. [2025-10-15T18:40:44.476491] [DEBUG] [LOCAL ] ELAN: Trimmed 77057 records to 53301 (keeping 200 days of data) [2025-10-15T18:40:44.672596] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-15T18:40:44.810598] [DEBUG] [LOCAL ] ELAN: Primary data saved (53301 records). [2025-10-15T18:40:44.810753] [INFO ] [MAIN ] ELAN: Full history saved. [2025-10-15T18:40:44.810831] [INFO ] [MAIN ] Update Progress: 722/2369 symbols completed. ELAN took 30.6s. Estimated remaining: 3h 49m 39s. Rate: 7.2 symbols/min [2025-10-15T18:40:44.919149] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-06. [2025-10-15T18:40:44.981967] [INFO ] [MAIN ] ELPC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:40:44.982152] [DEBUG] [LOCAL ] ELPC: No existing data file found in primary storage. [2025-10-15T18:40:44.982215] [WARN ] [MAIN ] ELPC: No existing data found, performing full refresh instead. [2025-10-15T18:40:44.982719] [INFO ] [MAIN ] ELPC: Wiping existing primary data before full refresh. [2025-10-15T18:40:44.982790] [INFO ] [LOCAL ] ELPC: Starting deletion of primary data. [2025-10-15T18:40:44.982845] [DEBUG] [LOCAL ] ELPC: No primary data file found to delete. [2025-10-15T18:40:44.982892] [INFO ] [MAIN ] ELPC: Starting full primary refresh. [2025-10-15T18:40:45.335351] [INFO ] [REMOTE ] ELPC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:40:45.681195] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-15T18:40:45.714015] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-10. [2025-10-15T18:40:46.173059] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-15T18:40:46.513974] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-07. [2025-10-15T18:40:47.276078] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-15T18:40:47.282038] [INFO ] [REMOTE ] ELME: Full fetch complete (56134 records). [2025-10-15T18:40:47.282170] [DEBUG] [VALIDATOR ] ELME: Validating primary data. [2025-10-15T18:40:47.319118] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2024-12. [2025-10-15T18:40:47.679700] [DEBUG] [VALIDATOR ] ELME: All expected trading days are present. [2025-10-15T18:40:47.679928] [DEBUG] [VALIDATOR ] ELME: Primary data validation passed. [2025-10-15T18:40:47.681039] [INFO ] [MAIN ] ELME: Fetched primary data is valid. [2025-10-15T18:40:47.681151] [DEBUG] [LOCAL ] ELME: Saving primary data. [2025-10-15T18:40:47.682400] [DEBUG] [LOCAL ] ELME: Trimmed 56134 records to 39404 (keeping 200 days of data) [2025-10-15T18:40:47.817510] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-15T18:40:47.938756] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-10-15T18:40:47.981138] [DEBUG] [LOCAL ] ELME: Primary data saved (39404 records). [2025-10-15T18:40:47.981319] [INFO ] [MAIN ] ELME: Full history saved. [2025-10-15T18:40:47.981430] [INFO ] [MAIN ] Update Progress: 723/2369 symbols completed. ELME took 33.8s. Estimated remaining: 3h 49m 19s. Rate: 7.2 symbols/min [2025-10-15T18:40:48.128849] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-07. [2025-10-15T18:40:48.160277] [INFO ] [MAIN ] ELS: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:40:48.210879] [DEBUG] [LOCAL ] ELS: Loaded 49892 existing records from primary storage. [2025-10-15T18:40:48.211243] [INFO ] [MAIN ] ELS: Loaded 49892 existing records. [2025-10-15T18:40:48.381385] [WARN ] [MAIN ] ELS: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:40:48.381579] [INFO ] [MAIN ] ELS: Wiping existing primary data before full refresh. [2025-10-15T18:40:48.381625] [INFO ] [LOCAL ] ELS: Starting deletion of primary data. [2025-10-15T18:40:48.381950] [DEBUG] [LOCAL ] ELS: Deleted primary data file. [2025-10-15T18:40:48.381995] [INFO ] [MAIN ] ELS: Starting full primary refresh. [2025-10-15T18:40:48.723989] [INFO ] [REMOTE ] ELS: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:40:48.913990] [INFO ] [REMOTE ] ELS: Fetching primary data for 2024-12. [2025-10-15T18:40:49.714069] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-01. [2025-10-15T18:40:50.162319] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-10-15T18:40:50.254740] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-07 (2.13 seconds). [2025-10-15T18:40:50.514024] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-08. [2025-10-15T18:40:50.961225] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2024-12 (2.05 seconds). [2025-10-15T18:40:51.314032] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-01. [2025-10-15T18:40:51.629855] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-15T18:40:52.114021] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-08. [2025-10-15T18:40:52.914465] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-09. [2025-10-15T18:40:52.919671] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-15T18:40:53.713976] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-02. [2025-10-15T18:40:53.949888] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-15T18:40:54.278437] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-08 (2.16 seconds). [2025-10-15T18:40:54.513991] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-09. [2025-10-15T18:40:54.977107] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-15T18:40:55.314012] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-10. [2025-10-15T18:40:56.114088] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-03. [2025-10-15T18:40:56.371216] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-15T18:40:56.522354] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-15T18:40:56.526108] [INFO ] [REMOTE ] ELP: Full fetch complete (36848 records). [2025-10-15T18:40:56.526210] [DEBUG] [VALIDATOR ] ELP: Validating primary data. [2025-10-15T18:40:56.901028] [DEBUG] [VALIDATOR ] ELP: All expected trading days are present. [2025-10-15T18:40:56.901117] [DEBUG] [VALIDATOR ] ELP: Primary data validation passed. [2025-10-15T18:40:56.901789] [INFO ] [MAIN ] ELP: Fetched primary data is valid. [2025-10-15T18:40:56.901852] [DEBUG] [LOCAL ] ELP: Saving primary data. [2025-10-15T18:40:56.902841] [DEBUG] [LOCAL ] ELP: Trimmed 36848 records to 25680 (keeping 200 days of data) [2025-10-15T18:40:56.949696] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-10. [2025-10-15T18:40:57.051909] [DEBUG] [LOCAL ] ELP: Primary data saved (25680 records). [2025-10-15T18:40:57.052049] [INFO ] [MAIN ] ELP: Full history saved. [2025-10-15T18:40:57.052128] [INFO ] [MAIN ] Update Progress: 724/2369 symbols completed. ELP took 30.5s. Estimated remaining: 3h 49m 12s. Rate: 7.2 symbols/min [2025-10-15T18:40:57.221260] [INFO ] [MAIN ] ELV: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:40:57.269945] [DEBUG] [LOCAL ] ELV: Loaded 50685 existing records from primary storage. [2025-10-15T18:40:57.270245] [INFO ] [MAIN ] ELV: Loaded 50685 existing records. [2025-10-15T18:40:57.448270] [WARN ] [MAIN ] ELV: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:40:57.448490] [INFO ] [MAIN ] ELV: Wiping existing primary data before full refresh. [2025-10-15T18:40:57.448537] [INFO ] [LOCAL ] ELV: Starting deletion of primary data. [2025-10-15T18:40:57.449197] [DEBUG] [LOCAL ] ELV: Deleted primary data file. [2025-10-15T18:40:57.449257] [INFO ] [MAIN ] ELV: Starting full primary refresh. [2025-10-15T18:40:57.729694] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-02. [2025-10-15T18:40:57.815370] [INFO ] [REMOTE ] ELV: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:40:57.845434] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-15T18:40:58.214790] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-15T18:40:58.513989] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-04. [2025-10-15T18:40:58.801489] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-10 (1.85 seconds). [2025-10-15T18:40:58.807454] [INFO ] [REMOTE ] ELF: Full fetch complete (75497 records). [2025-10-15T18:40:58.807596] [DEBUG] [VALIDATOR ] ELF: Validating primary data. [2025-10-15T18:40:59.230906] [DEBUG] [VALIDATOR ] ELF: All expected trading days are present. [2025-10-15T18:40:59.231002] [DEBUG] [VALIDATOR ] ELF: Primary data validation passed. [2025-10-15T18:40:59.232000] [INFO ] [MAIN ] ELF: Fetched primary data is valid. [2025-10-15T18:40:59.232064] [DEBUG] [LOCAL ] ELF: Saving primary data. [2025-10-15T18:40:59.233474] [DEBUG] [LOCAL ] ELF: Trimmed 75497 records to 52028 (keeping 200 days of data) [2025-10-15T18:40:59.316638] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-03. [2025-10-15T18:40:59.544440] [DEBUG] [LOCAL ] ELF: Primary data saved (52028 records). [2025-10-15T18:40:59.544626] [INFO ] [MAIN ] ELF: Full history saved. [2025-10-15T18:40:59.544744] [INFO ] [MAIN ] Update Progress: 725/2369 symbols completed. ELF took 45.4s. Estimated remaining: 3h 48m 50s. Rate: 7.2 symbols/min [2025-10-15T18:40:59.650155] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-03 (0.33 seconds). [2025-10-15T18:40:59.719971] [INFO ] [MAIN ] EMA: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:40:59.720132] [DEBUG] [LOCAL ] EMA: No existing data file found in primary storage. [2025-10-15T18:40:59.720168] [WARN ] [MAIN ] EMA: No existing data found, performing full refresh instead. [2025-10-15T18:40:59.720280] [INFO ] [MAIN ] EMA: Wiping existing primary data before full refresh. [2025-10-15T18:40:59.720361] [INFO ] [LOCAL ] EMA: Starting deletion of primary data. [2025-10-15T18:40:59.720411] [DEBUG] [LOCAL ] EMA: No primary data file found to delete. [2025-10-15T18:40:59.720444] [INFO ] [MAIN ] EMA: Starting full primary refresh. [2025-10-15T18:41:00.072951] [INFO ] [REMOTE ] EMA: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:41:00.113959] [INFO ] [REMOTE ] EMA: Fetching primary data for 2024-12. [2025-10-15T18:41:00.317707] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-15T18:41:00.439234] [DEBUG] [REMOTE ] EMA: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-15T18:41:00.439540] [WARN ] [REMOTE ] EMA: No data returned for month 2024-12 [2025-10-15T18:41:00.439669] [FATAL] [REMOTE ] EMA: API call failed - aborting fetch to avoid wasting further API calls [2025-10-15T18:41:00.439774] [FATAL] [MAIN ] EMA: Failed to fetch primary data. [2025-10-15T18:41:00.439857] [WARN ] [MAIN ] EMA: Deleting existing primary and derivative data due to fetch failure. [2025-10-15T18:41:00.439952] [INFO ] [LOCAL ] EMA: Starting deletion of primary data. [2025-10-15T18:41:00.440035] [DEBUG] [LOCAL ] EMA: No primary data file found to delete. [2025-10-15T18:41:00.440073] [INFO ] [LOCAL ] EMA: Starting deletion of derivative data. [2025-10-15T18:41:00.440116] [DEBUG] [LOCAL ] EMA: No derivative data file found to delete. [2025-10-15T18:41:00.440160] [INFO ] [MAIN ] Update Progress: 726/2369 symbols completed. EMA took 0.9s. Estimated remaining: 3h 48m 25s. Rate: 7.2 symbols/min [2025-10-15T18:41:00.611829] [INFO ] [MAIN ] EMD: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:41:00.631467] [DEBUG] [LOCAL ] EMD: Loaded 20965 existing records from primary storage. [2025-10-15T18:41:00.631709] [INFO ] [MAIN ] EMD: Loaded 20965 existing records. [2025-10-15T18:41:00.806720] [WARN ] [MAIN ] EMD: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:41:00.806939] [INFO ] [MAIN ] EMD: Wiping existing primary data before full refresh. [2025-10-15T18:41:00.807000] [INFO ] [LOCAL ] EMD: Starting deletion of primary data. [2025-10-15T18:41:00.807245] [DEBUG] [LOCAL ] EMD: Deleted primary data file. [2025-10-15T18:41:00.807313] [INFO ] [MAIN ] EMD: Starting full primary refresh. [2025-10-15T18:41:00.919106] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-05. [2025-10-15T18:41:01.161084] [INFO ] [REMOTE ] EMD: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:41:01.714032] [INFO ] [REMOTE ] EMD: Fetching primary data for 2024-12. [2025-10-15T18:41:02.514028] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-04. [2025-10-15T18:41:02.711244] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-15T18:41:02.940520] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-10-15T18:41:03.183117] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-15T18:41:03.314072] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-06. [2025-10-15T18:41:04.114016] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-05. [2025-10-15T18:41:04.469156] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-05 (0.36 seconds). [2025-10-15T18:41:04.484150] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-15T18:41:04.913994] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-06. [2025-10-15T18:41:05.413349] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-10-15T18:41:05.714017] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-07. [2025-10-15T18:41:06.046142] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-07 (0.33 seconds). [2025-10-15T18:41:06.514034] [INFO ] [REMOTE ] ELV: Fetching primary data for 2024-12. [2025-10-15T18:41:07.313993] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-07. [2025-10-15T18:41:08.114003] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-01. [2025-10-15T18:41:08.527200] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-10-15T18:41:08.698454] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-15T18:41:08.913989] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-08. [2025-10-15T18:41:09.119591] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-15T18:41:09.713984] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-02. [2025-10-15T18:41:10.513966] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-01. [2025-10-15T18:41:10.960856] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-15T18:41:11.314001] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-08. [2025-10-15T18:41:11.752008] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-10-15T18:41:12.113975] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-03. [2025-10-15T18:41:12.280790] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-15T18:41:12.914015] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-02. [2025-10-15T18:41:13.387184] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-15T18:41:13.679433] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-08 (4.77 seconds). [2025-10-15T18:41:13.714034] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-09. [2025-10-15T18:41:14.001965] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-09 (0.29 seconds). [2025-10-15T18:41:14.513977] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-09. [2025-10-15T18:41:15.314001] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-04. [2025-10-15T18:41:16.114024] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-10. [2025-10-15T18:41:16.211932] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-02 (3.30 seconds). [2025-10-15T18:41:16.398478] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-15T18:41:16.538842] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-10 (0.42 seconds). [2025-10-15T18:41:16.539476] [INFO ] [REMOTE ] ELPC: Full fetch complete (1404 records). [2025-10-15T18:41:16.539541] [DEBUG] [VALIDATOR ] ELPC: Validating primary data. [2025-10-15T18:41:16.720430] [WARN ] [VALIDATOR ] ELPC: Validation failed - insufficient historical data. Have 190 unique days, need 200 days [2025-10-15T18:41:16.720721] [FATAL] [MAIN ] ELPC: Fetched primary data is invalid. Refusing to save it. [2025-10-15T18:41:16.720797] [WARN ] [MAIN ] ELPC: Deleting existing primary and derivative data due to validation failure. [2025-10-15T18:41:16.720845] [INFO ] [LOCAL ] ELPC: Starting deletion of primary data. [2025-10-15T18:41:16.720899] [DEBUG] [LOCAL ] ELPC: No primary data file found to delete. [2025-10-15T18:41:16.720938] [INFO ] [LOCAL ] ELPC: Starting deletion of derivative data. [2025-10-15T18:41:16.720981] [DEBUG] [LOCAL ] ELPC: No derivative data file found to delete. [2025-10-15T18:41:16.721034] [INFO ] [MAIN ] Update Progress: 727/2369 symbols completed. ELPC took 31.9s. Estimated remaining: 3h 48m 35s. Rate: 7.2 symbols/min [2025-10-15T18:41:16.886719] [INFO ] [MAIN ] EME: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:41:16.915966] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-05. [2025-10-15T18:41:16.917554] [DEBUG] [LOCAL ] EME: Loaded 30969 existing records from primary storage. [2025-10-15T18:41:16.917830] [INFO ] [MAIN ] EME: Loaded 30969 existing records. [2025-10-15T18:41:17.095041] [WARN ] [MAIN ] EME: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:41:17.095242] [INFO ] [MAIN ] EME: Wiping existing primary data before full refresh. [2025-10-15T18:41:17.095295] [INFO ] [LOCAL ] EME: Starting deletion of primary data. [2025-10-15T18:41:17.095761] [DEBUG] [LOCAL ] EME: Deleted primary data file. [2025-10-15T18:41:17.095819] [INFO ] [MAIN ] EME: Starting full primary refresh. [2025-10-15T18:41:17.439146] [INFO ] [REMOTE ] EME: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:41:17.713983] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-03. [2025-10-15T18:41:17.934691] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-09 (3.42 seconds). [2025-10-15T18:41:17.985293] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-15T18:41:18.514045] [INFO ] [REMOTE ] EME: Fetching primary data for 2024-12. [2025-10-15T18:41:19.313990] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-06. [2025-10-15T18:41:19.558935] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-15T18:41:20.114050] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-10. [2025-10-15T18:41:20.211941] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-15T18:41:20.560942] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2024-12 (2.05 seconds). [2025-10-15T18:41:20.914009] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-07. [2025-10-15T18:41:21.713982] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-04. [2025-10-15T18:41:21.795801] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-15T18:41:21.802168] [INFO ] [REMOTE ] ELS: Full fetch complete (71187 records). [2025-10-15T18:41:21.802274] [DEBUG] [VALIDATOR ] ELS: Validating primary data. [2025-10-15T18:41:22.109509] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-15T18:41:22.205635] [DEBUG] [VALIDATOR ] ELS: All expected trading days are present. [2025-10-15T18:41:22.205744] [DEBUG] [VALIDATOR ] ELS: Primary data validation passed. [2025-10-15T18:41:22.206592] [INFO ] [MAIN ] ELS: Fetched primary data is valid. [2025-10-15T18:41:22.206634] [DEBUG] [LOCAL ] ELS: Saving primary data. [2025-10-15T18:41:22.208057] [DEBUG] [LOCAL ] ELS: Trimmed 71187 records to 49862 (keeping 200 days of data) [2025-10-15T18:41:22.511135] [DEBUG] [LOCAL ] ELS: Primary data saved (49862 records). [2025-10-15T18:41:22.511288] [INFO ] [MAIN ] ELS: Full history saved. [2025-10-15T18:41:22.512173] [INFO ] [MAIN ] Update Progress: 728/2369 symbols completed. ELS took 34.5s. Estimated remaining: 3h 48m 21s. Rate: 7.2 symbols/min [2025-10-15T18:41:22.523985] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-08. [2025-10-15T18:41:22.699772] [INFO ] [MAIN ] EMF: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:41:22.705779] [DEBUG] [LOCAL ] EMF: Loaded 3283 existing records from primary storage. [2025-10-15T18:41:22.706023] [INFO ] [MAIN ] EMF: Loaded 3283 existing records. [2025-10-15T18:41:22.893472] [WARN ] [MAIN ] EMF: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:41:22.893679] [INFO ] [MAIN ] EMF: Wiping existing primary data before full refresh. [2025-10-15T18:41:22.893739] [INFO ] [LOCAL ] EMF: Starting deletion of primary data. [2025-10-15T18:41:22.893898] [DEBUG] [LOCAL ] EMF: Deleted primary data file. [2025-10-15T18:41:22.893957] [INFO ] [MAIN ] EMF: Starting full primary refresh. [2025-10-15T18:41:23.278047] [INFO ] [REMOTE ] EMF: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:41:23.313961] [INFO ] [REMOTE ] EMF: Fetching primary data for 2024-12. [2025-10-15T18:41:23.500827] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-15T18:41:23.644225] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-15T18:41:24.114004] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-01. [2025-10-15T18:41:24.496268] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-15T18:41:24.914005] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-05. [2025-10-15T18:41:25.714058] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-09. [2025-10-15T18:41:26.064235] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-10-15T18:41:26.514030] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-02. [2025-10-15T18:41:26.741579] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-15T18:41:26.765571] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-15T18:41:27.314055] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-06. [2025-10-15T18:41:27.927108] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-15T18:41:28.114007] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-03. [2025-10-15T18:41:28.914030] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-01. [2025-10-15T18:41:29.285274] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-10-15T18:41:29.627257] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-15T18:41:29.714045] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-02. [2025-10-15T18:41:29.741786] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-15T18:41:30.348164] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-15T18:41:30.513993] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-03. [2025-10-15T18:41:31.234577] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-15T18:41:31.313990] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-10. [2025-10-15T18:41:32.114109] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-04. [2025-10-15T18:41:32.350669] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-15T18:41:32.353746] [INFO ] [REMOTE ] EMD: Full fetch complete (32060 records). [2025-10-15T18:41:32.353863] [DEBUG] [VALIDATOR ] EMD: Validating primary data. [2025-10-15T18:41:32.762053] [DEBUG] [VALIDATOR ] EMD: All expected trading days are present. [2025-10-15T18:41:32.762143] [DEBUG] [VALIDATOR ] EMD: Primary data validation passed. [2025-10-15T18:41:32.762847] [INFO ] [MAIN ] EMD: Fetched primary data is valid. [2025-10-15T18:41:32.762913] [DEBUG] [LOCAL ] EMD: Saving primary data. [2025-10-15T18:41:32.763891] [DEBUG] [LOCAL ] EMD: Trimmed 32060 records to 20863 (keeping 200 days of data) [2025-10-15T18:41:32.890235] [DEBUG] [LOCAL ] EMD: Primary data saved (20863 records). [2025-10-15T18:41:32.890359] [INFO ] [MAIN ] EMD: Full history saved. [2025-10-15T18:41:32.890487] [INFO ] [MAIN ] Update Progress: 729/2369 symbols completed. EMD took 32.5s. Estimated remaining: 3h 48m 17s. Rate: 7.2 symbols/min [2025-10-15T18:41:32.924303] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-04. [2025-10-15T18:41:33.071232] [INFO ] [MAIN ] EMN: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:41:33.117702] [DEBUG] [LOCAL ] EMN: Loaded 50738 existing records from primary storage. [2025-10-15T18:41:33.118063] [INFO ] [MAIN ] EMN: Loaded 50738 existing records. [2025-10-15T18:41:33.300996] [WARN ] [MAIN ] EMN: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:41:33.301385] [INFO ] [MAIN ] EMN: Wiping existing primary data before full refresh. [2025-10-15T18:41:33.301510] [INFO ] [LOCAL ] EMN: Starting deletion of primary data. [2025-10-15T18:41:33.301977] [DEBUG] [LOCAL ] EMN: Deleted primary data file. [2025-10-15T18:41:33.302037] [INFO ] [MAIN ] EMN: Starting full primary refresh. [2025-10-15T18:41:33.597079] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-10-15T18:41:33.706596] [INFO ] [REMOTE ] EMN: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:41:33.719698] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-05. [2025-10-15T18:41:33.722091] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-15T18:41:34.201881] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-10-15T18:41:34.514006] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-06. [2025-10-15T18:41:35.314009] [INFO ] [REMOTE ] EMN: Fetching primary data for 2024-12. [2025-10-15T18:41:35.326912] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-15T18:41:36.114012] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-07. [2025-10-15T18:41:36.913971] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-05. [2025-10-15T18:41:37.066968] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-15T18:41:37.713960] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-01. [2025-10-15T18:41:38.272865] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-07 (2.16 seconds). [2025-10-15T18:41:38.426671] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-15T18:41:38.513955] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-06. [2025-10-15T18:41:39.036080] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-15T18:41:39.314069] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-08. [2025-10-15T18:41:39.611049] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-15T18:41:40.114039] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-07. [2025-10-15T18:41:40.913959] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-02. [2025-10-15T18:41:41.250808] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-15T18:41:41.438792] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-08 (2.12 seconds). [2025-10-15T18:41:41.714021] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-09. [2025-10-15T18:41:42.498394] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-15T18:41:42.513952] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-03. [2025-10-15T18:41:43.314018] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-08. [2025-10-15T18:41:43.643773] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-15T18:41:44.114018] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-07. [2025-10-15T18:41:44.349166] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-15T18:41:44.521071] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-15T18:41:44.674279] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-15T18:41:44.914109] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-08. [2025-10-15T18:41:45.483122] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-15T18:41:45.713986] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-09. [2025-10-15T18:41:46.250570] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-10-15T18:41:46.514047] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-10. [2025-10-15T18:41:47.314043] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-04. [2025-10-15T18:41:48.114060] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-10. [2025-10-15T18:41:48.431927] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-10 (1.92 seconds). [2025-10-15T18:41:48.438085] [INFO ] [REMOTE ] ELV: Full fetch complete (73227 records). [2025-10-15T18:41:48.438204] [DEBUG] [VALIDATOR ] ELV: Validating primary data. [2025-10-15T18:41:48.542382] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-10 (0.43 seconds). [2025-10-15T18:41:48.558957] [INFO ] [REMOTE ] EMF: Full fetch complete (6498 records). [2025-10-15T18:41:48.564268] [DEBUG] [VALIDATOR ] EMF: Validating primary data. [2025-10-15T18:41:48.924338] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-09. [2025-10-15T18:41:49.136051] [DEBUG] [VALIDATOR ] ELV: All expected trading days are present. [2025-10-15T18:41:49.141807] [DEBUG] [VALIDATOR ] ELV: Primary data validation passed. [2025-10-15T18:41:49.153118] [INFO ] [MAIN ] ELV: Fetched primary data is valid. [2025-10-15T18:41:49.175842] [DEBUG] [LOCAL ] ELV: Saving primary data. [2025-10-15T18:41:49.216356] [DEBUG] [VALIDATOR ] EMF: All expected trading days are present. [2025-10-15T18:41:49.216459] [DEBUG] [VALIDATOR ] EMF: Primary data validation passed. [2025-10-15T18:41:49.216759] [INFO ] [MAIN ] EMF: Fetched primary data is valid. [2025-10-15T18:41:49.216914] [DEBUG] [LOCAL ] EMF: Saving primary data. [2025-10-15T18:41:49.218062] [DEBUG] [LOCAL ] EMF: Trimmed 6498 records to 3211 (keeping 200 days of data) [2025-10-15T18:41:49.218637] [DEBUG] [LOCAL ] ELV: Trimmed 73227 records to 50691 (keeping 200 days of data) [2025-10-15T18:41:49.356302] [DEBUG] [LOCAL ] EMF: Primary data saved (3211 records). [2025-10-15T18:41:49.364158] [INFO ] [MAIN ] EMF: Full history saved. [2025-10-15T18:41:49.364922] [INFO ] [MAIN ] Update Progress: 730/2369 symbols completed. EMF took 26.9s. Estimated remaining: 3h 48m 27s. Rate: 7.2 symbols/min [2025-10-15T18:41:49.613372] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-04 (2.30 seconds). [2025-10-15T18:41:49.699388] [INFO ] [MAIN ] EMO: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:41:49.714670] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-05. [2025-10-15T18:41:49.782985] [DEBUG] [LOCAL ] EMO: Loaded 13223 existing records from primary storage. [2025-10-15T18:41:49.786466] [INFO ] [MAIN ] EMO: Loaded 13223 existing records. [2025-10-15T18:41:49.977065] [WARN ] [MAIN ] EMO: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:41:49.978820] [INFO ] [MAIN ] EMO: Wiping existing primary data before full refresh. [2025-10-15T18:41:49.978900] [INFO ] [LOCAL ] EMO: Starting deletion of primary data. [2025-10-15T18:41:49.981112] [DEBUG] [LOCAL ] EMO: Deleted primary data file. [2025-10-15T18:41:49.981236] [INFO ] [MAIN ] EMO: Starting full primary refresh. [2025-10-15T18:41:49.981191] [DEBUG] [LOCAL ] ELV: Primary data saved (50691 records). [2025-10-15T18:41:50.012559] [INFO ] [MAIN ] ELV: Full history saved. [2025-10-15T18:41:50.036300] [INFO ] [MAIN ] Update Progress: 731/2369 symbols completed. ELV took 53.0s. Estimated remaining: 3h 48m 1s. Rate: 7.2 symbols/min [2025-10-15T18:41:50.431676] [INFO ] [MAIN ] EMP: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:41:50.510509] [INFO ] [REMOTE ] EMO: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:41:50.517294] [INFO ] [REMOTE ] EMO: Fetching primary data for 2024-12. [2025-10-15T18:41:50.529615] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-15T18:41:50.539115] [DEBUG] [LOCAL ] EMP: Loaded 3054 existing records from primary storage. [2025-10-15T18:41:50.539449] [INFO ] [MAIN ] EMP: Loaded 3054 existing records. [2025-10-15T18:41:50.714985] [WARN ] [MAIN ] EMP: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:41:50.715197] [INFO ] [MAIN ] EMP: Wiping existing primary data before full refresh. [2025-10-15T18:41:50.715248] [INFO ] [LOCAL ] EMP: Starting deletion of primary data. [2025-10-15T18:41:50.715410] [DEBUG] [LOCAL ] EMP: Deleted primary data file. [2025-10-15T18:41:50.715465] [INFO ] [MAIN ] EMP: Starting full primary refresh. [2025-10-15T18:41:51.086905] [INFO ] [REMOTE ] EMP: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:41:51.137429] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-15T18:41:51.186148] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-10-15T18:41:51.313992] [INFO ] [REMOTE ] EMP: Fetching primary data for 2024-12. [2025-10-15T18:41:52.087622] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-10-15T18:41:52.114006] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-10. [2025-10-15T18:41:52.913986] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-01. [2025-10-15T18:41:53.670075] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-15T18:41:53.714024] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-02. [2025-10-15T18:41:53.769266] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-15T18:41:53.776377] [INFO ] [REMOTE ] EME: Full fetch complete (47035 records). [2025-10-15T18:41:53.776718] [DEBUG] [VALIDATOR ] EME: Validating primary data. [2025-10-15T18:41:54.175922] [DEBUG] [VALIDATOR ] EME: All expected trading days are present. [2025-10-15T18:41:54.176008] [DEBUG] [VALIDATOR ] EME: Primary data validation passed. [2025-10-15T18:41:54.176732] [INFO ] [MAIN ] EME: Fetched primary data is valid. [2025-10-15T18:41:54.176793] [DEBUG] [LOCAL ] EME: Saving primary data. [2025-10-15T18:41:54.178040] [DEBUG] [LOCAL ] EME: Trimmed 47035 records to 30952 (keeping 200 days of data) [2025-10-15T18:41:54.391857] [DEBUG] [LOCAL ] EME: Primary data saved (30952 records). [2025-10-15T18:41:54.392006] [INFO ] [MAIN ] EME: Full history saved. [2025-10-15T18:41:54.392099] [INFO ] [MAIN ] Update Progress: 732/2369 symbols completed. EME took 37.7s. Estimated remaining: 3h 47m 44s. Rate: 7.2 symbols/min [2025-10-15T18:41:54.500938] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-15T18:41:54.518636] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-06. [2025-10-15T18:41:54.573467] [INFO ] [MAIN ] EMR: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:41:54.625304] [DEBUG] [LOCAL ] EMR: Loaded 53209 existing records from primary storage. [2025-10-15T18:41:54.625598] [INFO ] [MAIN ] EMR: Loaded 53209 existing records. [2025-10-15T18:41:54.797552] [WARN ] [MAIN ] EMR: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:41:54.797768] [INFO ] [MAIN ] EMR: Wiping existing primary data before full refresh. [2025-10-15T18:41:54.797824] [INFO ] [LOCAL ] EMR: Starting deletion of primary data. [2025-10-15T18:41:54.798260] [DEBUG] [LOCAL ] EMR: Deleted primary data file. [2025-10-15T18:41:54.798297] [INFO ] [MAIN ] EMR: Starting full primary refresh. [2025-10-15T18:41:55.155039] [INFO ] [REMOTE ] EMR: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:41:55.313995] [INFO ] [REMOTE ] EMR: Fetching primary data for 2024-12. [2025-10-15T18:41:56.114002] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-03. [2025-10-15T18:41:56.311397] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-15T18:41:56.913631] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-15T18:41:56.917018] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-01. [2025-10-15T18:41:57.066830] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-15T18:41:57.372778] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-10-15T18:41:57.713992] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-02. [2025-10-15T18:41:58.025983] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-02 (0.31 seconds). [2025-10-15T18:41:58.514016] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-04. [2025-10-15T18:41:59.314004] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-03. [2025-10-15T18:41:59.352256] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-15T18:41:59.775310] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-10-15T18:42:00.114020] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-05. [2025-10-15T18:42:00.913989] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-01. [2025-10-15T18:42:00.957487] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-15T18:42:01.714029] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-04. [2025-10-15T18:42:02.514038] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-07. [2025-10-15T18:42:03.011259] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-15T18:42:03.016724] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-01 (2.10 seconds). [2025-10-15T18:42:03.314000] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-06. [2025-10-15T18:42:04.119950] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-05. [2025-10-15T18:42:04.125353] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-15T18:42:04.171584] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-15T18:42:04.451319] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-05 (0.33 seconds). [2025-10-15T18:42:04.913991] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-06. [2025-10-15T18:42:05.285291] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-06 (0.37 seconds). [2025-10-15T18:42:05.714007] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-02. [2025-10-15T18:42:06.514043] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-07. [2025-10-15T18:42:06.973586] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-10-15T18:42:07.314006] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-08. [2025-10-15T18:42:07.733857] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-02 (2.02 seconds). [2025-10-15T18:42:08.113984] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-07. [2025-10-15T18:42:08.867389] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-15T18:42:08.913983] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-09. [2025-10-15T18:42:09.052987] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-15T18:42:09.713996] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-08. [2025-10-15T18:42:10.513849] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-15T18:42:10.513997] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-03. [2025-10-15T18:42:10.637753] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-15T18:42:11.314004] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-10. [2025-10-15T18:42:12.113969] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-09. [2025-10-15T18:42:12.403148] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-15T18:42:12.913998] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-04. [2025-10-15T18:42:12.949139] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-15T18:42:12.955355] [INFO ] [REMOTE ] EMN: Full fetch complete (72347 records). [2025-10-15T18:42:12.955496] [DEBUG] [VALIDATOR ] EMN: Validating primary data. [2025-10-15T18:42:13.264291] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-15T18:42:13.362931] [DEBUG] [VALIDATOR ] EMN: All expected trading days are present. [2025-10-15T18:42:13.363026] [DEBUG] [VALIDATOR ] EMN: Primary data validation passed. [2025-10-15T18:42:13.363947] [INFO ] [MAIN ] EMN: Fetched primary data is valid. [2025-10-15T18:42:13.364011] [DEBUG] [LOCAL ] EMN: Saving primary data. [2025-10-15T18:42:13.365364] [DEBUG] [LOCAL ] EMN: Trimmed 72347 records to 50780 (keeping 200 days of data) [2025-10-15T18:42:13.672573] [DEBUG] [LOCAL ] EMN: Primary data saved (50780 records). [2025-10-15T18:42:13.672750] [INFO ] [MAIN ] EMN: Full history saved. [2025-10-15T18:42:13.673194] [INFO ] [MAIN ] Update Progress: 733/2369 symbols completed. EMN took 40.8s. Estimated remaining: 3h 47m 60s. Rate: 7.2 symbols/min [2025-10-15T18:42:13.719100] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-10. [2025-10-15T18:42:13.840112] [INFO ] [MAIN ] ENB: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:42:13.891067] [DEBUG] [LOCAL ] ENB: Loaded 53512 existing records from primary storage. [2025-10-15T18:42:13.891413] [INFO ] [MAIN ] ENB: Loaded 53512 existing records. [2025-10-15T18:42:14.066873] [WARN ] [MAIN ] ENB: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:42:14.067070] [INFO ] [MAIN ] ENB: Wiping existing primary data before full refresh. [2025-10-15T18:42:14.067153] [INFO ] [LOCAL ] ENB: Starting deletion of primary data. [2025-10-15T18:42:14.067703] [DEBUG] [LOCAL ] ENB: Deleted primary data file. [2025-10-15T18:42:14.067764] [INFO ] [MAIN ] ENB: Starting full primary refresh. [2025-10-15T18:42:14.417448] [INFO ] [REMOTE ] ENB: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:42:14.513954] [INFO ] [REMOTE ] ENB: Fetching primary data for 2024-12. [2025-10-15T18:42:14.643968] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-15T18:42:15.120301] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-15T18:42:15.122721] [INFO ] [REMOTE ] EMO: Full fetch complete (17695 records). [2025-10-15T18:42:15.122816] [DEBUG] [VALIDATOR ] EMO: Validating primary data. [2025-10-15T18:42:15.321083] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-05. [2025-10-15T18:42:15.481100] [DEBUG] [VALIDATOR ] EMO: All expected trading days are present. [2025-10-15T18:42:15.481173] [DEBUG] [VALIDATOR ] EMO: Primary data validation passed. [2025-10-15T18:42:15.481553] [INFO ] [MAIN ] EMO: Fetched primary data is valid. [2025-10-15T18:42:15.481592] [DEBUG] [LOCAL ] EMO: Saving primary data. [2025-10-15T18:42:15.482134] [DEBUG] [LOCAL ] EMO: Trimmed 17695 records to 13265 (keeping 200 days of data) [2025-10-15T18:42:15.560306] [DEBUG] [LOCAL ] EMO: Primary data saved (13265 records). [2025-10-15T18:42:15.560431] [INFO ] [MAIN ] EMO: Full history saved. [2025-10-15T18:42:15.560506] [INFO ] [MAIN ] Update Progress: 734/2369 symbols completed. EMO took 26.2s. Estimated remaining: 3h 47m 37s. Rate: 7.2 symbols/min [2025-10-15T18:42:15.725598] [INFO ] [MAIN ] ENIC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:42:15.760960] [DEBUG] [LOCAL ] ENIC: Loaded 36677 existing records from primary storage. [2025-10-15T18:42:15.761253] [INFO ] [MAIN ] ENIC: Loaded 36677 existing records. [2025-10-15T18:42:15.940187] [WARN ] [MAIN ] ENIC: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:42:15.940404] [INFO ] [MAIN ] ENIC: Wiping existing primary data before full refresh. [2025-10-15T18:42:15.940455] [INFO ] [LOCAL ] ENIC: Starting deletion of primary data. [2025-10-15T18:42:15.940720] [DEBUG] [LOCAL ] ENIC: Deleted primary data file. [2025-10-15T18:42:15.940783] [INFO ] [MAIN ] ENIC: Starting full primary refresh. [2025-10-15T18:42:16.142764] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-08. [2025-10-15T18:42:16.296927] [INFO ] [REMOTE ] ENIC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:42:16.393187] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-10-15T18:42:16.594209] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-15T18:42:16.914033] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-09. [2025-10-15T18:42:17.258362] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-15T18:42:17.525932] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-15T18:42:17.713993] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-10. [2025-10-15T18:42:18.176348] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-15T18:42:18.177229] [INFO ] [REMOTE ] EMP: Full fetch complete (4233 records). [2025-10-15T18:42:18.177295] [DEBUG] [VALIDATOR ] EMP: Validating primary data. [2025-10-15T18:42:18.517779] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-01. [2025-10-15T18:42:18.540916] [DEBUG] [VALIDATOR ] EMP: All expected trading days are present. [2025-10-15T18:42:18.541532] [DEBUG] [VALIDATOR ] EMP: Primary data validation passed. [2025-10-15T18:42:18.541721] [INFO ] [MAIN ] EMP: Fetched primary data is valid. [2025-10-15T18:42:18.541782] [DEBUG] [LOCAL ] EMP: Saving primary data. [2025-10-15T18:42:18.542150] [DEBUG] [LOCAL ] EMP: Trimmed 4233 records to 3037 (keeping 200 days of data) [2025-10-15T18:42:18.561071] [DEBUG] [LOCAL ] EMP: Primary data saved (3037 records). [2025-10-15T18:42:18.561492] [INFO ] [MAIN ] EMP: Full history saved. [2025-10-15T18:42:18.561579] [INFO ] [MAIN ] Update Progress: 735/2369 symbols completed. EMP took 28.5s. Estimated remaining: 3h 47m 17s. Rate: 7.2 symbols/min [2025-10-15T18:42:18.728833] [INFO ] [MAIN ] ENO: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:42:18.733050] [DEBUG] [LOCAL ] ENO: Loaded 1862 existing records from primary storage. [2025-10-15T18:42:18.733209] [INFO ] [MAIN ] ENO: Loaded 1862 existing records. [2025-10-15T18:42:18.912183] [WARN ] [MAIN ] ENO: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:42:18.912506] [INFO ] [MAIN ] ENO: Wiping existing primary data before full refresh. [2025-10-15T18:42:18.912566] [INFO ] [LOCAL ] ENO: Starting deletion of primary data. [2025-10-15T18:42:18.912771] [DEBUG] [LOCAL ] ENO: Deleted primary data file. [2025-10-15T18:42:18.912835] [INFO ] [MAIN ] ENO: Starting full primary refresh. [2025-10-15T18:42:19.255061] [INFO ] [REMOTE ] ENO: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:42:19.314035] [INFO ] [REMOTE ] ENO: Fetching primary data for 2024-12. [2025-10-15T18:42:20.105052] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-10-15T18:42:20.113946] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-01. [2025-10-15T18:42:20.509214] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-10-15T18:42:20.583995] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-10-15T18:42:20.914092] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-02. [2025-10-15T18:42:21.714030] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-02. [2025-10-15T18:42:22.268517] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-15T18:42:22.514027] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-03. [2025-10-15T18:42:22.850853] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-10-15T18:42:23.015573] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-10-15T18:42:23.314042] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-04. [2025-10-15T18:42:23.912148] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-10-15T18:42:24.114000] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2024-12. [2025-10-15T18:42:24.913990] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-03. [2025-10-15T18:42:25.611390] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-15T18:42:25.713951] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-01. [2025-10-15T18:42:26.513977] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-06. [2025-10-15T18:42:26.673221] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-15T18:42:27.094138] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-15T18:42:27.314029] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-04. [2025-10-15T18:42:28.113959] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-05. [2025-10-15T18:42:28.219200] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-15T18:42:28.532593] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-10-15T18:42:28.914044] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-02. [2025-10-15T18:42:29.302835] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-15T18:42:29.713980] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-07. [2025-10-15T18:42:30.037132] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-15T18:42:30.514001] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-05. [2025-10-15T18:42:31.313956] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-06. [2025-10-15T18:42:31.664779] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-15T18:42:31.801842] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-10-15T18:42:32.113968] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-08. [2025-10-15T18:42:32.475806] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-15T18:42:32.913991] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-06. [2025-10-15T18:42:33.714002] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-03. [2025-10-15T18:42:33.941588] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-15T18:42:34.514033] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-09. [2025-10-15T18:42:34.693415] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-15T18:42:34.724186] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-15T18:42:35.314051] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-04. [2025-10-15T18:42:36.012413] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-15T18:42:36.113954] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-10. [2025-10-15T18:42:36.830994] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-15T18:42:36.913960] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-05. [2025-10-15T18:42:37.713968] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-07. [2025-10-15T18:42:38.038937] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-10 (1.92 seconds). [2025-10-15T18:42:38.045592] [INFO ] [REMOTE ] EMR: Full fetch complete (77241 records). [2025-10-15T18:42:38.045806] [DEBUG] [VALIDATOR ] EMR: Validating primary data. [2025-10-15T18:42:38.220356] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-15T18:42:38.476162] [DEBUG] [VALIDATOR ] EMR: All expected trading days are present. [2025-10-15T18:42:38.476243] [DEBUG] [VALIDATOR ] EMR: Primary data validation passed. [2025-10-15T18:42:38.477201] [INFO ] [MAIN ] EMR: Fetched primary data is valid. [2025-10-15T18:42:38.477267] [DEBUG] [LOCAL ] EMR: Saving primary data. [2025-10-15T18:42:38.478814] [DEBUG] [LOCAL ] EMR: Trimmed 77241 records to 53206 (keeping 200 days of data) [2025-10-15T18:42:38.538000] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-06. [2025-10-15T18:42:38.818333] [DEBUG] [LOCAL ] EMR: Primary data saved (53206 records). [2025-10-15T18:42:38.818513] [INFO ] [MAIN ] EMR: Full history saved. [2025-10-15T18:42:38.818611] [INFO ] [MAIN ] Update Progress: 736/2369 symbols completed. EMR took 44.4s. Estimated remaining: 3h 47m 35s. Rate: 7.2 symbols/min [2025-10-15T18:42:38.986148] [INFO ] [MAIN ] ENOV: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:42:39.027340] [DEBUG] [LOCAL ] ENOV: Loaded 44904 existing records from primary storage. [2025-10-15T18:42:39.027695] [INFO ] [MAIN ] ENOV: Loaded 44904 existing records. [2025-10-15T18:42:39.203851] [WARN ] [MAIN ] ENOV: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:42:39.204264] [INFO ] [MAIN ] ENOV: Wiping existing primary data before full refresh. [2025-10-15T18:42:39.204343] [INFO ] [LOCAL ] ENOV: Starting deletion of primary data. [2025-10-15T18:42:39.204888] [DEBUG] [LOCAL ] ENOV: Deleted primary data file. [2025-10-15T18:42:39.204946] [INFO ] [MAIN ] ENOV: Starting full primary refresh. [2025-10-15T18:42:39.318311] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-07. [2025-10-15T18:42:39.563459] [INFO ] [REMOTE ] ENOV: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:42:39.594131] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-15T18:42:39.862420] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-10-15T18:42:40.034944] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-15T18:42:40.114023] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-07. [2025-10-15T18:42:40.914013] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2024-12. [2025-10-15T18:42:41.504775] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-15T18:42:41.714048] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-08. [2025-10-15T18:42:42.306455] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-15T18:42:42.514038] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-01. [2025-10-15T18:42:43.142777] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-15T18:42:43.313972] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-09. [2025-10-15T18:42:43.923548] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-15T18:42:44.113970] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-02. [2025-10-15T18:42:44.309243] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-15T18:42:44.914053] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-08. [2025-10-15T18:42:45.562486] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-15T18:42:45.713992] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-03. [2025-10-15T18:42:46.513981] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-10. [2025-10-15T18:42:46.749312] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-15T18:42:47.311904] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-15T18:42:47.320405] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-09. [2025-10-15T18:42:47.734620] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-15T18:42:47.738818] [INFO ] [REMOTE ] ENIC: Full fetch complete (51605 records). [2025-10-15T18:42:47.738909] [DEBUG] [VALIDATOR ] ENIC: Validating primary data. [2025-10-15T18:42:48.106987] [DEBUG] [VALIDATOR ] ENIC: All expected trading days are present. [2025-10-15T18:42:48.107063] [DEBUG] [VALIDATOR ] ENIC: Primary data validation passed. [2025-10-15T18:42:48.107835] [INFO ] [MAIN ] ENIC: Fetched primary data is valid. [2025-10-15T18:42:48.107897] [DEBUG] [LOCAL ] ENIC: Saving primary data. [2025-10-15T18:42:48.109011] [DEBUG] [LOCAL ] ENIC: Trimmed 51605 records to 36700 (keeping 200 days of data) [2025-10-15T18:42:48.114046] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-08. [2025-10-15T18:42:48.333454] [DEBUG] [LOCAL ] ENIC: Primary data saved (36700 records). [2025-10-15T18:42:48.333582] [INFO ] [MAIN ] ENIC: Full history saved. [2025-10-15T18:42:48.333688] [INFO ] [MAIN ] Update Progress: 737/2369 symbols completed. ENIC took 32.8s. Estimated remaining: 3h 47m 29s. Rate: 7.2 symbols/min [2025-10-15T18:42:48.497932] [INFO ] [MAIN ] ENR: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:42:48.539675] [DEBUG] [LOCAL ] ENR: Loaded 43622 existing records from primary storage. [2025-10-15T18:42:48.539951] [INFO ] [MAIN ] ENR: Loaded 43622 existing records. [2025-10-15T18:42:48.712958] [WARN ] [MAIN ] ENR: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:42:48.713175] [INFO ] [MAIN ] ENR: Wiping existing primary data before full refresh. [2025-10-15T18:42:48.713221] [INFO ] [LOCAL ] ENR: Starting deletion of primary data. [2025-10-15T18:42:48.713601] [DEBUG] [LOCAL ] ENR: Deleted primary data file. [2025-10-15T18:42:48.713689] [INFO ] [MAIN ] ENR: Starting full primary refresh. [2025-10-15T18:42:48.923822] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-04. [2025-10-15T18:42:49.067798] [INFO ] [REMOTE ] ENR: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:42:49.071194] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-15T18:42:49.113549] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-15T18:42:49.714050] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-10. [2025-10-15T18:42:50.261701] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-15T18:42:50.513984] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-05. [2025-10-15T18:42:51.314001] [INFO ] [REMOTE ] ENR: Fetching primary data for 2024-12. [2025-10-15T18:42:51.404221] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-15T18:42:51.410550] [INFO ] [REMOTE ] ENB: Full fetch complete (77653 records). [2025-10-15T18:42:51.410693] [DEBUG] [VALIDATOR ] ENB: Validating primary data. [2025-10-15T18:42:51.820474] [DEBUG] [VALIDATOR ] ENB: All expected trading days are present. [2025-10-15T18:42:51.820717] [DEBUG] [VALIDATOR ] ENB: Primary data validation passed. [2025-10-15T18:42:51.821777] [INFO ] [MAIN ] ENB: Fetched primary data is valid. [2025-10-15T18:42:51.821958] [DEBUG] [LOCAL ] ENB: Saving primary data. [2025-10-15T18:42:51.823973] [DEBUG] [LOCAL ] ENB: Trimmed 77653 records to 53513 (keeping 200 days of data) [2025-10-15T18:42:52.057890] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-15T18:42:52.134928] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-06. [2025-10-15T18:42:52.184686] [DEBUG] [LOCAL ] ENB: Primary data saved (53513 records). [2025-10-15T18:42:52.184844] [INFO ] [MAIN ] ENB: Full history saved. [2025-10-15T18:42:52.185267] [INFO ] [MAIN ] Update Progress: 738/2369 symbols completed. ENB took 38.5s. Estimated remaining: 3h 47m 11s. Rate: 7.2 symbols/min [2025-10-15T18:42:52.358697] [INFO ] [MAIN ] ENS: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:42:52.390473] [DEBUG] [LOCAL ] ENS: Loaded 29567 existing records from primary storage. [2025-10-15T18:42:52.390773] [INFO ] [MAIN ] ENS: Loaded 29567 existing records. [2025-10-15T18:42:52.584609] [WARN ] [MAIN ] ENS: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:42:52.584872] [INFO ] [MAIN ] ENS: Wiping existing primary data before full refresh. [2025-10-15T18:42:52.584939] [INFO ] [LOCAL ] ENS: Starting deletion of primary data. [2025-10-15T18:42:52.585212] [DEBUG] [LOCAL ] ENS: Deleted primary data file. [2025-10-15T18:42:52.585268] [INFO ] [MAIN ] ENS: Starting full primary refresh. [2025-10-15T18:42:52.784088] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-15T18:42:52.919119] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-09. [2025-10-15T18:42:53.018664] [INFO ] [REMOTE ] ENS: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:42:53.380957] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-10-15T18:42:53.713997] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-01. [2025-10-15T18:42:53.782569] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-15T18:42:54.514074] [INFO ] [REMOTE ] ENS: Fetching primary data for 2024-12. [2025-10-15T18:42:55.121162] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-15T18:42:55.314024] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-02. [2025-10-15T18:42:56.092405] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-15T18:42:56.113950] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-01. [2025-10-15T18:42:56.662710] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-15T18:42:56.914022] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-03. [2025-10-15T18:42:56.938224] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-15T18:42:57.714004] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-07. [2025-10-15T18:42:58.260436] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-15T18:42:58.514069] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-04. [2025-10-15T18:42:59.319077] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-10. [2025-10-15T18:42:59.338501] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-15T18:42:59.945771] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-15T18:42:59.957013] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-15T18:42:59.958316] [INFO ] [REMOTE ] ENO: Full fetch complete (3051 records). [2025-10-15T18:42:59.958389] [DEBUG] [VALIDATOR ] ENO: Validating primary data. [2025-10-15T18:43:00.119138] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-05. [2025-10-15T18:43:00.322153] [DEBUG] [VALIDATOR ] ENO: All expected trading days are present. [2025-10-15T18:43:00.322228] [DEBUG] [VALIDATOR ] ENO: Primary data validation passed. [2025-10-15T18:43:00.322343] [INFO ] [MAIN ] ENO: Fetched primary data is valid. [2025-10-15T18:43:00.322380] [DEBUG] [LOCAL ] ENO: Saving primary data. [2025-10-15T18:43:00.322729] [DEBUG] [LOCAL ] ENO: Trimmed 3051 records to 1855 (keeping 200 days of data) [2025-10-15T18:43:00.333885] [DEBUG] [LOCAL ] ENO: Primary data saved (1855 records). [2025-10-15T18:43:00.333952] [INFO ] [MAIN ] ENO: Full history saved. [2025-10-15T18:43:00.334020] [INFO ] [MAIN ] Update Progress: 739/2369 symbols completed. ENO took 41.8s. Estimated remaining: 3h 47m 2s. Rate: 7.2 symbols/min [2025-10-15T18:43:00.496380] [INFO ] [MAIN ] ENVA: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:43:00.522487] [DEBUG] [LOCAL ] ENVA: Loaded 25448 existing records from primary storage. [2025-10-15T18:43:00.522757] [INFO ] [MAIN ] ENVA: Loaded 25448 existing records. [2025-10-15T18:43:00.693288] [WARN ] [MAIN ] ENVA: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:43:00.693493] [INFO ] [MAIN ] ENVA: Wiping existing primary data before full refresh. [2025-10-15T18:43:00.693558] [INFO ] [LOCAL ] ENVA: Starting deletion of primary data. [2025-10-15T18:43:00.693827] [DEBUG] [LOCAL ] ENVA: Deleted primary data file. [2025-10-15T18:43:00.693883] [INFO ] [MAIN ] ENVA: Starting full primary refresh. [2025-10-15T18:43:00.922940] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-02. [2025-10-15T18:43:01.039668] [INFO ] [REMOTE ] ENVA: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:43:01.713969] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2024-12. [2025-10-15T18:43:01.900271] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-15T18:43:01.975936] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-15T18:43:02.514046] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-08. [2025-10-15T18:43:03.085025] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-15T18:43:03.314077] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-01. [2025-10-15T18:43:04.113986] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-03. [2025-10-15T18:43:04.197160] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-15T18:43:04.248469] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-15T18:43:04.914007] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-06. [2025-10-15T18:43:05.409990] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-15T18:43:05.714050] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-09. [2025-10-15T18:43:06.256442] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-15T18:43:06.514005] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-04. [2025-10-15T18:43:07.131059] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-15T18:43:07.313995] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-07. [2025-10-15T18:43:08.031946] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-15T18:43:08.113960] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-02. [2025-10-15T18:43:08.915658] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-10. [2025-10-15T18:43:08.918251] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-15T18:43:08.982453] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-15T18:43:09.713985] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-05. [2025-10-15T18:43:10.410554] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-15T18:43:10.415380] [INFO ] [REMOTE ] ENOV: Full fetch complete (63482 records). [2025-10-15T18:43:10.415483] [DEBUG] [VALIDATOR ] ENOV: Validating primary data. [2025-10-15T18:43:10.514374] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-08. [2025-10-15T18:43:10.805435] [DEBUG] [VALIDATOR ] ENOV: All expected trading days are present. [2025-10-15T18:43:10.805666] [DEBUG] [VALIDATOR ] ENOV: Primary data validation passed. [2025-10-15T18:43:10.806527] [INFO ] [MAIN ] ENOV: Fetched primary data is valid. [2025-10-15T18:43:10.806666] [DEBUG] [LOCAL ] ENOV: Saving primary data. [2025-10-15T18:43:10.808074] [DEBUG] [LOCAL ] ENOV: Trimmed 63482 records to 44851 (keeping 200 days of data) [2025-10-15T18:43:10.922517] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-15T18:43:11.088581] [DEBUG] [LOCAL ] ENOV: Primary data saved (44851 records). [2025-10-15T18:43:11.088740] [INFO ] [MAIN ] ENOV: Full history saved. [2025-10-15T18:43:11.088828] [INFO ] [MAIN ] Update Progress: 740/2369 symbols completed. ENOV took 32.3s. Estimated remaining: 3h 46m 59s. Rate: 7.2 symbols/min [2025-10-15T18:43:11.252508] [INFO ] [MAIN ] EOD: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:43:11.269110] [DEBUG] [LOCAL ] EOD: Loaded 15024 existing records from primary storage. [2025-10-15T18:43:11.269331] [INFO ] [MAIN ] EOD: Loaded 15024 existing records. [2025-10-15T18:43:11.321990] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-06. [2025-10-15T18:43:11.445914] [WARN ] [MAIN ] EOD: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:43:11.446131] [INFO ] [MAIN ] EOD: Wiping existing primary data before full refresh. [2025-10-15T18:43:11.446179] [INFO ] [LOCAL ] EOD: Starting deletion of primary data. [2025-10-15T18:43:11.446405] [DEBUG] [LOCAL ] EOD: Deleted primary data file. [2025-10-15T18:43:11.446461] [INFO ] [MAIN ] EOD: Starting full primary refresh. [2025-10-15T18:43:11.791921] [INFO ] [REMOTE ] EOD: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:43:12.113979] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-03. [2025-10-15T18:43:12.178605] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-15T18:43:12.337235] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-15T18:43:12.914065] [INFO ] [REMOTE ] EOD: Fetching primary data for 2024-12. [2025-10-15T18:43:13.198921] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-15T18:43:13.686339] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-10-15T18:43:13.713975] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-01. [2025-10-15T18:43:14.513996] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-04. [2025-10-15T18:43:14.626316] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-15T18:43:15.314043] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-02. [2025-10-15T18:43:15.882166] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-15T18:43:16.108798] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-15T18:43:16.113954] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-07. [2025-10-15T18:43:16.913979] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-09. [2025-10-15T18:43:17.028605] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-15T18:43:17.714070] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-05. [2025-10-15T18:43:18.487253] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-15T18:43:18.513958] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-10. [2025-10-15T18:43:18.771111] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-15T18:43:19.313992] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-03. [2025-10-15T18:43:19.964210] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-15T18:43:20.095905] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-15T18:43:20.101203] [INFO ] [REMOTE ] ENR: Full fetch complete (59278 records). [2025-10-15T18:43:20.101352] [DEBUG] [VALIDATOR ] ENR: Validating primary data. [2025-10-15T18:43:20.123261] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-04. [2025-10-15T18:43:20.494810] [DEBUG] [VALIDATOR ] ENR: All expected trading days are present. [2025-10-15T18:43:20.494884] [DEBUG] [VALIDATOR ] ENR: Primary data validation passed. [2025-10-15T18:43:20.495732] [INFO ] [MAIN ] ENR: Fetched primary data is valid. [2025-10-15T18:43:20.495914] [DEBUG] [LOCAL ] ENR: Saving primary data. [2025-10-15T18:43:20.497350] [DEBUG] [LOCAL ] ENR: Trimmed 59278 records to 43703 (keeping 200 days of data) [2025-10-15T18:43:20.761149] [DEBUG] [LOCAL ] ENR: Primary data saved (43703 records). [2025-10-15T18:43:20.761313] [INFO ] [MAIN ] ENR: Full history saved. [2025-10-15T18:43:20.761408] [INFO ] [MAIN ] Update Progress: 741/2369 symbols completed. ENR took 32.4s. Estimated remaining: 3h 46m 53s. Rate: 7.2 symbols/min [2025-10-15T18:43:20.870517] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-15T18:43:20.919532] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-08. [2025-10-15T18:43:20.944254] [INFO ] [MAIN ] EOG: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:43:20.996145] [DEBUG] [LOCAL ] EOG: Loaded 53364 existing records from primary storage. [2025-10-15T18:43:20.996482] [INFO ] [MAIN ] EOG: Loaded 53364 existing records. [2025-10-15T18:43:21.166573] [WARN ] [MAIN ] EOG: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:43:21.166823] [INFO ] [MAIN ] EOG: Wiping existing primary data before full refresh. [2025-10-15T18:43:21.166871] [INFO ] [LOCAL ] EOG: Starting deletion of primary data. [2025-10-15T18:43:21.167184] [DEBUG] [LOCAL ] EOG: Deleted primary data file. [2025-10-15T18:43:21.167238] [INFO ] [MAIN ] EOG: Starting full primary refresh. [2025-10-15T18:43:21.514690] [INFO ] [REMOTE ] EOG: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:43:21.713969] [INFO ] [REMOTE ] EOG: Fetching primary data for 2024-12. [2025-10-15T18:43:22.163451] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-15T18:43:22.513958] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-09. [2025-10-15T18:43:23.313959] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-06. [2025-10-15T18:43:23.596082] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-10-15T18:43:23.993228] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-15T18:43:24.113957] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-10. [2025-10-15T18:43:24.429515] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-15T18:43:24.914044] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-07. [2025-10-15T18:43:25.618324] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-15T18:43:25.622412] [INFO ] [REMOTE ] ENS: Full fetch complete (42509 records). [2025-10-15T18:43:25.622503] [DEBUG] [VALIDATOR ] ENS: Validating primary data. [2025-10-15T18:43:25.719860] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-01. [2025-10-15T18:43:25.996700] [DEBUG] [VALIDATOR ] ENS: All expected trading days are present. [2025-10-15T18:43:25.996993] [DEBUG] [VALIDATOR ] ENS: Primary data validation passed. [2025-10-15T18:43:25.997719] [INFO ] [MAIN ] ENS: Fetched primary data is valid. [2025-10-15T18:43:25.997779] [DEBUG] [LOCAL ] ENS: Saving primary data. [2025-10-15T18:43:25.999008] [DEBUG] [LOCAL ] ENS: Trimmed 42509 records to 29689 (keeping 200 days of data) [2025-10-15T18:43:26.178119] [DEBUG] [LOCAL ] ENS: Primary data saved (29689 records). [2025-10-15T18:43:26.178251] [INFO ] [MAIN ] ENS: Full history saved. [2025-10-15T18:43:26.178332] [INFO ] [MAIN ] Update Progress: 742/2369 symbols completed. ENS took 34.0s. Estimated remaining: 3h 46m 39s. Rate: 7.2 symbols/min [2025-10-15T18:43:26.348373] [INFO ] [MAIN ] EOI: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:43:26.361387] [DEBUG] [LOCAL ] EOI: Loaded 10770 existing records from primary storage. [2025-10-15T18:43:26.361782] [INFO ] [MAIN ] EOI: Loaded 10770 existing records. [2025-10-15T18:43:26.532688] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-05. [2025-10-15T18:43:26.568448] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-15T18:43:26.573958] [WARN ] [MAIN ] EOI: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:43:26.580060] [INFO ] [MAIN ] EOI: Wiping existing primary data before full refresh. [2025-10-15T18:43:26.580360] [INFO ] [LOCAL ] EOI: Starting deletion of primary data. [2025-10-15T18:43:26.580764] [DEBUG] [LOCAL ] EOI: Deleted primary data file. [2025-10-15T18:43:26.580823] [INFO ] [MAIN ] EOI: Starting full primary refresh. [2025-10-15T18:43:26.926599] [INFO ] [REMOTE ] EOI: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:43:27.314069] [INFO ] [REMOTE ] EOI: Fetching primary data for 2024-12. [2025-10-15T18:43:27.480024] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-15T18:43:27.732243] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-10-15T18:43:28.114033] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-06. [2025-10-15T18:43:28.574710] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-15T18:43:28.914009] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-01. [2025-10-15T18:43:29.082060] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-15T18:43:29.713971] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-02. [2025-10-15T18:43:29.759705] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-15T18:43:30.513993] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-07. [2025-10-15T18:43:31.313960] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-02. [2025-10-15T18:43:31.416411] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-15T18:43:31.638863] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-15T18:43:32.113951] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-03. [2025-10-15T18:43:32.124158] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-15T18:43:32.913981] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-08. [2025-10-15T18:43:33.713981] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-03. [2025-10-15T18:43:33.982825] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-15T18:43:34.034327] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-15T18:43:34.506935] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-15T18:43:34.513944] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-04. [2025-10-15T18:43:35.139613] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-10-15T18:43:35.314028] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-08. [2025-10-15T18:43:36.113984] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-04. [2025-10-15T18:43:36.321454] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-15T18:43:36.914014] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-09. [2025-10-15T18:43:37.714004] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-05. [2025-10-15T18:43:37.884199] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-15T18:43:38.223130] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-15T18:43:38.328938] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-15T18:43:38.513981] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-06. [2025-10-15T18:43:39.242479] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-15T18:43:39.314036] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-09. [2025-10-15T18:43:40.113969] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-07. [2025-10-15T18:43:40.182458] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-15T18:43:40.719885] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-15T18:43:40.913989] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-05. [2025-10-15T18:43:41.714015] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-08. [2025-10-15T18:43:42.474379] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-15T18:43:42.513958] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-10. [2025-10-15T18:43:42.744023] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-15T18:43:43.314025] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-10. [2025-10-15T18:43:43.555439] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-15T18:43:43.558452] [INFO ] [REMOTE ] ENVA: Full fetch complete (36680 records). [2025-10-15T18:43:43.558548] [DEBUG] [VALIDATOR ] ENVA: Validating primary data. [2025-10-15T18:43:43.919122] [DEBUG] [VALIDATOR ] ENVA: All expected trading days are present. [2025-10-15T18:43:43.919198] [DEBUG] [VALIDATOR ] ENVA: Primary data validation passed. [2025-10-15T18:43:43.919826] [INFO ] [MAIN ] ENVA: Fetched primary data is valid. [2025-10-15T18:43:43.919887] [DEBUG] [LOCAL ] ENVA: Saving primary data. [2025-10-15T18:43:43.920638] [DEBUG] [LOCAL ] ENVA: Trimmed 36680 records to 25474 (keeping 200 days of data) [2025-10-15T18:43:44.071132] [DEBUG] [LOCAL ] ENVA: Primary data saved (25474 records). [2025-10-15T18:43:44.071259] [INFO ] [MAIN ] ENVA: Full history saved. [2025-10-15T18:43:44.071373] [INFO ] [MAIN ] Update Progress: 743/2369 symbols completed. ENVA took 43.7s. Estimated remaining: 3h 46m 51s. Rate: 7.2 symbols/min [2025-10-15T18:43:44.119131] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-06. [2025-10-15T18:43:44.250342] [INFO ] [MAIN ] EOS: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:43:44.266503] [DEBUG] [LOCAL ] EOS: Loaded 15287 existing records from primary storage. [2025-10-15T18:43:44.266756] [INFO ] [MAIN ] EOS: Loaded 15287 existing records. [2025-10-15T18:43:44.379158] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-15T18:43:44.398203] [INFO ] [REMOTE ] EOD: Full fetch complete (20966 records). [2025-10-15T18:43:44.403440] [DEBUG] [VALIDATOR ] EOD: Validating primary data. [2025-10-15T18:43:44.546226] [WARN ] [MAIN ] EOS: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:43:44.568756] [INFO ] [MAIN ] EOS: Wiping existing primary data before full refresh. [2025-10-15T18:43:44.568916] [INFO ] [LOCAL ] EOS: Starting deletion of primary data. [2025-10-15T18:43:44.569245] [DEBUG] [LOCAL ] EOS: Deleted primary data file. [2025-10-15T18:43:44.590120] [INFO ] [MAIN ] EOS: Starting full primary refresh. [2025-10-15T18:43:44.919185] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-09. [2025-10-15T18:43:45.151483] [DEBUG] [VALIDATOR ] EOD: All expected trading days are present. [2025-10-15T18:43:45.156723] [DEBUG] [VALIDATOR ] EOD: Primary data validation passed. [2025-10-15T18:43:45.170165] [INFO ] [MAIN ] EOD: Fetched primary data is valid. [2025-10-15T18:43:45.180891] [DEBUG] [LOCAL ] EOD: Saving primary data. [2025-10-15T18:43:45.212943] [DEBUG] [LOCAL ] EOD: Trimmed 20966 records to 15054 (keeping 200 days of data) [2025-10-15T18:43:45.212815] [INFO ] [REMOTE ] EOS: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:43:45.303698] [DEBUG] [LOCAL ] EOD: Primary data saved (15054 records). [2025-10-15T18:43:45.303866] [INFO ] [MAIN ] EOD: Full history saved. [2025-10-15T18:43:45.303972] [INFO ] [MAIN ] Update Progress: 744/2369 symbols completed. EOD took 34.2s. Estimated remaining: 3h 46m 27s. Rate: 7.2 symbols/min [2025-10-15T18:43:45.471106] [INFO ] [MAIN ] EOT: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:43:45.481862] [DEBUG] [LOCAL ] EOT: Loaded 6895 existing records from primary storage. [2025-10-15T18:43:45.482056] [INFO ] [MAIN ] EOT: Loaded 6895 existing records. [2025-10-15T18:43:45.660245] [WARN ] [MAIN ] EOT: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:43:45.661216] [INFO ] [MAIN ] EOT: Wiping existing primary data before full refresh. [2025-10-15T18:43:45.661365] [INFO ] [LOCAL ] EOT: Starting deletion of primary data. [2025-10-15T18:43:45.661574] [DEBUG] [LOCAL ] EOT: Deleted primary data file. [2025-10-15T18:43:45.661691] [INFO ] [MAIN ] EOT: Starting full primary refresh. [2025-10-15T18:43:45.722901] [INFO ] [REMOTE ] EOS: Fetching primary data for 2024-12. [2025-10-15T18:43:45.782683] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-15T18:43:46.051777] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-10-15T18:43:46.055260] [INFO ] [REMOTE ] EOT: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:43:46.514027] [INFO ] [REMOTE ] EOT: Fetching primary data for 2024-12. [2025-10-15T18:43:47.137277] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-15T18:43:47.314039] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-07. [2025-10-15T18:43:47.544182] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-15T18:43:48.114011] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-01. [2025-10-15T18:43:48.750209] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-15T18:43:48.913984] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-10. [2025-10-15T18:43:49.172387] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-15T18:43:49.714057] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-08. [2025-10-15T18:43:49.819952] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-15T18:43:49.821898] [INFO ] [REMOTE ] EOI: Full fetch complete (16241 records). [2025-10-15T18:43:49.821987] [DEBUG] [VALIDATOR ] EOI: Validating primary data. [2025-10-15T18:43:50.182528] [DEBUG] [VALIDATOR ] EOI: All expected trading days are present. [2025-10-15T18:43:50.182608] [DEBUG] [VALIDATOR ] EOI: Primary data validation passed. [2025-10-15T18:43:50.183000] [INFO ] [MAIN ] EOI: Fetched primary data is valid. [2025-10-15T18:43:50.183060] [DEBUG] [LOCAL ] EOI: Saving primary data. [2025-10-15T18:43:50.183616] [DEBUG] [LOCAL ] EOI: Trimmed 16241 records to 10670 (keeping 200 days of data) [2025-10-15T18:43:50.249054] [DEBUG] [LOCAL ] EOI: Primary data saved (10670 records). [2025-10-15T18:43:50.249197] [INFO ] [MAIN ] EOI: Full history saved. [2025-10-15T18:43:50.249330] [INFO ] [MAIN ] Update Progress: 745/2369 symbols completed. EOI took 24.1s. Estimated remaining: 3h 46m 11s. Rate: 7.2 symbols/min [2025-10-15T18:43:50.425218] [INFO ] [MAIN ] EPAC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:43:50.455433] [DEBUG] [LOCAL ] EPAC: Loaded 26413 existing records from primary storage. [2025-10-15T18:43:50.455801] [INFO ] [MAIN ] EPAC: Loaded 26413 existing records. [2025-10-15T18:43:50.519114] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-02. [2025-10-15T18:43:50.633711] [WARN ] [MAIN ] EPAC: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:43:50.633868] [INFO ] [MAIN ] EPAC: Wiping existing primary data before full refresh. [2025-10-15T18:43:50.633990] [INFO ] [LOCAL ] EPAC: Starting deletion of primary data. [2025-10-15T18:43:50.634254] [DEBUG] [LOCAL ] EPAC: Deleted primary data file. [2025-10-15T18:43:50.634293] [INFO ] [MAIN ] EPAC: Starting full primary refresh. [2025-10-15T18:43:50.987324] [INFO ] [REMOTE ] EPAC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:43:51.291695] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-15T18:43:51.314074] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-01. [2025-10-15T18:43:51.522138] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-15T18:43:51.913554] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-15T18:43:52.113997] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-02. [2025-10-15T18:43:52.883457] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-15T18:43:52.913995] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-03. [2025-10-15T18:43:53.713980] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-09. [2025-10-15T18:43:54.034158] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-15T18:43:54.514008] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-03. [2025-10-15T18:43:55.214400] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-15T18:43:55.314098] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-04. [2025-10-15T18:43:55.533634] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-15T18:43:55.895870] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-15T18:43:56.114083] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-05. [2025-10-15T18:43:56.678344] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-15T18:43:56.914070] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-10. [2025-10-15T18:43:57.713964] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-06. [2025-10-15T18:43:57.935894] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-15T18:43:57.942321] [INFO ] [REMOTE ] EOG: Full fetch complete (77460 records). [2025-10-15T18:43:57.942445] [DEBUG] [VALIDATOR ] EOG: Validating primary data. [2025-10-15T18:43:58.327035] [DEBUG] [VALIDATOR ] EOG: All expected trading days are present. [2025-10-15T18:43:58.327122] [DEBUG] [VALIDATOR ] EOG: Primary data validation passed. [2025-10-15T18:43:58.328100] [INFO ] [MAIN ] EOG: Fetched primary data is valid. [2025-10-15T18:43:58.328162] [DEBUG] [LOCAL ] EOG: Saving primary data. [2025-10-15T18:43:58.329593] [DEBUG] [LOCAL ] EOG: Trimmed 77460 records to 53373 (keeping 200 days of data) [2025-10-15T18:43:58.522505] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2024-12. [2025-10-15T18:43:58.554572] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-15T18:43:58.674071] [DEBUG] [LOCAL ] EOG: Primary data saved (53373 records). [2025-10-15T18:43:58.674207] [INFO ] [MAIN ] EOG: Full history saved. [2025-10-15T18:43:58.674284] [INFO ] [MAIN ] Update Progress: 746/2369 symbols completed. EOG took 37.9s. Estimated remaining: 3h 46m 3s. Rate: 7.2 symbols/min [2025-10-15T18:43:58.838775] [INFO ] [MAIN ] EPAM: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:43:58.838921] [DEBUG] [LOCAL ] EPAM: No existing data file found in primary storage. [2025-10-15T18:43:58.838957] [WARN ] [MAIN ] EPAM: No existing data found, performing full refresh instead. [2025-10-15T18:43:58.839062] [INFO ] [MAIN ] EPAM: Wiping existing primary data before full refresh. [2025-10-15T18:43:58.839102] [INFO ] [LOCAL ] EPAM: Starting deletion of primary data. [2025-10-15T18:43:58.839142] [DEBUG] [LOCAL ] EPAM: No primary data file found to delete. [2025-10-15T18:43:58.839225] [INFO ] [MAIN ] EPAM: Starting full primary refresh. [2025-10-15T18:43:59.185703] [INFO ] [REMOTE ] EPAM: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:43:59.313957] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2024-12. [2025-10-15T18:43:59.894175] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-15T18:44:00.114045] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-01. [2025-10-15T18:44:00.913976] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-04. [2025-10-15T18:44:01.100514] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-15T18:44:01.364186] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-15T18:44:01.714016] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-07. [2025-10-15T18:44:02.453377] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-15T18:44:02.513974] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-05. [2025-10-15T18:44:02.552362] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-15T18:44:03.313988] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-01. [2025-10-15T18:44:03.403801] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-15T18:44:04.113990] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-06. [2025-10-15T18:44:04.835507] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-15T18:44:04.913990] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-02. [2025-10-15T18:44:04.947915] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-15T18:44:05.713998] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-02. [2025-10-15T18:44:06.345527] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-15T18:44:06.513993] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-03. [2025-10-15T18:44:06.782495] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-15T18:44:07.314000] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-08. [2025-10-15T18:44:08.089871] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-15T18:44:08.113983] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-09. [2025-10-15T18:44:08.150233] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-15T18:44:08.698362] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-15T18:44:08.914032] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-03. [2025-10-15T18:44:09.714112] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-10. [2025-10-15T18:44:10.314436] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-15T18:44:10.495490] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-15T18:44:10.497087] [INFO ] [REMOTE ] EOT: Full fetch complete (10832 records). [2025-10-15T18:44:10.497154] [DEBUG] [VALIDATOR ] EOT: Validating primary data. [2025-10-15T18:44:10.519162] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-07. [2025-10-15T18:44:10.883495] [DEBUG] [VALIDATOR ] EOT: All expected trading days are present. [2025-10-15T18:44:10.883573] [DEBUG] [VALIDATOR ] EOT: Primary data validation passed. [2025-10-15T18:44:10.883839] [INFO ] [MAIN ] EOT: Fetched primary data is valid. [2025-10-15T18:44:10.883898] [DEBUG] [LOCAL ] EOT: Saving primary data. [2025-10-15T18:44:10.884318] [DEBUG] [LOCAL ] EOT: Trimmed 10832 records to 6957 (keeping 200 days of data) [2025-10-15T18:44:10.928370] [DEBUG] [LOCAL ] EOT: Primary data saved (6957 records). [2025-10-15T18:44:10.928473] [INFO ] [MAIN ] EOT: Full history saved. [2025-10-15T18:44:10.928571] [INFO ] [MAIN ] Update Progress: 747/2369 symbols completed. EOT took 25.6s. Estimated remaining: 3h 46m 3s. Rate: 7.2 symbols/min [2025-10-15T18:44:11.093807] [INFO ] [MAIN ] EPC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:44:11.093963] [DEBUG] [LOCAL ] EPC: No existing data file found in primary storage. [2025-10-15T18:44:11.093999] [WARN ] [MAIN ] EPC: No existing data found, performing full refresh instead. [2025-10-15T18:44:11.094102] [INFO ] [MAIN ] EPC: Wiping existing primary data before full refresh. [2025-10-15T18:44:11.094142] [INFO ] [LOCAL ] EPC: Starting deletion of primary data. [2025-10-15T18:44:11.094182] [DEBUG] [LOCAL ] EPC: No primary data file found to delete. [2025-10-15T18:44:11.094214] [INFO ] [MAIN ] EPC: Starting full primary refresh. [2025-10-15T18:44:11.322133] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-04. [2025-10-15T18:44:11.451216] [INFO ] [REMOTE ] EPC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:44:11.567263] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-15T18:44:12.113996] [INFO ] [REMOTE ] EPC: Fetching primary data for 2024-12. [2025-10-15T18:44:12.630971] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-15T18:44:12.914015] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-08. [2025-10-15T18:44:13.713969] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-05. [2025-10-15T18:44:13.768181] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-15T18:44:13.922808] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-15T18:44:14.517104] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-04. [2025-10-15T18:44:14.520976] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-15T18:44:15.314073] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-06. [2025-10-15T18:44:16.113977] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-09. [2025-10-15T18:44:16.142410] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-15T18:44:16.465278] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-15T18:44:16.914065] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-01. [2025-10-15T18:44:17.049230] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-15T18:44:17.714027] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-07. [2025-10-15T18:44:18.273828] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-15T18:44:18.519106] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-02. [2025-10-15T18:44:18.530999] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-15T18:44:19.314087] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-05. [2025-10-15T18:44:19.878773] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-15T18:44:20.114058] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-08. [2025-10-15T18:44:20.728814] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-15T18:44:20.913979] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-06. [2025-10-15T18:44:21.535304] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-15T18:44:21.714009] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-03. [2025-10-15T18:44:22.388512] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-15T18:44:22.514048] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-09. [2025-10-15T18:44:23.164017] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-15T18:44:23.313990] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-04. [2025-10-15T18:44:23.368412] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-15T18:44:24.114006] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-07. [2025-10-15T18:44:24.849105] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-15T18:44:24.913992] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-05. [2025-10-15T18:44:25.604783] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-15T18:44:25.713954] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-08. [2025-10-15T18:44:26.348315] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-15T18:44:26.514044] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-10. [2025-10-15T18:44:27.313977] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-10. [2025-10-15T18:44:27.347412] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-15T18:44:27.557409] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-15T18:44:27.559918] [INFO ] [REMOTE ] EOS: Full fetch complete (23099 records). [2025-10-15T18:44:27.560001] [DEBUG] [VALIDATOR ] EOS: Validating primary data. [2025-10-15T18:44:27.918029] [DEBUG] [VALIDATOR ] EOS: All expected trading days are present. [2025-10-15T18:44:27.918136] [DEBUG] [VALIDATOR ] EOS: Primary data validation passed. [2025-10-15T18:44:27.918676] [INFO ] [MAIN ] EOS: Fetched primary data is valid. [2025-10-15T18:44:27.918748] [DEBUG] [LOCAL ] EOS: Saving primary data. [2025-10-15T18:44:27.919540] [DEBUG] [LOCAL ] EOS: Trimmed 23099 records to 15153 (keeping 200 days of data) [2025-10-15T18:44:28.012470] [DEBUG] [LOCAL ] EOS: Primary data saved (15153 records). [2025-10-15T18:44:28.012606] [INFO ] [MAIN ] EOS: Full history saved. [2025-10-15T18:44:28.012706] [INFO ] [MAIN ] Update Progress: 748/2369 symbols completed. EOS took 43.9s. Estimated remaining: 3h 46m 14s. Rate: 7.2 symbols/min [2025-10-15T18:44:28.119122] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-09. [2025-10-15T18:44:28.183067] [INFO ] [MAIN ] EPD: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:44:28.234067] [DEBUG] [LOCAL ] EPD: Loaded 53611 existing records from primary storage. [2025-10-15T18:44:28.234367] [INFO ] [MAIN ] EPD: Loaded 53611 existing records. [2025-10-15T18:44:28.409572] [WARN ] [MAIN ] EPD: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:44:28.409896] [INFO ] [MAIN ] EPD: Wiping existing primary data before full refresh. [2025-10-15T18:44:28.409975] [INFO ] [LOCAL ] EPD: Starting deletion of primary data. [2025-10-15T18:44:28.410376] [DEBUG] [LOCAL ] EPD: Deleted primary data file. [2025-10-15T18:44:28.410417] [INFO ] [MAIN ] EPD: Starting full primary refresh. [2025-10-15T18:44:28.684413] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-15T18:44:28.715408] [INFO ] [REMOTE ] EPAC: Full fetch complete (38668 records). [2025-10-15T18:44:28.715544] [DEBUG] [VALIDATOR ] EPAC: Validating primary data. [2025-10-15T18:44:28.895708] [INFO ] [REMOTE ] EPD: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:44:28.919097] [INFO ] [REMOTE ] EPD: Fetching primary data for 2024-12. [2025-10-15T18:44:29.161530] [DEBUG] [VALIDATOR ] EPAC: All expected trading days are present. [2025-10-15T18:44:29.161612] [DEBUG] [VALIDATOR ] EPAC: Primary data validation passed. [2025-10-15T18:44:29.162244] [INFO ] [MAIN ] EPAC: Fetched primary data is valid. [2025-10-15T18:44:29.162304] [DEBUG] [LOCAL ] EPAC: Saving primary data. [2025-10-15T18:44:29.163128] [DEBUG] [LOCAL ] EPAC: Trimmed 38668 records to 26461 (keeping 200 days of data) [2025-10-15T18:44:29.326388] [DEBUG] [LOCAL ] EPAC: Primary data saved (26461 records). [2025-10-15T18:44:29.326523] [INFO ] [MAIN ] EPAC: Full history saved. [2025-10-15T18:44:29.326606] [INFO ] [MAIN ] Update Progress: 749/2369 symbols completed. EPAC took 39.1s. Estimated remaining: 3h 45m 50s. Rate: 7.2 symbols/min [2025-10-15T18:44:29.495215] [INFO ] [MAIN ] EPR: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:44:29.519599] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-15T18:44:29.566161] [DEBUG] [LOCAL ] EPR: Loaded 43858 existing records from primary storage. [2025-10-15T18:44:29.566450] [INFO ] [MAIN ] EPR: Loaded 43858 existing records. [2025-10-15T18:44:29.720505] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-10. [2025-10-15T18:44:29.742539] [WARN ] [MAIN ] EPR: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:44:29.742855] [INFO ] [MAIN ] EPR: Wiping existing primary data before full refresh. [2025-10-15T18:44:29.742915] [INFO ] [LOCAL ] EPR: Starting deletion of primary data. [2025-10-15T18:44:29.743293] [DEBUG] [LOCAL ] EPR: Deleted primary data file. [2025-10-15T18:44:29.743330] [INFO ] [MAIN ] EPR: Starting full primary refresh. [2025-10-15T18:44:30.091285] [INFO ] [REMOTE ] EPR: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:44:30.514049] [INFO ] [REMOTE ] EPR: Fetching primary data for 2024-12. [2025-10-15T18:44:30.959758] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-10-15T18:44:31.314007] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-01. [2025-10-15T18:44:31.379432] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-15T18:44:31.384558] [INFO ] [REMOTE ] EPAM: Full fetch complete (56306 records). [2025-10-15T18:44:31.384672] [DEBUG] [VALIDATOR ] EPAM: Validating primary data. [2025-10-15T18:44:31.769737] [DEBUG] [VALIDATOR ] EPAM: All expected trading days are present. [2025-10-15T18:44:31.769838] [DEBUG] [VALIDATOR ] EPAM: Primary data validation passed. [2025-10-15T18:44:31.770585] [INFO ] [MAIN ] EPAM: Fetched primary data is valid. [2025-10-15T18:44:31.770728] [DEBUG] [LOCAL ] EPAM: Saving primary data. [2025-10-15T18:44:31.772090] [DEBUG] [LOCAL ] EPAM: Trimmed 56306 records to 39462 (keeping 200 days of data) [2025-10-15T18:44:31.880554] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-15T18:44:32.037358] [DEBUG] [LOCAL ] EPAM: Primary data saved (39462 records). [2025-10-15T18:44:32.037492] [INFO ] [MAIN ] EPAM: Full history saved. [2025-10-15T18:44:32.037562] [INFO ] [MAIN ] Update Progress: 750/2369 symbols completed. EPAM took 33.4s. Estimated remaining: 3h 45m 29s. Rate: 7.2 symbols/min [2025-10-15T18:44:32.119152] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-01. [2025-10-15T18:44:32.206534] [INFO ] [MAIN ] EPRT: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:44:32.249094] [DEBUG] [LOCAL ] EPRT: Loaded 48439 existing records from primary storage. [2025-10-15T18:44:32.249389] [INFO ] [MAIN ] EPRT: Loaded 48439 existing records. [2025-10-15T18:44:32.421485] [WARN ] [MAIN ] EPRT: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:44:32.421726] [INFO ] [MAIN ] EPRT: Wiping existing primary data before full refresh. [2025-10-15T18:44:32.421779] [INFO ] [LOCAL ] EPRT: Starting deletion of primary data. [2025-10-15T18:44:32.422034] [DEBUG] [LOCAL ] EPRT: Deleted primary data file. [2025-10-15T18:44:32.422070] [INFO ] [MAIN ] EPRT: Starting full primary refresh. [2025-10-15T18:44:32.780046] [INFO ] [REMOTE ] EPRT: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:44:32.913980] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2024-12. [2025-10-15T18:44:32.990132] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-15T18:44:33.523317] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-15T18:44:33.713978] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-02. [2025-10-15T18:44:34.163271] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-15T18:44:34.513995] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-01. [2025-10-15T18:44:35.234684] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-15T18:44:35.313970] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-03. [2025-10-15T18:44:36.119106] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-06. [2025-10-15T18:44:36.130987] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-15T18:44:36.856379] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-15T18:44:36.913954] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-04. [2025-10-15T18:44:37.275135] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-15T18:44:37.714050] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-07. [2025-10-15T18:44:38.514002] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-02. [2025-10-15T18:44:38.577410] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-15T18:44:38.889976] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-15T18:44:39.314058] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-05. [2025-10-15T18:44:39.970583] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-15T18:44:40.114017] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-03. [2025-10-15T18:44:40.908742] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-15T18:44:40.917179] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-08. [2025-10-15T18:44:41.714031] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-06. [2025-10-15T18:44:42.234598] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-10-15T18:44:42.322192] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-15T18:44:42.513996] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-04. [2025-10-15T18:44:43.261085] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-15T18:44:43.314009] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-09. [2025-10-15T18:44:44.114068] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-02. [2025-10-15T18:44:44.561883] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-10-15T18:44:44.729680] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-15T18:44:44.914027] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-05. [2025-10-15T18:44:45.537056] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-15T18:44:45.714022] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-03. [2025-10-15T18:44:46.514054] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-07. [2025-10-15T18:44:46.831059] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-15T18:44:47.158690] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-15T18:44:47.314004] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-04. [2025-10-15T18:44:48.114025] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-06. [2025-10-15T18:44:48.252056] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-15T18:44:48.919213] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-10. [2025-10-15T18:44:48.931494] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-15T18:44:49.556803] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-15T18:44:49.713976] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-07. [2025-10-15T18:44:50.514033] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-05. [2025-10-15T18:44:50.542678] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-15T18:44:50.547402] [INFO ] [REMOTE ] EPC: Full fetch complete (57157 records). [2025-10-15T18:44:50.547513] [DEBUG] [VALIDATOR ] EPC: Validating primary data. [2025-10-15T18:44:50.924781] [DEBUG] [VALIDATOR ] EPC: All expected trading days are present. [2025-10-15T18:44:50.924857] [DEBUG] [VALIDATOR ] EPC: Primary data validation passed. [2025-10-15T18:44:50.925609] [INFO ] [MAIN ] EPC: Fetched primary data is valid. [2025-10-15T18:44:50.925674] [DEBUG] [LOCAL ] EPC: Saving primary data. [2025-10-15T18:44:50.926768] [DEBUG] [LOCAL ] EPC: Trimmed 57157 records to 39741 (keeping 200 days of data) [2025-10-15T18:44:51.175635] [DEBUG] [LOCAL ] EPC: Primary data saved (39741 records). [2025-10-15T18:44:51.175836] [INFO ] [MAIN ] EPC: Full history saved. [2025-10-15T18:44:51.175927] [INFO ] [MAIN ] Update Progress: 751/2369 symbols completed. EPC took 40.2s. Estimated remaining: 3h 45m 44s. Rate: 7.2 symbols/min [2025-10-15T18:44:51.319250] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-08. [2025-10-15T18:44:51.381482] [INFO ] [MAIN ] EQBK: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:44:51.394914] [DEBUG] [LOCAL ] EQBK: Loaded 11133 existing records from primary storage. [2025-10-15T18:44:51.395203] [INFO ] [MAIN ] EQBK: Loaded 11133 existing records. [2025-10-15T18:44:51.580123] [WARN ] [MAIN ] EQBK: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:44:51.581189] [INFO ] [MAIN ] EQBK: Wiping existing primary data before full refresh. [2025-10-15T18:44:51.581273] [INFO ] [LOCAL ] EQBK: Starting deletion of primary data. [2025-10-15T18:44:51.581531] [DEBUG] [LOCAL ] EQBK: Deleted primary data file. [2025-10-15T18:44:51.581628] [INFO ] [MAIN ] EQBK: Starting full primary refresh. [2025-10-15T18:44:51.972805] [INFO ] [REMOTE ] EQBK: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:44:51.991421] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-07 (2.28 seconds). [2025-10-15T18:44:52.079554] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-15T18:44:52.113950] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-06. [2025-10-15T18:44:52.696520] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-15T18:44:52.913988] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-08. [2025-10-15T18:44:53.713993] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-09. [2025-10-15T18:44:53.815407] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-15T18:44:54.513998] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2024-12. [2025-10-15T18:44:54.993700] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-08 (2.08 seconds). [2025-10-15T18:44:55.054473] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-15T18:44:55.314032] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-09. [2025-10-15T18:44:55.412411] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-10-15T18:44:56.114042] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-01. [2025-10-15T18:44:56.834599] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-15T18:44:56.913962] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-02. [2025-10-15T18:44:57.166886] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-15T18:44:57.642290] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-15T18:44:57.713964] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-03. [2025-10-15T18:44:58.465528] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-15T18:44:58.513957] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-04. [2025-10-15T18:44:59.248560] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-15T18:44:59.313974] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-10. [2025-10-15T18:45:00.114016] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-05. [2025-10-15T18:45:00.835706] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-15T18:45:00.914036] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-10. [2025-10-15T18:45:01.178361] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-10 (1.86 seconds). [2025-10-15T18:45:01.186067] [INFO ] [REMOTE ] EPD: Full fetch complete (77775 records). [2025-10-15T18:45:01.186417] [DEBUG] [VALIDATOR ] EPD: Validating primary data. [2025-10-15T18:45:01.618165] [DEBUG] [VALIDATOR ] EPD: All expected trading days are present. [2025-10-15T18:45:01.618289] [DEBUG] [VALIDATOR ] EPD: Primary data validation passed. [2025-10-15T18:45:01.619798] [INFO ] [MAIN ] EPD: Fetched primary data is valid. [2025-10-15T18:45:01.619878] [DEBUG] [LOCAL ] EPD: Saving primary data. [2025-10-15T18:45:01.622238] [DEBUG] [LOCAL ] EPD: Trimmed 77775 records to 53611 (keeping 200 days of data) [2025-10-15T18:45:01.722407] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-06. [2025-10-15T18:45:02.065275] [DEBUG] [LOCAL ] EPD: Primary data saved (53611 records). [2025-10-15T18:45:02.065485] [INFO ] [MAIN ] EPD: Full history saved. [2025-10-15T18:45:02.065586] [INFO ] [MAIN ] Update Progress: 752/2369 symbols completed. EPD took 34.1s. Estimated remaining: 3h 45m 41s. Rate: 7.2 symbols/min [2025-10-15T18:45:02.241990] [INFO ] [MAIN ] EQH: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:45:02.299834] [DEBUG] [LOCAL ] EQH: Loaded 52687 existing records from primary storage. [2025-10-15T18:45:02.300304] [INFO ] [MAIN ] EQH: Loaded 52687 existing records. [2025-10-15T18:45:02.492121] [WARN ] [MAIN ] EQH: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:45:02.492424] [INFO ] [MAIN ] EQH: Wiping existing primary data before full refresh. [2025-10-15T18:45:02.492480] [INFO ] [LOCAL ] EQH: Starting deletion of primary data. [2025-10-15T18:45:02.493038] [DEBUG] [LOCAL ] EQH: Deleted primary data file. [2025-10-15T18:45:02.493098] [INFO ] [MAIN ] EQH: Starting full primary refresh. [2025-10-15T18:45:02.526387] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-07. [2025-10-15T18:45:02.779006] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-15T18:45:02.909273] [INFO ] [REMOTE ] EQH: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:45:03.056386] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-10 (2.14 seconds). [2025-10-15T18:45:03.063450] [INFO ] [REMOTE ] EPR: Full fetch complete (63242 records). [2025-10-15T18:45:03.063736] [DEBUG] [VALIDATOR ] EPR: Validating primary data. [2025-10-15T18:45:03.320862] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-07. [2025-10-15T18:45:03.514860] [DEBUG] [VALIDATOR ] EPR: All expected trading days are present. [2025-10-15T18:45:03.515000] [DEBUG] [VALIDATOR ] EPR: Primary data validation passed. [2025-10-15T18:45:03.516341] [INFO ] [MAIN ] EPR: Fetched primary data is valid. [2025-10-15T18:45:03.516465] [DEBUG] [LOCAL ] EPR: Saving primary data. [2025-10-15T18:45:03.518548] [DEBUG] [LOCAL ] EPR: Trimmed 63242 records to 43877 (keeping 200 days of data) [2025-10-15T18:45:03.819519] [DEBUG] [LOCAL ] EPR: Primary data saved (43877 records). [2025-10-15T18:45:03.819773] [INFO ] [MAIN ] EPR: Full history saved. [2025-10-15T18:45:03.820392] [INFO ] [MAIN ] Update Progress: 753/2369 symbols completed. EPR took 34.5s. Estimated remaining: 3h 45m 19s. Rate: 7.2 symbols/min [2025-10-15T18:45:04.015444] [INFO ] [MAIN ] EQNR: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:45:04.074575] [DEBUG] [LOCAL ] EQNR: Loaded 53039 existing records from primary storage. [2025-10-15T18:45:04.075053] [INFO ] [MAIN ] EQNR: Loaded 53039 existing records. [2025-10-15T18:45:04.120227] [INFO ] [REMOTE ] EQH: Fetching primary data for 2024-12. [2025-10-15T18:45:04.283398] [WARN ] [MAIN ] EQNR: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:45:04.284229] [INFO ] [MAIN ] EQNR: Wiping existing primary data before full refresh. [2025-10-15T18:45:04.284284] [INFO ] [LOCAL ] EQNR: Starting deletion of primary data. [2025-10-15T18:45:04.284465] [DEBUG] [LOCAL ] EQNR: Deleted primary data file. [2025-10-15T18:45:04.284525] [INFO ] [MAIN ] EQNR: Starting full primary refresh. [2025-10-15T18:45:04.570045] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-15T18:45:04.710694] [INFO ] [REMOTE ] EQNR: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:45:04.746078] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-07 (2.22 seconds). [2025-10-15T18:45:04.914005] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-08. [2025-10-15T18:45:05.713983] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2024-12. [2025-10-15T18:45:05.892084] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-15T18:45:05.924270] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-15T18:45:06.514055] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-09. [2025-10-15T18:45:07.299725] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-15T18:45:07.314078] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-10. [2025-10-15T18:45:07.744001] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2024-12 (2.03 seconds). [2025-10-15T18:45:08.114061] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-08. [2025-10-15T18:45:08.358772] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-15T18:45:08.360669] [INFO ] [REMOTE ] EQBK: Full fetch complete (15574 records). [2025-10-15T18:45:08.360741] [DEBUG] [VALIDATOR ] EQBK: Validating primary data. [2025-10-15T18:45:08.740261] [DEBUG] [VALIDATOR ] EQBK: All expected trading days are present. [2025-10-15T18:45:08.740353] [DEBUG] [VALIDATOR ] EQBK: Primary data validation passed. [2025-10-15T18:45:08.740730] [INFO ] [MAIN ] EQBK: Fetched primary data is valid. [2025-10-15T18:45:08.740792] [DEBUG] [LOCAL ] EQBK: Saving primary data. [2025-10-15T18:45:08.741744] [DEBUG] [LOCAL ] EQBK: Trimmed 15574 records to 11247 (keeping 200 days of data) [2025-10-15T18:45:08.817713] [DEBUG] [LOCAL ] EQBK: Primary data saved (11247 records). [2025-10-15T18:45:08.817866] [INFO ] [MAIN ] EQBK: Full history saved. [2025-10-15T18:45:08.817947] [INFO ] [MAIN ] Update Progress: 754/2369 symbols completed. EQBK took 17.6s. Estimated remaining: 3h 45m 3s. Rate: 7.2 symbols/min [2025-10-15T18:45:08.922179] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-01. [2025-10-15T18:45:09.000895] [INFO ] [MAIN ] EQR: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:45:09.053572] [DEBUG] [LOCAL ] EQR: Loaded 51695 existing records from primary storage. [2025-10-15T18:45:09.053946] [INFO ] [MAIN ] EQR: Loaded 51695 existing records. [2025-10-15T18:45:09.276204] [WARN ] [MAIN ] EQR: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:45:09.276629] [INFO ] [MAIN ] EQR: Wiping existing primary data before full refresh. [2025-10-15T18:45:09.276719] [INFO ] [LOCAL ] EQR: Starting deletion of primary data. [2025-10-15T18:45:09.277012] [DEBUG] [LOCAL ] EQR: Deleted primary data file. [2025-10-15T18:45:09.277070] [INFO ] [MAIN ] EQR: Starting full primary refresh. [2025-10-15T18:45:09.671561] [INFO ] [REMOTE ] EQR: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:45:09.713960] [INFO ] [REMOTE ] EQR: Fetching primary data for 2024-12. [2025-10-15T18:45:09.804257] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-15T18:45:10.514028] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-09. [2025-10-15T18:45:10.798990] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-15T18:45:11.313968] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-02. [2025-10-15T18:45:11.568476] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-15T18:45:11.736903] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-15T18:45:12.113977] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-01. [2025-10-15T18:45:12.834231] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-15T18:45:12.913963] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-03. [2025-10-15T18:45:13.714056] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-10. [2025-10-15T18:45:13.792381] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-15T18:45:14.514036] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-02. [2025-10-15T18:45:14.742467] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-15T18:45:15.313976] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-04. [2025-10-15T18:45:15.377479] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-15T18:45:15.383096] [INFO ] [REMOTE ] EPRT: Full fetch complete (68943 records). [2025-10-15T18:45:15.383202] [DEBUG] [VALIDATOR ] EPRT: Validating primary data. [2025-10-15T18:45:15.383862] [FATAL] [VALIDATOR ] EPRT: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T18:45:15.383958] [FATAL] [MAIN ] EPRT: Fetched primary data is invalid. Refusing to save it. [2025-10-15T18:45:15.384033] [WARN ] [MAIN ] EPRT: Deleting existing primary and derivative data due to validation failure. [2025-10-15T18:45:15.384127] [INFO ] [LOCAL ] EPRT: Starting deletion of primary data. [2025-10-15T18:45:15.384226] [DEBUG] [LOCAL ] EPRT: No primary data file found to delete. [2025-10-15T18:45:15.384271] [INFO ] [LOCAL ] EPRT: Starting deletion of derivative data. [2025-10-15T18:45:15.384421] [DEBUG] [LOCAL ] EPRT: Deleted derivative data file. [2025-10-15T18:45:15.384507] [INFO ] [MAIN ] Update Progress: 755/2369 symbols completed. EPRT took 43.3s. Estimated remaining: 3h 44m 51s. Rate: 7.2 symbols/min [2025-10-15T18:45:15.548994] [INFO ] [MAIN ] EQS: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:45:15.549153] [DEBUG] [LOCAL ] EQS: No existing data file found in primary storage. [2025-10-15T18:45:15.549198] [WARN ] [MAIN ] EQS: No existing data found, performing full refresh instead. [2025-10-15T18:45:15.549353] [INFO ] [MAIN ] EQS: Wiping existing primary data before full refresh. [2025-10-15T18:45:15.549430] [INFO ] [LOCAL ] EQS: Starting deletion of primary data. [2025-10-15T18:45:15.549476] [DEBUG] [LOCAL ] EQS: No primary data file found to delete. [2025-10-15T18:45:15.549507] [INFO ] [MAIN ] EQS: Starting full primary refresh. [2025-10-15T18:45:15.897561] [INFO ] [REMOTE ] EQS: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:45:16.059440] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-15T18:45:16.113965] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-01. [2025-10-15T18:45:16.913976] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-03. [2025-10-15T18:45:17.082907] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-15T18:45:17.714042] [INFO ] [REMOTE ] EQS: Fetching primary data for 2024-12. [2025-10-15T18:45:17.865231] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-15T18:45:18.334575] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-10-15T18:45:18.516172] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-01. [2025-10-15T18:45:18.524893] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-15T18:45:18.883439] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-01 (0.37 seconds). [2025-10-15T18:45:19.314047] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-02. [2025-10-15T18:45:19.644842] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-10-15T18:45:20.114044] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-03. [2025-10-15T18:45:20.447797] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-03 (0.33 seconds). [2025-10-15T18:45:20.914035] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-04. [2025-10-15T18:45:21.237968] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-04 (0.32 seconds). [2025-10-15T18:45:21.714068] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-05. [2025-10-15T18:45:22.086539] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-10-15T18:45:22.514058] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-04. [2025-10-15T18:45:23.314101] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-06. [2025-10-15T18:45:23.857327] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-10-15T18:45:24.021129] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-15T18:45:24.113958] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-05. [2025-10-15T18:45:24.914013] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-02. [2025-10-15T18:45:25.719783] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-07. [2025-10-15T18:45:25.739314] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-15T18:45:26.230339] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-10-15T18:45:26.513983] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-06. [2025-10-15T18:45:26.751373] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-15T18:45:27.313976] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-05. [2025-10-15T18:45:28.079688] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-15T18:45:28.113980] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-07. [2025-10-15T18:45:28.913959] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-08. [2025-10-15T18:45:29.272938] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-15T18:45:29.405099] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-10-15T18:45:29.714076] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-03. [2025-10-15T18:45:29.890934] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-15T18:45:30.514034] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-08. [2025-10-15T18:45:31.314027] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-09. [2025-10-15T18:45:31.491771] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-15T18:45:31.651237] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-09 (0.34 seconds). [2025-10-15T18:45:32.113956] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-10. [2025-10-15T18:45:32.218036] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-15T18:45:32.578136] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-15T18:45:32.578941] [INFO ] [REMOTE ] EQS: Full fetch complete (2440 records). [2025-10-15T18:45:32.579008] [DEBUG] [VALIDATOR ] EQS: Validating primary data. [2025-10-15T18:45:32.777046] [WARN ] [VALIDATOR ] EQS: Validation failed - insufficient historical data. Have 189 unique days, need 200 days [2025-10-15T18:45:32.777270] [FATAL] [MAIN ] EQS: Fetched primary data is invalid. Refusing to save it. [2025-10-15T18:45:32.777316] [WARN ] [MAIN ] EQS: Deleting existing primary and derivative data due to validation failure. [2025-10-15T18:45:32.777354] [INFO ] [LOCAL ] EQS: Starting deletion of primary data. [2025-10-15T18:45:32.777407] [DEBUG] [LOCAL ] EQS: No primary data file found to delete. [2025-10-15T18:45:32.777440] [INFO ] [LOCAL ] EQS: Starting deletion of derivative data. [2025-10-15T18:45:32.777478] [DEBUG] [LOCAL ] EQS: No derivative data file found to delete. [2025-10-15T18:45:32.777528] [INFO ] [MAIN ] Update Progress: 756/2369 symbols completed. EQS took 17.4s. Estimated remaining: 3h 45m 2s. Rate: 7.2 symbols/min [2025-10-15T18:45:32.919133] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-04. [2025-10-15T18:45:32.942605] [INFO ] [MAIN ] EQT: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:45:32.992804] [DEBUG] [LOCAL ] EQT: Loaded 53685 existing records from primary storage. [2025-10-15T18:45:32.993150] [INFO ] [MAIN ] EQT: Loaded 53685 existing records. [2025-10-15T18:45:33.167107] [WARN ] [MAIN ] EQT: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:45:33.167354] [INFO ] [MAIN ] EQT: Wiping existing primary data before full refresh. [2025-10-15T18:45:33.167416] [INFO ] [LOCAL ] EQT: Starting deletion of primary data. [2025-10-15T18:45:33.167953] [DEBUG] [LOCAL ] EQT: Deleted primary data file. [2025-10-15T18:45:33.168012] [INFO ] [MAIN ] EQT: Starting full primary refresh. [2025-10-15T18:45:33.529206] [INFO ] [REMOTE ] EQT: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:45:33.714000] [INFO ] [REMOTE ] EQT: Fetching primary data for 2024-12. [2025-10-15T18:45:34.347927] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-15T18:45:34.513968] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-06. [2025-10-15T18:45:35.313985] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-05. [2025-10-15T18:45:35.740435] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2024-12 (2.03 seconds). [2025-10-15T18:45:36.114016] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-09. [2025-10-15T18:45:36.403721] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-15T18:45:36.716215] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-15T18:45:36.913990] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-07. [2025-10-15T18:45:37.713978] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-01. [2025-10-15T18:45:37.886893] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-15T18:45:38.513976] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-06. [2025-10-15T18:45:38.775283] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-15T18:45:39.314007] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-10. [2025-10-15T18:45:39.931210] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-15T18:45:39.962056] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-01 (2.25 seconds). [2025-10-15T18:45:40.113991] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-07. [2025-10-15T18:45:40.913974] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-08. [2025-10-15T18:45:41.128419] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-15T18:45:41.134746] [INFO ] [REMOTE ] EQH: Full fetch complete (76596 records). [2025-10-15T18:45:41.134864] [DEBUG] [VALIDATOR ] EQH: Validating primary data. [2025-10-15T18:45:41.511800] [DEBUG] [VALIDATOR ] EQH: All expected trading days are present. [2025-10-15T18:45:41.511895] [DEBUG] [VALIDATOR ] EQH: Primary data validation passed. [2025-10-15T18:45:41.512824] [INFO ] [MAIN ] EQH: Fetched primary data is valid. [2025-10-15T18:45:41.512896] [DEBUG] [LOCAL ] EQH: Saving primary data. [2025-10-15T18:45:41.514418] [DEBUG] [LOCAL ] EQH: Trimmed 76596 records to 52699 (keeping 200 days of data) [2025-10-15T18:45:41.720279] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-02. [2025-10-15T18:45:41.829556] [DEBUG] [LOCAL ] EQH: Primary data saved (52699 records). [2025-10-15T18:45:41.829739] [INFO ] [MAIN ] EQH: Full history saved. [2025-10-15T18:45:41.829845] [INFO ] [MAIN ] Update Progress: 757/2369 symbols completed. EQH took 39.8s. Estimated remaining: 3h 44m 55s. Rate: 7.2 symbols/min [2025-10-15T18:45:41.857766] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-15T18:45:42.513981] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-08. [2025-10-15T18:45:42.940492] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-10-15T18:45:43.213320] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-15T18:45:43.313949] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-03. [2025-10-15T18:45:44.113987] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-09. [2025-10-15T18:45:44.247701] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-15T18:45:44.914022] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-09. [2025-10-15T18:45:45.188988] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-15T18:45:45.714035] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-04. [2025-10-15T18:45:46.067735] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-15T18:45:46.483549] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-15T18:45:46.513958] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-10. [2025-10-15T18:45:47.314030] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-10. [2025-10-15T18:45:47.841588] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-10-15T18:45:48.114035] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-05. [2025-10-15T18:45:48.287927] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-15T18:45:48.294238] [INFO ] [REMOTE ] EQR: Full fetch complete (74386 records). [2025-10-15T18:45:48.294369] [DEBUG] [VALIDATOR ] EQR: Validating primary data. [2025-10-15T18:45:48.677582] [DEBUG] [VALIDATOR ] EQR: All expected trading days are present. [2025-10-15T18:45:48.677706] [DEBUG] [VALIDATOR ] EQR: Primary data validation passed. [2025-10-15T18:45:48.679564] [INFO ] [MAIN ] EQR: Fetched primary data is valid. [2025-10-15T18:45:48.679632] [DEBUG] [LOCAL ] EQR: Saving primary data. [2025-10-15T18:45:48.681120] [DEBUG] [LOCAL ] EQR: Trimmed 74386 records to 51721 (keeping 200 days of data) [2025-10-15T18:45:48.997205] [DEBUG] [LOCAL ] EQR: Primary data saved (51721 records). [2025-10-15T18:45:48.997342] [INFO ] [MAIN ] EQR: Full history saved. [2025-10-15T18:45:48.997439] [INFO ] [MAIN ] Update Progress: 758/2369 symbols completed. EQR took 40.2s. Estimated remaining: 3h 44m 44s. Rate: 7.2 symbols/min [2025-10-15T18:45:49.212284] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-15T18:45:49.220364] [INFO ] [REMOTE ] EQNR: Full fetch complete (77001 records). [2025-10-15T18:45:49.220606] [DEBUG] [VALIDATOR ] EQNR: Validating primary data. [2025-10-15T18:45:49.620577] [DEBUG] [VALIDATOR ] EQNR: All expected trading days are present. [2025-10-15T18:45:49.620765] [DEBUG] [VALIDATOR ] EQNR: Primary data validation passed. [2025-10-15T18:45:49.621914] [INFO ] [MAIN ] EQNR: Fetched primary data is valid. [2025-10-15T18:45:49.622069] [DEBUG] [LOCAL ] EQNR: Saving primary data. [2025-10-15T18:45:49.623739] [DEBUG] [LOCAL ] EQNR: Trimmed 77001 records to 53047 (keeping 200 days of data) [2025-10-15T18:45:49.777064] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-15T18:45:49.791588] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-06. [2025-10-15T18:45:49.994715] [DEBUG] [LOCAL ] EQNR: Primary data saved (53047 records). [2025-10-15T18:45:49.994895] [INFO ] [MAIN ] EQNR: Full history saved. [2025-10-15T18:45:49.995430] [INFO ] [MAIN ] Update Progress: 759/2369 symbols completed. EQNR took 46.2s. Estimated remaining: 3h 44m 20s. Rate: 7.2 symbols/min [2025-10-15T18:45:51.676253] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-15T18:45:51.688881] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-07. [2025-10-15T18:45:53.710719] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-15T18:45:53.730885] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-08. [2025-10-15T18:45:55.749897] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-10-15T18:45:55.761230] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-09. [2025-10-15T18:45:57.734677] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-10-15T18:45:57.746103] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-10. [2025-10-15T18:45:59.757553] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-10 (2.01 seconds). [2025-10-15T18:45:59.764566] [INFO ] [REMOTE ] EQT: Full fetch complete (77860 records). [2025-10-15T18:45:59.764797] [DEBUG] [VALIDATOR ] EQT: Validating primary data. [2025-10-15T18:46:00.170074] [DEBUG] [VALIDATOR ] EQT: All expected trading days are present. [2025-10-15T18:46:00.170150] [DEBUG] [VALIDATOR ] EQT: Primary data validation passed. [2025-10-15T18:46:00.171191] [INFO ] [MAIN ] EQT: Fetched primary data is valid. [2025-10-15T18:46:00.171263] [DEBUG] [LOCAL ] EQT: Saving primary data. [2025-10-15T18:46:00.172768] [DEBUG] [LOCAL ] EQT: Trimmed 77860 records to 53685 (keeping 200 days of data) [2025-10-15T18:46:00.490054] [DEBUG] [LOCAL ] EQT: Primary data saved (53685 records). [2025-10-15T18:46:00.490181] [INFO ] [MAIN ] EQT: Full history saved. [2025-10-15T18:46:00.491114] [INFO ] [MAIN ] Update Progress: 760/2369 symbols completed. EQT took 27.7s. Estimated remaining: 3h 44m 16s. Rate: 7.2 symbols/min [2025-10-15T18:46:01.091282] [INFO ] [MAIN ] ERO: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:46:01.200668] [INFO ] [MAIN ] ES: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:46:01.175223] [INFO ] [MAIN ] EQV: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:46:01.222389] [INFO ] [MAIN ] ERJ: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:46:01.229280] [DEBUG] [LOCAL ] EQV: Loaded 2660 existing records from primary storage. [2025-10-15T18:46:01.229723] [INFO ] [MAIN ] EQV: Loaded 2660 existing records. [2025-10-15T18:46:01.464976] [DEBUG] [LOCAL ] ERO: Loaded 41797 existing records from primary storage. [2025-10-15T18:46:01.502195] [WARN ] [MAIN ] EQV: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:46:01.502598] [INFO ] [MAIN ] ERO: Loaded 41797 existing records. [2025-10-15T18:46:01.546131] [INFO ] [MAIN ] EQV: Wiping existing primary data before full refresh. [2025-10-15T18:46:01.628460] [INFO ] [LOCAL ] EQV: Starting deletion of primary data. [2025-10-15T18:46:01.640596] [DEBUG] [LOCAL ] ERJ: Loaded 50329 existing records from primary storage. [2025-10-15T18:46:01.659408] [DEBUG] [LOCAL ] EQV: Deleted primary data file. [2025-10-15T18:46:01.653527] [DEBUG] [LOCAL ] ES: Loaded 52697 existing records from primary storage. [2025-10-15T18:46:01.659735] [INFO ] [MAIN ] EQV: Starting full primary refresh. [2025-10-15T18:46:01.670585] [INFO ] [MAIN ] ES: Loaded 52697 existing records. [2025-10-15T18:46:01.697188] [INFO ] [MAIN ] ERJ: Loaded 50329 existing records. [2025-10-15T18:46:01.997547] [WARN ] [MAIN ] ERO: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:46:02.076575] [INFO ] [MAIN ] ERO: Wiping existing primary data before full refresh. [2025-10-15T18:46:02.134041] [INFO ] [LOCAL ] ERO: Starting deletion of primary data. [2025-10-15T18:46:02.263284] [DEBUG] [LOCAL ] ERO: Deleted primary data file. [2025-10-15T18:46:02.323240] [WARN ] [MAIN ] ES: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:46:02.344241] [INFO ] [MAIN ] ERO: Starting full primary refresh. [2025-10-15T18:46:02.347699] [WARN ] [MAIN ] ERJ: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:46:02.373545] [INFO ] [MAIN ] ES: Wiping existing primary data before full refresh. [2025-10-15T18:46:02.378933] [INFO ] [LOCAL ] ES: Starting deletion of primary data. [2025-10-15T18:46:02.409796] [INFO ] [MAIN ] ERJ: Wiping existing primary data before full refresh. [2025-10-15T18:46:02.420333] [INFO ] [LOCAL ] ERJ: Starting deletion of primary data. [2025-10-15T18:46:02.415026] [DEBUG] [LOCAL ] ES: Deleted primary data file. [2025-10-15T18:46:02.443449] [INFO ] [MAIN ] ES: Starting full primary refresh. [2025-10-15T18:46:02.537832] [DEBUG] [LOCAL ] ERJ: Deleted primary data file. [2025-10-15T18:46:02.616706] [INFO ] [MAIN ] ERJ: Starting full primary refresh. [2025-10-15T18:46:02.959430] [INFO ] [REMOTE ] EQV: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:46:03.027849] [INFO ] [REMOTE ] EQV: Fetching primary data for 2024-12. [2025-10-15T18:46:03.602419] [INFO ] [REMOTE ] ERO: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:46:03.612804] [INFO ] [REMOTE ] ERO: Fetching primary data for 2024-12. [2025-10-15T18:46:03.612440] [INFO ] [REMOTE ] ES: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:46:03.640302] [INFO ] [REMOTE ] ES: Fetching primary data for 2024-12. [2025-10-15T18:46:03.719740] [INFO ] [REMOTE ] ERJ: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:46:03.720188] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2024-12. [2025-10-15T18:46:03.878765] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-15T18:46:03.880855] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-01. [2025-10-15T18:46:04.644014] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-15T18:46:04.646361] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-02. [2025-10-15T18:46:05.053975] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-15T18:46:05.062096] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-01. [2025-10-15T18:46:05.081479] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-15T18:46:05.082981] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-03. [2025-10-15T18:46:05.152331] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-15T18:46:05.162839] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-01. [2025-10-15T18:46:05.290995] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-15T18:46:05.300225] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-01. [2025-10-15T18:46:05.629590] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-10-15T18:46:05.631317] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-04. [2025-10-15T18:46:06.022083] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-04 (0.39 seconds). [2025-10-15T18:46:06.023349] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-05. [2025-10-15T18:46:06.230266] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-15T18:46:06.238062] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-02. [2025-10-15T18:46:06.340297] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-05 (0.32 seconds). [2025-10-15T18:46:06.341773] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-06. [2025-10-15T18:46:06.885075] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-10-15T18:46:06.886562] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-07. [2025-10-15T18:46:06.922901] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-15T18:46:06.933613] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-02. [2025-10-15T18:46:06.970856] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-15T18:46:06.980631] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-02. [2025-10-15T18:46:07.236390] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-15T18:46:07.244670] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-03. [2025-10-15T18:46:07.308224] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-10-15T18:46:07.313939] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-08. [2025-10-15T18:46:07.866686] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-15T18:46:08.114052] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-09. [2025-10-15T18:46:08.561226] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-10-15T18:46:08.712688] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-15T18:46:08.728011] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-15T18:46:08.813208] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-15T18:46:08.913986] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-04. [2025-10-15T18:46:09.714043] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-10. [2025-10-15T18:46:10.427731] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-15T18:46:10.428506] [INFO ] [REMOTE ] EQV: Full fetch complete (5489 records). [2025-10-15T18:46:10.428573] [DEBUG] [VALIDATOR ] EQV: Validating primary data. [2025-10-15T18:46:10.519185] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-03. [2025-10-15T18:46:10.756572] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-15T18:46:10.837724] [DEBUG] [VALIDATOR ] EQV: All expected trading days are present. [2025-10-15T18:46:10.837806] [DEBUG] [VALIDATOR ] EQV: Primary data validation passed. [2025-10-15T18:46:10.837977] [INFO ] [MAIN ] EQV: Fetched primary data is valid. [2025-10-15T18:46:10.838015] [DEBUG] [LOCAL ] EQV: Saving primary data. [2025-10-15T18:46:10.838369] [DEBUG] [LOCAL ] EQV: Trimmed 5489 records to 2688 (keeping 200 days of data) [2025-10-15T18:46:10.853900] [DEBUG] [LOCAL ] EQV: Primary data saved (2688 records). [2025-10-15T18:46:10.853966] [INFO ] [MAIN ] EQV: Full history saved. [2025-10-15T18:46:10.854035] [INFO ] [MAIN ] Update Progress: 761/2369 symbols completed. EQV took 10.4s. Estimated remaining: 3h 44m 12s. Rate: 7.2 symbols/min [2025-10-15T18:46:11.017995] [INFO ] [MAIN ] ESAB: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:46:11.043730] [DEBUG] [LOCAL ] ESAB: Loaded 26055 existing records from primary storage. [2025-10-15T18:46:11.043996] [INFO ] [MAIN ] ESAB: Loaded 26055 existing records. [2025-10-15T18:46:11.217303] [WARN ] [MAIN ] ESAB: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:46:11.217543] [INFO ] [MAIN ] ESAB: Wiping existing primary data before full refresh. [2025-10-15T18:46:11.217591] [INFO ] [LOCAL ] ESAB: Starting deletion of primary data. [2025-10-15T18:46:11.218133] [DEBUG] [LOCAL ] ESAB: Deleted primary data file. [2025-10-15T18:46:11.218190] [INFO ] [MAIN ] ESAB: Starting full primary refresh. [2025-10-15T18:46:11.319580] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-05. [2025-10-15T18:46:11.583629] [INFO ] [REMOTE ] ESAB: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:46:12.093304] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-15T18:46:12.114001] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-03. [2025-10-15T18:46:12.874854] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-15T18:46:12.913991] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-06. [2025-10-15T18:46:13.714029] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2024-12. [2025-10-15T18:46:13.974199] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-15T18:46:14.359997] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-15T18:46:14.513989] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-07. [2025-10-15T18:46:14.680157] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-10-15T18:46:15.313998] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-04. [2025-10-15T18:46:16.111506] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-15T18:46:16.120551] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-01. [2025-10-15T18:46:16.881451] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-15T18:46:16.913964] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-08. [2025-10-15T18:46:17.090333] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-15T18:46:17.714064] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-02. [2025-10-15T18:46:18.135061] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-15T18:46:18.514040] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-04. [2025-10-15T18:46:18.747954] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-15T18:46:19.313996] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-03. [2025-10-15T18:46:20.114029] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-09. [2025-10-15T18:46:20.265414] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-15T18:46:20.309286] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-15T18:46:20.914022] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-05. [2025-10-15T18:46:21.657557] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-15T18:46:21.713978] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-05. [2025-10-15T18:46:22.514087] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-04. [2025-10-15T18:46:22.746665] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-15T18:46:23.323925] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-10. [2025-10-15T18:46:23.349571] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-15T18:46:23.466966] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-15T18:46:24.114061] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-06. [2025-10-15T18:46:24.914074] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-06. [2025-10-15T18:46:25.021094] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-15T18:46:25.027201] [INFO ] [REMOTE ] ERO: Full fetch complete (60294 records). [2025-10-15T18:46:25.027358] [DEBUG] [VALIDATOR ] ERO: Validating primary data. [2025-10-15T18:46:25.405335] [DEBUG] [VALIDATOR ] ERO: All expected trading days are present. [2025-10-15T18:46:25.405416] [DEBUG] [VALIDATOR ] ERO: Primary data validation passed. [2025-10-15T18:46:25.406226] [INFO ] [MAIN ] ERO: Fetched primary data is valid. [2025-10-15T18:46:25.406288] [DEBUG] [LOCAL ] ERO: Saving primary data. [2025-10-15T18:46:25.407432] [DEBUG] [LOCAL ] ERO: Trimmed 60294 records to 41875 (keeping 200 days of data) [2025-10-15T18:46:25.648085] [DEBUG] [LOCAL ] ERO: Primary data saved (41875 records). [2025-10-15T18:46:25.648253] [INFO ] [MAIN ] ERO: Full history saved. [2025-10-15T18:46:25.648343] [INFO ] [MAIN ] Update Progress: 762/2369 symbols completed. ERO took 25.2s. Estimated remaining: 3h 44m 17s. Rate: 7.2 symbols/min [2025-10-15T18:46:25.718209] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-05. [2025-10-15T18:46:25.828226] [INFO ] [MAIN ] ESE: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:46:25.844496] [DEBUG] [LOCAL ] ESE: Loaded 16489 existing records from primary storage. [2025-10-15T18:46:25.844739] [INFO ] [MAIN ] ESE: Loaded 16489 existing records. [2025-10-15T18:46:26.023283] [WARN ] [MAIN ] ESE: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:46:26.023682] [INFO ] [MAIN ] ESE: Wiping existing primary data before full refresh. [2025-10-15T18:46:26.023763] [INFO ] [LOCAL ] ESE: Starting deletion of primary data. [2025-10-15T18:46:26.024313] [DEBUG] [LOCAL ] ESE: Deleted primary data file. [2025-10-15T18:46:26.024380] [INFO ] [MAIN ] ESE: Starting full primary refresh. [2025-10-15T18:46:26.194085] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-06 (2.08 seconds). [2025-10-15T18:46:26.487596] [INFO ] [REMOTE ] ESE: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:46:26.513959] [INFO ] [REMOTE ] ESE: Fetching primary data for 2024-12. [2025-10-15T18:46:26.653096] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-15T18:46:26.884190] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-15T18:46:27.313973] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-07. [2025-10-15T18:46:27.339149] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-10-15T18:46:28.113993] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-06. [2025-10-15T18:46:28.914026] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-01. [2025-10-15T18:46:29.183338] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-15T18:46:29.228734] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-15T18:46:29.433308] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-10-15T18:46:29.713993] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-08. [2025-10-15T18:46:30.514066] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-07. [2025-10-15T18:46:31.314091] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-07. [2025-10-15T18:46:31.519292] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-15T18:46:32.114018] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-02. [2025-10-15T18:46:32.318493] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-15T18:46:32.505341] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-15T18:46:32.914010] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-09. [2025-10-15T18:46:33.115711] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-15T18:46:33.714071] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-03. [2025-10-15T18:46:34.513967] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-08. [2025-10-15T18:46:34.554619] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-15T18:46:34.733567] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-15T18:46:35.314057] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-10. [2025-10-15T18:46:35.907514] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-15T18:46:36.114005] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-04. [2025-10-15T18:46:36.706458] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-15T18:46:36.712517] [INFO ] [REMOTE ] ERJ: Full fetch complete (72735 records). [2025-10-15T18:46:36.712716] [DEBUG] [VALIDATOR ] ERJ: Validating primary data. [2025-10-15T18:46:36.919068] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-08. [2025-10-15T18:46:37.113982] [DEBUG] [VALIDATOR ] ERJ: All expected trading days are present. [2025-10-15T18:46:37.114097] [DEBUG] [VALIDATOR ] ERJ: Primary data validation passed. [2025-10-15T18:46:37.115218] [INFO ] [MAIN ] ERJ: Fetched primary data is valid. [2025-10-15T18:46:37.115281] [DEBUG] [LOCAL ] ERJ: Saving primary data. [2025-10-15T18:46:37.116695] [DEBUG] [LOCAL ] ERJ: Trimmed 72735 records to 50317 (keeping 200 days of data) [2025-10-15T18:46:37.215524] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-15T18:46:37.433204] [DEBUG] [LOCAL ] ERJ: Primary data saved (50317 records). [2025-10-15T18:46:37.433352] [INFO ] [MAIN ] ERJ: Full history saved. [2025-10-15T18:46:37.433437] [INFO ] [MAIN ] Update Progress: 763/2369 symbols completed. ERJ took 36.9s. Estimated remaining: 3h 44m 16s. Rate: 7.2 symbols/min [2025-10-15T18:46:37.601016] [INFO ] [MAIN ] ESI: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:46:37.646298] [DEBUG] [LOCAL ] ESI: Loaded 50665 existing records from primary storage. [2025-10-15T18:46:37.646626] [INFO ] [MAIN ] ESI: Loaded 50665 existing records. [2025-10-15T18:46:37.719134] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-05. [2025-10-15T18:46:37.822170] [WARN ] [MAIN ] ESI: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:46:37.822371] [INFO ] [MAIN ] ESI: Wiping existing primary data before full refresh. [2025-10-15T18:46:37.822417] [INFO ] [LOCAL ] ESI: Starting deletion of primary data. [2025-10-15T18:46:37.823254] [DEBUG] [LOCAL ] ESI: Deleted primary data file. [2025-10-15T18:46:37.823326] [INFO ] [MAIN ] ESI: Starting full primary refresh. [2025-10-15T18:46:38.210031] [INFO ] [REMOTE ] ESI: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:46:38.514009] [INFO ] [REMOTE ] ESI: Fetching primary data for 2024-12. [2025-10-15T18:46:38.551342] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-15T18:46:38.575076] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-15T18:46:39.313992] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-09. [2025-10-15T18:46:40.091502] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-15T18:46:40.113940] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-01. [2025-10-15T18:46:40.166981] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-15T18:46:40.913993] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-06. [2025-10-15T18:46:41.708790] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-15T18:46:41.719185] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-09. [2025-10-15T18:46:41.870793] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-15T18:46:42.514020] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-07. [2025-10-15T18:46:43.314030] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-10. [2025-10-15T18:46:43.358541] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-15T18:46:43.460932] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-15T18:46:44.113992] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-08. [2025-10-15T18:46:44.286103] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-15T18:46:44.290972] [INFO ] [REMOTE ] ESAB: Full fetch complete (36059 records). [2025-10-15T18:46:44.291064] [DEBUG] [VALIDATOR ] ESAB: Validating primary data. [2025-10-15T18:46:44.660615] [DEBUG] [VALIDATOR ] ESAB: All expected trading days are present. [2025-10-15T18:46:44.660725] [DEBUG] [VALIDATOR ] ESAB: Primary data validation passed. [2025-10-15T18:46:44.661347] [INFO ] [MAIN ] ESAB: Fetched primary data is valid. [2025-10-15T18:46:44.661389] [DEBUG] [LOCAL ] ESAB: Saving primary data. [2025-10-15T18:46:44.662230] [DEBUG] [LOCAL ] ESAB: Trimmed 36059 records to 26058 (keeping 200 days of data) [2025-10-15T18:46:44.825568] [DEBUG] [LOCAL ] ESAB: Primary data saved (26058 records). [2025-10-15T18:46:44.825726] [INFO ] [MAIN ] ESAB: Full history saved. [2025-10-15T18:46:44.825816] [INFO ] [MAIN ] Update Progress: 764/2369 symbols completed. ESAB took 34.0s. Estimated remaining: 3h 44m 6s. Rate: 7.2 symbols/min [2025-10-15T18:46:44.919360] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-10. [2025-10-15T18:46:44.953805] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-15T18:46:45.025836] [INFO ] [MAIN ] ESNT: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:46:45.063028] [DEBUG] [LOCAL ] ESNT: Loaded 38293 existing records from primary storage. [2025-10-15T18:46:45.063324] [INFO ] [MAIN ] ESNT: Loaded 38293 existing records. [2025-10-15T18:46:45.238911] [WARN ] [MAIN ] ESNT: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:46:45.239127] [INFO ] [MAIN ] ESNT: Wiping existing primary data before full refresh. [2025-10-15T18:46:45.239177] [INFO ] [LOCAL ] ESNT: Starting deletion of primary data. [2025-10-15T18:46:45.239465] [DEBUG] [LOCAL ] ESNT: Deleted primary data file. [2025-10-15T18:46:45.239503] [INFO ] [MAIN ] ESNT: Starting full primary refresh. [2025-10-15T18:46:45.600573] [INFO ] [REMOTE ] ESNT: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:46:45.714048] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2024-12. [2025-10-15T18:46:45.744453] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-15T18:46:45.756002] [INFO ] [REMOTE ] ES: Full fetch complete (76443 records). [2025-10-15T18:46:45.756338] [DEBUG] [VALIDATOR ] ES: Validating primary data. [2025-10-15T18:46:46.248528] [DEBUG] [VALIDATOR ] ES: All expected trading days are present. [2025-10-15T18:46:46.248716] [DEBUG] [VALIDATOR ] ES: Primary data validation passed. [2025-10-15T18:46:46.250193] [INFO ] [MAIN ] ES: Fetched primary data is valid. [2025-10-15T18:46:46.250341] [DEBUG] [LOCAL ] ES: Saving primary data. [2025-10-15T18:46:46.252073] [DEBUG] [LOCAL ] ES: Trimmed 76443 records to 52695 (keeping 200 days of data) [2025-10-15T18:46:46.550288] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-02. [2025-10-15T18:46:46.702052] [DEBUG] [LOCAL ] ES: Primary data saved (52695 records). [2025-10-15T18:46:46.702268] [INFO ] [MAIN ] ES: Full history saved. [2025-10-15T18:46:46.702388] [INFO ] [MAIN ] Update Progress: 765/2369 symbols completed. ES took 46.2s. Estimated remaining: 3h 43m 44s. Rate: 7.2 symbols/min [2025-10-15T18:46:46.917874] [INFO ] [MAIN ] ESRT: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:46:46.966120] [DEBUG] [LOCAL ] ESRT: Loaded 46416 existing records from primary storage. [2025-10-15T18:46:46.966539] [INFO ] [MAIN ] ESRT: Loaded 46416 existing records. [2025-10-15T18:46:47.181601] [WARN ] [MAIN ] ESRT: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:46:47.182081] [INFO ] [MAIN ] ESRT: Wiping existing primary data before full refresh. [2025-10-15T18:46:47.182188] [INFO ] [LOCAL ] ESRT: Starting deletion of primary data. [2025-10-15T18:46:47.182756] [DEBUG] [LOCAL ] ESRT: Deleted primary data file. [2025-10-15T18:46:47.182817] [INFO ] [MAIN ] ESRT: Starting full primary refresh. [2025-10-15T18:46:47.317116] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-09. [2025-10-15T18:46:47.321125] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-15T18:46:47.625014] [INFO ] [REMOTE ] ESRT: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:46:48.040755] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-15T18:46:48.087211] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-15T18:46:48.113999] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-10. [2025-10-15T18:46:48.913970] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-01. [2025-10-15T18:46:49.153566] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-15T18:46:49.156166] [INFO ] [REMOTE ] ESE: Full fetch complete (22602 records). [2025-10-15T18:46:49.156271] [DEBUG] [VALIDATOR ] ESE: Validating primary data. [2025-10-15T18:46:49.527807] [DEBUG] [VALIDATOR ] ESE: All expected trading days are present. [2025-10-15T18:46:49.527924] [DEBUG] [VALIDATOR ] ESE: Primary data validation passed. [2025-10-15T18:46:49.528617] [INFO ] [MAIN ] ESE: Fetched primary data is valid. [2025-10-15T18:46:49.528711] [DEBUG] [LOCAL ] ESE: Saving primary data. [2025-10-15T18:46:49.529607] [DEBUG] [LOCAL ] ESE: Trimmed 22602 records to 16509 (keeping 200 days of data) [2025-10-15T18:46:49.640582] [DEBUG] [LOCAL ] ESE: Primary data saved (16509 records). [2025-10-15T18:46:49.640761] [INFO ] [MAIN ] ESE: Full history saved. [2025-10-15T18:46:49.640866] [INFO ] [MAIN ] Update Progress: 766/2369 symbols completed. ESE took 24.0s. Estimated remaining: 3h 43m 24s. Rate: 7.2 symbols/min [2025-10-15T18:46:49.719156] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-03. [2025-10-15T18:46:49.825580] [INFO ] [MAIN ] ESS: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:46:49.863165] [DEBUG] [LOCAL ] ESS: Loaded 29971 existing records from primary storage. [2025-10-15T18:46:49.863460] [INFO ] [MAIN ] ESS: Loaded 29971 existing records. [2025-10-15T18:46:50.071503] [WARN ] [MAIN ] ESS: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:46:50.071739] [INFO ] [MAIN ] ESS: Wiping existing primary data before full refresh. [2025-10-15T18:46:50.071791] [INFO ] [LOCAL ] ESS: Starting deletion of primary data. [2025-10-15T18:46:50.072134] [DEBUG] [LOCAL ] ESS: Deleted primary data file. [2025-10-15T18:46:50.072195] [INFO ] [MAIN ] ESS: Starting full primary refresh. [2025-10-15T18:46:50.442591] [INFO ] [REMOTE ] ESS: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:46:50.474295] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-15T18:46:50.514015] [INFO ] [REMOTE ] ESS: Fetching primary data for 2024-12. [2025-10-15T18:46:51.314033] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-02. [2025-10-15T18:46:51.473028] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-15T18:46:51.767211] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-15T18:46:52.114047] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2024-12. [2025-10-15T18:46:52.427558] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-15T18:46:52.914016] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-01. [2025-10-15T18:46:53.717755] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-04. [2025-10-15T18:46:53.723290] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-15T18:46:54.342477] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-15T18:46:54.514026] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-03. [2025-10-15T18:46:55.313993] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-02. [2025-10-15T18:46:55.417187] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-15T18:46:55.958243] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-15T18:46:56.114048] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-04. [2025-10-15T18:46:56.685418] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-15T18:46:56.914047] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-03. [2025-10-15T18:46:57.659880] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-15T18:46:57.713949] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-05. [2025-10-15T18:46:58.271964] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-15T18:46:58.514090] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-04. [2025-10-15T18:46:59.167431] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-15T18:46:59.314025] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-06. [2025-10-15T18:46:59.727218] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-15T18:47:00.114151] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-05. [2025-10-15T18:47:00.788082] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-15T18:47:00.913969] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-01. [2025-10-15T18:47:01.573928] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-15T18:47:01.714064] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-06. [2025-10-15T18:47:02.408067] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-15T18:47:02.514015] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-05. [2025-10-15T18:47:02.997926] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-15T18:47:03.314043] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-07. [2025-10-15T18:47:04.113973] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-02. [2025-10-15T18:47:04.225623] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-15T18:47:04.287063] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-15T18:47:04.914071] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-08. [2025-10-15T18:47:05.552882] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-15T18:47:05.714018] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-07. [2025-10-15T18:47:05.918883] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-15T18:47:06.514052] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-03. [2025-10-15T18:47:07.018554] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-15T18:47:07.314072] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-06. [2025-10-15T18:47:08.114085] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-09. [2025-10-15T18:47:08.160345] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-15T18:47:08.856261] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-15T18:47:08.913985] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-07. [2025-10-15T18:47:09.430438] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-15T18:47:09.714008] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-10. [2025-10-15T18:47:10.513976] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-04. [2025-10-15T18:47:10.828862] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-15T18:47:11.042963] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-15T18:47:11.046728] [INFO ] [REMOTE ] ESS: Full fetch complete (43582 records). [2025-10-15T18:47:11.046813] [DEBUG] [VALIDATOR ] ESS: Validating primary data. [2025-10-15T18:47:11.321544] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-08. [2025-10-15T18:47:11.423281] [DEBUG] [VALIDATOR ] ESS: All expected trading days are present. [2025-10-15T18:47:11.423358] [DEBUG] [VALIDATOR ] ESS: Primary data validation passed. [2025-10-15T18:47:11.424064] [INFO ] [MAIN ] ESS: Fetched primary data is valid. [2025-10-15T18:47:11.424125] [DEBUG] [LOCAL ] ESS: Saving primary data. [2025-10-15T18:47:11.425077] [DEBUG] [LOCAL ] ESS: Trimmed 43582 records to 30136 (keeping 200 days of data) [2025-10-15T18:47:11.613435] [DEBUG] [LOCAL ] ESS: Primary data saved (30136 records). [2025-10-15T18:47:11.613565] [INFO ] [MAIN ] ESS: Full history saved. [2025-10-15T18:47:11.613664] [INFO ] [MAIN ] Update Progress: 767/2369 symbols completed. ESS took 22.0s. Estimated remaining: 3h 43m 44s. Rate: 7.2 symbols/min [2025-10-15T18:47:11.780730] [INFO ] [MAIN ] ESTC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:47:11.829295] [DEBUG] [LOCAL ] ESTC: Loaded 50322 existing records from primary storage. [2025-10-15T18:47:11.829672] [INFO ] [MAIN ] ESTC: Loaded 50322 existing records. [2025-10-15T18:47:12.009007] [WARN ] [MAIN ] ESTC: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:47:12.009278] [INFO ] [MAIN ] ESTC: Wiping existing primary data before full refresh. [2025-10-15T18:47:12.009472] [INFO ] [LOCAL ] ESTC: Starting deletion of primary data. [2025-10-15T18:47:12.009888] [DEBUG] [LOCAL ] ESTC: Deleted primary data file. [2025-10-15T18:47:12.009955] [INFO ] [MAIN ] ESTC: Starting full primary refresh. [2025-10-15T18:47:12.114791] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-08. [2025-10-15T18:47:12.340955] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-15T18:47:12.423131] [INFO ] [REMOTE ] ESTC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:47:12.618147] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-15T18:47:12.913992] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-09. [2025-10-15T18:47:13.618449] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-15T18:47:13.713962] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-09. [2025-10-15T18:47:14.515769] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-05. [2025-10-15T18:47:14.523180] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-15T18:47:15.088075] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-15T18:47:15.314037] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2024-12. [2025-10-15T18:47:16.113985] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-10. [2025-10-15T18:47:16.147155] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-15T18:47:16.680103] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-15T18:47:16.913975] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-10. [2025-10-15T18:47:17.714027] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-01. [2025-10-15T18:47:17.937847] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-15T18:47:17.945628] [INFO ] [REMOTE ] ESI: Full fetch complete (73133 records). [2025-10-15T18:47:17.945835] [DEBUG] [VALIDATOR ] ESI: Validating primary data. [2025-10-15T18:47:18.338053] [DEBUG] [VALIDATOR ] ESI: All expected trading days are present. [2025-10-15T18:47:18.338215] [DEBUG] [VALIDATOR ] ESI: Primary data validation passed. [2025-10-15T18:47:18.339171] [INFO ] [MAIN ] ESI: Fetched primary data is valid. [2025-10-15T18:47:18.339267] [DEBUG] [LOCAL ] ESI: Saving primary data. [2025-10-15T18:47:18.352726] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-15T18:47:18.358075] [INFO ] [REMOTE ] ESNT: Full fetch complete (57191 records). [2025-10-15T18:47:18.358255] [DEBUG] [LOCAL ] ESI: Trimmed 73133 records to 50648 (keeping 200 days of data) [2025-10-15T18:47:18.358541] [DEBUG] [VALIDATOR ] ESNT: Validating primary data. [2025-10-15T18:47:18.520293] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-06. [2025-10-15T18:47:19.002033] [DEBUG] [VALIDATOR ] ESNT: All expected trading days are present. [2025-10-15T18:47:19.003556] [DEBUG] [VALIDATOR ] ESNT: Primary data validation passed. [2025-10-15T18:47:19.004680] [INFO ] [MAIN ] ESNT: Fetched primary data is valid. [2025-10-15T18:47:19.004758] [DEBUG] [LOCAL ] ESNT: Saving primary data. [2025-10-15T18:47:19.034009] [DEBUG] [LOCAL ] ESNT: Trimmed 57191 records to 38289 (keeping 200 days of data) [2025-10-15T18:47:19.187239] [DEBUG] [LOCAL ] ESI: Primary data saved (50648 records). [2025-10-15T18:47:19.187928] [INFO ] [MAIN ] ESI: Full history saved. [2025-10-15T18:47:19.188054] [INFO ] [MAIN ] Update Progress: 768/2369 symbols completed. ESI took 41.8s. Estimated remaining: 3h 43m 34s. Rate: 7.2 symbols/min [2025-10-15T18:47:19.450860] [INFO ] [MAIN ] ET: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:47:19.480969] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-15T18:47:19.497391] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-02. [2025-10-15T18:47:19.537739] [DEBUG] [LOCAL ] ESNT: Primary data saved (38289 records). [2025-10-15T18:47:19.537913] [INFO ] [MAIN ] ESNT: Full history saved. [2025-10-15T18:47:19.538013] [INFO ] [MAIN ] Update Progress: 769/2369 symbols completed. ESNT took 34.7s. Estimated remaining: 3h 43m 9s. Rate: 7.2 symbols/min [2025-10-15T18:47:19.661204] [DEBUG] [LOCAL ] ET: Loaded 53789 existing records from primary storage. [2025-10-15T18:47:19.677331] [INFO ] [MAIN ] ET: Loaded 53789 existing records. [2025-10-15T18:47:19.788929] [INFO ] [MAIN ] ETB: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:47:19.907468] [DEBUG] [LOCAL ] ETB: Loaded 12065 existing records from primary storage. [2025-10-15T18:47:19.938542] [WARN ] [MAIN ] ET: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:47:19.939333] [INFO ] [MAIN ] ET: Wiping existing primary data before full refresh. [2025-10-15T18:47:19.939038] [INFO ] [MAIN ] ETB: Loaded 12065 existing records. [2025-10-15T18:47:19.939488] [INFO ] [LOCAL ] ET: Starting deletion of primary data. [2025-10-15T18:47:19.971348] [DEBUG] [LOCAL ] ET: Deleted primary data file. [2025-10-15T18:47:19.982795] [INFO ] [MAIN ] ET: Starting full primary refresh. [2025-10-15T18:47:20.232716] [WARN ] [MAIN ] ETB: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:47:20.258939] [INFO ] [MAIN ] ETB: Wiping existing primary data before full refresh. [2025-10-15T18:47:20.272218] [INFO ] [LOCAL ] ETB: Starting deletion of primary data. [2025-10-15T18:47:20.342842] [DEBUG] [LOCAL ] ETB: Deleted primary data file. [2025-10-15T18:47:20.392878] [INFO ] [MAIN ] ETB: Starting full primary refresh. [2025-10-15T18:47:20.479676] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-10-15T18:47:20.628359] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-07. [2025-10-15T18:47:20.696632] [INFO ] [REMOTE ] ET: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:47:20.900946] [INFO ] [REMOTE ] ETB: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:47:20.913949] [INFO ] [REMOTE ] ETB: Fetching primary data for 2024-12. [2025-10-15T18:47:21.112617] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-15T18:47:21.714021] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-03. [2025-10-15T18:47:21.992920] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-15T18:47:22.158678] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-15T18:47:22.514005] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-08. [2025-10-15T18:47:23.313996] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-01. [2025-10-15T18:47:23.500806] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-15T18:47:23.938529] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-15T18:47:24.081431] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-15T18:47:24.113961] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-09. [2025-10-15T18:47:24.914040] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-04. [2025-10-15T18:47:25.656470] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-15T18:47:25.713990] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-10. [2025-10-15T18:47:26.524913] [INFO ] [REMOTE ] ET: Fetching primary data for 2024-12. [2025-10-15T18:47:26.533892] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-15T18:47:27.314010] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-02. [2025-10-15T18:47:27.382490] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-15T18:47:27.389558] [INFO ] [REMOTE ] ESRT: Full fetch complete (66551 records). [2025-10-15T18:47:27.389895] [DEBUG] [VALIDATOR ] ESRT: Validating primary data. [2025-10-15T18:47:27.786278] [DEBUG] [VALIDATOR ] ESRT: All expected trading days are present. [2025-10-15T18:47:27.786432] [DEBUG] [VALIDATOR ] ESRT: Primary data validation passed. [2025-10-15T18:47:27.787297] [INFO ] [MAIN ] ESRT: Fetched primary data is valid. [2025-10-15T18:47:27.787362] [DEBUG] [LOCAL ] ESRT: Saving primary data. [2025-10-15T18:47:27.792333] [DEBUG] [LOCAL ] ESRT: Trimmed 66551 records to 46481 (keeping 200 days of data) [2025-10-15T18:47:28.060867] [DEBUG] [LOCAL ] ESRT: Primary data saved (46481 records). [2025-10-15T18:47:28.061017] [INFO ] [MAIN ] ESRT: Full history saved. [2025-10-15T18:47:28.062324] [INFO ] [MAIN ] Update Progress: 770/2369 symbols completed. ESRT took 41.4s. Estimated remaining: 3h 43m 1s. Rate: 7.2 symbols/min [2025-10-15T18:47:28.119082] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-05. [2025-10-15T18:47:28.241473] [INFO ] [MAIN ] ETD: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:47:28.272845] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-15T18:47:28.285955] [DEBUG] [LOCAL ] ETD: Loaded 27280 existing records from primary storage. [2025-10-15T18:47:28.286197] [INFO ] [MAIN ] ETD: Loaded 27280 existing records. [2025-10-15T18:47:28.462855] [WARN ] [MAIN ] ETD: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:47:28.463013] [INFO ] [MAIN ] ETD: Wiping existing primary data before full refresh. [2025-10-15T18:47:28.463059] [INFO ] [LOCAL ] ETD: Starting deletion of primary data. [2025-10-15T18:47:28.463402] [DEBUG] [LOCAL ] ETD: Deleted primary data file. [2025-10-15T18:47:28.463628] [INFO ] [MAIN ] ETD: Starting full primary refresh. [2025-10-15T18:47:28.833766] [INFO ] [REMOTE ] ETD: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:47:28.913978] [INFO ] [REMOTE ] ETD: Fetching primary data for 2024-12. [2025-10-15T18:47:28.963807] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2024-12 (2.44 seconds). [2025-10-15T18:47:29.622085] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-10-15T18:47:29.714077] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-01. [2025-10-15T18:47:29.926778] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-15T18:47:30.513981] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-01. [2025-10-15T18:47:30.554513] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-15T18:47:31.314020] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-03. [2025-10-15T18:47:31.952151] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-15T18:47:32.114006] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-04. [2025-10-15T18:47:32.658539] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-01 (2.14 seconds). [2025-10-15T18:47:32.913978] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-02. [2025-10-15T18:47:33.059067] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-15T18:47:33.713975] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-06. [2025-10-15T18:47:34.104206] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-15T18:47:34.513960] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-05. [2025-10-15T18:47:35.257596] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-15T18:47:35.258433] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-15T18:47:35.313948] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-06. [2025-10-15T18:47:36.114073] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-02. [2025-10-15T18:47:36.138163] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-15T18:47:36.914066] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-07. [2025-10-15T18:47:37.714012] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-07. [2025-10-15T18:47:37.743665] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-15T18:47:37.993560] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-10-15T18:47:38.514059] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-03. [2025-10-15T18:47:39.314119] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-08. [2025-10-15T18:47:39.433131] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-15T18:47:39.951896] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-15T18:47:40.114105] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-08. [2025-10-15T18:47:40.723518] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-03 (2.21 seconds). [2025-10-15T18:47:40.914010] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-04. [2025-10-15T18:47:41.714030] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-09. [2025-10-15T18:47:41.843596] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-15T18:47:42.256870] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-10-15T18:47:42.514014] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-09. [2025-10-15T18:47:43.219588] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-04 (2.31 seconds). [2025-10-15T18:47:43.314028] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-10. [2025-10-15T18:47:44.114061] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-05. [2025-10-15T18:47:44.185870] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-15T18:47:44.246488] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-15T18:47:44.248969] [INFO ] [REMOTE ] ETB: Full fetch complete (18298 records). [2025-10-15T18:47:44.249060] [DEBUG] [VALIDATOR ] ETB: Validating primary data. [2025-10-15T18:47:44.667971] [DEBUG] [VALIDATOR ] ETB: All expected trading days are present. [2025-10-15T18:47:44.668072] [DEBUG] [VALIDATOR ] ETB: Primary data validation passed. [2025-10-15T18:47:44.668619] [INFO ] [MAIN ] ETB: Fetched primary data is valid. [2025-10-15T18:47:44.668707] [DEBUG] [LOCAL ] ETB: Saving primary data. [2025-10-15T18:47:44.669251] [DEBUG] [LOCAL ] ETB: Trimmed 18298 records to 11985 (keeping 200 days of data) [2025-10-15T18:47:44.748104] [DEBUG] [LOCAL ] ETB: Primary data saved (11985 records). [2025-10-15T18:47:44.748241] [INFO ] [MAIN ] ETB: Full history saved. [2025-10-15T18:47:44.748325] [INFO ] [MAIN ] Update Progress: 771/2369 symbols completed. ETB took 25.2s. Estimated remaining: 3h 43m 10s. Rate: 7.2 symbols/min [2025-10-15T18:47:44.925513] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-10. [2025-10-15T18:47:44.946485] [INFO ] [MAIN ] ETG: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:47:44.965957] [DEBUG] [LOCAL ] ETG: Loaded 16697 existing records from primary storage. [2025-10-15T18:47:44.966209] [INFO ] [MAIN ] ETG: Loaded 16697 existing records. [2025-10-15T18:47:45.161223] [WARN ] [MAIN ] ETG: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:47:45.161459] [INFO ] [MAIN ] ETG: Wiping existing primary data before full refresh. [2025-10-15T18:47:45.161517] [INFO ] [LOCAL ] ETG: Starting deletion of primary data. [2025-10-15T18:47:45.161807] [DEBUG] [LOCAL ] ETG: Deleted primary data file. [2025-10-15T18:47:45.161879] [INFO ] [MAIN ] ETG: Starting full primary refresh. [2025-10-15T18:47:45.543041] [INFO ] [REMOTE ] ETG: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:47:45.714005] [INFO ] [REMOTE ] ETG: Fetching primary data for 2024-12. [2025-10-15T18:47:46.400283] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-05 (2.29 seconds). [2025-10-15T18:47:46.430023] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-15T18:47:46.436117] [INFO ] [REMOTE ] ESTC: Full fetch complete (72405 records). [2025-10-15T18:47:46.436233] [DEBUG] [VALIDATOR ] ESTC: Validating primary data. [2025-10-15T18:47:46.520110] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-03. [2025-10-15T18:47:46.820491] [DEBUG] [VALIDATOR ] ESTC: All expected trading days are present. [2025-10-15T18:47:46.820568] [DEBUG] [VALIDATOR ] ESTC: Primary data validation passed. [2025-10-15T18:47:46.821455] [INFO ] [MAIN ] ESTC: Fetched primary data is valid. [2025-10-15T18:47:46.821518] [DEBUG] [LOCAL ] ESTC: Saving primary data. [2025-10-15T18:47:46.822862] [DEBUG] [LOCAL ] ESTC: Trimmed 72405 records to 50337 (keeping 200 days of data) [2025-10-15T18:47:46.918591] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-15T18:47:47.129525] [DEBUG] [LOCAL ] ESTC: Primary data saved (50337 records). [2025-10-15T18:47:47.129717] [INFO ] [MAIN ] ESTC: Full history saved. [2025-10-15T18:47:47.130226] [INFO ] [MAIN ] Update Progress: 772/2369 symbols completed. ESTC took 35.5s. Estimated remaining: 3h 42m 49s. Rate: 7.2 symbols/min [2025-10-15T18:47:47.308206] [INFO ] [MAIN ] ETJ: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:47:47.314039] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-01. [2025-10-15T18:47:47.327589] [DEBUG] [LOCAL ] ETJ: Loaded 16926 existing records from primary storage. [2025-10-15T18:47:47.327862] [INFO ] [MAIN ] ETJ: Loaded 16926 existing records. [2025-10-15T18:47:47.508501] [WARN ] [MAIN ] ETJ: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:47:47.508740] [INFO ] [MAIN ] ETJ: Wiping existing primary data before full refresh. [2025-10-15T18:47:47.508793] [INFO ] [LOCAL ] ETJ: Starting deletion of primary data. [2025-10-15T18:47:47.508970] [DEBUG] [LOCAL ] ETJ: Deleted primary data file. [2025-10-15T18:47:47.509025] [INFO ] [MAIN ] ETJ: Starting full primary refresh. [2025-10-15T18:47:47.853201] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-15T18:47:47.917296] [INFO ] [REMOTE ] ETJ: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:47:48.113979] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2024-12. [2025-10-15T18:47:48.379037] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-15T18:47:48.914025] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-06. [2025-10-15T18:47:49.266637] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-15T18:47:49.713982] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-02. [2025-10-15T18:47:50.513967] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-04. [2025-10-15T18:47:50.687541] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-15T18:47:51.011380] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-06 (2.10 seconds). [2025-10-15T18:47:51.313998] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-07. [2025-10-15T18:47:51.475745] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-15T18:47:52.114013] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-05. [2025-10-15T18:47:52.914013] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-03. [2025-10-15T18:47:53.421483] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-15T18:47:53.540230] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-07 (2.23 seconds). [2025-10-15T18:47:53.707145] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-15T18:47:53.713941] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-04. [2025-10-15T18:47:54.518134] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-08. [2025-10-15T18:47:54.521018] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-15T18:47:55.314001] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-05. [2025-10-15T18:47:56.113987] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-06. [2025-10-15T18:47:56.368005] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-15T18:47:56.755901] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-08 (2.24 seconds). [2025-10-15T18:47:56.914015] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-06. [2025-10-15T18:47:57.214809] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-15T18:47:57.714025] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-09. [2025-10-15T18:47:57.912013] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-15T18:47:58.514076] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-07. [2025-10-15T18:47:59.314067] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-01. [2025-10-15T18:47:59.671794] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-10-15T18:47:59.717829] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-15T18:48:00.114074] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-08. [2025-10-15T18:48:00.285224] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-15T18:48:00.914095] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-02. [2025-10-15T18:48:00.956873] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-15T18:48:01.713987] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-10. [2025-10-15T18:48:01.939169] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-15T18:48:02.514086] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-03. [2025-10-15T18:48:03.313980] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-09. [2025-10-15T18:48:03.591793] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-15T18:48:04.063782] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-10 (2.35 seconds). [2025-10-15T18:48:04.070602] [INFO ] [REMOTE ] ET: Full fetch complete (77969 records). [2025-10-15T18:48:04.070810] [DEBUG] [VALIDATOR ] ET: Validating primary data. [2025-10-15T18:48:04.115122] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-04. [2025-10-15T18:48:04.208895] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-15T18:48:04.510362] [DEBUG] [VALIDATOR ] ET: All expected trading days are present. [2025-10-15T18:48:04.510447] [DEBUG] [VALIDATOR ] ET: Primary data validation passed. [2025-10-15T18:48:04.511387] [INFO ] [MAIN ] ET: Fetched primary data is valid. [2025-10-15T18:48:04.511450] [DEBUG] [LOCAL ] ET: Saving primary data. [2025-10-15T18:48:04.512947] [DEBUG] [LOCAL ] ET: Trimmed 77969 records to 53789 (keeping 200 days of data) [2025-10-15T18:48:04.839716] [DEBUG] [LOCAL ] ET: Primary data saved (53789 records). [2025-10-15T18:48:04.839905] [INFO ] [MAIN ] ET: Full history saved. [2025-10-15T18:48:04.840017] [INFO ] [MAIN ] Update Progress: 773/2369 symbols completed. ET took 45.7s. Estimated remaining: 3h 42m 60s. Rate: 7.2 symbols/min [2025-10-15T18:48:04.919112] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-10. [2025-10-15T18:48:05.008463] [INFO ] [MAIN ] ETN: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:48:05.059105] [DEBUG] [LOCAL ] ETN: Loaded 52656 existing records from primary storage. [2025-10-15T18:48:05.059433] [INFO ] [MAIN ] ETN: Loaded 52656 existing records. [2025-10-15T18:48:05.239179] [WARN ] [MAIN ] ETN: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:48:05.239431] [INFO ] [MAIN ] ETN: Wiping existing primary data before full refresh. [2025-10-15T18:48:05.239503] [INFO ] [LOCAL ] ETN: Starting deletion of primary data. [2025-10-15T18:48:05.245316] [DEBUG] [LOCAL ] ETN: Deleted primary data file. [2025-10-15T18:48:05.254268] [INFO ] [MAIN ] ETN: Starting full primary refresh. [2025-10-15T18:48:05.254832] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-15T18:48:05.641633] [INFO ] [REMOTE ] ETN: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:48:05.714020] [INFO ] [REMOTE ] ETN: Fetching primary data for 2024-12. [2025-10-15T18:48:06.046745] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-15T18:48:06.049532] [INFO ] [REMOTE ] ETG: Full fetch complete (24848 records). [2025-10-15T18:48:06.049682] [DEBUG] [VALIDATOR ] ETG: Validating primary data. [2025-10-15T18:48:06.455920] [DEBUG] [VALIDATOR ] ETG: All expected trading days are present. [2025-10-15T18:48:06.456026] [DEBUG] [VALIDATOR ] ETG: Primary data validation passed. [2025-10-15T18:48:06.456587] [INFO ] [MAIN ] ETG: Fetched primary data is valid. [2025-10-15T18:48:06.456628] [DEBUG] [LOCAL ] ETG: Saving primary data. [2025-10-15T18:48:06.457260] [DEBUG] [LOCAL ] ETG: Trimmed 24848 records to 16670 (keeping 200 days of data) [2025-10-15T18:48:06.535062] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-05. [2025-10-15T18:48:06.568678] [DEBUG] [LOCAL ] ETG: Primary data saved (16670 records). [2025-10-15T18:48:06.568837] [INFO ] [MAIN ] ETG: Full history saved. [2025-10-15T18:48:06.568925] [INFO ] [MAIN ] Update Progress: 774/2369 symbols completed. ETG took 21.8s. Estimated remaining: 3h 42m 38s. Rate: 7.2 symbols/min [2025-10-15T18:48:06.738334] [INFO ] [MAIN ] ETO: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:48:06.747036] [DEBUG] [LOCAL ] ETO: Loaded 6995 existing records from primary storage. [2025-10-15T18:48:06.747234] [INFO ] [MAIN ] ETO: Loaded 6995 existing records. [2025-10-15T18:48:06.918944] [WARN ] [MAIN ] ETO: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:48:06.919139] [INFO ] [MAIN ] ETO: Wiping existing primary data before full refresh. [2025-10-15T18:48:06.919186] [INFO ] [LOCAL ] ETO: Starting deletion of primary data. [2025-10-15T18:48:06.919332] [DEBUG] [LOCAL ] ETO: Deleted primary data file. [2025-10-15T18:48:06.919368] [INFO ] [MAIN ] ETO: Starting full primary refresh. [2025-10-15T18:48:07.274160] [INFO ] [REMOTE ] ETO: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:48:07.313954] [INFO ] [REMOTE ] ETO: Fetching primary data for 2024-12. [2025-10-15T18:48:07.327138] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-15T18:48:07.431840] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-15T18:48:07.920558] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-10-15T18:48:08.114034] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-06. [2025-10-15T18:48:08.913971] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-01. [2025-10-15T18:48:09.142049] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-15T18:48:09.713998] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-07. [2025-10-15T18:48:10.513985] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-07. [2025-10-15T18:48:10.874854] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-10-15T18:48:10.907759] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-15T18:48:11.089456] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-15T18:48:11.314051] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-08. [2025-10-15T18:48:12.114010] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-08. [2025-10-15T18:48:12.530973] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-15T18:48:12.914009] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-02. [2025-10-15T18:48:13.045992] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-15T18:48:13.713984] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-09. [2025-10-15T18:48:14.507523] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-15T18:48:14.517235] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-09. [2025-10-15T18:48:14.532010] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-15T18:48:15.314040] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-03. [2025-10-15T18:48:15.689877] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-15T18:48:16.114056] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-01. [2025-10-15T18:48:16.914034] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-10. [2025-10-15T18:48:17.339179] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-15T18:48:17.398008] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-10-15T18:48:17.714064] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-02. [2025-10-15T18:48:18.320184] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-15T18:48:18.324276] [INFO ] [REMOTE ] ETD: Full fetch complete (38651 records). [2025-10-15T18:48:18.324421] [DEBUG] [VALIDATOR ] ETD: Validating primary data. [2025-10-15T18:48:18.520274] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-10. [2025-10-15T18:48:18.714339] [DEBUG] [VALIDATOR ] ETD: All expected trading days are present. [2025-10-15T18:48:18.714457] [DEBUG] [VALIDATOR ] ETD: Primary data validation passed. [2025-10-15T18:48:18.715474] [INFO ] [MAIN ] ETD: Fetched primary data is valid. [2025-10-15T18:48:18.715539] [DEBUG] [LOCAL ] ETD: Saving primary data. [2025-10-15T18:48:18.716874] [DEBUG] [LOCAL ] ETD: Trimmed 38651 records to 27336 (keeping 200 days of data) [2025-10-15T18:48:18.819341] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-15T18:48:18.919527] [DEBUG] [LOCAL ] ETD: Primary data saved (27336 records). [2025-10-15T18:48:18.919714] [INFO ] [MAIN ] ETD: Full history saved. [2025-10-15T18:48:18.919831] [INFO ] [MAIN ] Update Progress: 775/2369 symbols completed. ETD took 50.9s. Estimated remaining: 3h 42m 38s. Rate: 7.2 symbols/min [2025-10-15T18:48:19.088590] [INFO ] [MAIN ] ETR: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:48:19.138357] [DEBUG] [LOCAL ] ETR: Loaded 53213 existing records from primary storage. [2025-10-15T18:48:19.138748] [INFO ] [MAIN ] ETR: Loaded 53213 existing records. [2025-10-15T18:48:19.315311] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-04. [2025-10-15T18:48:19.341292] [WARN ] [MAIN ] ETR: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:48:19.342758] [INFO ] [MAIN ] ETR: Wiping existing primary data before full refresh. [2025-10-15T18:48:19.342851] [INFO ] [LOCAL ] ETR: Starting deletion of primary data. [2025-10-15T18:48:19.343080] [DEBUG] [LOCAL ] ETR: Deleted primary data file. [2025-10-15T18:48:19.343122] [INFO ] [MAIN ] ETR: Starting full primary refresh. [2025-10-15T18:48:19.692763] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-15T18:48:19.738240] [INFO ] [REMOTE ] ETJ: Full fetch complete (25580 records). [2025-10-15T18:48:19.750698] [DEBUG] [VALIDATOR ] ETJ: Validating primary data. [2025-10-15T18:48:19.781966] [INFO ] [REMOTE ] ETR: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:48:20.119118] [INFO ] [REMOTE ] ETR: Fetching primary data for 2024-12. [2025-10-15T18:48:20.155266] [DEBUG] [VALIDATOR ] ETJ: All expected trading days are present. [2025-10-15T18:48:20.155347] [DEBUG] [VALIDATOR ] ETJ: Primary data validation passed. [2025-10-15T18:48:20.155997] [INFO ] [MAIN ] ETJ: Fetched primary data is valid. [2025-10-15T18:48:20.156060] [DEBUG] [LOCAL ] ETJ: Saving primary data. [2025-10-15T18:48:20.156743] [DEBUG] [LOCAL ] ETJ: Trimmed 25580 records to 16847 (keeping 200 days of data) [2025-10-15T18:48:20.260682] [DEBUG] [LOCAL ] ETJ: Primary data saved (16847 records). [2025-10-15T18:48:20.260824] [INFO ] [MAIN ] ETJ: Full history saved. [2025-10-15T18:48:20.260906] [INFO ] [MAIN ] Update Progress: 776/2369 symbols completed. ETJ took 33.1s. Estimated remaining: 3h 42m 15s. Rate: 7.2 symbols/min [2025-10-15T18:48:20.431794] [INFO ] [MAIN ] ETSY: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:48:20.482089] [DEBUG] [LOCAL ] ETSY: Loaded 53577 existing records from primary storage. [2025-10-15T18:48:20.482453] [INFO ] [MAIN ] ETSY: Loaded 53577 existing records. [2025-10-15T18:48:20.675091] [WARN ] [MAIN ] ETSY: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:48:20.675316] [INFO ] [MAIN ] ETSY: Wiping existing primary data before full refresh. [2025-10-15T18:48:20.675364] [INFO ] [LOCAL ] ETSY: Starting deletion of primary data. [2025-10-15T18:48:20.675847] [DEBUG] [LOCAL ] ETSY: Deleted primary data file. [2025-10-15T18:48:20.675904] [INFO ] [MAIN ] ETSY: Starting full primary refresh. [2025-10-15T18:48:20.922603] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-03. [2025-10-15T18:48:21.037050] [INFO ] [REMOTE ] ETSY: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:48:21.454097] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-10-15T18:48:21.488920] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-04 (2.17 seconds). [2025-10-15T18:48:21.714014] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2024-12. [2025-10-15T18:48:21.984175] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-10-15T18:48:22.514025] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-01. [2025-10-15T18:48:23.314010] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-04. [2025-10-15T18:48:23.564735] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-15T18:48:23.892334] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-15T18:48:24.113963] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-01. [2025-10-15T18:48:24.274991] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-15T18:48:24.913995] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-05. [2025-10-15T18:48:25.714045] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-02. [2025-10-15T18:48:25.894232] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-15T18:48:26.514047] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-05. [2025-10-15T18:48:26.950126] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-10-15T18:48:27.228236] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-15T18:48:27.323154] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-02. [2025-10-15T18:48:27.344444] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-15T18:48:28.114061] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-06. [2025-10-15T18:48:28.823940] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-15T18:48:28.913993] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-03. [2025-10-15T18:48:29.109207] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-15T18:48:29.714010] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-03. [2025-10-15T18:48:30.513976] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-07. [2025-10-15T18:48:30.778820] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-15T18:48:31.221814] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-15T18:48:31.313981] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-04. [2025-10-15T18:48:31.566154] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-15T18:48:32.114189] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-04. [2025-10-15T18:48:32.914059] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-06. [2025-10-15T18:48:33.071753] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-15T18:48:33.608400] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-15T18:48:33.713956] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-05. [2025-10-15T18:48:34.360704] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-15T18:48:34.513998] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-07. [2025-10-15T18:48:35.313994] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-08. [2025-10-15T18:48:35.584690] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-15T18:48:35.756159] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-10-15T18:48:36.114093] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-05. [2025-10-15T18:48:36.335442] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-15T18:48:36.914013] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-06. [2025-10-15T18:48:37.582519] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-15T18:48:37.713976] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-06. [2025-10-15T18:48:38.514016] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-09. [2025-10-15T18:48:38.656065] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-15T18:48:39.116221] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-15T18:48:39.313978] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-07. [2025-10-15T18:48:39.459998] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-15T18:48:40.114012] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-10. [2025-10-15T18:48:40.807575] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-15T18:48:40.809359] [INFO ] [REMOTE ] ETO: Full fetch complete (9733 records). [2025-10-15T18:48:40.809427] [DEBUG] [VALIDATOR ] ETO: Validating primary data. [2025-10-15T18:48:40.917804] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-08. [2025-10-15T18:48:41.182484] [DEBUG] [VALIDATOR ] ETO: All expected trading days are present. [2025-10-15T18:48:41.182586] [DEBUG] [VALIDATOR ] ETO: Primary data validation passed. [2025-10-15T18:48:41.182973] [INFO ] [MAIN ] ETO: Fetched primary data is valid. [2025-10-15T18:48:41.183052] [DEBUG] [LOCAL ] ETO: Saving primary data. [2025-10-15T18:48:41.183689] [DEBUG] [LOCAL ] ETO: Trimmed 9733 records to 6976 (keeping 200 days of data) [2025-10-15T18:48:41.249512] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-15T18:48:41.271092] [DEBUG] [LOCAL ] ETO: Primary data saved (6976 records). [2025-10-15T18:48:41.271211] [INFO ] [MAIN ] ETO: Full history saved. [2025-10-15T18:48:41.271287] [INFO ] [MAIN ] Update Progress: 777/2369 symbols completed. ETO took 34.7s. Estimated remaining: 3h 42m 32s. Rate: 7.2 symbols/min [2025-10-15T18:48:41.439025] [INFO ] [MAIN ] ETV: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:48:41.461619] [DEBUG] [LOCAL ] ETV: Loaded 22316 existing records from primary storage. [2025-10-15T18:48:41.461884] [INFO ] [MAIN ] ETV: Loaded 22316 existing records. [2025-10-15T18:48:41.654262] [WARN ] [MAIN ] ETV: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:48:41.654506] [INFO ] [MAIN ] ETV: Wiping existing primary data before full refresh. [2025-10-15T18:48:41.654554] [INFO ] [LOCAL ] ETV: Starting deletion of primary data. [2025-10-15T18:48:41.654889] [DEBUG] [LOCAL ] ETV: Deleted primary data file. [2025-10-15T18:48:41.654947] [INFO ] [MAIN ] ETV: Starting full primary refresh. [2025-10-15T18:48:41.719358] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-07. [2025-10-15T18:48:42.013571] [INFO ] [REMOTE ] ETV: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:48:42.514094] [INFO ] [REMOTE ] ETV: Fetching primary data for 2024-12. [2025-10-15T18:48:43.120225] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-08 (2.20 seconds). [2025-10-15T18:48:43.314018] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-09. [2025-10-15T18:48:43.681951] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-15T18:48:43.757580] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-15T18:48:44.114063] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-08. [2025-10-15T18:48:44.913991] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-08. [2025-10-15T18:48:45.321694] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-10-15T18:48:45.713999] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-10. [2025-10-15T18:48:45.899726] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-15T18:48:46.514000] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-01. [2025-10-15T18:48:46.868193] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-10-15T18:48:47.314003] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-09. [2025-10-15T18:48:47.489398] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-15T18:48:47.674372] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-10 (1.96 seconds). [2025-10-15T18:48:47.680865] [INFO ] [REMOTE ] ETN: Full fetch complete (76659 records). [2025-10-15T18:48:47.680987] [DEBUG] [VALIDATOR ] ETN: Validating primary data. [2025-10-15T18:48:48.065469] [DEBUG] [VALIDATOR ] ETN: All expected trading days are present. [2025-10-15T18:48:48.065564] [DEBUG] [VALIDATOR ] ETN: Primary data validation passed. [2025-10-15T18:48:48.066542] [INFO ] [MAIN ] ETN: Fetched primary data is valid. [2025-10-15T18:48:48.066606] [DEBUG] [LOCAL ] ETN: Saving primary data. [2025-10-15T18:48:48.068163] [DEBUG] [LOCAL ] ETN: Trimmed 76659 records to 52641 (keeping 200 days of data) [2025-10-15T18:48:48.124120] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-02. [2025-10-15T18:48:48.395969] [DEBUG] [LOCAL ] ETN: Primary data saved (52641 records). [2025-10-15T18:48:48.396143] [INFO ] [MAIN ] ETN: Full history saved. [2025-10-15T18:48:48.396245] [INFO ] [MAIN ] Update Progress: 778/2369 symbols completed. ETN took 43.6s. Estimated remaining: 3h 42m 21s. Rate: 7.2 symbols/min [2025-10-15T18:48:48.561187] [INFO ] [MAIN ] ETW: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:48:48.587977] [DEBUG] [LOCAL ] ETW: Loaded 25635 existing records from primary storage. [2025-10-15T18:48:48.588260] [INFO ] [MAIN ] ETW: Loaded 25635 existing records. [2025-10-15T18:48:48.767818] [WARN ] [MAIN ] ETW: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:48:48.768156] [INFO ] [MAIN ] ETW: Wiping existing primary data before full refresh. [2025-10-15T18:48:48.768233] [INFO ] [LOCAL ] ETW: Starting deletion of primary data. [2025-10-15T18:48:48.768575] [DEBUG] [LOCAL ] ETW: Deleted primary data file. [2025-10-15T18:48:48.768688] [INFO ] [MAIN ] ETW: Starting full primary refresh. [2025-10-15T18:48:48.927829] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-09. [2025-10-15T18:48:49.105730] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-15T18:48:49.182809] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-15T18:48:49.214908] [INFO ] [REMOTE ] ETW: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:48:49.714018] [INFO ] [REMOTE ] ETW: Fetching primary data for 2024-12. [2025-10-15T18:48:50.514003] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-03. [2025-10-15T18:48:50.737844] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-15T18:48:50.784629] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-15T18:48:51.313992] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-01. [2025-10-15T18:48:51.537227] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-15T18:48:52.059743] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-15T18:48:52.113980] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-02. [2025-10-15T18:48:52.914008] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-04. [2025-10-15T18:48:53.139596] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-15T18:48:53.713976] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-10. [2025-10-15T18:48:54.052846] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-15T18:48:54.514050] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-03. [2025-10-15T18:48:55.314255] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-05. [2025-10-15T18:48:55.320200] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-15T18:48:55.327029] [INFO ] [REMOTE ] ETR: Full fetch complete (77274 records). [2025-10-15T18:48:55.327193] [DEBUG] [VALIDATOR ] ETR: Validating primary data. [2025-10-15T18:48:55.745217] [DEBUG] [VALIDATOR ] ETR: All expected trading days are present. [2025-10-15T18:48:55.746304] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-15T18:48:55.746389] [DEBUG] [VALIDATOR ] ETR: Primary data validation passed. [2025-10-15T18:48:55.753394] [INFO ] [MAIN ] ETR: Fetched primary data is valid. [2025-10-15T18:48:55.754011] [DEBUG] [LOCAL ] ETR: Saving primary data. [2025-10-15T18:48:55.755511] [DEBUG] [LOCAL ] ETR: Trimmed 77274 records to 53210 (keeping 200 days of data) [2025-10-15T18:48:56.095083] [DEBUG] [LOCAL ] ETR: Primary data saved (53210 records). [2025-10-15T18:48:56.095222] [INFO ] [MAIN ] ETR: Full history saved. [2025-10-15T18:48:56.096104] [INFO ] [MAIN ] Update Progress: 779/2369 symbols completed. ETR took 37.2s. Estimated remaining: 3h 42m 11s. Rate: 7.2 symbols/min [2025-10-15T18:48:56.119114] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-10. [2025-10-15T18:48:56.265902] [INFO ] [MAIN ] ETX: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:48:56.274528] [DEBUG] [LOCAL ] ETX: Loaded 5253 existing records from primary storage. [2025-10-15T18:48:56.274774] [INFO ] [MAIN ] ETX: Loaded 5253 existing records. [2025-10-15T18:48:56.457471] [WARN ] [MAIN ] ETX: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:48:56.458014] [INFO ] [MAIN ] ETX: Wiping existing primary data before full refresh. [2025-10-15T18:48:56.458119] [INFO ] [LOCAL ] ETX: Starting deletion of primary data. [2025-10-15T18:48:56.463511] [DEBUG] [LOCAL ] ETX: Deleted primary data file. [2025-10-15T18:48:56.470629] [INFO ] [MAIN ] ETX: Starting full primary refresh. [2025-10-15T18:48:56.477366] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-15T18:48:56.873705] [INFO ] [REMOTE ] ETX: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:48:56.913974] [INFO ] [REMOTE ] ETX: Fetching primary data for 2024-12. [2025-10-15T18:48:57.713977] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-06. [2025-10-15T18:48:57.736558] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-10-15T18:48:58.172792] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-10 (2.05 seconds). [2025-10-15T18:48:58.179230] [INFO ] [REMOTE ] ETSY: Full fetch complete (77667 records). [2025-10-15T18:48:58.179347] [DEBUG] [VALIDATOR ] ETSY: Validating primary data. [2025-10-15T18:48:58.523108] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-04. [2025-10-15T18:48:58.561483] [DEBUG] [VALIDATOR ] ETSY: All expected trading days are present. [2025-10-15T18:48:58.561605] [DEBUG] [VALIDATOR ] ETSY: Primary data validation passed. [2025-10-15T18:48:58.562607] [INFO ] [MAIN ] ETSY: Fetched primary data is valid. [2025-10-15T18:48:58.562764] [DEBUG] [LOCAL ] ETSY: Saving primary data. [2025-10-15T18:48:58.564190] [DEBUG] [LOCAL ] ETSY: Trimmed 77667 records to 53577 (keeping 200 days of data) [2025-10-15T18:48:58.789029] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-15T18:48:58.903516] [DEBUG] [LOCAL ] ETSY: Primary data saved (53577 records). [2025-10-15T18:48:58.903672] [INFO ] [MAIN ] ETSY: Full history saved. [2025-10-15T18:48:58.904129] [INFO ] [MAIN ] Update Progress: 780/2369 symbols completed. ETSY took 38.6s. Estimated remaining: 3h 41m 52s. Rate: 7.2 symbols/min [2025-10-15T18:48:59.071332] [INFO ] [MAIN ] ETY: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:48:59.094360] [DEBUG] [LOCAL ] ETY: Loaded 23026 existing records from primary storage. [2025-10-15T18:48:59.094593] [INFO ] [MAIN ] ETY: Loaded 23026 existing records. [2025-10-15T18:48:59.265850] [WARN ] [MAIN ] ETY: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:48:59.266023] [INFO ] [MAIN ] ETY: Wiping existing primary data before full refresh. [2025-10-15T18:48:59.266070] [INFO ] [LOCAL ] ETY: Starting deletion of primary data. [2025-10-15T18:48:59.266332] [DEBUG] [LOCAL ] ETY: Deleted primary data file. [2025-10-15T18:48:59.266387] [INFO ] [MAIN ] ETY: Starting full primary refresh. [2025-10-15T18:48:59.327065] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-01. [2025-10-15T18:48:59.616437] [INFO ] [REMOTE ] ETY: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:48:59.891351] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-15T18:48:59.906757] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-15T18:49:00.114030] [INFO ] [REMOTE ] ETY: Fetching primary data for 2024-12. [2025-10-15T18:49:00.913968] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-02. [2025-10-15T18:49:01.010202] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-10-15T18:49:01.446478] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-15T18:49:01.714062] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-07. [2025-10-15T18:49:02.513966] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-03. [2025-10-15T18:49:02.882936] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-15T18:49:03.147872] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-15T18:49:03.314005] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-01. [2025-10-15T18:49:04.113959] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-04. [2025-10-15T18:49:04.453414] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-15T18:49:04.717362] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-10-15T18:49:04.913990] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-02. [2025-10-15T18:49:05.713968] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-08. [2025-10-15T18:49:05.971846] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-15T18:49:06.513963] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-05. [2025-10-15T18:49:06.709774] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-15T18:49:07.050756] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-10-15T18:49:07.314007] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-09. [2025-10-15T18:49:08.113987] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-03. [2025-10-15T18:49:08.250733] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-15T18:49:08.914085] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-06. [2025-10-15T18:49:09.296853] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-15T18:49:09.619263] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-15T18:49:09.714020] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-05. [2025-10-15T18:49:10.514020] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-10. [2025-10-15T18:49:10.795248] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-15T18:49:11.314016] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-04. [2025-10-15T18:49:11.783577] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-15T18:49:11.787633] [INFO ] [REMOTE ] ETV: Full fetch complete (32478 records). [2025-10-15T18:49:11.787788] [DEBUG] [VALIDATOR ] ETV: Validating primary data. [2025-10-15T18:49:12.120678] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-07. [2025-10-15T18:49:12.171906] [DEBUG] [VALIDATOR ] ETV: All expected trading days are present. [2025-10-15T18:49:12.172116] [DEBUG] [VALIDATOR ] ETV: Primary data validation passed. [2025-10-15T18:49:12.173058] [INFO ] [MAIN ] ETV: Fetched primary data is valid. [2025-10-15T18:49:12.173214] [DEBUG] [LOCAL ] ETV: Saving primary data. [2025-10-15T18:49:12.174543] [DEBUG] [LOCAL ] ETV: Trimmed 32478 records to 22258 (keeping 200 days of data) [2025-10-15T18:49:12.311353] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-15T18:49:12.342769] [DEBUG] [LOCAL ] ETV: Primary data saved (22258 records). [2025-10-15T18:49:12.342885] [INFO ] [MAIN ] ETV: Full history saved. [2025-10-15T18:49:12.342963] [INFO ] [MAIN ] Update Progress: 781/2369 symbols completed. ETV took 31.1s. Estimated remaining: 3h 41m 54s. Rate: 7.2 symbols/min [2025-10-15T18:49:12.526204] [INFO ] [MAIN ] EVC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:49:12.545287] [DEBUG] [LOCAL ] EVC: Loaded 18136 existing records from primary storage. [2025-10-15T18:49:12.545515] [INFO ] [MAIN ] EVC: Loaded 18136 existing records. [2025-10-15T18:49:12.721177] [WARN ] [MAIN ] EVC: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:49:12.721455] [INFO ] [MAIN ] EVC: Wiping existing primary data before full refresh. [2025-10-15T18:49:12.721505] [INFO ] [LOCAL ] EVC: Starting deletion of primary data. [2025-10-15T18:49:12.721884] [DEBUG] [LOCAL ] EVC: Deleted primary data file. [2025-10-15T18:49:12.721947] [INFO ] [MAIN ] EVC: Starting full primary refresh. [2025-10-15T18:49:12.826030] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-15T18:49:12.919145] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-06. [2025-10-15T18:49:13.083931] [INFO ] [REMOTE ] EVC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:49:13.713999] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-05. [2025-10-15T18:49:14.120423] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-15T18:49:14.514035] [INFO ] [REMOTE ] EVC: Fetching primary data for 2024-12. [2025-10-15T18:49:14.931479] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-15T18:49:15.314017] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-07. [2025-10-15T18:49:15.921467] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-15T18:49:16.113966] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-08. [2025-10-15T18:49:16.563725] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-15T18:49:16.599465] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-10-15T18:49:16.914014] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-09. [2025-10-15T18:49:17.258200] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-09 (0.34 seconds). [2025-10-15T18:49:17.714045] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-01. [2025-10-15T18:49:18.513968] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-08. [2025-10-15T18:49:18.893492] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-15T18:49:19.314018] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-06. [2025-10-15T18:49:19.596044] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-15T18:49:20.113984] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-09. [2025-10-15T18:49:20.349831] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-15T18:49:20.868093] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-15T18:49:20.913954] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-10. [2025-10-15T18:49:21.713993] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-10. [2025-10-15T18:49:21.770168] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-15T18:49:21.773770] [INFO ] [REMOTE ] ETW: Full fetch complete (36855 records). [2025-10-15T18:49:21.773848] [DEBUG] [VALIDATOR ] ETW: Validating primary data. [2025-10-15T18:49:22.143637] [DEBUG] [VALIDATOR ] ETW: All expected trading days are present. [2025-10-15T18:49:22.143776] [DEBUG] [VALIDATOR ] ETW: Primary data validation passed. [2025-10-15T18:49:22.144484] [INFO ] [MAIN ] ETW: Fetched primary data is valid. [2025-10-15T18:49:22.144553] [DEBUG] [LOCAL ] ETW: Saving primary data. [2025-10-15T18:49:22.145711] [DEBUG] [LOCAL ] ETW: Trimmed 36855 records to 25583 (keeping 200 days of data) [2025-10-15T18:49:22.292383] [DEBUG] [LOCAL ] ETW: Primary data saved (25583 records). [2025-10-15T18:49:22.292502] [INFO ] [MAIN ] ETW: Full history saved. [2025-10-15T18:49:22.292576] [INFO ] [MAIN ] Update Progress: 782/2369 symbols completed. ETW took 33.9s. Estimated remaining: 3h 41m 48s. Rate: 7.2 symbols/min [2025-10-15T18:49:22.412990] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-15T18:49:22.437454] [INFO ] [REMOTE ] ETX: Full fetch complete (6924 records). [2025-10-15T18:49:22.450178] [DEBUG] [VALIDATOR ] ETX: Validating primary data. [2025-10-15T18:49:22.519170] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-02. [2025-10-15T18:49:22.522367] [INFO ] [MAIN ] EVEX: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:49:22.789929] [DEBUG] [LOCAL ] EVEX: Loaded 32175 existing records from primary storage. [2025-10-15T18:49:22.811038] [INFO ] [MAIN ] EVEX: Loaded 32175 existing records. [2025-10-15T18:49:22.976858] [DEBUG] [VALIDATOR ] ETX: All expected trading days are present. [2025-10-15T18:49:22.992788] [DEBUG] [VALIDATOR ] ETX: Primary data validation passed. [2025-10-15T18:49:22.998269] [INFO ] [MAIN ] ETX: Fetched primary data is valid. [2025-10-15T18:49:23.003475] [DEBUG] [LOCAL ] ETX: Saving primary data. [2025-10-15T18:49:23.028181] [DEBUG] [LOCAL ] ETX: Trimmed 6924 records to 5256 (keeping 200 days of data) [2025-10-15T18:49:23.058535] [WARN ] [MAIN ] EVEX: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:49:23.059160] [INFO ] [MAIN ] EVEX: Wiping existing primary data before full refresh. [2025-10-15T18:49:23.076339] [INFO ] [LOCAL ] EVEX: Starting deletion of primary data. [2025-10-15T18:49:23.087721] [DEBUG] [LOCAL ] EVEX: Deleted primary data file. [2025-10-15T18:49:23.093414] [DEBUG] [LOCAL ] ETX: Primary data saved (5256 records). [2025-10-15T18:49:23.093350] [INFO ] [MAIN ] EVEX: Starting full primary refresh. [2025-10-15T18:49:23.093560] [INFO ] [MAIN ] ETX: Full history saved. [2025-10-15T18:49:23.111743] [INFO ] [MAIN ] Update Progress: 783/2369 symbols completed. ETX took 27.0s. Estimated remaining: 3h 41m 25s. Rate: 7.2 symbols/min [2025-10-15T18:49:23.327360] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-07. [2025-10-15T18:49:23.495523] [INFO ] [MAIN ] EVF: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:49:23.538504] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-15T18:49:23.618890] [DEBUG] [LOCAL ] EVF: Loaded 9853 existing records from primary storage. [2025-10-15T18:49:23.640856] [INFO ] [MAIN ] EVF: Loaded 9853 existing records. [2025-10-15T18:49:23.811798] [INFO ] [REMOTE ] EVEX: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:49:23.926044] [WARN ] [MAIN ] EVF: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:49:23.926318] [INFO ] [MAIN ] EVF: Wiping existing primary data before full refresh. [2025-10-15T18:49:23.926369] [INFO ] [LOCAL ] EVF: Starting deletion of primary data. [2025-10-15T18:49:23.926538] [DEBUG] [LOCAL ] EVF: Deleted primary data file. [2025-10-15T18:49:23.926577] [INFO ] [MAIN ] EVF: Starting full primary refresh. [2025-10-15T18:49:24.122509] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2024-12. [2025-10-15T18:49:24.282467] [INFO ] [REMOTE ] EVF: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:49:24.533551] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-15T18:49:24.914051] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-08. [2025-10-15T18:49:25.286771] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-15T18:49:25.714035] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-01. [2025-10-15T18:49:25.766909] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-15T18:49:26.513993] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-03. [2025-10-15T18:49:26.883793] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-15T18:49:27.314024] [INFO ] [REMOTE ] EVF: Fetching primary data for 2024-12. [2025-10-15T18:49:27.735945] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-15T18:49:28.114050] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-04. [2025-10-15T18:49:28.147860] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-10-15T18:49:28.914025] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-09. [2025-10-15T18:49:29.114032] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-15T18:49:29.714051] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-02. [2025-10-15T18:49:29.988589] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-15T18:49:30.513970] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-05. [2025-10-15T18:49:30.756517] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-15T18:49:31.314017] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-03. [2025-10-15T18:49:31.648214] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-15T18:49:32.114000] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-06. [2025-10-15T18:49:32.353509] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-15T18:49:32.914017] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-01. [2025-10-15T18:49:33.234131] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-15T18:49:33.495945] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-15T18:49:33.714028] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-07. [2025-10-15T18:49:34.514083] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-10. [2025-10-15T18:49:34.682438] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-15T18:49:35.313977] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-08. [2025-10-15T18:49:35.552499] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-15T18:49:35.556408] [INFO ] [REMOTE ] ETY: Full fetch complete (34302 records). [2025-10-15T18:49:35.556513] [DEBUG] [VALIDATOR ] ETY: Validating primary data. [2025-10-15T18:49:35.967901] [DEBUG] [VALIDATOR ] ETY: All expected trading days are present. [2025-10-15T18:49:35.968005] [DEBUG] [VALIDATOR ] ETY: Primary data validation passed. [2025-10-15T18:49:35.968901] [INFO ] [MAIN ] ETY: Fetched primary data is valid. [2025-10-15T18:49:35.968966] [DEBUG] [LOCAL ] ETY: Saving primary data. [2025-10-15T18:49:35.970084] [DEBUG] [LOCAL ] ETY: Trimmed 34302 records to 22961 (keeping 200 days of data) [2025-10-15T18:49:36.095304] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-15T18:49:36.115258] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-02. [2025-10-15T18:49:36.140637] [DEBUG] [LOCAL ] ETY: Primary data saved (22961 records). [2025-10-15T18:49:36.140857] [INFO ] [MAIN ] ETY: Full history saved. [2025-10-15T18:49:36.140962] [INFO ] [MAIN ] Update Progress: 784/2369 symbols completed. ETY took 37.2s. Estimated remaining: 3h 41m 26s. Rate: 7.2 symbols/min [2025-10-15T18:49:36.327449] [INFO ] [MAIN ] EVG: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:49:36.337182] [DEBUG] [LOCAL ] EVG: Loaded 5939 existing records from primary storage. [2025-10-15T18:49:36.337446] [INFO ] [MAIN ] EVG: Loaded 5939 existing records. [2025-10-15T18:49:36.524070] [WARN ] [MAIN ] EVG: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:49:36.524371] [INFO ] [MAIN ] EVG: Wiping existing primary data before full refresh. [2025-10-15T18:49:36.524422] [INFO ] [LOCAL ] EVG: Starting deletion of primary data. [2025-10-15T18:49:36.524717] [DEBUG] [LOCAL ] EVG: Deleted primary data file. [2025-10-15T18:49:36.524776] [INFO ] [MAIN ] EVG: Starting full primary refresh. [2025-10-15T18:49:36.835061] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-15T18:49:36.914737] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-03. [2025-10-15T18:49:36.941832] [INFO ] [REMOTE ] EVG: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:49:37.547393] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-15T18:49:37.714030] [INFO ] [REMOTE ] EVG: Fetching primary data for 2024-12. [2025-10-15T18:49:38.449244] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-10-15T18:49:38.514005] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-01. [2025-10-15T18:49:39.087903] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-15T18:49:39.314012] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-02. [2025-10-15T18:49:39.762365] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-15T18:49:40.114017] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-03. [2025-10-15T18:49:40.717862] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-15T18:49:40.914019] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-04. [2025-10-15T18:49:41.633556] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-15T18:49:41.714073] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-05. [2025-10-15T18:49:42.320200] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-15T18:49:42.514047] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-04. [2025-10-15T18:49:43.314039] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-04. [2025-10-15T18:49:43.524446] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-15T18:49:44.114023] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-05. [2025-10-15T18:49:44.394945] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-15T18:49:44.728535] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-15T18:49:44.913998] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-05. [2025-10-15T18:49:45.714035] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-06. [2025-10-15T18:49:45.909190] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-15T18:49:46.054310] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-10-15T18:49:46.513993] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-06. [2025-10-15T18:49:47.313983] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-07. [2025-10-15T18:49:47.732013] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-15T18:49:47.898966] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-15T18:49:48.113994] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-08. [2025-10-15T18:49:48.914022] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-07. [2025-10-15T18:49:49.065089] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-15T18:49:49.713994] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-09. [2025-10-15T18:49:50.359503] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-15T18:49:50.514036] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-06. [2025-10-15T18:49:50.757051] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-15T18:49:51.235725] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-15T18:49:51.313995] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-08. [2025-10-15T18:49:52.114023] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-10. [2025-10-15T18:49:52.829186] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-15T18:49:52.914002] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-07. [2025-10-15T18:49:53.054198] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-15T18:49:53.056326] [INFO ] [REMOTE ] EVC: Full fetch complete (29003 records). [2025-10-15T18:49:53.056401] [DEBUG] [VALIDATOR ] EVC: Validating primary data. [2025-10-15T18:49:53.420114] [DEBUG] [VALIDATOR ] EVC: All expected trading days are present. [2025-10-15T18:49:53.420191] [DEBUG] [VALIDATOR ] EVC: Primary data validation passed. [2025-10-15T18:49:53.420769] [INFO ] [MAIN ] EVC: Fetched primary data is valid. [2025-10-15T18:49:53.420831] [DEBUG] [LOCAL ] EVC: Saving primary data. [2025-10-15T18:49:53.421549] [DEBUG] [LOCAL ] EVC: Trimmed 29003 records to 18093 (keeping 200 days of data) [2025-10-15T18:49:53.527044] [DEBUG] [LOCAL ] EVC: Primary data saved (18093 records). [2025-10-15T18:49:53.527187] [INFO ] [MAIN ] EVC: Full history saved. [2025-10-15T18:49:53.527270] [INFO ] [MAIN ] Update Progress: 785/2369 symbols completed. EVC took 41.2s. Estimated remaining: 3h 41m 36s. Rate: 7.1 symbols/min [2025-10-15T18:49:53.696772] [INFO ] [MAIN ] EVH: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:49:53.719889] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-09. [2025-10-15T18:49:53.740624] [DEBUG] [LOCAL ] EVH: Loaded 49624 existing records from primary storage. [2025-10-15T18:49:53.740986] [INFO ] [MAIN ] EVH: Loaded 49624 existing records. [2025-10-15T18:49:53.848338] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-15T18:49:53.928506] [WARN ] [MAIN ] EVH: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:49:53.928737] [INFO ] [MAIN ] EVH: Wiping existing primary data before full refresh. [2025-10-15T18:49:53.928796] [INFO ] [LOCAL ] EVH: Starting deletion of primary data. [2025-10-15T18:49:53.929205] [DEBUG] [LOCAL ] EVH: Deleted primary data file. [2025-10-15T18:49:53.929262] [INFO ] [MAIN ] EVH: Starting full primary refresh. [2025-10-15T18:49:54.280764] [INFO ] [REMOTE ] EVH: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:49:54.334033] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-15T18:49:54.513995] [INFO ] [REMOTE ] EVH: Fetching primary data for 2024-12. [2025-10-15T18:49:55.314066] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-10. [2025-10-15T18:49:55.925431] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-15T18:49:56.029001] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-15T18:49:56.030462] [INFO ] [REMOTE ] EVG: Full fetch complete (8174 records). [2025-10-15T18:49:56.030532] [DEBUG] [VALIDATOR ] EVG: Validating primary data. [2025-10-15T18:49:56.119173] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-01. [2025-10-15T18:49:56.382942] [DEBUG] [VALIDATOR ] EVG: All expected trading days are present. [2025-10-15T18:49:56.383016] [DEBUG] [VALIDATOR ] EVG: Primary data validation passed. [2025-10-15T18:49:56.383233] [INFO ] [MAIN ] EVG: Fetched primary data is valid. [2025-10-15T18:49:56.383272] [DEBUG] [LOCAL ] EVG: Saving primary data. [2025-10-15T18:49:56.383684] [DEBUG] [LOCAL ] EVG: Trimmed 8174 records to 5933 (keeping 200 days of data) [2025-10-15T18:49:56.420582] [DEBUG] [LOCAL ] EVG: Primary data saved (5933 records). [2025-10-15T18:49:56.420700] [INFO ] [MAIN ] EVG: Full history saved. [2025-10-15T18:49:56.420786] [INFO ] [MAIN ] Update Progress: 786/2369 symbols completed. EVG took 20.3s. Estimated remaining: 3h 41m 16s. Rate: 7.2 symbols/min [2025-10-15T18:49:56.589412] [INFO ] [MAIN ] EVN: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:49:56.601244] [DEBUG] [LOCAL ] EVN: Loaded 10794 existing records from primary storage. [2025-10-15T18:49:56.601440] [INFO ] [MAIN ] EVN: Loaded 10794 existing records. [2025-10-15T18:49:56.775023] [WARN ] [MAIN ] EVN: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:49:56.775222] [INFO ] [MAIN ] EVN: Wiping existing primary data before full refresh. [2025-10-15T18:49:56.775270] [INFO ] [LOCAL ] EVN: Starting deletion of primary data. [2025-10-15T18:49:56.775414] [DEBUG] [LOCAL ] EVN: Deleted primary data file. [2025-10-15T18:49:56.775452] [INFO ] [MAIN ] EVN: Starting full primary refresh. [2025-10-15T18:49:56.917015] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-08. [2025-10-15T18:49:57.126906] [INFO ] [REMOTE ] EVN: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:49:57.714004] [INFO ] [REMOTE ] EVN: Fetching primary data for 2024-12. [2025-10-15T18:49:57.797022] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-15T18:49:57.796698] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-15T18:49:58.370740] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-10-15T18:49:58.514032] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-01. [2025-10-15T18:49:59.314076] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-09. [2025-10-15T18:49:59.448128] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-15T18:50:00.071755] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-15T18:50:00.114024] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-02. [2025-10-15T18:50:00.914086] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-02. [2025-10-15T18:50:01.234292] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-15T18:50:01.714010] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-10. [2025-10-15T18:50:02.513983] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-09. [2025-10-15T18:50:02.569560] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-15T18:50:02.571671] [INFO ] [REMOTE ] EVF: Full fetch complete (12845 records). [2025-10-15T18:50:02.571773] [DEBUG] [VALIDATOR ] EVF: Validating primary data. [2025-10-15T18:50:02.912868] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-10-15T18:50:02.964570] [DEBUG] [VALIDATOR ] EVF: All expected trading days are present. [2025-10-15T18:50:02.964672] [DEBUG] [VALIDATOR ] EVF: Primary data validation passed. [2025-10-15T18:50:02.964970] [INFO ] [MAIN ] EVF: Fetched primary data is valid. [2025-10-15T18:50:02.965010] [DEBUG] [LOCAL ] EVF: Saving primary data. [2025-10-15T18:50:02.965471] [DEBUG] [LOCAL ] EVF: Trimmed 12845 records to 9830 (keeping 200 days of data) [2025-10-15T18:50:03.022135] [DEBUG] [LOCAL ] EVF: Primary data saved (9830 records). [2025-10-15T18:50:03.022253] [INFO ] [MAIN ] EVF: Full history saved. [2025-10-15T18:50:03.022362] [INFO ] [MAIN ] Update Progress: 787/2369 symbols completed. EVF took 39.9s. Estimated remaining: 3h 41m 4s. Rate: 7.2 symbols/min [2025-10-15T18:50:03.185246] [INFO ] [MAIN ] EVR: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:50:03.224996] [DEBUG] [LOCAL ] EVR: Loaded 34470 existing records from primary storage. [2025-10-15T18:50:03.225321] [INFO ] [MAIN ] EVR: Loaded 34470 existing records. [2025-10-15T18:50:03.320281] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-03. [2025-10-15T18:50:03.400736] [WARN ] [MAIN ] EVR: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:50:03.400918] [INFO ] [MAIN ] EVR: Wiping existing primary data before full refresh. [2025-10-15T18:50:03.400970] [INFO ] [LOCAL ] EVR: Starting deletion of primary data. [2025-10-15T18:50:03.401143] [DEBUG] [LOCAL ] EVR: Deleted primary data file. [2025-10-15T18:50:03.401181] [INFO ] [MAIN ] EVR: Starting full primary refresh. [2025-10-15T18:50:03.744250] [INFO ] [REMOTE ] EVR: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:50:04.114008] [INFO ] [REMOTE ] EVR: Fetching primary data for 2024-12. [2025-10-15T18:50:04.159328] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-15T18:50:04.914033] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-10. [2025-10-15T18:50:05.047077] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-15T18:50:05.267480] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-15T18:50:05.714008] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-03. [2025-10-15T18:50:06.514051] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-04. [2025-10-15T18:50:06.532366] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-15T18:50:06.699467] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-15T18:50:06.705306] [INFO ] [REMOTE ] EVEX: Full fetch complete (43332 records). [2025-10-15T18:50:06.705418] [DEBUG] [VALIDATOR ] EVEX: Validating primary data. [2025-10-15T18:50:07.131099] [DEBUG] [VALIDATOR ] EVEX: All expected trading days are present. [2025-10-15T18:50:07.131201] [DEBUG] [VALIDATOR ] EVEX: Primary data validation passed. [2025-10-15T18:50:07.131938] [INFO ] [MAIN ] EVEX: Fetched primary data is valid. [2025-10-15T18:50:07.132002] [DEBUG] [LOCAL ] EVEX: Saving primary data. [2025-10-15T18:50:07.133309] [DEBUG] [LOCAL ] EVEX: Trimmed 43332 records to 32374 (keeping 200 days of data) [2025-10-15T18:50:07.309735] [DEBUG] [LOCAL ] EVEX: Primary data saved (32374 records). [2025-10-15T18:50:07.309876] [INFO ] [MAIN ] EVEX: Full history saved. [2025-10-15T18:50:07.309959] [INFO ] [MAIN ] Update Progress: 788/2369 symbols completed. EVEX took 45.0s. Estimated remaining: 3h 40m 47s. Rate: 7.2 symbols/min [2025-10-15T18:50:07.321211] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-04. [2025-10-15T18:50:07.478286] [INFO ] [MAIN ] EVT: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:50:07.495203] [DEBUG] [LOCAL ] EVT: Loaded 16854 existing records from primary storage. [2025-10-15T18:50:07.495466] [INFO ] [MAIN ] EVT: Loaded 16854 existing records. [2025-10-15T18:50:07.667914] [WARN ] [MAIN ] EVT: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:50:07.668116] [INFO ] [MAIN ] EVT: Wiping existing primary data before full refresh. [2025-10-15T18:50:07.668163] [INFO ] [LOCAL ] EVT: Starting deletion of primary data. [2025-10-15T18:50:07.668417] [DEBUG] [LOCAL ] EVT: Deleted primary data file. [2025-10-15T18:50:07.668472] [INFO ] [MAIN ] EVT: Starting full primary refresh. [2025-10-15T18:50:08.025024] [INFO ] [REMOTE ] EVT: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:50:08.113981] [INFO ] [REMOTE ] EVT: Fetching primary data for 2024-12. [2025-10-15T18:50:08.207513] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-15T18:50:08.252465] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-15T18:50:08.910051] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-10-15T18:50:08.914498] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-01. [2025-10-15T18:50:09.713977] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-05. [2025-10-15T18:50:09.984101] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-15T18:50:10.137849] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-10-15T18:50:10.514011] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-05. [2025-10-15T18:50:11.314003] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-02. [2025-10-15T18:50:12.113975] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-01. [2025-10-15T18:50:12.220863] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-15T18:50:12.317470] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-15T18:50:12.913994] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-03. [2025-10-15T18:50:13.632530] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-15T18:50:13.653625] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-15T18:50:13.713959] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-02. [2025-10-15T18:50:14.513962] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-04. [2025-10-15T18:50:15.287225] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-15T18:50:15.313997] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-03. [2025-10-15T18:50:15.624967] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-15T18:50:16.114043] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-05. [2025-10-15T18:50:16.913966] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-06. [2025-10-15T18:50:16.980618] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-15T18:50:17.150205] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-15T18:50:17.714012] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-06. [2025-10-15T18:50:18.364853] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-15T18:50:18.514038] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-04. [2025-10-15T18:50:18.680635] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-15T18:50:19.314046] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-06. [2025-10-15T18:50:20.024456] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-15T18:50:20.070928] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-15T18:50:20.113999] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-05. [2025-10-15T18:50:20.914054] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-07. [2025-10-15T18:50:21.601932] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-15T18:50:21.713993] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-06. [2025-10-15T18:50:22.513981] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-07. [2025-10-15T18:50:22.610593] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-15T18:50:22.739500] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-15T18:50:23.308555] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-15T18:50:23.313940] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-08. [2025-10-15T18:50:24.114053] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-07. [2025-10-15T18:50:24.282745] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-15T18:50:24.913972] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-08. [2025-10-15T18:50:25.061875] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-15T18:50:25.714053] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-08. [2025-10-15T18:50:26.513963] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-09. [2025-10-15T18:50:26.712965] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-15T18:50:26.733714] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-15T18:50:27.082526] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-15T18:50:27.313995] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-09. [2025-10-15T18:50:28.113995] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-07. [2025-10-15T18:50:28.811180] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-15T18:50:28.913977] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-10. [2025-10-15T18:50:29.573094] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-15T18:50:29.714005] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-08. [2025-10-15T18:50:29.735056] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-15T18:50:29.736882] [INFO ] [REMOTE ] EVN: Full fetch complete (17392 records). [2025-10-15T18:50:29.736951] [DEBUG] [VALIDATOR ] EVN: Validating primary data. [2025-10-15T18:50:30.094911] [DEBUG] [VALIDATOR ] EVN: All expected trading days are present. [2025-10-15T18:50:30.095024] [DEBUG] [VALIDATOR ] EVN: Primary data validation passed. [2025-10-15T18:50:30.095406] [INFO ] [MAIN ] EVN: Fetched primary data is valid. [2025-10-15T18:50:30.095447] [DEBUG] [LOCAL ] EVN: Saving primary data. [2025-10-15T18:50:30.095955] [DEBUG] [LOCAL ] EVN: Trimmed 17392 records to 10787 (keeping 200 days of data) [2025-10-15T18:50:30.158893] [DEBUG] [LOCAL ] EVN: Primary data saved (10787 records). [2025-10-15T18:50:30.159015] [INFO ] [MAIN ] EVN: Full history saved. [2025-10-15T18:50:30.159091] [INFO ] [MAIN ] Update Progress: 789/2369 symbols completed. EVN took 33.7s. Estimated remaining: 3h 41m 8s. Rate: 7.1 symbols/min [2025-10-15T18:50:30.324376] [INFO ] [MAIN ] EVTC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:50:30.349549] [DEBUG] [LOCAL ] EVTC: Loaded 26612 existing records from primary storage. [2025-10-15T18:50:30.349835] [INFO ] [MAIN ] EVTC: Loaded 26612 existing records. [2025-10-15T18:50:30.519210] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-10. [2025-10-15T18:50:30.523254] [WARN ] [MAIN ] EVTC: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:50:30.524347] [INFO ] [MAIN ] EVTC: Wiping existing primary data before full refresh. [2025-10-15T18:50:30.524405] [INFO ] [LOCAL ] EVTC: Starting deletion of primary data. [2025-10-15T18:50:30.524694] [DEBUG] [LOCAL ] EVTC: Deleted primary data file. [2025-10-15T18:50:30.524752] [INFO ] [MAIN ] EVTC: Starting full primary refresh. [2025-10-15T18:50:30.891190] [INFO ] [REMOTE ] EVTC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:50:30.908276] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-15T18:50:31.314029] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2024-12. [2025-10-15T18:50:32.113971] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-09. [2025-10-15T18:50:32.268727] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-15T18:50:32.275588] [INFO ] [REMOTE ] EVH: Full fetch complete (71855 records). [2025-10-15T18:50:32.275790] [DEBUG] [VALIDATOR ] EVH: Validating primary data. [2025-10-15T18:50:32.722336] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-15T18:50:32.761871] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-15T18:50:32.789475] [DEBUG] [VALIDATOR ] EVH: All expected trading days are present. [2025-10-15T18:50:32.789949] [DEBUG] [VALIDATOR ] EVH: Primary data validation passed. [2025-10-15T18:50:32.790966] [INFO ] [MAIN ] EVH: Fetched primary data is valid. [2025-10-15T18:50:32.791028] [DEBUG] [LOCAL ] EVH: Saving primary data. [2025-10-15T18:50:32.792380] [DEBUG] [LOCAL ] EVH: Trimmed 71855 records to 49624 (keeping 200 days of data) [2025-10-15T18:50:32.950527] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-01. [2025-10-15T18:50:33.074278] [DEBUG] [LOCAL ] EVH: Primary data saved (49624 records). [2025-10-15T18:50:33.074446] [INFO ] [MAIN ] EVH: Full history saved. [2025-10-15T18:50:33.074528] [INFO ] [MAIN ] Update Progress: 790/2369 symbols completed. EVH took 39.5s. Estimated remaining: 3h 40m 49s. Rate: 7.2 symbols/min [2025-10-15T18:50:33.238754] [INFO ] [MAIN ] EVTL: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:50:33.276430] [DEBUG] [LOCAL ] EVTL: Loaded 40083 existing records from primary storage. [2025-10-15T18:50:33.276743] [INFO ] [MAIN ] EVTL: Loaded 40083 existing records. [2025-10-15T18:50:33.449500] [WARN ] [MAIN ] EVTL: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:50:33.449725] [INFO ] [MAIN ] EVTL: Wiping existing primary data before full refresh. [2025-10-15T18:50:33.449778] [INFO ] [LOCAL ] EVTL: Starting deletion of primary data. [2025-10-15T18:50:33.450000] [DEBUG] [LOCAL ] EVTL: Deleted primary data file. [2025-10-15T18:50:33.450037] [INFO ] [MAIN ] EVTL: Starting full primary refresh. [2025-10-15T18:50:33.720502] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-10. [2025-10-15T18:50:33.834315] [INFO ] [REMOTE ] EVTL: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:50:34.093082] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-15T18:50:34.514015] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-09. [2025-10-15T18:50:34.518434] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-15T18:50:34.521757] [INFO ] [REMOTE ] EVT: Full fetch complete (25278 records). [2025-10-15T18:50:34.521874] [DEBUG] [VALIDATOR ] EVT: Validating primary data. [2025-10-15T18:50:35.051639] [DEBUG] [VALIDATOR ] EVT: All expected trading days are present. [2025-10-15T18:50:35.051792] [DEBUG] [VALIDATOR ] EVT: Primary data validation passed. [2025-10-15T18:50:35.052471] [INFO ] [MAIN ] EVT: Fetched primary data is valid. [2025-10-15T18:50:35.052544] [DEBUG] [LOCAL ] EVT: Saving primary data. [2025-10-15T18:50:35.053594] [DEBUG] [LOCAL ] EVT: Trimmed 25278 records to 16833 (keeping 200 days of data) [2025-10-15T18:50:35.172715] [DEBUG] [LOCAL ] EVT: Primary data saved (16833 records). [2025-10-15T18:50:35.172863] [INFO ] [MAIN ] EVT: Full history saved. [2025-10-15T18:50:35.172945] [INFO ] [MAIN ] Update Progress: 791/2369 symbols completed. EVT took 27.9s. Estimated remaining: 3h 40m 28s. Rate: 7.2 symbols/min [2025-10-15T18:50:35.319123] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-02. [2025-10-15T18:50:35.345796] [INFO ] [MAIN ] EVTR: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:50:35.371005] [DEBUG] [LOCAL ] EVTR: Loaded 24584 existing records from primary storage. [2025-10-15T18:50:35.371331] [INFO ] [MAIN ] EVTR: Loaded 24584 existing records. [2025-10-15T18:50:35.549858] [WARN ] [MAIN ] EVTR: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:50:35.550103] [INFO ] [MAIN ] EVTR: Wiping existing primary data before full refresh. [2025-10-15T18:50:35.550168] [INFO ] [LOCAL ] EVTR: Starting deletion of primary data. [2025-10-15T18:50:35.550444] [DEBUG] [LOCAL ] EVTR: Deleted primary data file. [2025-10-15T18:50:35.550500] [INFO ] [MAIN ] EVTR: Starting full primary refresh. [2025-10-15T18:50:35.937191] [INFO ] [REMOTE ] EVTR: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:50:35.954048] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-15T18:50:36.113974] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2024-12. [2025-10-15T18:50:36.394823] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-15T18:50:36.913978] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-03. [2025-10-15T18:50:37.153472] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-10-15T18:50:37.713963] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-01. [2025-10-15T18:50:37.829162] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-15T18:50:38.273820] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-15T18:50:38.514078] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-04. [2025-10-15T18:50:39.313975] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-10. [2025-10-15T18:50:39.731179] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-15T18:50:40.114012] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-02. [2025-10-15T18:50:40.289744] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-15T18:50:40.293462] [INFO ] [REMOTE ] EVR: Full fetch complete (50797 records). [2025-10-15T18:50:40.293538] [DEBUG] [VALIDATOR ] EVR: Validating primary data. [2025-10-15T18:50:40.666391] [DEBUG] [VALIDATOR ] EVR: All expected trading days are present. [2025-10-15T18:50:40.666473] [DEBUG] [VALIDATOR ] EVR: Primary data validation passed. [2025-10-15T18:50:40.667212] [INFO ] [MAIN ] EVR: Fetched primary data is valid. [2025-10-15T18:50:40.667276] [DEBUG] [LOCAL ] EVR: Saving primary data. [2025-10-15T18:50:40.668423] [DEBUG] [LOCAL ] EVR: Trimmed 50797 records to 34420 (keeping 200 days of data) [2025-10-15T18:50:40.881664] [DEBUG] [LOCAL ] EVR: Primary data saved (34420 records). [2025-10-15T18:50:40.881797] [INFO ] [MAIN ] EVR: Full history saved. [2025-10-15T18:50:40.881876] [INFO ] [MAIN ] Update Progress: 792/2369 symbols completed. EVR took 37.9s. Estimated remaining: 3h 40m 14s. Rate: 7.2 symbols/min [2025-10-15T18:50:40.914113] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2024-12. [2025-10-15T18:50:41.056036] [INFO ] [MAIN ] EW: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:50:41.104208] [DEBUG] [LOCAL ] EW: Loaded 53406 existing records from primary storage. [2025-10-15T18:50:41.104500] [INFO ] [MAIN ] EW: Loaded 53406 existing records. [2025-10-15T18:50:41.234761] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-15T18:50:41.292606] [WARN ] [MAIN ] EW: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:50:41.292813] [INFO ] [MAIN ] EW: Wiping existing primary data before full refresh. [2025-10-15T18:50:41.292859] [INFO ] [LOCAL ] EW: Starting deletion of primary data. [2025-10-15T18:50:41.293174] [DEBUG] [LOCAL ] EW: Deleted primary data file. [2025-10-15T18:50:41.293225] [INFO ] [MAIN ] EW: Starting full primary refresh. [2025-10-15T18:50:41.636943] [INFO ] [REMOTE ] EW: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:50:41.713966] [INFO ] [REMOTE ] EW: Fetching primary data for 2024-12. [2025-10-15T18:50:42.254069] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-15T18:50:42.514040] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-03. [2025-10-15T18:50:43.241681] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-15T18:50:43.263373] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-15T18:50:43.313999] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-04. [2025-10-15T18:50:44.113974] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-01. [2025-10-15T18:50:44.155343] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-15T18:50:44.914036] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-05. [2025-10-15T18:50:45.711332] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-15T18:50:45.717558] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-01. [2025-10-15T18:50:45.904029] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-15T18:50:46.514060] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-05. [2025-10-15T18:50:47.148819] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-15T18:50:47.313948] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-02. [2025-10-15T18:50:47.685877] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-15T18:50:48.113986] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-06. [2025-10-15T18:50:48.897524] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-15T18:50:48.913932] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-06. [2025-10-15T18:50:49.191283] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-15T18:50:49.713999] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-02. [2025-10-15T18:50:50.064037] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-15T18:50:50.514016] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-03. [2025-10-15T18:50:51.101713] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-15T18:50:51.314006] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-03. [2025-10-15T18:50:52.113975] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-07. [2025-10-15T18:50:52.215791] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-15T18:50:52.226686] [DEBUG] [REMOTE ] EVTR: Error fetching primary data for 2025-07: 'API call returned an empty response.' [2025-10-15T18:50:52.227057] [WARN ] [REMOTE ] EVTR: No data returned for month 2025-07 [2025-10-15T18:50:52.227550] [FATAL] [REMOTE ] EVTR: API call failed - aborting fetch to avoid wasting further API calls [2025-10-15T18:50:52.228080] [FATAL] [MAIN ] EVTR: Failed to fetch primary data. [2025-10-15T18:50:52.228149] [WARN ] [MAIN ] EVTR: Deleting existing primary and derivative data due to fetch failure. [2025-10-15T18:50:52.228220] [INFO ] [LOCAL ] EVTR: Starting deletion of primary data. [2025-10-15T18:50:52.228282] [DEBUG] [LOCAL ] EVTR: No primary data file found to delete. [2025-10-15T18:50:52.228318] [INFO ] [LOCAL ] EVTR: Starting deletion of derivative data. [2025-10-15T18:50:52.228440] [DEBUG] [LOCAL ] EVTR: Deleted derivative data file. [2025-10-15T18:50:52.228519] [INFO ] [MAIN ] Update Progress: 793/2369 symbols completed. EVTR took 17.1s. Estimated remaining: 3h 40m 12s. Rate: 7.2 symbols/min [2025-10-15T18:50:52.392675] [INFO ] [MAIN ] EXG: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:50:52.425116] [DEBUG] [LOCAL ] EXG: Loaded 34136 existing records from primary storage. [2025-10-15T18:50:52.425393] [INFO ] [MAIN ] EXG: Loaded 34136 existing records. [2025-10-15T18:50:52.596989] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-15T18:50:52.622451] [WARN ] [MAIN ] EXG: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:50:52.623343] [INFO ] [MAIN ] EXG: Wiping existing primary data before full refresh. [2025-10-15T18:50:52.623403] [INFO ] [LOCAL ] EXG: Starting deletion of primary data. [2025-10-15T18:50:52.623838] [DEBUG] [LOCAL ] EXG: Deleted primary data file. [2025-10-15T18:50:52.623895] [INFO ] [MAIN ] EXG: Starting full primary refresh. [2025-10-15T18:50:52.919163] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-04. [2025-10-15T18:50:52.972068] [INFO ] [REMOTE ] EXG: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:50:53.714046] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-04. [2025-10-15T18:50:54.514044] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-07. [2025-10-15T18:50:54.911493] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-15T18:50:55.079334] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-04 (2.16 seconds). [2025-10-15T18:50:55.314052] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-05. [2025-10-15T18:50:55.457438] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-15T18:50:56.114073] [INFO ] [REMOTE ] EXG: Fetching primary data for 2024-12. [2025-10-15T18:50:56.913985] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-05. [2025-10-15T18:50:56.991586] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-15T18:50:57.406607] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-15T18:50:57.714074] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-08. [2025-10-15T18:50:57.946262] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-15T18:50:58.514045] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-01. [2025-10-15T18:50:58.841760] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-15T18:50:59.314024] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-06. [2025-10-15T18:50:59.892467] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-15T18:51:00.114009] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-06. [2025-10-15T18:51:00.914052] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-02. [2025-10-15T18:51:01.003960] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-15T18:51:01.719127] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-07. [2025-10-15T18:51:01.731461] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-15T18:51:02.306618] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-15T18:51:02.513993] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-09. [2025-10-15T18:51:03.313960] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-03. [2025-10-15T18:51:03.419532] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-15T18:51:03.631967] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-15T18:51:04.114041] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-08. [2025-10-15T18:51:04.386063] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-15T18:51:04.913995] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-04. [2025-10-15T18:51:05.714001] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-10. [2025-10-15T18:51:05.866024] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-15T18:51:06.378011] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-15T18:51:06.514027] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-05. [2025-10-15T18:51:06.956190] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-15T18:51:06.963756] [INFO ] [REMOTE ] EVTC: Full fetch complete (38371 records). [2025-10-15T18:51:06.963889] [DEBUG] [VALIDATOR ] EVTC: Validating primary data. [2025-10-15T18:51:07.320403] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-07. [2025-10-15T18:51:07.322853] [DEBUG] [VALIDATOR ] EVTC: All expected trading days are present. [2025-10-15T18:51:07.323572] [DEBUG] [VALIDATOR ] EVTC: Primary data validation passed. [2025-10-15T18:51:07.324267] [INFO ] [MAIN ] EVTC: Fetched primary data is valid. [2025-10-15T18:51:07.324382] [DEBUG] [LOCAL ] EVTC: Saving primary data. [2025-10-15T18:51:07.325504] [DEBUG] [LOCAL ] EVTC: Trimmed 38371 records to 26787 (keeping 200 days of data) [2025-10-15T18:51:07.481856] [DEBUG] [LOCAL ] EVTC: Primary data saved (26787 records). [2025-10-15T18:51:07.482001] [INFO ] [MAIN ] EVTC: Full history saved. [2025-10-15T18:51:07.482088] [INFO ] [MAIN ] Update Progress: 794/2369 symbols completed. EVTC took 37.3s. Estimated remaining: 3h 40m 17s. Rate: 7.1 symbols/min [2025-10-15T18:51:07.646308] [INFO ] [MAIN ] EXK: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:51:07.701631] [DEBUG] [LOCAL ] EXK: Loaded 53169 existing records from primary storage. [2025-10-15T18:51:07.702001] [INFO ] [MAIN ] EXK: Loaded 53169 existing records. [2025-10-15T18:51:07.882389] [WARN ] [MAIN ] EXK: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:51:07.882874] [INFO ] [MAIN ] EXK: Wiping existing primary data before full refresh. [2025-10-15T18:51:07.882951] [INFO ] [LOCAL ] EXK: Starting deletion of primary data. [2025-10-15T18:51:07.883584] [DEBUG] [LOCAL ] EXK: Deleted primary data file. [2025-10-15T18:51:07.883691] [INFO ] [MAIN ] EXK: Starting full primary refresh. [2025-10-15T18:51:08.087019] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-15T18:51:08.121036] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-09. [2025-10-15T18:51:08.275256] [INFO ] [REMOTE ] EXK: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:51:08.913985] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-06. [2025-10-15T18:51:09.333090] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-10-15T18:51:09.497402] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-15T18:51:09.714027] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-10. [2025-10-15T18:51:09.860088] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-15T18:51:10.356546] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-15T18:51:10.363168] [INFO ] [REMOTE ] EW: Full fetch complete (77521 records). [2025-10-15T18:51:10.363299] [DEBUG] [VALIDATOR ] EW: Validating primary data. [2025-10-15T18:51:10.521312] [INFO ] [REMOTE ] EXK: Fetching primary data for 2024-12. [2025-10-15T18:51:10.772418] [DEBUG] [VALIDATOR ] EW: All expected trading days are present. [2025-10-15T18:51:10.772531] [DEBUG] [VALIDATOR ] EW: Primary data validation passed. [2025-10-15T18:51:10.773506] [INFO ] [MAIN ] EW: Fetched primary data is valid. [2025-10-15T18:51:10.773571] [DEBUG] [LOCAL ] EW: Saving primary data. [2025-10-15T18:51:10.774998] [DEBUG] [LOCAL ] EW: Trimmed 77521 records to 53406 (keeping 200 days of data) [2025-10-15T18:51:11.087138] [DEBUG] [LOCAL ] EW: Primary data saved (53406 records). [2025-10-15T18:51:11.087277] [INFO ] [MAIN ] EW: Full history saved. [2025-10-15T18:51:11.087355] [INFO ] [MAIN ] Update Progress: 795/2369 symbols completed. EW took 30.2s. Estimated remaining: 3h 39m 59s. Rate: 7.2 symbols/min [2025-10-15T18:51:11.251931] [INFO ] [MAIN ] EXP: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:51:11.282103] [DEBUG] [LOCAL ] EXP: Loaded 29541 existing records from primary storage. [2025-10-15T18:51:11.282400] [INFO ] [MAIN ] EXP: Loaded 29541 existing records. [2025-10-15T18:51:11.319269] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-07. [2025-10-15T18:51:11.482982] [WARN ] [MAIN ] EXP: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:51:11.483228] [INFO ] [MAIN ] EXP: Wiping existing primary data before full refresh. [2025-10-15T18:51:11.483304] [INFO ] [LOCAL ] EXP: Starting deletion of primary data. [2025-10-15T18:51:11.483750] [DEBUG] [LOCAL ] EXP: Deleted primary data file. [2025-10-15T18:51:11.483807] [INFO ] [MAIN ] EXP: Starting full primary refresh. [2025-10-15T18:51:11.881353] [INFO ] [REMOTE ] EXP: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:51:12.114021] [INFO ] [REMOTE ] EXP: Fetching primary data for 2024-12. [2025-10-15T18:51:12.347076] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-15T18:51:12.866595] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-15T18:51:12.914005] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-01. [2025-10-15T18:51:13.389964] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-15T18:51:13.713995] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-01. [2025-10-15T18:51:14.514053] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-08. [2025-10-15T18:51:14.640461] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-15T18:51:14.901290] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-15T18:51:15.314009] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-02. [2025-10-15T18:51:16.040527] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-15T18:51:16.114024] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-02. [2025-10-15T18:51:16.913971] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-08. [2025-10-15T18:51:17.112101] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-15T18:51:17.376456] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-15T18:51:17.714007] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-09. [2025-10-15T18:51:18.205522] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-15T18:51:18.514052] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-03. [2025-10-15T18:51:19.314052] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-03. [2025-10-15T18:51:19.483999] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-15T18:51:19.826590] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-15T18:51:20.113995] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-10. [2025-10-15T18:51:20.913960] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-09. [2025-10-15T18:51:21.406856] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-10-15T18:51:21.713983] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-04. [2025-10-15T18:51:21.890405] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-15T18:51:21.896508] [INFO ] [REMOTE ] EVTL: Full fetch complete (54328 records). [2025-10-15T18:51:21.896611] [DEBUG] [VALIDATOR ] EVTL: Validating primary data. [2025-10-15T18:51:22.261594] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-15T18:51:22.299859] [DEBUG] [VALIDATOR ] EVTL: All expected trading days are present. [2025-10-15T18:51:22.299940] [DEBUG] [VALIDATOR ] EVTL: Primary data validation passed. [2025-10-15T18:51:22.300738] [INFO ] [MAIN ] EVTL: Fetched primary data is valid. [2025-10-15T18:51:22.300818] [DEBUG] [LOCAL ] EVTL: Saving primary data. [2025-10-15T18:51:22.302039] [DEBUG] [LOCAL ] EVTL: Trimmed 54328 records to 40293 (keeping 200 days of data) [2025-10-15T18:51:22.523604] [DEBUG] [LOCAL ] EVTL: Primary data saved (40293 records). [2025-10-15T18:51:22.518258] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-10. [2025-10-15T18:51:22.524294] [INFO ] [MAIN ] EVTL: Full history saved. [2025-10-15T18:51:22.525243] [INFO ] [MAIN ] Update Progress: 796/2369 symbols completed. EVTL took 49.5s. Estimated remaining: 3h 39m 57s. Rate: 7.2 symbols/min [2025-10-15T18:51:22.696373] [INFO ] [MAIN ] EXPD: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:51:22.741667] [DEBUG] [LOCAL ] EXPD: Loaded 47953 existing records from primary storage. [2025-10-15T18:51:22.741983] [INFO ] [MAIN ] EXPD: Loaded 47953 existing records. [2025-10-15T18:51:22.947436] [WARN ] [MAIN ] EXPD: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:51:22.947730] [INFO ] [MAIN ] EXPD: Wiping existing primary data before full refresh. [2025-10-15T18:51:22.947867] [INFO ] [LOCAL ] EXPD: Starting deletion of primary data. [2025-10-15T18:51:22.948361] [DEBUG] [LOCAL ] EXPD: Deleted primary data file. [2025-10-15T18:51:22.948422] [INFO ] [MAIN ] EXPD: Starting full primary refresh. [2025-10-15T18:51:23.088778] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-15T18:51:23.339829] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-04. [2025-10-15T18:51:23.344905] [INFO ] [REMOTE ] EXPD: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:51:23.865475] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-15T18:51:23.869584] [INFO ] [REMOTE ] EXG: Full fetch complete (49887 records). [2025-10-15T18:51:23.869701] [DEBUG] [VALIDATOR ] EXG: Validating primary data. [2025-10-15T18:51:24.119070] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2024-12. [2025-10-15T18:51:24.273688] [DEBUG] [VALIDATOR ] EXG: All expected trading days are present. [2025-10-15T18:51:24.273783] [DEBUG] [VALIDATOR ] EXG: Primary data validation passed. [2025-10-15T18:51:24.274628] [INFO ] [MAIN ] EXG: Fetched primary data is valid. [2025-10-15T18:51:24.274716] [DEBUG] [LOCAL ] EXG: Saving primary data. [2025-10-15T18:51:24.275922] [DEBUG] [LOCAL ] EXG: Trimmed 49887 records to 34033 (keeping 200 days of data) [2025-10-15T18:51:24.477703] [DEBUG] [LOCAL ] EXG: Primary data saved (34033 records). [2025-10-15T18:51:24.477855] [INFO ] [MAIN ] EXG: Full history saved. [2025-10-15T18:51:24.477936] [INFO ] [MAIN ] Update Progress: 797/2369 symbols completed. EXG took 32.2s. Estimated remaining: 3h 39m 36s. Rate: 7.2 symbols/min [2025-10-15T18:51:24.914047] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-05. [2025-10-15T18:51:24.952717] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-15T18:51:25.651778] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-15T18:51:25.713955] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-01. [2025-10-15T18:51:26.261517] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-15T18:51:26.514033] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-06. [2025-10-15T18:51:27.314087] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-05. [2025-10-15T18:51:27.424369] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-15T18:51:27.852853] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-15T18:51:28.114047] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-07. [2025-10-15T18:51:28.913993] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-02. [2025-10-15T18:51:29.176983] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-15T18:51:29.217308] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-15T18:51:29.714017] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-08. [2025-10-15T18:51:30.514004] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-06. [2025-10-15T18:51:30.577188] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-15T18:51:30.877765] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-15T18:51:31.314021] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-03. [2025-10-15T18:51:32.114027] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-09. [2025-10-15T18:51:32.371972] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-15T18:51:32.913966] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-07. [2025-10-15T18:51:32.954822] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-15T18:51:33.329022] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-15T18:51:33.713998] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-04. [2025-10-15T18:51:34.513980] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-10. [2025-10-15T18:51:34.892811] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-15T18:51:35.002154] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-15T18:51:35.314000] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-05. [2025-10-15T18:51:35.753462] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-15T18:51:35.757252] [INFO ] [REMOTE ] EXP: Full fetch complete (42963 records). [2025-10-15T18:51:35.757348] [DEBUG] [VALIDATOR ] EXP: Validating primary data. [2025-10-15T18:51:36.119169] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-08. [2025-10-15T18:51:36.138222] [DEBUG] [VALIDATOR ] EXP: All expected trading days are present. [2025-10-15T18:51:36.138331] [DEBUG] [VALIDATOR ] EXP: Primary data validation passed. [2025-10-15T18:51:36.139058] [INFO ] [MAIN ] EXP: Fetched primary data is valid. [2025-10-15T18:51:36.139121] [DEBUG] [LOCAL ] EXP: Saving primary data. [2025-10-15T18:51:36.140203] [DEBUG] [LOCAL ] EXP: Trimmed 42963 records to 29600 (keeping 200 days of data) [2025-10-15T18:51:36.323866] [DEBUG] [LOCAL ] EXP: Primary data saved (29600 records). [2025-10-15T18:51:36.324001] [INFO ] [MAIN ] EXP: Full history saved. [2025-10-15T18:51:36.324079] [INFO ] [MAIN ] Update Progress: 798/2369 symbols completed. EXP took 25.2s. Estimated remaining: 3h 39m 34s. Rate: 7.2 symbols/min [2025-10-15T18:51:36.990474] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-15T18:51:37.001526] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-06. [2025-10-15T18:51:38.025056] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-15T18:51:38.036170] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-09. [2025-10-15T18:51:38.292184] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-15T18:51:38.514024] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-07. [2025-10-15T18:51:39.620546] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-15T18:51:39.632218] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-10. [2025-10-15T18:51:40.153450] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-15T18:51:40.164250] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-08. [2025-10-15T18:51:41.479833] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-15T18:51:41.490285] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-09. [2025-10-15T18:51:41.579826] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-10 (1.95 seconds). [2025-10-15T18:51:41.586169] [INFO ] [REMOTE ] EXK: Full fetch complete (76786 records). [2025-10-15T18:51:41.586290] [DEBUG] [VALIDATOR ] EXK: Validating primary data. [2025-10-15T18:51:41.974517] [DEBUG] [VALIDATOR ] EXK: All expected trading days are present. [2025-10-15T18:51:41.974608] [DEBUG] [VALIDATOR ] EXK: Primary data validation passed. [2025-10-15T18:51:41.975669] [INFO ] [MAIN ] EXK: Fetched primary data is valid. [2025-10-15T18:51:41.975735] [DEBUG] [LOCAL ] EXK: Saving primary data. [2025-10-15T18:51:41.977151] [DEBUG] [LOCAL ] EXK: Trimmed 76786 records to 53171 (keeping 200 days of data) [2025-10-15T18:51:42.285113] [DEBUG] [LOCAL ] EXK: Primary data saved (53171 records). [2025-10-15T18:51:42.285250] [INFO ] [MAIN ] EXK: Full history saved. [2025-10-15T18:51:42.285545] [INFO ] [MAIN ] Update Progress: 799/2369 symbols completed. EXK took 34.8s. Estimated remaining: 3h 39m 21s. Rate: 7.2 symbols/min [2025-10-15T18:51:43.162066] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-15T18:51:43.172599] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-10. [2025-10-15T18:51:43.722501] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-15T18:51:43.731318] [INFO ] [REMOTE ] EXPD: Full fetch complete (69534 records). [2025-10-15T18:51:43.731478] [DEBUG] [VALIDATOR ] EXPD: Validating primary data. [2025-10-15T18:51:44.150780] [DEBUG] [VALIDATOR ] EXPD: All expected trading days are present. [2025-10-15T18:51:44.150878] [DEBUG] [VALIDATOR ] EXPD: Primary data validation passed. [2025-10-15T18:51:44.151899] [INFO ] [MAIN ] EXPD: Fetched primary data is valid. [2025-10-15T18:51:44.151968] [DEBUG] [LOCAL ] EXPD: Saving primary data. [2025-10-15T18:51:44.153491] [DEBUG] [LOCAL ] EXPD: Trimmed 69534 records to 47973 (keeping 200 days of data) [2025-10-15T18:51:44.470803] [DEBUG] [LOCAL ] EXPD: Primary data saved (47973 records). [2025-10-15T18:51:44.470961] [INFO ] [MAIN ] EXPD: Full history saved. [2025-10-15T18:51:44.471047] [INFO ] [MAIN ] Update Progress: 800/2369 symbols completed. EXPD took 21.9s. Estimated remaining: 3h 39m 0s. Rate: 7.2 symbols/min [2025-10-15T18:51:45.039282] [INFO ] [MAIN ] F: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:51:45.116490] [INFO ] [MAIN ] EXR: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:51:45.202437] [INFO ] [MAIN ] FAF: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:51:45.201609] [INFO ] [MAIN ] FBIN: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:51:45.296299] [DEBUG] [LOCAL ] EXR: Loaded 45464 existing records from primary storage. [2025-10-15T18:51:45.297548] [DEBUG] [LOCAL ] F: Loaded 53820 existing records from primary storage. [2025-10-15T18:51:45.298088] [INFO ] [MAIN ] EXR: Loaded 45464 existing records. [2025-10-15T18:51:45.339063] [INFO ] [MAIN ] F: Loaded 53820 existing records. [2025-10-15T18:51:45.445091] [DEBUG] [LOCAL ] FBIN: Loaded 50395 existing records from primary storage. [2025-10-15T18:51:45.464814] [DEBUG] [LOCAL ] FAF: Loaded 41537 existing records from primary storage. [2025-10-15T18:51:45.518321] [INFO ] [MAIN ] FAF: Loaded 41537 existing records. [2025-10-15T18:51:45.518024] [INFO ] [MAIN ] FBIN: Loaded 50395 existing records. [2025-10-15T18:51:45.785909] [WARN ] [MAIN ] EXR: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:51:45.921689] [INFO ] [MAIN ] EXR: Wiping existing primary data before full refresh. [2025-10-15T18:51:45.921880] [INFO ] [LOCAL ] EXR: Starting deletion of primary data. [2025-10-15T18:51:45.978181] [WARN ] [MAIN ] F: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:51:46.044668] [DEBUG] [LOCAL ] EXR: Deleted primary data file. [2025-10-15T18:51:46.056484] [INFO ] [MAIN ] EXR: Starting full primary refresh. [2025-10-15T18:51:46.015233] [INFO ] [MAIN ] F: Wiping existing primary data before full refresh. [2025-10-15T18:51:46.077988] [INFO ] [LOCAL ] F: Starting deletion of primary data. [2025-10-15T18:51:46.095697] [DEBUG] [LOCAL ] F: Deleted primary data file. [2025-10-15T18:51:46.103420] [INFO ] [MAIN ] F: Starting full primary refresh. [2025-10-15T18:51:46.126720] [WARN ] [MAIN ] FAF: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:51:46.211055] [INFO ] [MAIN ] FAF: Wiping existing primary data before full refresh. [2025-10-15T18:51:46.224782] [INFO ] [LOCAL ] FAF: Starting deletion of primary data. [2025-10-15T18:51:46.305769] [DEBUG] [LOCAL ] FAF: Deleted primary data file. [2025-10-15T18:51:46.246295] [WARN ] [MAIN ] FBIN: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:51:46.359888] [INFO ] [MAIN ] FBIN: Wiping existing primary data before full refresh. [2025-10-15T18:51:46.359799] [INFO ] [MAIN ] FAF: Starting full primary refresh. [2025-10-15T18:51:46.360472] [INFO ] [LOCAL ] FBIN: Starting deletion of primary data. [2025-10-15T18:51:46.371086] [DEBUG] [LOCAL ] FBIN: Deleted primary data file. [2025-10-15T18:51:46.376339] [INFO ] [MAIN ] FBIN: Starting full primary refresh. [2025-10-15T18:51:47.404006] [INFO ] [REMOTE ] EXR: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:51:47.488971] [INFO ] [REMOTE ] EXR: Fetching primary data for 2024-12. [2025-10-15T18:51:47.483261] [INFO ] [REMOTE ] F: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:51:47.514727] [INFO ] [REMOTE ] F: Fetching primary data for 2024-12. [2025-10-15T18:51:47.660091] [INFO ] [REMOTE ] FAF: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:51:47.686494] [INFO ] [REMOTE ] FAF: Fetching primary data for 2024-12. [2025-10-15T18:51:47.691782] [INFO ] [REMOTE ] FBIN: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:51:47.692176] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2024-12. [2025-10-15T18:51:49.052095] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-15T18:51:49.059635] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-01. [2025-10-15T18:51:49.148970] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-15T18:51:49.157770] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-01. [2025-10-15T18:51:49.233000] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-15T18:51:49.242461] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-01. [2025-10-15T18:51:49.824595] [INFO ] [REMOTE ] F: Incremental fetch complete for 2024-12 (2.31 seconds). [2025-10-15T18:51:49.835867] [INFO ] [REMOTE ] F: Fetching primary data for 2025-01. [2025-10-15T18:51:50.426300] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-15T18:51:50.434345] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-02. [2025-10-15T18:51:50.591164] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-15T18:51:50.601843] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-02. [2025-10-15T18:51:50.671534] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-15T18:51:50.680983] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-02. [2025-10-15T18:51:51.695474] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-15T18:51:51.702871] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-03. [2025-10-15T18:51:52.159134] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-15T18:51:52.168522] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-03. [2025-10-15T18:51:52.204501] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-15T18:51:52.245407] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-01 (2.41 seconds). [2025-10-15T18:51:52.822935] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-15T18:51:52.913998] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-04. [2025-10-15T18:51:53.714052] [INFO ] [REMOTE ] F: Fetching primary data for 2025-02. [2025-10-15T18:51:53.768329] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-15T18:51:54.236698] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-15T18:51:54.514015] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-03. [2025-10-15T18:51:55.314036] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-05. [2025-10-15T18:51:56.113725] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-02 (2.40 seconds). [2025-10-15T18:51:56.123565] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-04. [2025-10-15T18:51:56.155002] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-15T18:51:56.792024] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-15T18:51:56.913956] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-06. [2025-10-15T18:51:57.714049] [INFO ] [REMOTE ] F: Fetching primary data for 2025-03. [2025-10-15T18:51:57.803483] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-15T18:51:58.408003] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-15T18:51:58.513961] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-07. [2025-10-15T18:51:59.314079] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-04. [2025-10-15T18:51:59.908764] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-15T18:52:00.113010] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-03 (2.40 seconds). [2025-10-15T18:52:00.117118] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-08. [2025-10-15T18:52:00.914031] [INFO ] [REMOTE ] F: Fetching primary data for 2025-04. [2025-10-15T18:52:00.996882] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-15T18:52:01.714030] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-05. [2025-10-15T18:52:01.799236] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-15T18:52:02.514010] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-09. [2025-10-15T18:52:03.313983] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-05. [2025-10-15T18:52:03.419558] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-04 (2.51 seconds). [2025-10-15T18:52:03.543590] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-15T18:52:03.942560] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-15T18:52:04.114008] [INFO ] [REMOTE ] F: Fetching primary data for 2025-05. [2025-10-15T18:52:04.726140] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-15T18:52:04.914007] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-06. [2025-10-15T18:52:05.714025] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-06. [2025-10-15T18:52:06.513993] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-10. [2025-10-15T18:52:06.598899] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-15T18:52:06.644536] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-05 (2.53 seconds). [2025-10-15T18:52:07.260632] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-15T18:52:07.313979] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-07. [2025-10-15T18:52:07.748801] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-15T18:52:07.753169] [INFO ] [REMOTE ] FAF: Full fetch complete (57911 records). [2025-10-15T18:52:07.753262] [DEBUG] [VALIDATOR ] FAF: Validating primary data. [2025-10-15T18:52:08.126759] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-07. [2025-10-15T18:52:08.130823] [DEBUG] [VALIDATOR ] FAF: All expected trading days are present. [2025-10-15T18:52:08.130891] [DEBUG] [VALIDATOR ] FAF: Primary data validation passed. [2025-10-15T18:52:08.131739] [INFO ] [MAIN ] FAF: Fetched primary data is valid. [2025-10-15T18:52:08.131804] [DEBUG] [LOCAL ] FAF: Saving primary data. [2025-10-15T18:52:08.133142] [DEBUG] [LOCAL ] FAF: Trimmed 57911 records to 41492 (keeping 200 days of data) [2025-10-15T18:52:08.387205] [DEBUG] [LOCAL ] FAF: Primary data saved (41492 records). [2025-10-15T18:52:08.387327] [INFO ] [MAIN ] FAF: Full history saved. [2025-10-15T18:52:08.387708] [INFO ] [MAIN ] Update Progress: 801/2369 symbols completed. FAF took 23.9s. Estimated remaining: 3h 39m 22s. Rate: 7.1 symbols/min [2025-10-15T18:52:08.555547] [INFO ] [MAIN ] FBK: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:52:08.582907] [DEBUG] [LOCAL ] FBK: Loaded 27211 existing records from primary storage. [2025-10-15T18:52:08.583163] [INFO ] [MAIN ] FBK: Loaded 27211 existing records. [2025-10-15T18:52:08.758527] [WARN ] [MAIN ] FBK: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:52:08.758903] [INFO ] [MAIN ] FBK: Wiping existing primary data before full refresh. [2025-10-15T18:52:08.759007] [INFO ] [LOCAL ] FBK: Starting deletion of primary data. [2025-10-15T18:52:08.759349] [DEBUG] [LOCAL ] FBK: Deleted primary data file. [2025-10-15T18:52:08.759406] [INFO ] [MAIN ] FBK: Starting full primary refresh. [2025-10-15T18:52:08.933359] [INFO ] [REMOTE ] F: Fetching primary data for 2025-06. [2025-10-15T18:52:09.158373] [INFO ] [REMOTE ] FBK: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:52:09.160171] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-15T18:52:09.714027] [INFO ] [REMOTE ] FBK: Fetching primary data for 2024-12. [2025-10-15T18:52:09.956146] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-15T18:52:10.514018] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-08. [2025-10-15T18:52:10.747837] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-15T18:52:11.271434] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-06 (2.34 seconds). [2025-10-15T18:52:11.313988] [INFO ] [REMOTE ] F: Fetching primary data for 2025-07. [2025-10-15T18:52:12.114008] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-08. [2025-10-15T18:52:12.232433] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-15T18:52:12.914057] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-09. [2025-10-15T18:52:13.714033] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-01. [2025-10-15T18:52:13.789832] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-15T18:52:13.900490] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-07 (2.59 seconds). [2025-10-15T18:52:14.124195] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-15T18:52:14.513965] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-09. [2025-10-15T18:52:14.759368] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-15T18:52:15.314035] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-02. [2025-10-15T18:52:16.113977] [INFO ] [REMOTE ] F: Fetching primary data for 2025-08. [2025-10-15T18:52:16.231033] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-15T18:52:16.249727] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-15T18:52:16.914037] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-03. [2025-10-15T18:52:17.713975] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-10. [2025-10-15T18:52:17.916556] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-15T18:52:18.513965] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-10. [2025-10-15T18:52:18.544215] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-08 (2.43 seconds). [2025-10-15T18:52:19.314013] [INFO ] [REMOTE ] F: Fetching primary data for 2025-09. [2025-10-15T18:52:19.341396] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-15T18:52:19.347426] [INFO ] [REMOTE ] FBIN: Full fetch complete (72924 records). [2025-10-15T18:52:19.347568] [DEBUG] [VALIDATOR ] FBIN: Validating primary data. [2025-10-15T18:52:19.757830] [DEBUG] [VALIDATOR ] FBIN: All expected trading days are present. [2025-10-15T18:52:19.757922] [DEBUG] [VALIDATOR ] FBIN: Primary data validation passed. [2025-10-15T18:52:19.758921] [INFO ] [MAIN ] FBIN: Fetched primary data is valid. [2025-10-15T18:52:19.758990] [DEBUG] [LOCAL ] FBIN: Saving primary data. [2025-10-15T18:52:19.760562] [DEBUG] [LOCAL ] FBIN: Trimmed 72924 records to 50393 (keeping 200 days of data) [2025-10-15T18:52:20.083598] [DEBUG] [LOCAL ] FBIN: Primary data saved (50393 records). [2025-10-15T18:52:20.083774] [INFO ] [MAIN ] FBIN: Full history saved. [2025-10-15T18:52:20.084840] [INFO ] [MAIN ] Update Progress: 802/2369 symbols completed. FBIN took 35.6s. Estimated remaining: 3h 39m 20s. Rate: 7.1 symbols/min [2025-10-15T18:52:20.119118] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-04. [2025-10-15T18:52:20.234883] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-15T18:52:20.282754] [INFO ] [REMOTE ] EXR: Full fetch complete (66120 records). [2025-10-15T18:52:20.302203] [DEBUG] [VALIDATOR ] EXR: Validating primary data. [2025-10-15T18:52:20.308915] [INFO ] [MAIN ] FBP: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:52:20.693916] [DEBUG] [LOCAL ] FBP: Loaded 45726 existing records from primary storage. [2025-10-15T18:52:20.714771] [INFO ] [MAIN ] FBP: Loaded 45726 existing records. [2025-10-15T18:52:20.997435] [DEBUG] [VALIDATOR ] EXR: All expected trading days are present. [2025-10-15T18:52:21.024794] [DEBUG] [VALIDATOR ] EXR: Primary data validation passed. [2025-10-15T18:52:21.046476] [INFO ] [MAIN ] EXR: Fetched primary data is valid. [2025-10-15T18:52:21.064701] [DEBUG] [LOCAL ] EXR: Saving primary data. [2025-10-15T18:52:21.068469] [WARN ] [MAIN ] FBP: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:52:21.068799] [INFO ] [MAIN ] FBP: Wiping existing primary data before full refresh. [2025-10-15T18:52:21.068866] [INFO ] [LOCAL ] FBP: Starting deletion of primary data. [2025-10-15T18:52:21.069297] [DEBUG] [LOCAL ] FBP: Deleted primary data file. [2025-10-15T18:52:21.069431] [INFO ] [MAIN ] FBP: Starting full primary refresh. [2025-10-15T18:52:21.101477] [DEBUG] [LOCAL ] EXR: Trimmed 66120 records to 45550 (keeping 200 days of data) [2025-10-15T18:52:21.561389] [INFO ] [REMOTE ] FBP: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:52:21.563890] [INFO ] [REMOTE ] FBP: Fetching primary data for 2024-12. [2025-10-15T18:52:21.591030] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-15T18:52:21.713957] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-05. [2025-10-15T18:52:21.816307] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-09 (2.50 seconds). [2025-10-15T18:52:21.833996] [DEBUG] [LOCAL ] EXR: Primary data saved (45550 records). [2025-10-15T18:52:21.834140] [INFO ] [MAIN ] EXR: Full history saved. [2025-10-15T18:52:21.834250] [INFO ] [MAIN ] Update Progress: 803/2369 symbols completed. EXR took 37.4s. Estimated remaining: 3h 38m 59s. Rate: 7.2 symbols/min [2025-10-15T18:52:21.996917] [INFO ] [MAIN ] FBRT: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:52:21.997036] [DEBUG] [LOCAL ] FBRT: No existing data file found in primary storage. [2025-10-15T18:52:21.997073] [WARN ] [MAIN ] FBRT: No existing data found, performing full refresh instead. [2025-10-15T18:52:21.997177] [INFO ] [MAIN ] FBRT: Wiping existing primary data before full refresh. [2025-10-15T18:52:21.997218] [INFO ] [LOCAL ] FBRT: Starting deletion of primary data. [2025-10-15T18:52:21.997257] [DEBUG] [LOCAL ] FBRT: No primary data file found to delete. [2025-10-15T18:52:21.997288] [INFO ] [MAIN ] FBRT: Starting full primary refresh. [2025-10-15T18:52:22.347969] [INFO ] [REMOTE ] FBRT: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:52:22.514000] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2024-12. [2025-10-15T18:52:22.615695] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-15T18:52:22.801777] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-15T18:52:23.314011] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-06. [2025-10-15T18:52:23.804046] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-15T18:52:24.114012] [INFO ] [REMOTE ] F: Fetching primary data for 2025-10. [2025-10-15T18:52:24.314938] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-15T18:52:24.593799] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-15T18:52:24.600314] [INFO ] [REMOTE ] F: Full fetch complete (78000 records). [2025-10-15T18:52:24.600479] [DEBUG] [VALIDATOR ] F: Validating primary data. [2025-10-15T18:52:24.919242] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-01. [2025-10-15T18:52:25.000299] [DEBUG] [VALIDATOR ] F: All expected trading days are present. [2025-10-15T18:52:25.000393] [DEBUG] [VALIDATOR ] F: Primary data validation passed. [2025-10-15T18:52:25.001458] [INFO ] [MAIN ] F: Fetched primary data is valid. [2025-10-15T18:52:25.001524] [DEBUG] [LOCAL ] F: Saving primary data. [2025-10-15T18:52:25.003186] [DEBUG] [LOCAL ] F: Trimmed 78000 records to 53820 (keeping 200 days of data) [2025-10-15T18:52:25.338172] [DEBUG] [LOCAL ] F: Primary data saved (53820 records). [2025-10-15T18:52:25.338347] [INFO ] [MAIN ] F: Full history saved. [2025-10-15T18:52:25.338435] [INFO ] [MAIN ] Update Progress: 804/2369 symbols completed. F took 40.9s. Estimated remaining: 3h 38m 41s. Rate: 7.2 symbols/min [2025-10-15T18:52:25.503851] [INFO ] [MAIN ] FC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:52:25.519471] [DEBUG] [LOCAL ] FC: Loaded 14892 existing records from primary storage. [2025-10-15T18:52:25.519709] [INFO ] [MAIN ] FC: Loaded 14892 existing records. [2025-10-15T18:52:25.700816] [WARN ] [MAIN ] FC: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:52:25.701025] [INFO ] [MAIN ] FC: Wiping existing primary data before full refresh. [2025-10-15T18:52:25.701074] [INFO ] [LOCAL ] FC: Starting deletion of primary data. [2025-10-15T18:52:25.701252] [DEBUG] [LOCAL ] FC: Deleted primary data file. [2025-10-15T18:52:25.701312] [INFO ] [MAIN ] FC: Starting full primary refresh. [2025-10-15T18:52:25.722638] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-01. [2025-10-15T18:52:26.062109] [INFO ] [REMOTE ] FC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:52:26.513971] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-07. [2025-10-15T18:52:26.638614] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-15T18:52:27.037351] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-15T18:52:27.314031] [INFO ] [REMOTE ] FC: Fetching primary data for 2024-12. [2025-10-15T18:52:27.557623] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-15T18:52:28.094151] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-10-15T18:52:28.113956] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-01. [2025-10-15T18:52:28.913972] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-02. [2025-10-15T18:52:28.959963] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-15T18:52:29.714044] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-02. [2025-10-15T18:52:30.389035] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-15T18:52:30.482951] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-15T18:52:30.513957] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-02. [2025-10-15T18:52:31.313987] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-08. [2025-10-15T18:52:31.853481] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-15T18:52:32.113976] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-03. [2025-10-15T18:52:32.563339] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-15T18:52:32.913991] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-03. [2025-10-15T18:52:33.459907] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-15T18:52:33.714013] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-03. [2025-10-15T18:52:34.513990] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-09. [2025-10-15T18:52:34.604458] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-15T18:52:34.651471] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-15T18:52:35.313997] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-04. [2025-10-15T18:52:35.637512] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-15T18:52:36.089244] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-15T18:52:36.113954] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-05. [2025-10-15T18:52:36.913182] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-15T18:52:36.915801] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-10. [2025-10-15T18:52:37.714021] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-04. [2025-10-15T18:52:38.259787] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-15T18:52:38.264850] [INFO ] [REMOTE ] FBK: Full fetch complete (34919 records). [2025-10-15T18:52:38.264958] [DEBUG] [VALIDATOR ] FBK: Validating primary data. [2025-10-15T18:52:38.519275] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-06. [2025-10-15T18:52:38.686052] [DEBUG] [VALIDATOR ] FBK: All expected trading days are present. [2025-10-15T18:52:38.686126] [DEBUG] [VALIDATOR ] FBK: Primary data validation passed. [2025-10-15T18:52:38.686735] [INFO ] [MAIN ] FBK: Fetched primary data is valid. [2025-10-15T18:52:38.686796] [DEBUG] [LOCAL ] FBK: Saving primary data. [2025-10-15T18:52:38.687517] [DEBUG] [LOCAL ] FBK: Trimmed 34919 records to 27411 (keeping 200 days of data) [2025-10-15T18:52:38.855565] [DEBUG] [LOCAL ] FBK: Primary data saved (27411 records). [2025-10-15T18:52:38.855751] [INFO ] [MAIN ] FBK: Full history saved. [2025-10-15T18:52:38.855844] [INFO ] [MAIN ] Update Progress: 805/2369 symbols completed. FBK took 30.5s. Estimated remaining: 3h 38m 43s. Rate: 7.2 symbols/min [2025-10-15T18:52:39.022385] [INFO ] [MAIN ] FCF: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:52:39.060793] [DEBUG] [LOCAL ] FCF: Loaded 39283 existing records from primary storage. [2025-10-15T18:52:39.061066] [INFO ] [MAIN ] FCF: Loaded 39283 existing records. [2025-10-15T18:52:39.239906] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-15T18:52:39.255911] [WARN ] [MAIN ] FCF: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:52:39.256195] [INFO ] [MAIN ] FCF: Wiping existing primary data before full refresh. [2025-10-15T18:52:39.256921] [INFO ] [LOCAL ] FCF: Starting deletion of primary data. [2025-10-15T18:52:39.257735] [DEBUG] [LOCAL ] FCF: Deleted primary data file. [2025-10-15T18:52:39.257794] [INFO ] [MAIN ] FCF: Starting full primary refresh. [2025-10-15T18:52:39.319730] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-04. [2025-10-15T18:52:39.638562] [INFO ] [REMOTE ] FCF: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:52:39.668889] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-15T18:52:40.114005] [INFO ] [REMOTE ] FCF: Fetching primary data for 2024-12. [2025-10-15T18:52:40.876739] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-15T18:52:40.914002] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-05. [2025-10-15T18:52:41.540904] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-15T18:52:41.713995] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-01. [2025-10-15T18:52:41.934007] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-15T18:52:42.513995] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-06. [2025-10-15T18:52:43.215638] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-15T18:52:43.313952] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-02. [2025-10-15T18:52:43.381191] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-15T18:52:44.113987] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-07. [2025-10-15T18:52:44.272988] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-15T18:52:44.914010] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-07. [2025-10-15T18:52:45.083439] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-15T18:52:45.713996] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-05. [2025-10-15T18:52:46.280197] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-15T18:52:46.513999] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-08. [2025-10-15T18:52:46.816790] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-15T18:52:47.314066] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-03. [2025-10-15T18:52:47.796581] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-15T18:52:48.114064] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-06. [2025-10-15T18:52:48.832370] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-15T18:52:48.913980] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-04. [2025-10-15T18:52:49.574107] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-15T18:52:49.714029] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-08. [2025-10-15T18:52:50.514044] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-09. [2025-10-15T18:52:50.516950] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-15T18:52:50.624021] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-15T18:52:51.314020] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-09. [2025-10-15T18:52:51.773311] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-15T18:52:52.113989] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-07. [2025-10-15T18:52:52.207591] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-15T18:52:52.914053] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-10. [2025-10-15T18:52:53.713971] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-05. [2025-10-15T18:52:53.818910] [DEBUG] [REMOTE ] FCF: Error fetching primary data for 2025-05: 'API call returned an empty response.' [2025-10-15T18:52:53.822728] [WARN ] [REMOTE ] FCF: No data returned for month 2025-05 [2025-10-15T18:52:53.824795] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-15T18:52:53.823252] [FATAL] [REMOTE ] FCF: API call failed - aborting fetch to avoid wasting further API calls [2025-10-15T18:52:53.825009] [FATAL] [MAIN ] FCF: Failed to fetch primary data. [2025-10-15T18:52:53.839462] [WARN ] [MAIN ] FCF: Deleting existing primary and derivative data due to fetch failure. [2025-10-15T18:52:53.839733] [INFO ] [LOCAL ] FCF: Starting deletion of primary data. [2025-10-15T18:52:53.839826] [DEBUG] [LOCAL ] FCF: No primary data file found to delete. [2025-10-15T18:52:53.839874] [INFO ] [LOCAL ] FCF: Starting deletion of derivative data. [2025-10-15T18:52:53.840408] [DEBUG] [LOCAL ] FCF: Deleted derivative data file. [2025-10-15T18:52:53.840696] [INFO ] [MAIN ] Update Progress: 806/2369 symbols completed. FCF took 15.0s. Estimated remaining: 3h 38m 47s. Rate: 7.1 symbols/min [2025-10-15T18:52:54.023083] [INFO ] [MAIN ] FCN: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:52:54.051324] [DEBUG] [LOCAL ] FCN: Loaded 25989 existing records from primary storage. [2025-10-15T18:52:54.051584] [INFO ] [MAIN ] FCN: Loaded 25989 existing records. [2025-10-15T18:52:54.225790] [WARN ] [MAIN ] FCN: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:52:54.225982] [INFO ] [MAIN ] FCN: Wiping existing primary data before full refresh. [2025-10-15T18:52:54.226028] [INFO ] [LOCAL ] FCN: Starting deletion of primary data. [2025-10-15T18:52:54.226290] [DEBUG] [LOCAL ] FCN: Deleted primary data file. [2025-10-15T18:52:54.226328] [INFO ] [MAIN ] FCN: Starting full primary refresh. [2025-10-15T18:52:54.518764] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-10. [2025-10-15T18:52:54.520724] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-15T18:52:54.600017] [INFO ] [REMOTE ] FCN: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:52:54.600230] [INFO ] [REMOTE ] FBRT: Full fetch complete (49526 records). [2025-10-15T18:52:54.600758] [DEBUG] [VALIDATOR ] FBRT: Validating primary data. [2025-10-15T18:52:54.971767] [DEBUG] [VALIDATOR ] FBRT: All expected trading days are present. [2025-10-15T18:52:54.971869] [DEBUG] [VALIDATOR ] FBRT: Primary data validation passed. [2025-10-15T18:52:54.972685] [INFO ] [MAIN ] FBRT: Fetched primary data is valid. [2025-10-15T18:52:54.972748] [DEBUG] [LOCAL ] FBRT: Saving primary data. [2025-10-15T18:52:54.973793] [DEBUG] [LOCAL ] FBRT: Trimmed 49526 records to 35439 (keeping 200 days of data) [2025-10-15T18:52:55.206162] [DEBUG] [LOCAL ] FBRT: Primary data saved (35439 records). [2025-10-15T18:52:55.206303] [INFO ] [MAIN ] FBRT: Full history saved. [2025-10-15T18:52:55.206379] [INFO ] [MAIN ] Update Progress: 807/2369 symbols completed. FBRT took 33.4s. Estimated remaining: 3h 38m 25s. Rate: 7.2 symbols/min [2025-10-15T18:52:55.315693] [INFO ] [REMOTE ] FCN: Fetching primary data for 2024-12. [2025-10-15T18:52:55.387099] [INFO ] [MAIN ] FCPT: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:52:55.422960] [DEBUG] [LOCAL ] FCPT: Loaded 37291 existing records from primary storage. [2025-10-15T18:52:55.423329] [INFO ] [MAIN ] FCPT: Loaded 37291 existing records. [2025-10-15T18:52:55.605812] [WARN ] [MAIN ] FCPT: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:52:55.607293] [INFO ] [MAIN ] FCPT: Wiping existing primary data before full refresh. [2025-10-15T18:52:55.607136] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-15T18:52:55.607456] [INFO ] [LOCAL ] FCPT: Starting deletion of primary data. [2025-10-15T18:52:55.610024] [INFO ] [REMOTE ] FC: Full fetch complete (21815 records). [2025-10-15T18:52:55.610161] [DEBUG] [LOCAL ] FCPT: Deleted primary data file. [2025-10-15T18:52:55.610136] [DEBUG] [VALIDATOR ] FC: Validating primary data. [2025-10-15T18:52:55.610334] [INFO ] [MAIN ] FCPT: Starting full primary refresh. [2025-10-15T18:52:56.116757] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-08. [2025-10-15T18:52:56.338259] [INFO ] [REMOTE ] FCPT: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:52:56.367567] [DEBUG] [VALIDATOR ] FC: All expected trading days are present. [2025-10-15T18:52:56.367793] [DEBUG] [VALIDATOR ] FC: Primary data validation passed. [2025-10-15T18:52:56.368513] [INFO ] [MAIN ] FC: Fetched primary data is valid. [2025-10-15T18:52:56.368684] [DEBUG] [LOCAL ] FC: Saving primary data. [2025-10-15T18:52:56.369338] [DEBUG] [LOCAL ] FC: Trimmed 21815 records to 14873 (keeping 200 days of data) [2025-10-15T18:52:56.451813] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-15T18:52:56.478879] [DEBUG] [LOCAL ] FC: Primary data saved (14873 records). [2025-10-15T18:52:56.479032] [INFO ] [MAIN ] FC: Full history saved. [2025-10-15T18:52:56.479122] [INFO ] [MAIN ] Update Progress: 808/2369 symbols completed. FC took 31.1s. Estimated remaining: 3h 38m 3s. Rate: 7.2 symbols/min [2025-10-15T18:52:56.645266] [INFO ] [MAIN ] FCRX: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:52:56.645475] [DEBUG] [LOCAL ] FCRX: No existing data file found in primary storage. [2025-10-15T18:52:56.645551] [WARN ] [MAIN ] FCRX: No existing data found, performing full refresh instead. [2025-10-15T18:52:56.645733] [INFO ] [MAIN ] FCRX: Wiping existing primary data before full refresh. [2025-10-15T18:52:56.645827] [INFO ] [LOCAL ] FCRX: Starting deletion of primary data. [2025-10-15T18:52:56.645917] [DEBUG] [LOCAL ] FCRX: No primary data file found to delete. [2025-10-15T18:52:56.645986] [INFO ] [MAIN ] FCRX: Starting full primary refresh. [2025-10-15T18:52:56.919180] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2024-12. [2025-10-15T18:52:57.021317] [INFO ] [REMOTE ] FCRX: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:52:57.714006] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-01. [2025-10-15T18:52:57.786180] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-15T18:52:58.293927] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-15T18:52:58.480890] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-15T18:52:58.513973] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-02. [2025-10-15T18:52:59.313986] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-09. [2025-10-15T18:52:59.379947] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-15T18:53:00.114017] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-01. [2025-10-15T18:53:00.914115] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2024-12. [2025-10-15T18:53:00.951038] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-15T18:53:01.231499] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2024-12 (0.32 seconds). [2025-10-15T18:53:01.297324] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-15T18:53:01.714033] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-02. [2025-10-15T18:53:02.513960] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-10. [2025-10-15T18:53:02.990734] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-15T18:53:03.314029] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-01. [2025-10-15T18:53:03.744794] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-10-15T18:53:03.835375] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-15T18:53:03.841189] [INFO ] [REMOTE ] FBP: Full fetch complete (66660 records). [2025-10-15T18:53:03.841319] [DEBUG] [VALIDATOR ] FBP: Validating primary data. [2025-10-15T18:53:04.119115] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-03. [2025-10-15T18:53:04.227903] [DEBUG] [VALIDATOR ] FBP: All expected trading days are present. [2025-10-15T18:53:04.227990] [DEBUG] [VALIDATOR ] FBP: Primary data validation passed. [2025-10-15T18:53:04.228889] [INFO ] [MAIN ] FBP: Fetched primary data is valid. [2025-10-15T18:53:04.228958] [DEBUG] [LOCAL ] FBP: Saving primary data. [2025-10-15T18:53:04.230311] [DEBUG] [LOCAL ] FBP: Trimmed 66660 records to 45728 (keeping 200 days of data) [2025-10-15T18:53:04.523795] [DEBUG] [LOCAL ] FBP: Primary data saved (45728 records). [2025-10-15T18:53:04.523926] [INFO ] [MAIN ] FBP: Full history saved. [2025-10-15T18:53:04.524004] [INFO ] [MAIN ] Update Progress: 809/2369 symbols completed. FBP took 44.4s. Estimated remaining: 3h 37m 54s. Rate: 7.2 symbols/min [2025-10-15T18:53:04.686547] [INFO ] [MAIN ] FCT: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:53:04.700974] [DEBUG] [LOCAL ] FCT: Loaded 14666 existing records from primary storage. [2025-10-15T18:53:04.701180] [INFO ] [MAIN ] FCT: Loaded 14666 existing records. [2025-10-15T18:53:04.875355] [WARN ] [MAIN ] FCT: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:53:04.875602] [INFO ] [MAIN ] FCT: Wiping existing primary data before full refresh. [2025-10-15T18:53:04.875682] [INFO ] [LOCAL ] FCT: Starting deletion of primary data. [2025-10-15T18:53:04.875907] [DEBUG] [LOCAL ] FCT: Deleted primary data file. [2025-10-15T18:53:04.875962] [INFO ] [MAIN ] FCT: Starting full primary refresh. [2025-10-15T18:53:04.919222] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-03. [2025-10-15T18:53:05.228496] [INFO ] [REMOTE ] FCT: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:53:05.245900] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-15T18:53:05.714054] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-04. [2025-10-15T18:53:06.429745] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-15T18:53:06.514026] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-04. [2025-10-15T18:53:07.052725] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-15T18:53:07.314016] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-05. [2025-10-15T18:53:08.120454] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-02. [2025-10-15T18:53:08.122845] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-15T18:53:08.555921] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-15T18:53:08.608005] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-15T18:53:08.914014] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-06. [2025-10-15T18:53:09.713966] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-03. [2025-10-15T18:53:09.992764] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-15T18:53:10.045151] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-03 (0.33 seconds). [2025-10-15T18:53:10.514027] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-05. [2025-10-15T18:53:11.313979] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-04. [2025-10-15T18:53:11.681109] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-04 (0.37 seconds). [2025-10-15T18:53:11.912265] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-15T18:53:12.114014] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-06. [2025-10-15T18:53:12.914016] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-07. [2025-10-15T18:53:13.497159] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-15T18:53:13.713975] [INFO ] [REMOTE ] FCT: Fetching primary data for 2024-12. [2025-10-15T18:53:13.932857] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-15T18:53:14.513977] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-08. [2025-10-15T18:53:14.703805] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-10-15T18:53:15.313964] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-01. [2025-10-15T18:53:15.622498] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-15T18:53:16.113966] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-09. [2025-10-15T18:53:16.314938] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-15T18:53:16.913973] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-07. [2025-10-15T18:53:17.267305] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-15T18:53:17.714044] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-10. [2025-10-15T18:53:17.977399] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-15T18:53:18.514059] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-02. [2025-10-15T18:53:18.915822] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-15T18:53:18.919229] [INFO ] [REMOTE ] FCN: Full fetch complete (35917 records). [2025-10-15T18:53:18.919312] [DEBUG] [VALIDATOR ] FCN: Validating primary data. [2025-10-15T18:53:19.282248] [DEBUG] [VALIDATOR ] FCN: All expected trading days are present. [2025-10-15T18:53:19.288710] [DEBUG] [VALIDATOR ] FCN: Primary data validation passed. [2025-10-15T18:53:19.289380] [INFO ] [MAIN ] FCN: Fetched primary data is valid. [2025-10-15T18:53:19.289930] [DEBUG] [LOCAL ] FCN: Saving primary data. [2025-10-15T18:53:19.290301] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-15T18:53:19.293831] [DEBUG] [LOCAL ] FCN: Trimmed 35917 records to 26052 (keeping 200 days of data) [2025-10-15T18:53:19.342991] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-08. [2025-10-15T18:53:19.447800] [DEBUG] [LOCAL ] FCN: Primary data saved (26052 records). [2025-10-15T18:53:19.447928] [INFO ] [MAIN ] FCN: Full history saved. [2025-10-15T18:53:19.448005] [INFO ] [MAIN ] Update Progress: 810/2369 symbols completed. FCN took 25.6s. Estimated remaining: 3h 37m 58s. Rate: 7.2 symbols/min [2025-10-15T18:53:19.611639] [INFO ] [MAIN ] FCX: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:53:19.659991] [DEBUG] [LOCAL ] FCX: Loaded 53700 existing records from primary storage. [2025-10-15T18:53:19.660305] [INFO ] [MAIN ] FCX: Loaded 53700 existing records. [2025-10-15T18:53:19.836105] [WARN ] [MAIN ] FCX: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:53:19.836322] [INFO ] [MAIN ] FCX: Wiping existing primary data before full refresh. [2025-10-15T18:53:19.836375] [INFO ] [LOCAL ] FCX: Starting deletion of primary data. [2025-10-15T18:53:19.836559] [DEBUG] [LOCAL ] FCX: Deleted primary data file. [2025-10-15T18:53:19.836596] [INFO ] [MAIN ] FCX: Starting full primary refresh. [2025-10-15T18:53:20.119111] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-05. [2025-10-15T18:53:20.179664] [INFO ] [REMOTE ] FCX: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:53:20.395819] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-15T18:53:20.479612] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-05 (0.36 seconds). [2025-10-15T18:53:20.914042] [INFO ] [REMOTE ] FCX: Fetching primary data for 2024-12. [2025-10-15T18:53:21.714023] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-03. [2025-10-15T18:53:22.513969] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-06. [2025-10-15T18:53:22.622939] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-15T18:53:22.749009] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-15T18:53:22.925961] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-10-15T18:53:23.314035] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-04. [2025-10-15T18:53:24.113996] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-09. [2025-10-15T18:53:24.612051] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-15T18:53:24.913992] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-01. [2025-10-15T18:53:25.714000] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-07. [2025-10-15T18:53:26.028567] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-15T18:53:26.093696] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-07 (0.38 seconds). [2025-10-15T18:53:26.513963] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-08. [2025-10-15T18:53:26.841879] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-08 (0.33 seconds). [2025-10-15T18:53:26.944077] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-01 (2.03 seconds). [2025-10-15T18:53:27.313986] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-10. [2025-10-15T18:53:28.114061] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-02. [2025-10-15T18:53:28.758978] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-15T18:53:28.766212] [INFO ] [REMOTE ] FCPT: Full fetch complete (53877 records). [2025-10-15T18:53:28.766419] [DEBUG] [VALIDATOR ] FCPT: Validating primary data. [2025-10-15T18:53:28.919139] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-09. [2025-10-15T18:53:29.149162] [DEBUG] [VALIDATOR ] FCPT: All expected trading days are present. [2025-10-15T18:53:29.149238] [DEBUG] [VALIDATOR ] FCPT: Primary data validation passed. [2025-10-15T18:53:29.150004] [INFO ] [MAIN ] FCPT: Fetched primary data is valid. [2025-10-15T18:53:29.150067] [DEBUG] [LOCAL ] FCPT: Saving primary data. [2025-10-15T18:53:29.151154] [DEBUG] [LOCAL ] FCPT: Trimmed 53877 records to 37344 (keeping 200 days of data) [2025-10-15T18:53:29.375560] [DEBUG] [LOCAL ] FCPT: Primary data saved (37344 records). [2025-10-15T18:53:29.375745] [INFO ] [MAIN ] FCPT: Full history saved. [2025-10-15T18:53:29.375836] [INFO ] [MAIN ] Update Progress: 811/2369 symbols completed. FCPT took 34.2s. Estimated remaining: 3h 37m 53s. Rate: 7.2 symbols/min [2025-10-15T18:53:29.523375] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-15T18:53:29.587814] [INFO ] [MAIN ] FDP: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:53:29.622482] [DEBUG] [LOCAL ] FDP: Loaded 29846 existing records from primary storage. [2025-10-15T18:53:29.622798] [INFO ] [MAIN ] FDP: Loaded 29846 existing records. [2025-10-15T18:53:29.719009] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-05. [2025-10-15T18:53:29.879706] [WARN ] [MAIN ] FDP: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:53:29.880553] [INFO ] [MAIN ] FDP: Wiping existing primary data before full refresh. [2025-10-15T18:53:29.880719] [INFO ] [LOCAL ] FDP: Starting deletion of primary data. [2025-10-15T18:53:29.881368] [DEBUG] [LOCAL ] FDP: Deleted primary data file. [2025-10-15T18:53:29.881442] [INFO ] [MAIN ] FDP: Starting full primary refresh. [2025-10-15T18:53:30.390207] [INFO ] [REMOTE ] FDP: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:53:30.386489] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-02 (2.27 seconds). [2025-10-15T18:53:30.419556] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-15T18:53:30.514034] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-03. [2025-10-15T18:53:31.314017] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-10. [2025-10-15T18:53:31.661872] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-10 (0.35 seconds). [2025-10-15T18:53:31.662504] [INFO ] [REMOTE ] FCRX: Full fetch complete (1671 records). [2025-10-15T18:53:31.662569] [DEBUG] [VALIDATOR ] FCRX: Validating primary data. [2025-10-15T18:53:31.837167] [WARN ] [VALIDATOR ] FCRX: Validation failed - insufficient historical data. Have 189 unique days, need 200 days [2025-10-15T18:53:31.837330] [FATAL] [MAIN ] FCRX: Fetched primary data is invalid. Refusing to save it. [2025-10-15T18:53:31.837395] [WARN ] [MAIN ] FCRX: Deleting existing primary and derivative data due to validation failure. [2025-10-15T18:53:31.837444] [INFO ] [LOCAL ] FCRX: Starting deletion of primary data. [2025-10-15T18:53:31.837501] [DEBUG] [LOCAL ] FCRX: No primary data file found to delete. [2025-10-15T18:53:31.837538] [INFO ] [LOCAL ] FCRX: Starting deletion of derivative data. [2025-10-15T18:53:31.837625] [DEBUG] [LOCAL ] FCRX: No derivative data file found to delete. [2025-10-15T18:53:31.837739] [INFO ] [MAIN ] Update Progress: 812/2369 symbols completed. FCRX took 35.4s. Estimated remaining: 3h 37m 33s. Rate: 7.2 symbols/min [2025-10-15T18:53:32.003144] [INFO ] [MAIN ] FDS: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:53:32.029696] [DEBUG] [LOCAL ] FDS: Loaded 27588 existing records from primary storage. [2025-10-15T18:53:32.029944] [INFO ] [MAIN ] FDS: Loaded 27588 existing records. [2025-10-15T18:53:32.119103] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-06. [2025-10-15T18:53:32.205273] [WARN ] [MAIN ] FDS: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:53:32.205449] [INFO ] [MAIN ] FDS: Wiping existing primary data before full refresh. [2025-10-15T18:53:32.205493] [INFO ] [LOCAL ] FDS: Starting deletion of primary data. [2025-10-15T18:53:32.205715] [DEBUG] [LOCAL ] FDS: Deleted primary data file. [2025-10-15T18:53:32.205770] [INFO ] [MAIN ] FDS: Starting full primary refresh. [2025-10-15T18:53:32.555917] [INFO ] [REMOTE ] FDS: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:53:32.597328] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-10-15T18:53:32.914028] [INFO ] [REMOTE ] FDS: Fetching primary data for 2024-12. [2025-10-15T18:53:33.092105] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-15T18:53:33.714032] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-04. [2025-10-15T18:53:33.788227] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-10-15T18:53:34.514080] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-01. [2025-10-15T18:53:35.313982] [INFO ] [REMOTE ] FDP: Fetching primary data for 2024-12. [2025-10-15T18:53:35.699527] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-15T18:53:35.726149] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-15T18:53:36.113972] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-07. [2025-10-15T18:53:36.510366] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-15T18:53:36.913999] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-05. [2025-10-15T18:53:37.033123] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-15T18:53:37.714016] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-02. [2025-10-15T18:53:38.514020] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-08. [2025-10-15T18:53:38.797265] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-15T18:53:38.875540] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-15T18:53:39.318130] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-03. [2025-10-15T18:53:39.322347] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-15T18:53:40.114020] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-01. [2025-10-15T18:53:40.593857] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-15T18:53:40.914012] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-09. [2025-10-15T18:53:41.199225] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-15T18:53:41.713963] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-02. [2025-10-15T18:53:41.846178] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-15T18:53:42.513967] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-04. [2025-10-15T18:53:42.829817] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-15T18:53:43.314005] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-10. [2025-10-15T18:53:43.768985] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-15T18:53:44.114027] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-03. [2025-10-15T18:53:44.312964] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-15T18:53:44.315360] [INFO ] [REMOTE ] FCT: Full fetch complete (21060 records). [2025-10-15T18:53:44.315440] [DEBUG] [VALIDATOR ] FCT: Validating primary data. [2025-10-15T18:53:44.667532] [DEBUG] [VALIDATOR ] FCT: All expected trading days are present. [2025-10-15T18:53:44.667603] [DEBUG] [VALIDATOR ] FCT: Primary data validation passed. [2025-10-15T18:53:44.668067] [INFO ] [MAIN ] FCT: Fetched primary data is valid. [2025-10-15T18:53:44.668128] [DEBUG] [LOCAL ] FCT: Saving primary data. [2025-10-15T18:53:44.668677] [DEBUG] [LOCAL ] FCT: Trimmed 21060 records to 14677 (keeping 200 days of data) [2025-10-15T18:53:44.752814] [DEBUG] [LOCAL ] FCT: Primary data saved (14677 records). [2025-10-15T18:53:44.752937] [INFO ] [MAIN ] FCT: Full history saved. [2025-10-15T18:53:44.753014] [INFO ] [MAIN ] Update Progress: 813/2369 symbols completed. FCT took 40.2s. Estimated remaining: 3h 37m 33s. Rate: 7.2 symbols/min [2025-10-15T18:53:44.920097] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-06. [2025-10-15T18:53:44.920020] [INFO ] [MAIN ] FDX: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:53:44.968601] [DEBUG] [LOCAL ] FDX: Loaded 51393 existing records from primary storage. [2025-10-15T18:53:44.969083] [INFO ] [MAIN ] FDX: Loaded 51393 existing records. [2025-10-15T18:53:45.141540] [WARN ] [MAIN ] FDX: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:53:45.141763] [INFO ] [MAIN ] FDX: Wiping existing primary data before full refresh. [2025-10-15T18:53:45.141814] [INFO ] [LOCAL ] FDX: Starting deletion of primary data. [2025-10-15T18:53:45.142186] [DEBUG] [LOCAL ] FDX: Deleted primary data file. [2025-10-15T18:53:45.142241] [INFO ] [MAIN ] FDX: Starting full primary refresh. [2025-10-15T18:53:45.491626] [INFO ] [REMOTE ] FDX: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:53:45.559445] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-15T18:53:45.713956] [INFO ] [REMOTE ] FDX: Fetching primary data for 2024-12. [2025-10-15T18:53:46.514019] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-05. [2025-10-15T18:53:46.554960] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-15T18:53:47.314037] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-07. [2025-10-15T18:53:47.540727] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-15T18:53:47.578403] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-10-15T18:53:48.114024] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-04. [2025-10-15T18:53:48.913997] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-01. [2025-10-15T18:53:49.512869] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-15T18:53:49.675277] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-07 (2.36 seconds). [2025-10-15T18:53:49.713997] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-06. [2025-10-15T18:53:50.514025] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-08. [2025-10-15T18:53:50.634480] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-15T18:53:50.698183] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-15T18:53:51.314008] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-05. [2025-10-15T18:53:52.113957] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-07. [2025-10-15T18:53:52.323174] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-15T18:53:52.657028] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-15T18:53:52.913955] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-09. [2025-10-15T18:53:53.161027] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-15T18:53:53.714043] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-02. [2025-10-15T18:53:54.513996] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-08. [2025-10-15T18:53:54.900884] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-10-15T18:53:55.120004] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-15T18:53:55.314009] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-06. [2025-10-15T18:53:55.728875] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-15T18:53:56.114021] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-10. [2025-10-15T18:53:56.199964] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-15T18:53:56.913991] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-09. [2025-10-15T18:53:57.714045] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-07. [2025-10-15T18:53:58.486785] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-15T18:53:58.519090] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-10. [2025-10-15T18:53:58.530429] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-10 (2.42 seconds). [2025-10-15T18:53:58.537307] [INFO ] [REMOTE ] FCX: Full fetch complete (77878 records). [2025-10-15T18:53:58.537438] [DEBUG] [VALIDATOR ] FCX: Validating primary data. [2025-10-15T18:53:58.943224] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-15T18:53:58.953354] [DEBUG] [VALIDATOR ] FCX: All expected trading days are present. [2025-10-15T18:53:58.953612] [DEBUG] [VALIDATOR ] FCX: Primary data validation passed. [2025-10-15T18:53:58.955060] [INFO ] [MAIN ] FCX: Fetched primary data is valid. [2025-10-15T18:53:58.955501] [DEBUG] [LOCAL ] FCX: Saving primary data. [2025-10-15T18:53:58.956980] [DEBUG] [LOCAL ] FCX: Trimmed 77878 records to 53701 (keeping 200 days of data) [2025-10-15T18:53:59.284637] [DEBUG] [LOCAL ] FCX: Primary data saved (53701 records). [2025-10-15T18:53:59.284797] [INFO ] [MAIN ] FCX: Full history saved. [2025-10-15T18:53:59.285245] [INFO ] [MAIN ] Update Progress: 814/2369 symbols completed. FCX took 39.8s. Estimated remaining: 3h 37m 37s. Rate: 7.1 symbols/min [2025-10-15T18:53:59.319257] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-08. [2025-10-15T18:53:59.452153] [INFO ] [MAIN ] FE: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:53:59.501533] [DEBUG] [LOCAL ] FE: Loaded 53434 existing records from primary storage. [2025-10-15T18:53:59.501870] [INFO ] [MAIN ] FE: Loaded 53434 existing records. [2025-10-15T18:53:59.677169] [WARN ] [MAIN ] FE: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:53:59.677421] [INFO ] [MAIN ] FE: Wiping existing primary data before full refresh. [2025-10-15T18:53:59.677485] [INFO ] [LOCAL ] FE: Starting deletion of primary data. [2025-10-15T18:53:59.677870] [DEBUG] [LOCAL ] FE: Deleted primary data file. [2025-10-15T18:53:59.677927] [INFO ] [MAIN ] FE: Starting full primary refresh. [2025-10-15T18:54:00.019959] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-15T18:54:00.055708] [INFO ] [REMOTE ] FE: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:54:00.056950] [INFO ] [REMOTE ] FDS: Full fetch complete (38612 records). [2025-10-15T18:54:00.057105] [DEBUG] [VALIDATOR ] FDS: Validating primary data. [2025-10-15T18:54:00.123578] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-03. [2025-10-15T18:54:00.498694] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-15T18:54:00.520139] [DEBUG] [VALIDATOR ] FDS: All expected trading days are present. [2025-10-15T18:54:00.520891] [DEBUG] [VALIDATOR ] FDS: Primary data validation passed. [2025-10-15T18:54:00.522005] [INFO ] [MAIN ] FDS: Fetched primary data is valid. [2025-10-15T18:54:00.522097] [DEBUG] [LOCAL ] FDS: Saving primary data. [2025-10-15T18:54:00.523493] [DEBUG] [LOCAL ] FDS: Trimmed 38612 records to 27640 (keeping 200 days of data) [2025-10-15T18:54:00.693012] [DEBUG] [LOCAL ] FDS: Primary data saved (27640 records). [2025-10-15T18:54:00.693154] [INFO ] [MAIN ] FDS: Full history saved. [2025-10-15T18:54:00.693239] [INFO ] [MAIN ] Update Progress: 815/2369 symbols completed. FDS took 28.9s. Estimated remaining: 3h 37m 15s. Rate: 7.2 symbols/min [2025-10-15T18:54:00.860467] [INFO ] [MAIN ] FENG: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:54:00.860688] [DEBUG] [LOCAL ] FENG: No existing data file found in primary storage. [2025-10-15T18:54:00.860742] [WARN ] [MAIN ] FENG: No existing data found, performing full refresh instead. [2025-10-15T18:54:00.860852] [INFO ] [MAIN ] FENG: Wiping existing primary data before full refresh. [2025-10-15T18:54:00.860894] [INFO ] [LOCAL ] FENG: Starting deletion of primary data. [2025-10-15T18:54:00.860935] [DEBUG] [LOCAL ] FENG: No primary data file found to delete. [2025-10-15T18:54:00.860967] [INFO ] [MAIN ] FENG: Starting full primary refresh. [2025-10-15T18:54:00.921317] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-09. [2025-10-15T18:54:01.208010] [INFO ] [REMOTE ] FENG: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:54:01.714044] [INFO ] [REMOTE ] FENG: Fetching primary data for 2024-12. [2025-10-15T18:54:01.826673] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-15T18:54:02.081891] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2024-12 (0.37 seconds). [2025-10-15T18:54:02.446862] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-15T18:54:02.514007] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-01. [2025-10-15T18:54:02.935878] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-10-15T18:54:03.314055] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-10. [2025-10-15T18:54:04.113982] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-04. [2025-10-15T18:54:04.530164] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-15T18:54:04.533564] [INFO ] [REMOTE ] FDP: Full fetch complete (42655 records). [2025-10-15T18:54:04.533665] [DEBUG] [VALIDATOR ] FDP: Validating primary data. [2025-10-15T18:54:04.897297] [DEBUG] [VALIDATOR ] FDP: All expected trading days are present. [2025-10-15T18:54:04.897372] [DEBUG] [VALIDATOR ] FDP: Primary data validation passed. [2025-10-15T18:54:04.898091] [INFO ] [MAIN ] FDP: Fetched primary data is valid. [2025-10-15T18:54:04.898155] [DEBUG] [LOCAL ] FDP: Saving primary data. [2025-10-15T18:54:04.899428] [DEBUG] [LOCAL ] FDP: Trimmed 42655 records to 29807 (keeping 200 days of data) [2025-10-15T18:54:04.955831] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-02. [2025-10-15T18:54:05.085662] [DEBUG] [LOCAL ] FDP: Primary data saved (29807 records). [2025-10-15T18:54:05.085803] [INFO ] [MAIN ] FDP: Full history saved. [2025-10-15T18:54:05.085887] [INFO ] [MAIN ] Update Progress: 816/2369 symbols completed. FDP took 35.7s. Estimated remaining: 3h 36m 59s. Rate: 7.2 symbols/min [2025-10-15T18:54:05.251184] [INFO ] [MAIN ] FERG: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:54:05.296893] [DEBUG] [LOCAL ] FERG: Loaded 48763 existing records from primary storage. [2025-10-15T18:54:05.297189] [INFO ] [MAIN ] FERG: Loaded 48763 existing records. [2025-10-15T18:54:05.379550] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-10-15T18:54:05.477931] [WARN ] [MAIN ] FERG: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:54:05.478166] [INFO ] [MAIN ] FERG: Wiping existing primary data before full refresh. [2025-10-15T18:54:05.478230] [INFO ] [LOCAL ] FERG: Starting deletion of primary data. [2025-10-15T18:54:05.478630] [DEBUG] [LOCAL ] FERG: Deleted primary data file. [2025-10-15T18:54:05.478738] [INFO ] [MAIN ] FERG: Starting full primary refresh. [2025-10-15T18:54:05.717561] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-03. [2025-10-15T18:54:05.841856] [INFO ] [REMOTE ] FERG: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:54:06.083042] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-15T18:54:06.216504] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-10-15T18:54:06.513999] [INFO ] [REMOTE ] FERG: Fetching primary data for 2024-12. [2025-10-15T18:54:07.313983] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-05. [2025-10-15T18:54:08.113982] [INFO ] [REMOTE ] FE: Fetching primary data for 2024-12. [2025-10-15T18:54:08.187136] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-15T18:54:08.913994] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-01. [2025-10-15T18:54:09.227620] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-15T18:54:09.713975] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-06. [2025-10-15T18:54:09.855381] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-15T18:54:10.299454] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-15T18:54:10.514017] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-04. [2025-10-15T18:54:10.964962] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-10-15T18:54:11.313986] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-05. [2025-10-15T18:54:11.663717] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-10-15T18:54:11.729792] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-10-15T18:54:12.114022] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-02. [2025-10-15T18:54:12.914046] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-06. [2025-10-15T18:54:13.233498] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-06 (0.32 seconds). [2025-10-15T18:54:13.719746] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-01. [2025-10-15T18:54:13.732347] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-15T18:54:14.514038] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-07. [2025-10-15T18:54:15.267213] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-15T18:54:15.314052] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-02. [2025-10-15T18:54:16.113975] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-07. [2025-10-15T18:54:16.411872] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-15T18:54:16.470115] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-07 (0.36 seconds). [2025-10-15T18:54:16.913978] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-03. [2025-10-15T18:54:17.237639] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-10-15T18:54:17.714017] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-03. [2025-10-15T18:54:18.513995] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-08. [2025-10-15T18:54:18.661033] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-15T18:54:19.314064] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-08. [2025-10-15T18:54:19.583833] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-08 (0.27 seconds). [2025-10-15T18:54:19.585323] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-15T18:54:20.114029] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-09. [2025-10-15T18:54:20.392081] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-15T18:54:20.499345] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-10-15T18:54:20.914055] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-09. [2025-10-15T18:54:21.714011] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-04. [2025-10-15T18:54:22.508702] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-15T18:54:22.523953] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-04. [2025-10-15T18:54:23.314001] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-10. [2025-10-15T18:54:23.599622] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-15T18:54:24.113980] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-05. [2025-10-15T18:54:24.210531] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-15T18:54:24.914007] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-05. [2025-10-15T18:54:25.299133] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-10 (1.99 seconds). [2025-10-15T18:54:25.305349] [INFO ] [REMOTE ] FDX: Full fetch complete (74413 records). [2025-10-15T18:54:25.305794] [DEBUG] [VALIDATOR ] FDX: Validating primary data. [2025-10-15T18:54:25.710013] [DEBUG] [VALIDATOR ] FDX: All expected trading days are present. [2025-10-15T18:54:25.710176] [DEBUG] [VALIDATOR ] FDX: Primary data validation passed. [2025-10-15T18:54:25.711369] [INFO ] [MAIN ] FDX: Fetched primary data is valid. [2025-10-15T18:54:25.711456] [DEBUG] [LOCAL ] FDX: Saving primary data. [2025-10-15T18:54:25.713225] [DEBUG] [LOCAL ] FDX: Trimmed 74413 records to 51368 (keeping 200 days of data) [2025-10-15T18:54:25.713980] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-10. [2025-10-15T18:54:25.970481] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-15T18:54:26.079364] [DEBUG] [LOCAL ] FDX: Primary data saved (51368 records). [2025-10-15T18:54:26.079508] [INFO ] [MAIN ] FDX: Full history saved. [2025-10-15T18:54:26.079589] [INFO ] [MAIN ] Update Progress: 817/2369 symbols completed. FDX took 41.3s. Estimated remaining: 3h 37m 14s. Rate: 7.1 symbols/min [2025-10-15T18:54:26.254125] [INFO ] [MAIN ] FET: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:54:26.257797] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-15T18:54:26.258876] [INFO ] [REMOTE ] FENG: Full fetch complete (2280 records). [2025-10-15T18:54:26.259112] [DEBUG] [VALIDATOR ] FENG: Validating primary data. [2025-10-15T18:54:26.388072] [DEBUG] [LOCAL ] FET: Loaded 12800 existing records from primary storage. [2025-10-15T18:54:26.424095] [INFO ] [MAIN ] FET: Loaded 12800 existing records. [2025-10-15T18:54:26.473159] [WARN ] [VALIDATOR ] FENG: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-15T18:54:26.496792] [FATAL] [MAIN ] FENG: Fetched primary data is invalid. Refusing to save it. [2025-10-15T18:54:26.509177] [WARN ] [MAIN ] FENG: Deleting existing primary and derivative data due to validation failure. [2025-10-15T18:54:26.529504] [INFO ] [LOCAL ] FENG: Starting deletion of primary data. [2025-10-15T18:54:26.529262] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-06. [2025-10-15T18:54:26.564558] [DEBUG] [LOCAL ] FENG: No primary data file found to delete. [2025-10-15T18:54:26.573676] [INFO ] [LOCAL ] FENG: Starting deletion of derivative data. [2025-10-15T18:54:26.574203] [DEBUG] [LOCAL ] FENG: No derivative data file found to delete. [2025-10-15T18:54:26.584780] [INFO ] [MAIN ] Update Progress: 818/2369 symbols completed. FENG took 25.9s. Estimated remaining: 3h 36m 51s. Rate: 7.2 symbols/min [2025-10-15T18:54:26.705842] [WARN ] [MAIN ] FET: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:54:26.758566] [INFO ] [MAIN ] FET: Wiping existing primary data before full refresh. [2025-10-15T18:54:26.765032] [INFO ] [LOCAL ] FET: Starting deletion of primary data. [2025-10-15T18:54:26.789473] [DEBUG] [LOCAL ] FET: Deleted primary data file. [2025-10-15T18:54:26.795983] [INFO ] [MAIN ] FET: Starting full primary refresh. [2025-10-15T18:54:26.795820] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-15T18:54:27.023066] [INFO ] [MAIN ] FF: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:54:27.221538] [DEBUG] [LOCAL ] FF: Loaded 24316 existing records from primary storage. [2025-10-15T18:54:27.242625] [INFO ] [MAIN ] FF: Loaded 24316 existing records. [2025-10-15T18:54:27.322186] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-06. [2025-10-15T18:54:27.325888] [INFO ] [REMOTE ] FET: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:54:27.445815] [WARN ] [MAIN ] FF: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:54:27.445993] [INFO ] [MAIN ] FF: Wiping existing primary data before full refresh. [2025-10-15T18:54:27.446061] [INFO ] [LOCAL ] FF: Starting deletion of primary data. [2025-10-15T18:54:27.446374] [DEBUG] [LOCAL ] FF: Deleted primary data file. [2025-10-15T18:54:27.446445] [INFO ] [MAIN ] FF: Starting full primary refresh. [2025-10-15T18:54:27.797787] [INFO ] [REMOTE ] FF: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:54:28.113966] [INFO ] [REMOTE ] FET: Fetching primary data for 2024-12. [2025-10-15T18:54:28.188994] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-15T18:54:28.897536] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-15T18:54:28.913952] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-07. [2025-10-15T18:54:28.927967] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-10-15T18:54:29.714021] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-07. [2025-10-15T18:54:30.514028] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-01. [2025-10-15T18:54:30.749581] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-15T18:54:30.969230] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-15T18:54:31.072397] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-15T18:54:31.313972] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-08. [2025-10-15T18:54:32.114025] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-02. [2025-10-15T18:54:32.926026] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-08. [2025-10-15T18:54:32.928968] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-15T18:54:32.956430] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-15T18:54:33.714003] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-09. [2025-10-15T18:54:34.514022] [INFO ] [REMOTE ] FF: Fetching primary data for 2024-12. [2025-10-15T18:54:34.744380] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-15T18:54:35.311320] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-10-15T18:54:35.317095] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-01. [2025-10-15T18:54:35.512131] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-15T18:54:36.027229] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-15T18:54:36.113967] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-02. [2025-10-15T18:54:36.914011] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-03. [2025-10-15T18:54:37.181022] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-15T18:54:37.713996] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-03. [2025-10-15T18:54:37.733158] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-15T18:54:38.513997] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-04. [2025-10-15T18:54:38.990524] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-15T18:54:39.268547] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-15T18:54:39.313951] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-05. [2025-10-15T18:54:40.078199] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-15T18:54:40.113960] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-09. [2025-10-15T18:54:40.914029] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-04. [2025-10-15T18:54:41.714022] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-06. [2025-10-15T18:54:41.983939] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-15T18:54:42.269870] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-15T18:54:42.495869] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-15T18:54:42.513953] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-07. [2025-10-15T18:54:43.313968] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-10. [2025-10-15T18:54:43.409941] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-15T18:54:44.113985] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-10. [2025-10-15T18:54:44.911075] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-15T18:54:44.917289] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-08. [2025-10-15T18:54:44.919012] [INFO ] [REMOTE ] FE: Full fetch complete (77465 records). [2025-10-15T18:54:44.919138] [DEBUG] [VALIDATOR ] FE: Validating primary data. [2025-10-15T18:54:45.117954] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-15T18:54:45.227692] [INFO ] [REMOTE ] FERG: Full fetch complete (71030 records). [2025-10-15T18:54:45.248940] [DEBUG] [VALIDATOR ] FERG: Validating primary data. [2025-10-15T18:54:45.484816] [DEBUG] [VALIDATOR ] FE: All expected trading days are present. [2025-10-15T18:54:45.508057] [DEBUG] [VALIDATOR ] FE: Primary data validation passed. [2025-10-15T18:54:45.517173] [INFO ] [MAIN ] FE: Fetched primary data is valid. [2025-10-15T18:54:45.517830] [DEBUG] [LOCAL ] FE: Saving primary data. [2025-10-15T18:54:45.611708] [DEBUG] [LOCAL ] FE: Trimmed 77465 records to 53432 (keeping 200 days of data) [2025-10-15T18:54:45.718107] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-05. [2025-10-15T18:54:45.855238] [DEBUG] [VALIDATOR ] FERG: All expected trading days are present. [2025-10-15T18:54:45.857266] [DEBUG] [VALIDATOR ] FERG: Primary data validation passed. [2025-10-15T18:54:45.858531] [INFO ] [MAIN ] FERG: Fetched primary data is valid. [2025-10-15T18:54:45.859958] [DEBUG] [LOCAL ] FERG: Saving primary data. [2025-10-15T18:54:45.867363] [DEBUG] [LOCAL ] FERG: Trimmed 71030 records to 48746 (keeping 200 days of data) [2025-10-15T18:54:46.004235] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-15T18:54:46.418191] [DEBUG] [LOCAL ] FE: Primary data saved (53432 records). [2025-10-15T18:54:46.420986] [INFO ] [MAIN ] FE: Full history saved. [2025-10-15T18:54:46.421822] [INFO ] [MAIN ] Update Progress: 819/2369 symbols completed. FE took 47.1s. Estimated remaining: 3h 37m 4s. Rate: 7.1 symbols/min [2025-10-15T18:54:46.516350] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-09. [2025-10-15T18:54:46.516273] [DEBUG] [LOCAL ] FERG: Primary data saved (48746 records). [2025-10-15T18:54:46.537365] [INFO ] [MAIN ] FERG: Full history saved. [2025-10-15T18:54:46.543672] [INFO ] [MAIN ] Update Progress: 820/2369 symbols completed. FERG took 41.5s. Estimated remaining: 3h 36m 40s. Rate: 7.1 symbols/min [2025-10-15T18:54:46.689809] [INFO ] [MAIN ] FFA: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:54:46.783019] [INFO ] [MAIN ] FFC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:54:46.800223] [DEBUG] [LOCAL ] FFA: Loaded 6023 existing records from primary storage. [2025-10-15T18:54:46.802101] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-15T18:54:46.802260] [INFO ] [MAIN ] FFA: Loaded 6023 existing records. [2025-10-15T18:54:46.938425] [DEBUG] [LOCAL ] FFC: Loaded 16759 existing records from primary storage. [2025-10-15T18:54:46.961590] [INFO ] [MAIN ] FFC: Loaded 16759 existing records. [2025-10-15T18:54:46.998440] [WARN ] [MAIN ] FFA: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:54:47.047619] [INFO ] [MAIN ] FFA: Wiping existing primary data before full refresh. [2025-10-15T18:54:47.072461] [INFO ] [LOCAL ] FFA: Starting deletion of primary data. [2025-10-15T18:54:47.101892] [DEBUG] [LOCAL ] FFA: Deleted primary data file. [2025-10-15T18:54:47.101967] [INFO ] [MAIN ] FFA: Starting full primary refresh. [2025-10-15T18:54:47.289812] [WARN ] [MAIN ] FFC: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:54:47.311379] [INFO ] [MAIN ] FFC: Wiping existing primary data before full refresh. [2025-10-15T18:54:47.316680] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-06. [2025-10-15T18:54:47.345163] [INFO ] [LOCAL ] FFC: Starting deletion of primary data. [2025-10-15T18:54:47.367355] [DEBUG] [LOCAL ] FFC: Deleted primary data file. [2025-10-15T18:54:47.409092] [INFO ] [MAIN ] FFC: Starting full primary refresh. [2025-10-15T18:54:47.720019] [INFO ] [REMOTE ] FFA: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:54:47.750793] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-15T18:54:47.953115] [INFO ] [REMOTE ] FFC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:54:48.113953] [INFO ] [REMOTE ] FFC: Fetching primary data for 2024-12. [2025-10-15T18:54:48.131502] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-15T18:54:48.913988] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-07. [2025-10-15T18:54:49.134364] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-15T18:54:49.674766] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-15T18:54:49.713947] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-08. [2025-10-15T18:54:50.514022] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-01. [2025-10-15T18:54:50.807833] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-15T18:54:51.314028] [INFO ] [REMOTE ] FFA: Fetching primary data for 2024-12. [2025-10-15T18:54:51.493425] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-15T18:54:51.949576] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-10-15T18:54:52.114002] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-09. [2025-10-15T18:54:52.872552] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-15T18:54:52.913953] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-10. [2025-10-15T18:54:53.713987] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-10. [2025-10-15T18:54:53.911945] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-15T18:54:53.915521] [INFO ] [REMOTE ] FF: Full fetch complete (36552 records). [2025-10-15T18:54:53.915751] [DEBUG] [VALIDATOR ] FF: Validating primary data. [2025-10-15T18:54:54.280750] [DEBUG] [VALIDATOR ] FF: All expected trading days are present. [2025-10-15T18:54:54.280841] [DEBUG] [VALIDATOR ] FF: Primary data validation passed. [2025-10-15T18:54:54.281514] [INFO ] [MAIN ] FF: Fetched primary data is valid. [2025-10-15T18:54:54.281553] [DEBUG] [LOCAL ] FF: Saving primary data. [2025-10-15T18:54:54.282335] [DEBUG] [LOCAL ] FF: Trimmed 36552 records to 24337 (keeping 200 days of data) [2025-10-15T18:54:54.423374] [DEBUG] [LOCAL ] FF: Primary data saved (24337 records). [2025-10-15T18:54:54.423504] [INFO ] [MAIN ] FF: Full history saved. [2025-10-15T18:54:54.423589] [INFO ] [MAIN ] Update Progress: 821/2369 symbols completed. FF took 27.8s. Estimated remaining: 3h 36m 31s. Rate: 7.1 symbols/min [2025-10-15T18:54:54.516841] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-02. [2025-10-15T18:54:54.599354] [INFO ] [MAIN ] FFWM: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:54:54.632895] [DEBUG] [LOCAL ] FFWM: Loaded 35818 existing records from primary storage. [2025-10-15T18:54:54.633188] [INFO ] [MAIN ] FFWM: Loaded 35818 existing records. [2025-10-15T18:54:54.708591] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-15T18:54:54.740436] [INFO ] [REMOTE ] FET: Full fetch complete (18366 records). [2025-10-15T18:54:54.742938] [DEBUG] [VALIDATOR ] FET: Validating primary data. [2025-10-15T18:54:54.932874] [WARN ] [MAIN ] FFWM: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:54:54.948466] [INFO ] [MAIN ] FFWM: Wiping existing primary data before full refresh. [2025-10-15T18:54:54.961359] [INFO ] [LOCAL ] FFWM: Starting deletion of primary data. [2025-10-15T18:54:54.981103] [DEBUG] [LOCAL ] FFWM: Deleted primary data file. [2025-10-15T18:54:54.996159] [INFO ] [MAIN ] FFWM: Starting full primary refresh. [2025-10-15T18:54:55.322724] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-01. [2025-10-15T18:54:55.504060] [DEBUG] [VALIDATOR ] FET: All expected trading days are present. [2025-10-15T18:54:55.507065] [DEBUG] [VALIDATOR ] FET: Primary data validation passed. [2025-10-15T18:54:55.507924] [INFO ] [MAIN ] FET: Fetched primary data is valid. [2025-10-15T18:54:55.508115] [DEBUG] [LOCAL ] FET: Saving primary data. [2025-10-15T18:54:55.557915] [DEBUG] [LOCAL ] FET: Trimmed 18366 records to 12838 (keeping 200 days of data) [2025-10-15T18:54:55.587740] [INFO ] [REMOTE ] FFWM: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:54:55.598598] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-15T18:54:55.680826] [DEBUG] [LOCAL ] FET: Primary data saved (12838 records). [2025-10-15T18:54:55.681011] [INFO ] [MAIN ] FET: Full history saved. [2025-10-15T18:54:55.681151] [INFO ] [MAIN ] Update Progress: 822/2369 symbols completed. FET took 29.6s. Estimated remaining: 3h 36m 9s. Rate: 7.2 symbols/min [2025-10-15T18:54:55.859867] [INFO ] [MAIN ] FG: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:54:55.881583] [DEBUG] [LOCAL ] FG: Loaded 22259 existing records from primary storage. [2025-10-15T18:54:55.881885] [INFO ] [MAIN ] FG: Loaded 22259 existing records. [2025-10-15T18:54:56.054935] [WARN ] [MAIN ] FG: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:54:56.060053] [INFO ] [MAIN ] FG: Wiping existing primary data before full refresh. [2025-10-15T18:54:56.060734] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-15T18:54:56.060520] [INFO ] [LOCAL ] FG: Starting deletion of primary data. [2025-10-15T18:54:56.063323] [DEBUG] [LOCAL ] FG: Deleted primary data file. [2025-10-15T18:54:56.063379] [INFO ] [MAIN ] FG: Starting full primary refresh. [2025-10-15T18:54:56.122113] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-02. [2025-10-15T18:54:56.409197] [INFO ] [REMOTE ] FG: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:54:56.732775] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-15T18:54:56.913985] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-03. [2025-10-15T18:54:57.672853] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-15T18:54:57.714065] [INFO ] [REMOTE ] FG: Fetching primary data for 2024-12. [2025-10-15T18:54:58.456908] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-10-15T18:54:58.513957] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-01. [2025-10-15T18:54:59.291765] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-15T18:54:59.313964] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-02. [2025-10-15T18:55:00.050524] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-15T18:55:00.113992] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-03. [2025-10-15T18:55:00.914015] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2024-12. [2025-10-15T18:55:01.312194] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-15T18:55:01.714009] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-04. [2025-10-15T18:55:02.037369] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-15T18:55:02.486448] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-15T18:55:02.513954] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-04. [2025-10-15T18:55:03.314040] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-05. [2025-10-15T18:55:03.860485] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-15T18:55:03.915231] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-15T18:55:04.114032] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-05. [2025-10-15T18:55:04.914016] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-01. [2025-10-15T18:55:05.272500] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-15T18:55:05.714009] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-06. [2025-10-15T18:55:06.514037] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-06. [2025-10-15T18:55:06.555593] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-15T18:55:06.726038] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-15T18:55:07.105537] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-15T18:55:07.313995] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-07. [2025-10-15T18:55:07.952404] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-10-15T18:55:08.113997] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-02. [2025-10-15T18:55:08.914007] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-07. [2025-10-15T18:55:09.184000] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-15T18:55:09.713985] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-03. [2025-10-15T18:55:10.173870] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-15T18:55:10.513983] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-08. [2025-10-15T18:55:11.181055] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-15T18:55:11.313961] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-03. [2025-10-15T18:55:11.560029] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-15T18:55:12.114008] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-04. [2025-10-15T18:55:12.313739] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-15T18:55:12.914053] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-08. [2025-10-15T18:55:13.502502] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-15T18:55:13.561152] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-15T18:55:13.714013] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-04. [2025-10-15T18:55:14.514020] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-09. [2025-10-15T18:55:14.577621] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-15T18:55:15.314060] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-05. [2025-10-15T18:55:15.589748] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-15T18:55:16.114026] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-09. [2025-10-15T18:55:16.551545] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-10-15T18:55:16.740990] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-15T18:55:16.913999] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-10. [2025-10-15T18:55:17.632526] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-15T18:55:17.634130] [INFO ] [REMOTE ] FFA: Full fetch complete (8790 records). [2025-10-15T18:55:17.634265] [DEBUG] [VALIDATOR ] FFA: Validating primary data. [2025-10-15T18:55:17.719214] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-06. [2025-10-15T18:55:18.072781] [DEBUG] [VALIDATOR ] FFA: All expected trading days are present. [2025-10-15T18:55:18.072899] [DEBUG] [VALIDATOR ] FFA: Primary data validation passed. [2025-10-15T18:55:18.073208] [INFO ] [MAIN ] FFA: Fetched primary data is valid. [2025-10-15T18:55:18.073250] [DEBUG] [LOCAL ] FFA: Saving primary data. [2025-10-15T18:55:18.073922] [DEBUG] [LOCAL ] FFA: Trimmed 8790 records to 5921 (keeping 200 days of data) [2025-10-15T18:55:18.114871] [DEBUG] [LOCAL ] FFA: Primary data saved (5921 records). [2025-10-15T18:55:18.115083] [INFO ] [MAIN ] FFA: Full history saved. [2025-10-15T18:55:18.115195] [INFO ] [MAIN ] Update Progress: 823/2369 symbols completed. FFA took 31.7s. Estimated remaining: 3h 36m 27s. Rate: 7.1 symbols/min [2025-10-15T18:55:18.300346] [INFO ] [MAIN ] FGN: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:55:18.311024] [DEBUG] [LOCAL ] FGN: Loaded 3718 existing records from primary storage. [2025-10-15T18:55:18.311289] [INFO ] [MAIN ] FGN: Loaded 3718 existing records. [2025-10-15T18:55:18.499670] [WARN ] [MAIN ] FGN: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:55:18.500058] [INFO ] [MAIN ] FGN: Wiping existing primary data before full refresh. [2025-10-15T18:55:18.500122] [INFO ] [LOCAL ] FGN: Starting deletion of primary data. [2025-10-15T18:55:18.500289] [DEBUG] [LOCAL ] FGN: Deleted primary data file. [2025-10-15T18:55:18.500327] [INFO ] [MAIN ] FGN: Starting full primary refresh. [2025-10-15T18:55:18.520804] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-10. [2025-10-15T18:55:18.871027] [INFO ] [REMOTE ] FGN: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:55:18.892102] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-15T18:55:19.313970] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-05. [2025-10-15T18:55:19.620871] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-15T18:55:19.624468] [INFO ] [REMOTE ] FG: Full fetch complete (28567 records). [2025-10-15T18:55:19.624684] [DEBUG] [VALIDATOR ] FG: Validating primary data. [2025-10-15T18:55:19.993991] [DEBUG] [VALIDATOR ] FG: All expected trading days are present. [2025-10-15T18:55:19.994075] [DEBUG] [VALIDATOR ] FG: Primary data validation passed. [2025-10-15T18:55:19.994874] [INFO ] [MAIN ] FG: Fetched primary data is valid. [2025-10-15T18:55:19.995064] [DEBUG] [LOCAL ] FG: Saving primary data. [2025-10-15T18:55:19.996002] [DEBUG] [LOCAL ] FG: Trimmed 28567 records to 22183 (keeping 200 days of data) [2025-10-15T18:55:20.116694] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-07. [2025-10-15T18:55:20.145472] [DEBUG] [LOCAL ] FG: Primary data saved (22183 records). [2025-10-15T18:55:20.145729] [INFO ] [MAIN ] FG: Full history saved. [2025-10-15T18:55:20.145899] [INFO ] [MAIN ] Update Progress: 824/2369 symbols completed. FG took 24.5s. Estimated remaining: 3h 36m 7s. Rate: 7.1 symbols/min [2025-10-15T18:55:20.280167] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-15T18:55:20.356747] [INFO ] [MAIN ] FGSN: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:55:20.356956] [DEBUG] [LOCAL ] FGSN: No existing data file found in primary storage. [2025-10-15T18:55:20.357031] [WARN ] [MAIN ] FGSN: No existing data found, performing full refresh instead. [2025-10-15T18:55:20.357161] [INFO ] [MAIN ] FGSN: Wiping existing primary data before full refresh. [2025-10-15T18:55:20.357204] [INFO ] [LOCAL ] FGSN: Starting deletion of primary data. [2025-10-15T18:55:20.357248] [DEBUG] [LOCAL ] FGSN: No primary data file found to delete. [2025-10-15T18:55:20.357280] [INFO ] [MAIN ] FGSN: Starting full primary refresh. [2025-10-15T18:55:20.713606] [INFO ] [REMOTE ] FGSN: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:55:20.913949] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2024-12. [2025-10-15T18:55:21.098709] [DEBUG] [REMOTE ] FGSN: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-15T18:55:21.099035] [WARN ] [REMOTE ] FGSN: No data returned for month 2024-12 [2025-10-15T18:55:21.099147] [FATAL] [REMOTE ] FGSN: API call failed - aborting fetch to avoid wasting further API calls [2025-10-15T18:55:21.099231] [FATAL] [MAIN ] FGSN: Failed to fetch primary data. [2025-10-15T18:55:21.099316] [WARN ] [MAIN ] FGSN: Deleting existing primary and derivative data due to fetch failure. [2025-10-15T18:55:21.099430] [INFO ] [LOCAL ] FGSN: Starting deletion of primary data. [2025-10-15T18:55:21.099529] [DEBUG] [LOCAL ] FGSN: No primary data file found to delete. [2025-10-15T18:55:21.099573] [INFO ] [LOCAL ] FGSN: Starting deletion of derivative data. [2025-10-15T18:55:21.099617] [DEBUG] [LOCAL ] FGSN: No derivative data file found to delete. [2025-10-15T18:55:21.099694] [INFO ] [MAIN ] Update Progress: 825/2369 symbols completed. FGSN took 1.0s. Estimated remaining: 3h 35m 44s. Rate: 7.2 symbols/min [2025-10-15T18:55:21.269309] [INFO ] [MAIN ] FHI: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:55:21.311169] [DEBUG] [LOCAL ] FHI: Loaded 39897 existing records from primary storage. [2025-10-15T18:55:21.311451] [INFO ] [MAIN ] FHI: Loaded 39897 existing records. [2025-10-15T18:55:21.491192] [WARN ] [MAIN ] FHI: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:55:21.491414] [INFO ] [MAIN ] FHI: Wiping existing primary data before full refresh. [2025-10-15T18:55:21.491474] [INFO ] [LOCAL ] FHI: Starting deletion of primary data. [2025-10-15T18:55:21.491886] [DEBUG] [LOCAL ] FHI: Deleted primary data file. [2025-10-15T18:55:21.491943] [INFO ] [MAIN ] FHI: Starting full primary refresh. [2025-10-15T18:55:21.695559] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-15T18:55:21.720906] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-06. [2025-10-15T18:55:21.895029] [INFO ] [REMOTE ] FHI: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:55:22.514001] [INFO ] [REMOTE ] FGN: Fetching primary data for 2024-12. [2025-10-15T18:55:22.779592] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-15T18:55:23.081269] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-10-15T18:55:23.314004] [INFO ] [REMOTE ] FHI: Fetching primary data for 2024-12. [2025-10-15T18:55:24.113997] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-08. [2025-10-15T18:55:24.691795] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-15T18:55:24.914064] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-07. [2025-10-15T18:55:25.478123] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-15T18:55:25.713970] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-01. [2025-10-15T18:55:25.906945] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-15T18:55:26.514018] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-09. [2025-10-15T18:55:27.062446] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-15T18:55:27.314002] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-02. [2025-10-15T18:55:27.766575] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-15T18:55:28.114071] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-08. [2025-10-15T18:55:28.887860] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-15T18:55:28.913952] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-03. [2025-10-15T18:55:29.053726] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-15T18:55:29.713999] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-10. [2025-10-15T18:55:30.449313] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-15T18:55:30.513992] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-04. [2025-10-15T18:55:30.762897] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-15T18:55:30.767736] [INFO ] [REMOTE ] FFWM: Full fetch complete (51874 records). [2025-10-15T18:55:30.767910] [DEBUG] [VALIDATOR ] FFWM: Validating primary data. [2025-10-15T18:55:31.156250] [DEBUG] [VALIDATOR ] FFWM: All expected trading days are present. [2025-10-15T18:55:31.156334] [DEBUG] [VALIDATOR ] FFWM: Primary data validation passed. [2025-10-15T18:55:31.157099] [INFO ] [MAIN ] FFWM: Fetched primary data is valid. [2025-10-15T18:55:31.157162] [DEBUG] [LOCAL ] FFWM: Saving primary data. [2025-10-15T18:55:31.158352] [DEBUG] [LOCAL ] FFWM: Trimmed 51874 records to 35915 (keeping 200 days of data) [2025-10-15T18:55:31.327446] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-09. [2025-10-15T18:55:31.355134] [DEBUG] [LOCAL ] FFWM: Primary data saved (35915 records). [2025-10-15T18:55:31.355261] [INFO ] [MAIN ] FFWM: Full history saved. [2025-10-15T18:55:31.355343] [INFO ] [MAIN ] Update Progress: 826/2369 symbols completed. FFWM took 36.9s. Estimated remaining: 3h 35m 40s. Rate: 7.2 symbols/min [2025-10-15T18:55:31.519193] [INFO ] [MAIN ] FHN: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:55:31.569154] [DEBUG] [LOCAL ] FHN: Loaded 53391 existing records from primary storage. [2025-10-15T18:55:31.569670] [INFO ] [MAIN ] FHN: Loaded 53391 existing records. [2025-10-15T18:55:31.749466] [WARN ] [MAIN ] FHN: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:55:31.749723] [INFO ] [MAIN ] FHN: Wiping existing primary data before full refresh. [2025-10-15T18:55:31.749788] [INFO ] [LOCAL ] FHN: Starting deletion of primary data. [2025-10-15T18:55:31.750246] [DEBUG] [LOCAL ] FHN: Deleted primary data file. [2025-10-15T18:55:31.750316] [INFO ] [MAIN ] FHN: Starting full primary refresh. [2025-10-15T18:55:31.911207] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-15T18:55:32.115681] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-05. [2025-10-15T18:55:32.137311] [INFO ] [REMOTE ] FHN: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:55:32.268906] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-15T18:55:32.914026] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-01. [2025-10-15T18:55:33.385436] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-10-15T18:55:33.704513] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-15T18:55:33.714016] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-02. [2025-10-15T18:55:34.179511] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-15T18:55:34.514067] [INFO ] [REMOTE ] FHN: Fetching primary data for 2024-12. [2025-10-15T18:55:35.314059] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-06. [2025-10-15T18:55:36.114033] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-03. [2025-10-15T18:55:36.180311] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-15T18:55:36.454660] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-03 (0.34 seconds). [2025-10-15T18:55:36.692579] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-15T18:55:36.914087] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-07. [2025-10-15T18:55:37.713989] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-04. [2025-10-15T18:55:38.299850] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-15T18:55:38.341639] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-15T18:55:38.514018] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-01. [2025-10-15T18:55:39.314003] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-05. [2025-10-15T18:55:39.780538] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-15T18:55:40.114092] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-08. [2025-10-15T18:55:40.285288] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-15T18:55:40.914000] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-02. [2025-10-15T18:55:41.367493] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-15T18:55:41.714034] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-10. [2025-10-15T18:55:42.513962] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-09. [2025-10-15T18:55:42.549284] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-15T18:55:42.731263] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-15T18:55:42.733463] [INFO ] [REMOTE ] FFC: Full fetch complete (24602 records). [2025-10-15T18:55:42.733560] [DEBUG] [VALIDATOR ] FFC: Validating primary data. [2025-10-15T18:55:43.099424] [DEBUG] [VALIDATOR ] FFC: All expected trading days are present. [2025-10-15T18:55:43.099547] [DEBUG] [VALIDATOR ] FFC: Primary data validation passed. [2025-10-15T18:55:43.100073] [INFO ] [MAIN ] FFC: Fetched primary data is valid. [2025-10-15T18:55:43.100133] [DEBUG] [LOCAL ] FFC: Saving primary data. [2025-10-15T18:55:43.100941] [DEBUG] [LOCAL ] FFC: Trimmed 24602 records to 16719 (keeping 200 days of data) [2025-10-15T18:55:43.203028] [DEBUG] [LOCAL ] FFC: Primary data saved (16719 records). [2025-10-15T18:55:43.203162] [INFO ] [MAIN ] FFC: Full history saved. [2025-10-15T18:55:43.203254] [INFO ] [MAIN ] Update Progress: 827/2369 symbols completed. FFC took 56.7s. Estimated remaining: 3h 35m 38s. Rate: 7.2 symbols/min [2025-10-15T18:55:43.319127] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-06. [2025-10-15T18:55:43.377253] [INFO ] [MAIN ] FI: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:55:43.431363] [DEBUG] [LOCAL ] FI: Loaded 53575 existing records from primary storage. [2025-10-15T18:55:43.431763] [INFO ] [MAIN ] FI: Loaded 53575 existing records. [2025-10-15T18:55:43.605959] [WARN ] [MAIN ] FI: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:55:43.606208] [INFO ] [MAIN ] FI: Wiping existing primary data before full refresh. [2025-10-15T18:55:43.606289] [INFO ] [LOCAL ] FI: Starting deletion of primary data. [2025-10-15T18:55:43.606796] [DEBUG] [LOCAL ] FI: Deleted primary data file. [2025-10-15T18:55:43.606870] [INFO ] [MAIN ] FI: Starting full primary refresh. [2025-10-15T18:55:43.867793] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-10-15T18:55:43.988703] [INFO ] [REMOTE ] FI: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:55:44.008421] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-15T18:55:44.113981] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-10. [2025-10-15T18:55:44.914051] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-07. [2025-10-15T18:55:45.442278] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-10-15T18:55:45.544728] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-15T18:55:45.549607] [INFO ] [REMOTE ] FHI: Full fetch complete (57695 records). [2025-10-15T18:55:45.549762] [DEBUG] [VALIDATOR ] FHI: Validating primary data. [2025-10-15T18:55:45.721318] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-08. [2025-10-15T18:55:45.936689] [DEBUG] [VALIDATOR ] FHI: All expected trading days are present. [2025-10-15T18:55:45.936786] [DEBUG] [VALIDATOR ] FHI: Primary data validation passed. [2025-10-15T18:55:45.937568] [INFO ] [MAIN ] FHI: Fetched primary data is valid. [2025-10-15T18:55:45.937611] [DEBUG] [LOCAL ] FHI: Saving primary data. [2025-10-15T18:55:45.938872] [DEBUG] [LOCAL ] FHI: Trimmed 57695 records to 39897 (keeping 200 days of data) [2025-10-15T18:55:46.177352] [DEBUG] [LOCAL ] FHI: Primary data saved (39897 records). [2025-10-15T18:55:46.177492] [INFO ] [MAIN ] FHI: Full history saved. [2025-10-15T18:55:46.177572] [INFO ] [MAIN ] Update Progress: 828/2369 symbols completed. FHI took 25.1s. Estimated remaining: 3h 35m 19s. Rate: 7.2 symbols/min [2025-10-15T18:55:46.346636] [INFO ] [MAIN ] FICO: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:55:46.367453] [DEBUG] [LOCAL ] FICO: Loaded 21736 existing records from primary storage. [2025-10-15T18:55:46.367715] [INFO ] [MAIN ] FICO: Loaded 21736 existing records. [2025-10-15T18:55:46.464731] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-15T18:55:46.519119] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-03. [2025-10-15T18:55:46.556416] [WARN ] [MAIN ] FICO: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:55:46.556698] [INFO ] [MAIN ] FICO: Wiping existing primary data before full refresh. [2025-10-15T18:55:46.556755] [INFO ] [LOCAL ] FICO: Starting deletion of primary data. [2025-10-15T18:55:46.557294] [DEBUG] [LOCAL ] FICO: Deleted primary data file. [2025-10-15T18:55:46.557351] [INFO ] [MAIN ] FICO: Starting full primary refresh. [2025-10-15T18:55:46.905242] [INFO ] [REMOTE ] FICO: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:55:47.314053] [INFO ] [REMOTE ] FICO: Fetching primary data for 2024-12. [2025-10-15T18:55:48.114027] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-09. [2025-10-15T18:55:48.175796] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-15T18:55:48.196416] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-15T18:55:48.636008] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-10-15T18:55:48.914045] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-04. [2025-10-15T18:55:49.714058] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-01. [2025-10-15T18:55:50.514038] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-10. [2025-10-15T18:55:50.710436] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-15T18:55:50.784871] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-15T18:55:50.973108] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-15T18:55:50.974310] [INFO ] [REMOTE ] FGN: Full fetch complete (5633 records). [2025-10-15T18:55:50.974398] [DEBUG] [VALIDATOR ] FGN: Validating primary data. [2025-10-15T18:55:51.322202] [INFO ] [REMOTE ] FI: Fetching primary data for 2024-12. [2025-10-15T18:55:51.329241] [DEBUG] [VALIDATOR ] FGN: All expected trading days are present. [2025-10-15T18:55:51.329345] [DEBUG] [VALIDATOR ] FGN: Primary data validation passed. [2025-10-15T18:55:51.329510] [INFO ] [MAIN ] FGN: Fetched primary data is valid. [2025-10-15T18:55:51.329549] [DEBUG] [LOCAL ] FGN: Saving primary data. [2025-10-15T18:55:51.329942] [DEBUG] [LOCAL ] FGN: Trimmed 5633 records to 3724 (keeping 200 days of data) [2025-10-15T18:55:51.351994] [DEBUG] [LOCAL ] FGN: Primary data saved (3724 records). [2025-10-15T18:55:51.352069] [INFO ] [MAIN ] FGN: Full history saved. [2025-10-15T18:55:51.352141] [INFO ] [MAIN ] Update Progress: 829/2369 symbols completed. FGN took 33.2s. Estimated remaining: 3h 35m 5s. Rate: 7.2 symbols/min [2025-10-15T18:55:51.516162] [INFO ] [MAIN ] FIG: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:55:51.516318] [DEBUG] [LOCAL ] FIG: No existing data file found in primary storage. [2025-10-15T18:55:51.516355] [WARN ] [MAIN ] FIG: No existing data found, performing full refresh instead. [2025-10-15T18:55:51.516466] [INFO ] [MAIN ] FIG: Wiping existing primary data before full refresh. [2025-10-15T18:55:51.516507] [INFO ] [LOCAL ] FIG: Starting deletion of primary data. [2025-10-15T18:55:51.516548] [DEBUG] [LOCAL ] FIG: No primary data file found to delete. [2025-10-15T18:55:51.516580] [INFO ] [MAIN ] FIG: Starting full primary refresh. [2025-10-15T18:55:51.861033] [INFO ] [REMOTE ] FIG: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:55:52.114024] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-02. [2025-10-15T18:55:52.913985] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-05. [2025-10-15T18:55:53.204907] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-10-15T18:55:53.290461] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-15T18:55:53.714067] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-03. [2025-10-15T18:55:54.455544] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-15T18:55:54.476960] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-15T18:55:54.513966] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-04. [2025-10-15T18:55:55.314019] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-01. [2025-10-15T18:55:55.609593] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-15T18:55:56.114006] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-05. [2025-10-15T18:55:56.914000] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-06. [2025-10-15T18:55:57.025660] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-15T18:55:57.182021] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-15T18:55:57.713986] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-06. [2025-10-15T18:55:58.514068] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-02. [2025-10-15T18:55:58.706118] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-15T18:55:58.842940] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-15T18:55:59.314045] [INFO ] [REMOTE ] FIG: Fetching primary data for 2024-12. [2025-10-15T18:55:59.635726] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2024-12 (0.32 seconds). [2025-10-15T18:55:59.862474] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-15T18:56:00.114031] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-01. [2025-10-15T18:56:00.353919] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-01 (0.24 seconds). [2025-10-15T18:56:00.914056] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-07. [2025-10-15T18:56:01.713994] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-07. [2025-10-15T18:56:02.513971] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-03. [2025-10-15T18:56:02.743914] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-15T18:56:03.157191] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-15T18:56:03.313978] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-02. [2025-10-15T18:56:03.573835] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-02 (0.26 seconds). [2025-10-15T18:56:04.113978] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-08. [2025-10-15T18:56:04.205361] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-15T18:56:04.913992] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-08. [2025-10-15T18:56:05.515456] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-15T18:56:05.714016] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-04. [2025-10-15T18:56:06.514089] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-03. [2025-10-15T18:56:06.574976] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-15T18:56:06.791009] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-03 (0.28 seconds). [2025-10-15T18:56:07.277281] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-15T18:56:07.313990] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-05. [2025-10-15T18:56:08.114051] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-09. [2025-10-15T18:56:08.914010] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-09. [2025-10-15T18:56:09.231377] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-15T18:56:09.273829] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-15T18:56:09.714052] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-06. [2025-10-15T18:56:10.513985] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-10. [2025-10-15T18:56:10.662117] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-15T18:56:11.314044] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-10. [2025-10-15T18:56:11.631350] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-10-15T18:56:11.632383] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-15T18:56:11.647343] [INFO ] [REMOTE ] FICO: Full fetch complete (29810 records). [2025-10-15T18:56:11.647437] [DEBUG] [VALIDATOR ] FICO: Validating primary data. [2025-10-15T18:56:12.063836] [DEBUG] [VALIDATOR ] FICO: All expected trading days are present. [2025-10-15T18:56:12.063949] [DEBUG] [VALIDATOR ] FICO: Primary data validation passed. [2025-10-15T18:56:12.064790] [INFO ] [MAIN ] FICO: Fetched primary data is valid. [2025-10-15T18:56:12.064857] [DEBUG] [LOCAL ] FICO: Saving primary data. [2025-10-15T18:56:12.065770] [DEBUG] [LOCAL ] FICO: Trimmed 29810 records to 21752 (keeping 200 days of data) [2025-10-15T18:56:12.120946] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-04. [2025-10-15T18:56:12.217293] [DEBUG] [LOCAL ] FICO: Primary data saved (21752 records). [2025-10-15T18:56:12.217428] [INFO ] [MAIN ] FICO: Full history saved. [2025-10-15T18:56:12.217509] [INFO ] [MAIN ] Update Progress: 830/2369 symbols completed. FICO took 26.0s. Estimated remaining: 3h 35m 20s. Rate: 7.1 symbols/min [2025-10-15T18:56:12.381529] [INFO ] [MAIN ] FIGS: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:56:12.422569] [DEBUG] [LOCAL ] FIGS: Loaded 48563 existing records from primary storage. [2025-10-15T18:56:12.422932] [INFO ] [MAIN ] FIGS: Loaded 48563 existing records. [2025-10-15T18:56:12.521324] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-04 (0.40 seconds). [2025-10-15T18:56:12.602729] [WARN ] [MAIN ] FIGS: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:56:12.602961] [INFO ] [MAIN ] FIGS: Wiping existing primary data before full refresh. [2025-10-15T18:56:12.603009] [INFO ] [LOCAL ] FIGS: Starting deletion of primary data. [2025-10-15T18:56:12.603765] [DEBUG] [LOCAL ] FIGS: Deleted primary data file. [2025-10-15T18:56:12.603823] [INFO ] [MAIN ] FIGS: Starting full primary refresh. [2025-10-15T18:56:12.915394] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-07. [2025-10-15T18:56:12.986120] [INFO ] [REMOTE ] FIGS: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:56:13.079277] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-15T18:56:13.085849] [INFO ] [REMOTE ] FHN: Full fetch complete (77471 records). [2025-10-15T18:56:13.086007] [DEBUG] [VALIDATOR ] FHN: Validating primary data. [2025-10-15T18:56:13.485611] [DEBUG] [VALIDATOR ] FHN: All expected trading days are present. [2025-10-15T18:56:13.485733] [DEBUG] [VALIDATOR ] FHN: Primary data validation passed. [2025-10-15T18:56:13.486706] [INFO ] [MAIN ] FHN: Fetched primary data is valid. [2025-10-15T18:56:13.486774] [DEBUG] [LOCAL ] FHN: Saving primary data. [2025-10-15T18:56:13.488391] [DEBUG] [LOCAL ] FHN: Trimmed 77471 records to 53392 (keeping 200 days of data) [2025-10-15T18:56:13.718793] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2024-12. [2025-10-15T18:56:13.828995] [DEBUG] [LOCAL ] FHN: Primary data saved (53392 records). [2025-10-15T18:56:13.829158] [INFO ] [MAIN ] FHN: Full history saved. [2025-10-15T18:56:13.830129] [INFO ] [MAIN ] Update Progress: 831/2369 symbols completed. FHN took 42.5s. Estimated remaining: 3h 34m 59s. Rate: 7.2 symbols/min [2025-10-15T18:56:13.998298] [INFO ] [MAIN ] FIHL: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:56:14.039790] [DEBUG] [LOCAL ] FIHL: Loaded 39429 existing records from primary storage. [2025-10-15T18:56:14.040083] [INFO ] [MAIN ] FIHL: Loaded 39429 existing records. [2025-10-15T18:56:14.222131] [WARN ] [MAIN ] FIHL: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:56:14.222331] [INFO ] [MAIN ] FIHL: Wiping existing primary data before full refresh. [2025-10-15T18:56:14.222378] [INFO ] [LOCAL ] FIHL: Starting deletion of primary data. [2025-10-15T18:56:14.223043] [DEBUG] [LOCAL ] FIHL: Deleted primary data file. [2025-10-15T18:56:14.223101] [INFO ] [MAIN ] FIHL: Starting full primary refresh. [2025-10-15T18:56:14.519189] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-05. [2025-10-15T18:56:14.586232] [INFO ] [REMOTE ] FIHL: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:56:14.881623] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-05 (0.36 seconds). [2025-10-15T18:56:15.141052] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-07 (2.23 seconds). [2025-10-15T18:56:15.232618] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-15T18:56:15.314004] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-01. [2025-10-15T18:56:16.114058] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-08. [2025-10-15T18:56:16.865083] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-15T18:56:16.913977] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-02. [2025-10-15T18:56:17.714053] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2024-12. [2025-10-15T18:56:18.109214] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-10-15T18:56:18.451189] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-15T18:56:18.514040] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-03. [2025-10-15T18:56:18.670117] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-10-15T18:56:19.314073] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-09. [2025-10-15T18:56:20.113963] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-01. [2025-10-15T18:56:20.318966] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-15T18:56:20.919487] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-04. [2025-10-15T18:56:20.921590] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-15T18:56:21.306235] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-10-15T18:56:21.713993] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-10. [2025-10-15T18:56:22.340343] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-15T18:56:22.346904] [INFO ] [REMOTE ] FI: Full fetch complete (77421 records). [2025-10-15T18:56:22.347051] [DEBUG] [VALIDATOR ] FI: Validating primary data. [2025-10-15T18:56:22.530835] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-02. [2025-10-15T18:56:22.797263] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-15T18:56:22.830748] [DEBUG] [VALIDATOR ] FI: All expected trading days are present. [2025-10-15T18:56:22.830929] [DEBUG] [VALIDATOR ] FI: Primary data validation passed. [2025-10-15T18:56:22.831903] [INFO ] [MAIN ] FI: Fetched primary data is valid. [2025-10-15T18:56:22.831984] [DEBUG] [LOCAL ] FI: Saving primary data. [2025-10-15T18:56:22.833339] [DEBUG] [LOCAL ] FI: Trimmed 77421 records to 53580 (keeping 200 days of data) [2025-10-15T18:56:23.157514] [DEBUG] [LOCAL ] FI: Primary data saved (53580 records). [2025-10-15T18:56:23.157681] [INFO ] [MAIN ] FI: Full history saved. [2025-10-15T18:56:23.157782] [INFO ] [MAIN ] Update Progress: 832/2369 symbols completed. FI took 40.0s. Estimated remaining: 3h 34m 52s. Rate: 7.2 symbols/min [2025-10-15T18:56:23.320001] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-05. [2025-10-15T18:56:23.322514] [INFO ] [MAIN ] FINS: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:56:23.332752] [DEBUG] [LOCAL ] FINS: Loaded 8322 existing records from primary storage. [2025-10-15T18:56:23.332949] [INFO ] [MAIN ] FINS: Loaded 8322 existing records. [2025-10-15T18:56:23.508204] [WARN ] [MAIN ] FINS: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:56:23.508522] [INFO ] [MAIN ] FINS: Wiping existing primary data before full refresh. [2025-10-15T18:56:23.508595] [INFO ] [LOCAL ] FINS: Starting deletion of primary data. [2025-10-15T18:56:23.509030] [DEBUG] [LOCAL ] FINS: Deleted primary data file. [2025-10-15T18:56:23.509090] [INFO ] [MAIN ] FINS: Starting full primary refresh. [2025-10-15T18:56:23.868285] [INFO ] [REMOTE ] FINS: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:56:23.914969] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-15T18:56:24.113993] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-06. [2025-10-15T18:56:24.325440] [DEBUG] [REMOTE ] FIG: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-15T18:56:24.325812] [WARN ] [REMOTE ] FIG: No data returned for month 2025-06 [2025-10-15T18:56:24.325899] [FATAL] [REMOTE ] FIG: API call failed - aborting fetch to avoid wasting further API calls [2025-10-15T18:56:24.326000] [FATAL] [MAIN ] FIG: Failed to fetch primary data. [2025-10-15T18:56:24.326069] [WARN ] [MAIN ] FIG: Deleting existing primary and derivative data due to fetch failure. [2025-10-15T18:56:24.326144] [INFO ] [LOCAL ] FIG: Starting deletion of primary data. [2025-10-15T18:56:24.326208] [DEBUG] [LOCAL ] FIG: No primary data file found to delete. [2025-10-15T18:56:24.326244] [INFO ] [LOCAL ] FIG: Starting deletion of derivative data. [2025-10-15T18:56:24.326282] [DEBUG] [LOCAL ] FIG: No derivative data file found to delete. [2025-10-15T18:56:24.326327] [INFO ] [MAIN ] Update Progress: 833/2369 symbols completed. FIG took 33.0s. Estimated remaining: 3h 34m 30s. Rate: 7.2 symbols/min [2025-10-15T18:56:24.511509] [INFO ] [MAIN ] FINV: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:56:24.550631] [DEBUG] [LOCAL ] FINV: Loaded 45286 existing records from primary storage. [2025-10-15T18:56:24.550949] [INFO ] [MAIN ] FINV: Loaded 45286 existing records. [2025-10-15T18:56:24.726670] [WARN ] [MAIN ] FINV: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:56:24.726936] [INFO ] [MAIN ] FINV: Wiping existing primary data before full refresh. [2025-10-15T18:56:24.726999] [INFO ] [LOCAL ] FINV: Starting deletion of primary data. [2025-10-15T18:56:24.727879] [DEBUG] [LOCAL ] FINV: Deleted primary data file. [2025-10-15T18:56:24.727939] [INFO ] [MAIN ] FINV: Starting full primary refresh. [2025-10-15T18:56:24.885893] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-15T18:56:24.923089] [INFO ] [REMOTE ] FINS: Fetching primary data for 2024-12. [2025-10-15T18:56:25.196034] [INFO ] [REMOTE ] FINV: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:56:25.714015] [INFO ] [REMOTE ] FINV: Fetching primary data for 2024-12. [2025-10-15T18:56:25.923950] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-10-15T18:56:26.514015] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-03. [2025-10-15T18:56:26.797866] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-15T18:56:27.314006] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-01. [2025-10-15T18:56:28.016424] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-15T18:56:28.113984] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-04. [2025-10-15T18:56:28.858267] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-15T18:56:28.913961] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-02. [2025-10-15T18:56:29.664018] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-15T18:56:29.713973] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-05. [2025-10-15T18:56:30.426101] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-15T18:56:30.513994] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-03. [2025-10-15T18:56:31.108631] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-15T18:56:31.313988] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-01. [2025-10-15T18:56:32.085202] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-15T18:56:32.112364] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-15T18:56:32.121175] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-02. [2025-10-15T18:56:32.778606] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-15T18:56:32.914007] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-04. [2025-10-15T18:56:33.714016] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-06. [2025-10-15T18:56:34.514002] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-06. [2025-10-15T18:56:34.606262] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-15T18:56:35.192364] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-15T18:56:35.313973] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-07. [2025-10-15T18:56:36.056125] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-15T18:56:36.113989] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-07. [2025-10-15T18:56:36.913972] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-03. [2025-10-15T18:56:37.063154] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-15T18:56:37.531864] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-15T18:56:37.556173] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-15T18:56:37.714013] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-08. [2025-10-15T18:56:38.514009] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-08. [2025-10-15T18:56:39.224074] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-15T18:56:39.314010] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-09. [2025-10-15T18:56:40.095251] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-15T18:56:40.113975] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-09. [2025-10-15T18:56:40.729598] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-15T18:56:40.914080] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-10. [2025-10-15T18:56:41.719151] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-04. [2025-10-15T18:56:41.736318] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-15T18:56:42.150186] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-15T18:56:42.154899] [INFO ] [REMOTE ] FIHL: Full fetch complete (56417 records). [2025-10-15T18:56:42.154991] [DEBUG] [VALIDATOR ] FIHL: Validating primary data. [2025-10-15T18:56:42.516454] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-05. [2025-10-15T18:56:42.549595] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-15T18:56:42.573870] [DEBUG] [VALIDATOR ] FIHL: All expected trading days are present. [2025-10-15T18:56:42.574125] [DEBUG] [VALIDATOR ] FIHL: Primary data validation passed. [2025-10-15T18:56:42.575409] [INFO ] [MAIN ] FIHL: Fetched primary data is valid. [2025-10-15T18:56:42.575502] [DEBUG] [LOCAL ] FIHL: Saving primary data. [2025-10-15T18:56:42.579350] [DEBUG] [LOCAL ] FIHL: Trimmed 56417 records to 39437 (keeping 200 days of data) [2025-10-15T18:56:42.845557] [DEBUG] [LOCAL ] FIHL: Primary data saved (39437 records). [2025-10-15T18:56:42.845799] [INFO ] [MAIN ] FIHL: Full history saved. [2025-10-15T18:56:42.845954] [INFO ] [MAIN ] Update Progress: 834/2369 symbols completed. FIHL took 29.0s. Estimated remaining: 3h 34m 41s. Rate: 7.2 symbols/min [2025-10-15T18:56:43.028478] [INFO ] [MAIN ] FIS: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:56:43.085050] [DEBUG] [LOCAL ] FIS: Loaded 53343 existing records from primary storage. [2025-10-15T18:56:43.085512] [INFO ] [MAIN ] FIS: Loaded 53343 existing records. [2025-10-15T18:56:43.281980] [WARN ] [MAIN ] FIS: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:56:43.282278] [INFO ] [MAIN ] FIS: Wiping existing primary data before full refresh. [2025-10-15T18:56:43.282333] [INFO ] [LOCAL ] FIS: Starting deletion of primary data. [2025-10-15T18:56:43.283375] [DEBUG] [LOCAL ] FIS: Deleted primary data file. [2025-10-15T18:56:43.283440] [INFO ] [MAIN ] FIS: Starting full primary refresh. [2025-10-15T18:56:43.319160] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-10. [2025-10-15T18:56:43.662189] [INFO ] [REMOTE ] FIS: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:56:43.897983] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-15T18:56:44.113985] [INFO ] [REMOTE ] FIS: Fetching primary data for 2024-12. [2025-10-15T18:56:44.657415] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-15T18:56:44.663602] [INFO ] [REMOTE ] FIGS: Full fetch complete (70888 records). [2025-10-15T18:56:44.663768] [DEBUG] [VALIDATOR ] FIGS: Validating primary data. [2025-10-15T18:56:44.922582] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-06. [2025-10-15T18:56:45.043217] [DEBUG] [VALIDATOR ] FIGS: All expected trading days are present. [2025-10-15T18:56:45.043302] [DEBUG] [VALIDATOR ] FIGS: Primary data validation passed. [2025-10-15T18:56:45.044257] [INFO ] [MAIN ] FIGS: Fetched primary data is valid. [2025-10-15T18:56:45.044324] [DEBUG] [LOCAL ] FIGS: Saving primary data. [2025-10-15T18:56:45.045751] [DEBUG] [LOCAL ] FIGS: Trimmed 70888 records to 48583 (keeping 200 days of data) [2025-10-15T18:56:45.315357] [DEBUG] [LOCAL ] FIGS: Primary data saved (48583 records). [2025-10-15T18:56:45.315529] [INFO ] [MAIN ] FIGS: Full history saved. [2025-10-15T18:56:45.315667] [INFO ] [MAIN ] Update Progress: 835/2369 symbols completed. FIGS took 33.1s. Estimated remaining: 3h 34m 21s. Rate: 7.2 symbols/min [2025-10-15T18:56:45.484044] [INFO ] [MAIN ] FIX: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:56:45.510543] [DEBUG] [LOCAL ] FIX: Loaded 28900 existing records from primary storage. [2025-10-15T18:56:45.510863] [INFO ] [MAIN ] FIX: Loaded 28900 existing records. [2025-10-15T18:56:45.686774] [WARN ] [MAIN ] FIX: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:56:45.687116] [INFO ] [MAIN ] FIX: Wiping existing primary data before full refresh. [2025-10-15T18:56:45.687238] [INFO ] [LOCAL ] FIX: Starting deletion of primary data. [2025-10-15T18:56:45.688017] [DEBUG] [LOCAL ] FIX: Deleted primary data file. [2025-10-15T18:56:45.688074] [INFO ] [MAIN ] FIX: Starting full primary refresh. [2025-10-15T18:56:45.718526] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-05. [2025-10-15T18:56:45.892393] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-15T18:56:46.082800] [INFO ] [REMOTE ] FIX: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:56:46.279816] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-15T18:56:46.416546] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-15T18:56:46.514011] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-06. [2025-10-15T18:56:47.314062] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-01. [2025-10-15T18:56:47.313992] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-15T18:56:48.114013] [INFO ] [REMOTE ] FIX: Fetching primary data for 2024-12. [2025-10-15T18:56:48.914029] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-07. [2025-10-15T18:56:49.031602] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-15T18:56:49.422026] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-15T18:56:49.714322] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-15T18:56:49.714048] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-01. [2025-10-15T18:56:50.514008] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-02. [2025-10-15T18:56:51.047810] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-15T18:56:51.313995] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-08. [2025-10-15T18:56:51.902323] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-15T18:56:52.114005] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-02. [2025-10-15T18:56:52.176117] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-15T18:56:52.914015] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-09. [2025-10-15T18:56:53.599582] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-15T18:56:53.631185] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-15T18:56:53.713970] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-03. [2025-10-15T18:56:54.514052] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-07. [2025-10-15T18:56:55.318351] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-03. [2025-10-15T18:56:55.324156] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-15T18:56:55.881450] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-15T18:56:56.114028] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-08. [2025-10-15T18:56:56.914027] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-04. [2025-10-15T18:56:57.150888] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-15T18:56:57.713971] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-04. [2025-10-15T18:56:57.855546] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-15T18:56:58.059622] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-15T18:56:58.514000] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-10. [2025-10-15T18:56:59.054995] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-15T18:56:59.056276] [INFO ] [REMOTE ] FINS: Full fetch complete (11780 records). [2025-10-15T18:56:59.056345] [DEBUG] [VALIDATOR ] FINS: Validating primary data. [2025-10-15T18:56:59.324337] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-05. [2025-10-15T18:56:59.416326] [DEBUG] [VALIDATOR ] FINS: All expected trading days are present. [2025-10-15T18:56:59.416458] [DEBUG] [VALIDATOR ] FINS: Primary data validation passed. [2025-10-15T18:56:59.416762] [INFO ] [MAIN ] FINS: Fetched primary data is valid. [2025-10-15T18:56:59.416822] [DEBUG] [LOCAL ] FINS: Saving primary data. [2025-10-15T18:56:59.417695] [DEBUG] [LOCAL ] FINS: Trimmed 11780 records to 8292 (keeping 200 days of data) [2025-10-15T18:56:59.476011] [DEBUG] [LOCAL ] FINS: Primary data saved (8292 records). [2025-10-15T18:56:59.476186] [INFO ] [MAIN ] FINS: Full history saved. [2025-10-15T18:56:59.476317] [INFO ] [MAIN ] Update Progress: 836/2369 symbols completed. FINS took 36.3s. Estimated remaining: 3h 34m 24s. Rate: 7.2 symbols/min [2025-10-15T18:56:59.645475] [INFO ] [MAIN ] FIXT: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:56:59.645790] [DEBUG] [LOCAL ] FIXT: No existing data file found in primary storage. [2025-10-15T18:56:59.645971] [WARN ] [MAIN ] FIXT: No existing data found, performing full refresh instead. [2025-10-15T18:56:59.646088] [INFO ] [MAIN ] FIXT: Wiping existing primary data before full refresh. [2025-10-15T18:56:59.656541] [INFO ] [LOCAL ] FIXT: Starting deletion of primary data. [2025-10-15T18:56:59.671204] [DEBUG] [LOCAL ] FIXT: No primary data file found to delete. [2025-10-15T18:56:59.674514] [INFO ] [MAIN ] FIXT: Starting full primary refresh. [2025-10-15T18:56:59.704248] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-15T18:57:00.093684] [INFO ] [REMOTE ] FIXT: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:57:00.113957] [INFO ] [REMOTE ] FIXT: Fetching primary data for 2024-12. [2025-10-15T18:57:00.316220] [DEBUG] [REMOTE ] FIXT: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-15T18:57:00.316553] [WARN ] [REMOTE ] FIXT: No data returned for month 2024-12 [2025-10-15T18:57:00.316694] [FATAL] [REMOTE ] FIXT: API call failed - aborting fetch to avoid wasting further API calls [2025-10-15T18:57:00.316779] [FATAL] [MAIN ] FIXT: Failed to fetch primary data. [2025-10-15T18:57:00.316854] [WARN ] [MAIN ] FIXT: Deleting existing primary and derivative data due to fetch failure. [2025-10-15T18:57:00.316930] [INFO ] [LOCAL ] FIXT: Starting deletion of primary data. [2025-10-15T18:57:00.316992] [DEBUG] [LOCAL ] FIXT: No primary data file found to delete. [2025-10-15T18:57:00.317034] [INFO ] [LOCAL ] FIXT: Starting deletion of derivative data. [2025-10-15T18:57:00.317127] [DEBUG] [LOCAL ] FIXT: No derivative data file found to delete. [2025-10-15T18:57:00.317215] [INFO ] [MAIN ] Update Progress: 837/2369 symbols completed. FIXT took 0.8s. Estimated remaining: 3h 34m 1s. Rate: 7.2 symbols/min [2025-10-15T18:57:00.696769] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-15T18:57:00.914012] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-09. [2025-10-15T18:57:01.714007] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-05. [2025-10-15T18:57:02.514109] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-06. [2025-10-15T18:57:02.575777] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-15T18:57:03.111490] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-15T18:57:03.314038] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-06. [2025-10-15T18:57:03.814350] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-15T18:57:04.114020] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-07. [2025-10-15T18:57:04.913989] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-10. [2025-10-15T18:57:05.047327] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-15T18:57:05.598265] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-15T18:57:05.714008] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-07. [2025-10-15T18:57:06.405421] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-15T18:57:06.411694] [INFO ] [REMOTE ] FINV: Full fetch complete (64518 records). [2025-10-15T18:57:06.411804] [DEBUG] [VALIDATOR ] FINV: Validating primary data. [2025-10-15T18:57:06.515540] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-08. [2025-10-15T18:57:06.801429] [DEBUG] [VALIDATOR ] FINV: All expected trading days are present. [2025-10-15T18:57:06.801513] [DEBUG] [VALIDATOR ] FINV: Primary data validation passed. [2025-10-15T18:57:06.802392] [INFO ] [MAIN ] FINV: Fetched primary data is valid. [2025-10-15T18:57:06.802454] [DEBUG] [LOCAL ] FINV: Saving primary data. [2025-10-15T18:57:06.803778] [DEBUG] [LOCAL ] FINV: Trimmed 64518 records to 45270 (keeping 200 days of data) [2025-10-15T18:57:07.056248] [DEBUG] [LOCAL ] FINV: Primary data saved (45270 records). [2025-10-15T18:57:07.056391] [INFO ] [MAIN ] FINV: Full history saved. [2025-10-15T18:57:07.056762] [INFO ] [MAIN ] Update Progress: 838/2369 symbols completed. FINV took 42.7s. Estimated remaining: 3h 33m 50s. Rate: 7.2 symbols/min [2025-10-15T18:57:07.597808] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-15T18:57:07.610979] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-08. [2025-10-15T18:57:07.630104] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-15T18:57:08.114013] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-09. [2025-10-15T18:57:09.491947] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-15T18:57:09.498175] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-10. [2025-10-15T18:57:09.538965] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-10-15T18:57:09.714031] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-09. [2025-10-15T18:57:11.309826] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-15T18:57:11.313088] [INFO ] [REMOTE ] FIX: Full fetch complete (45389 records). [2025-10-15T18:57:11.313193] [DEBUG] [VALIDATOR ] FIX: Validating primary data. [2025-10-15T18:57:11.709101] [DEBUG] [VALIDATOR ] FIX: All expected trading days are present. [2025-10-15T18:57:11.709193] [DEBUG] [VALIDATOR ] FIX: Primary data validation passed. [2025-10-15T18:57:11.720737] [INFO ] [MAIN ] FIX: Fetched primary data is valid. [2025-10-15T18:57:11.725948] [DEBUG] [LOCAL ] FIX: Saving primary data. [2025-10-15T18:57:11.741425] [DEBUG] [LOCAL ] FIX: Trimmed 45389 records to 28800 (keeping 200 days of data) [2025-10-15T18:57:11.742550] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-10-15T18:57:11.843530] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-10. [2025-10-15T18:57:11.931870] [DEBUG] [LOCAL ] FIX: Primary data saved (28800 records). [2025-10-15T18:57:11.931997] [INFO ] [MAIN ] FIX: Full history saved. [2025-10-15T18:57:11.932075] [INFO ] [MAIN ] Update Progress: 839/2369 symbols completed. FIX took 26.6s. Estimated remaining: 3h 33m 35s. Rate: 7.2 symbols/min [2025-10-15T18:57:12.665912] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-15T18:57:12.672635] [INFO ] [REMOTE ] FIS: Full fetch complete (77375 records). [2025-10-15T18:57:12.672847] [DEBUG] [VALIDATOR ] FIS: Validating primary data. [2025-10-15T18:57:13.078675] [DEBUG] [VALIDATOR ] FIS: All expected trading days are present. [2025-10-15T18:57:13.078763] [DEBUG] [VALIDATOR ] FIS: Primary data validation passed. [2025-10-15T18:57:13.079791] [INFO ] [MAIN ] FIS: Fetched primary data is valid. [2025-10-15T18:57:13.079856] [DEBUG] [LOCAL ] FIS: Saving primary data. [2025-10-15T18:57:13.081351] [DEBUG] [LOCAL ] FIS: Trimmed 77375 records to 53339 (keeping 200 days of data) [2025-10-15T18:57:13.411508] [DEBUG] [LOCAL ] FIS: Primary data saved (53339 records). [2025-10-15T18:57:13.411670] [INFO ] [MAIN ] FIS: Full history saved. [2025-10-15T18:57:13.412553] [INFO ] [MAIN ] Update Progress: 840/2369 symbols completed. FIS took 30.6s. Estimated remaining: 3h 33m 14s. Rate: 7.2 symbols/min [2025-10-15T18:57:14.028074] [INFO ] [MAIN ] FLNG: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:57:14.115047] [INFO ] [MAIN ] FLC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:57:14.103398] [INFO ] [MAIN ] FLG: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:57:14.141114] [INFO ] [MAIN ] FLO: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:57:14.149196] [DEBUG] [LOCAL ] FLC: Loaded 5437 existing records from primary storage. [2025-10-15T18:57:14.149425] [INFO ] [MAIN ] FLC: Loaded 5437 existing records. [2025-10-15T18:57:14.308563] [DEBUG] [LOCAL ] FLNG: Loaded 33716 existing records from primary storage. [2025-10-15T18:57:14.337987] [INFO ] [MAIN ] FLNG: Loaded 33716 existing records. [2025-10-15T18:57:14.386855] [WARN ] [MAIN ] FLC: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:57:14.450463] [INFO ] [MAIN ] FLC: Wiping existing primary data before full refresh. [2025-10-15T18:57:14.460226] [INFO ] [LOCAL ] FLC: Starting deletion of primary data. [2025-10-15T18:57:14.472210] [DEBUG] [LOCAL ] FLC: Deleted primary data file. [2025-10-15T18:57:14.472305] [INFO ] [MAIN ] FLC: Starting full primary refresh. [2025-10-15T18:57:14.551836] [DEBUG] [LOCAL ] FLO: Loaded 52059 existing records from primary storage. [2025-10-15T18:57:14.664691] [DEBUG] [LOCAL ] FLG: Loaded 53324 existing records from primary storage. [2025-10-15T18:57:14.629403] [INFO ] [MAIN ] FLO: Loaded 52059 existing records. [2025-10-15T18:57:14.675459] [INFO ] [MAIN ] FLG: Loaded 53324 existing records. [2025-10-15T18:57:14.815261] [WARN ] [MAIN ] FLNG: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:57:14.985173] [INFO ] [MAIN ] FLNG: Wiping existing primary data before full refresh. [2025-10-15T18:57:15.031885] [INFO ] [LOCAL ] FLNG: Starting deletion of primary data. [2025-10-15T18:57:15.158726] [DEBUG] [LOCAL ] FLNG: Deleted primary data file. [2025-10-15T18:57:15.228600] [INFO ] [MAIN ] FLNG: Starting full primary refresh. [2025-10-15T18:57:15.332765] [WARN ] [MAIN ] FLO: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:57:15.362844] [INFO ] [MAIN ] FLO: Wiping existing primary data before full refresh. [2025-10-15T18:57:15.357236] [WARN ] [MAIN ] FLG: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:57:15.381966] [INFO ] [LOCAL ] FLO: Starting deletion of primary data. [2025-10-15T18:57:15.406444] [DEBUG] [LOCAL ] FLO: Deleted primary data file. [2025-10-15T18:57:15.411622] [INFO ] [MAIN ] FLG: Wiping existing primary data before full refresh. [2025-10-15T18:57:15.432401] [INFO ] [LOCAL ] FLG: Starting deletion of primary data. [2025-10-15T18:57:15.432336] [INFO ] [MAIN ] FLO: Starting full primary refresh. [2025-10-15T18:57:15.438015] [DEBUG] [LOCAL ] FLG: Deleted primary data file. [2025-10-15T18:57:15.477856] [INFO ] [MAIN ] FLG: Starting full primary refresh. [2025-10-15T18:57:15.621098] [INFO ] [REMOTE ] FLC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:57:15.708119] [INFO ] [REMOTE ] FLC: Fetching primary data for 2024-12. [2025-10-15T18:57:16.307858] [INFO ] [REMOTE ] FLNG: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:57:16.313538] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2024-12. [2025-10-15T18:57:16.511725] [INFO ] [REMOTE ] FLO: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:57:16.517184] [INFO ] [REMOTE ] FLO: Fetching primary data for 2024-12. [2025-10-15T18:57:16.553786] [INFO ] [REMOTE ] FLG: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:57:16.554108] [INFO ] [REMOTE ] FLG: Fetching primary data for 2024-12. [2025-10-15T18:57:16.670289] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-10-15T18:57:16.672279] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-01. [2025-10-15T18:57:17.284814] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-15T18:57:17.286595] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-02. [2025-10-15T18:57:17.751991] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-15T18:57:17.759689] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-01. [2025-10-15T18:57:17.880788] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-15T18:57:17.882499] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-03. [2025-10-15T18:57:18.184854] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-15T18:57:18.195008] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-01. [2025-10-15T18:57:18.290891] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-15T18:57:18.444230] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-10-15T18:57:18.513964] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-04. [2025-10-15T18:57:19.042455] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-15T18:57:19.225073] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-15T18:57:19.314058] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-05. [2025-10-15T18:57:19.694765] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-15T18:57:19.695773] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-10-15T18:57:20.114043] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-06. [2025-10-15T18:57:20.694723] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-15T18:57:20.913990] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-07. [2025-10-15T18:57:21.393530] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-15T18:57:21.714031] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-08. [2025-10-15T18:57:22.475493] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-15T18:57:22.514052] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-02. [2025-10-15T18:57:23.314058] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-09. [2025-10-15T18:57:23.689720] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-15T18:57:23.951759] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-15T18:57:24.114044] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-10. [2025-10-15T18:57:24.754252] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-15T18:57:24.755335] [INFO ] [REMOTE ] FLC: Full fetch complete (7845 records). [2025-10-15T18:57:24.755406] [DEBUG] [VALIDATOR ] FLC: Validating primary data. [2025-10-15T18:57:24.915720] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-02. [2025-10-15T18:57:25.119875] [DEBUG] [VALIDATOR ] FLC: All expected trading days are present. [2025-10-15T18:57:25.119954] [DEBUG] [VALIDATOR ] FLC: Primary data validation passed. [2025-10-15T18:57:25.120155] [INFO ] [MAIN ] FLC: Fetched primary data is valid. [2025-10-15T18:57:25.120193] [DEBUG] [LOCAL ] FLC: Saving primary data. [2025-10-15T18:57:25.120574] [DEBUG] [LOCAL ] FLC: Trimmed 7845 records to 5420 (keeping 200 days of data) [2025-10-15T18:57:25.153123] [DEBUG] [LOCAL ] FLC: Primary data saved (5420 records). [2025-10-15T18:57:25.153246] [INFO ] [MAIN ] FLC: Full history saved. [2025-10-15T18:57:25.153337] [INFO ] [MAIN ] Update Progress: 841/2369 symbols completed. FLC took 11.7s. Estimated remaining: 3h 33m 12s. Rate: 7.2 symbols/min [2025-10-15T18:57:25.320880] [INFO ] [MAIN ] FLOC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:57:25.321047] [DEBUG] [LOCAL ] FLOC: No existing data file found in primary storage. [2025-10-15T18:57:25.321086] [WARN ] [MAIN ] FLOC: No existing data found, performing full refresh instead. [2025-10-15T18:57:25.321200] [INFO ] [MAIN ] FLOC: Wiping existing primary data before full refresh. [2025-10-15T18:57:25.321242] [INFO ] [LOCAL ] FLOC: Starting deletion of primary data. [2025-10-15T18:57:25.321285] [DEBUG] [LOCAL ] FLOC: No primary data file found to delete. [2025-10-15T18:57:25.321320] [INFO ] [MAIN ] FLOC: Starting full primary refresh. [2025-10-15T18:57:25.679574] [INFO ] [REMOTE ] FLOC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:57:25.713954] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2024-12. [2025-10-15T18:57:25.899938] [DEBUG] [REMOTE ] FLOC: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-15T18:57:25.900187] [WARN ] [REMOTE ] FLOC: No data returned for month 2024-12 [2025-10-15T18:57:25.900288] [FATAL] [REMOTE ] FLOC: API call failed - aborting fetch to avoid wasting further API calls [2025-10-15T18:57:25.900339] [FATAL] [MAIN ] FLOC: Failed to fetch primary data. [2025-10-15T18:57:25.900399] [WARN ] [MAIN ] FLOC: Deleting existing primary and derivative data due to fetch failure. [2025-10-15T18:57:25.900494] [INFO ] [LOCAL ] FLOC: Starting deletion of primary data. [2025-10-15T18:57:25.900562] [DEBUG] [LOCAL ] FLOC: No primary data file found to delete. [2025-10-15T18:57:25.900598] [INFO ] [LOCAL ] FLOC: Starting deletion of derivative data. [2025-10-15T18:57:25.900637] [DEBUG] [LOCAL ] FLOC: No derivative data file found to delete. [2025-10-15T18:57:25.900729] [INFO ] [MAIN ] Update Progress: 842/2369 symbols completed. FLOC took 0.7s. Estimated remaining: 3h 32m 50s. Rate: 7.2 symbols/min [2025-10-15T18:57:26.066210] [INFO ] [MAIN ] FLR: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:57:26.118208] [DEBUG] [LOCAL ] FLR: Loaded 53229 existing records from primary storage. [2025-10-15T18:57:26.118536] [INFO ] [MAIN ] FLR: Loaded 53229 existing records. [2025-10-15T18:57:26.312707] [WARN ] [MAIN ] FLR: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:57:26.313009] [INFO ] [MAIN ] FLR: Wiping existing primary data before full refresh. [2025-10-15T18:57:26.313077] [INFO ] [LOCAL ] FLR: Starting deletion of primary data. [2025-10-15T18:57:26.313590] [DEBUG] [LOCAL ] FLR: Deleted primary data file. [2025-10-15T18:57:26.313760] [INFO ] [MAIN ] FLR: Starting full primary refresh. [2025-10-15T18:57:26.529157] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-03. [2025-10-15T18:57:26.614663] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-15T18:57:26.725794] [INFO ] [REMOTE ] FLR: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:57:27.314027] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-03. [2025-10-15T18:57:28.042999] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-15T18:57:28.113987] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-04. [2025-10-15T18:57:28.914024] [INFO ] [REMOTE ] FLR: Fetching primary data for 2024-12. [2025-10-15T18:57:29.094163] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-15T18:57:29.176863] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-15T18:57:29.714014] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-04. [2025-10-15T18:57:30.514119] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-05. [2025-10-15T18:57:30.576339] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-15T18:57:31.062750] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-15T18:57:31.314041] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-01. [2025-10-15T18:57:31.719355] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-15T18:57:32.114026] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-06. [2025-10-15T18:57:32.919278] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-05. [2025-10-15T18:57:32.945083] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-15T18:57:33.030456] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-15T18:57:33.714007] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-07. [2025-10-15T18:57:34.513993] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-02. [2025-10-15T18:57:34.683267] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-15T18:57:34.815159] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-15T18:57:35.313983] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-08. [2025-10-15T18:57:36.115329] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-01. [2025-10-15T18:57:36.120402] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-15T18:57:36.717039] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-15T18:57:36.913971] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-06. [2025-10-15T18:57:37.622671] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-15T18:57:37.713994] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-03. [2025-10-15T18:57:38.514026] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-09. [2025-10-15T18:57:38.796813] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-15T18:57:39.314117] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-02. [2025-10-15T18:57:39.437349] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-15T18:57:39.954913] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-15T18:57:40.113977] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-07. [2025-10-15T18:57:40.696751] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-15T18:57:40.914031] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-10. [2025-10-15T18:57:41.713969] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-04. [2025-10-15T18:57:41.776320] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-15T18:57:42.233298] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-15T18:57:42.237137] [INFO ] [REMOTE ] FLNG: Full fetch complete (50201 records). [2025-10-15T18:57:42.237216] [DEBUG] [VALIDATOR ] FLNG: Validating primary data. [2025-10-15T18:57:42.519211] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-08. [2025-10-15T18:57:42.628054] [DEBUG] [VALIDATOR ] FLNG: All expected trading days are present. [2025-10-15T18:57:42.628126] [DEBUG] [VALIDATOR ] FLNG: Primary data validation passed. [2025-10-15T18:57:42.628862] [INFO ] [MAIN ] FLNG: Fetched primary data is valid. [2025-10-15T18:57:42.628923] [DEBUG] [LOCAL ] FLNG: Saving primary data. [2025-10-15T18:57:42.629902] [DEBUG] [LOCAL ] FLNG: Trimmed 50201 records to 33712 (keeping 200 days of data) [2025-10-15T18:57:42.828737] [DEBUG] [LOCAL ] FLNG: Primary data saved (33712 records). [2025-10-15T18:57:42.828860] [INFO ] [MAIN ] FLNG: Full history saved. [2025-10-15T18:57:42.828936] [INFO ] [MAIN ] Update Progress: 843/2369 symbols completed. FLNG took 29.4s. Estimated remaining: 3h 32m 57s. Rate: 7.2 symbols/min [2025-10-15T18:57:42.995902] [INFO ] [MAIN ] FLS: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:57:43.038604] [DEBUG] [LOCAL ] FLS: Loaded 50337 existing records from primary storage. [2025-10-15T18:57:43.038945] [INFO ] [MAIN ] FLS: Loaded 50337 existing records. [2025-10-15T18:57:43.240974] [WARN ] [MAIN ] FLS: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:57:43.241345] [INFO ] [MAIN ] FLS: Wiping existing primary data before full refresh. [2025-10-15T18:57:43.241454] [INFO ] [LOCAL ] FLS: Starting deletion of primary data. [2025-10-15T18:57:43.241751] [DEBUG] [LOCAL ] FLS: Deleted primary data file. [2025-10-15T18:57:43.241812] [INFO ] [MAIN ] FLS: Starting full primary refresh. [2025-10-15T18:57:43.316832] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-03. [2025-10-15T18:57:43.430849] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-15T18:57:43.664087] [INFO ] [REMOTE ] FLS: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:57:44.114023] [INFO ] [REMOTE ] FLS: Fetching primary data for 2024-12. [2025-10-15T18:57:44.217185] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-15T18:57:44.914054] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-05. [2025-10-15T18:57:45.118012] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-15T18:57:45.323977] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-15T18:57:45.714018] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-04. [2025-10-15T18:57:46.340332] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-15T18:57:46.514025] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-06. [2025-10-15T18:57:47.239938] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-15T18:57:47.314019] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-05. [2025-10-15T18:57:48.114000] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-09. [2025-10-15T18:57:48.240453] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-15T18:57:48.914035] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-07. [2025-10-15T18:57:49.027458] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-15T18:57:49.637467] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-15T18:57:49.713956] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-10. [2025-10-15T18:57:50.514038] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-01. [2025-10-15T18:57:50.758414] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-15T18:57:51.313969] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-08. [2025-10-15T18:57:51.566267] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-10 (1.85 seconds). [2025-10-15T18:57:51.576252] [INFO ] [REMOTE ] FLO: Full fetch complete (75254 records). [2025-10-15T18:57:51.576452] [DEBUG] [VALIDATOR ] FLO: Validating primary data. [2025-10-15T18:57:51.988002] [DEBUG] [VALIDATOR ] FLO: All expected trading days are present. [2025-10-15T18:57:51.988098] [DEBUG] [VALIDATOR ] FLO: Primary data validation passed. [2025-10-15T18:57:51.989168] [INFO ] [MAIN ] FLO: Fetched primary data is valid. [2025-10-15T18:57:51.989249] [DEBUG] [LOCAL ] FLO: Saving primary data. [2025-10-15T18:57:52.015325] [DEBUG] [LOCAL ] FLO: Trimmed 75254 records to 52082 (keeping 200 days of data) [2025-10-15T18:57:52.017057] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-15T18:57:52.119343] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-02. [2025-10-15T18:57:52.353466] [DEBUG] [LOCAL ] FLO: Primary data saved (52082 records). [2025-10-15T18:57:52.353623] [INFO ] [MAIN ] FLO: Full history saved. [2025-10-15T18:57:52.353744] [INFO ] [MAIN ] Update Progress: 844/2369 symbols completed. FLO took 38.9s. Estimated remaining: 3h 32m 51s. Rate: 7.2 symbols/min [2025-10-15T18:57:52.522906] [INFO ] [MAIN ] FLUT: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:57:52.571167] [DEBUG] [LOCAL ] FLUT: Loaded 50767 existing records from primary storage. [2025-10-15T18:57:52.571463] [INFO ] [MAIN ] FLUT: Loaded 50767 existing records. [2025-10-15T18:57:52.743752] [WARN ] [MAIN ] FLUT: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:57:52.743990] [INFO ] [MAIN ] FLUT: Wiping existing primary data before full refresh. [2025-10-15T18:57:52.744037] [INFO ] [LOCAL ] FLUT: Starting deletion of primary data. [2025-10-15T18:57:52.744386] [DEBUG] [LOCAL ] FLUT: Deleted primary data file. [2025-10-15T18:57:52.744440] [INFO ] [MAIN ] FLUT: Starting full primary refresh. [2025-10-15T18:57:52.915233] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-06. [2025-10-15T18:57:53.092761] [INFO ] [REMOTE ] FLUT: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:57:53.337225] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-10-15T18:57:53.506327] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-15T18:57:53.714036] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-03. [2025-10-15T18:57:54.513997] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-09. [2025-10-15T18:57:54.594373] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-15T18:57:55.314047] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-07. [2025-10-15T18:57:55.402937] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-15T18:57:56.005873] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-15T18:57:56.114002] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-10. [2025-10-15T18:57:56.913965] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-04. [2025-10-15T18:57:57.098782] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-15T18:57:57.714027] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2024-12. [2025-10-15T18:57:57.911725] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-15T18:57:57.918136] [INFO ] [REMOTE ] FLR: Full fetch complete (76779 records). [2025-10-15T18:57:57.918277] [DEBUG] [VALIDATOR ] FLR: Validating primary data. [2025-10-15T18:57:58.312498] [DEBUG] [VALIDATOR ] FLR: All expected trading days are present. [2025-10-15T18:57:58.312580] [DEBUG] [VALIDATOR ] FLR: Primary data validation passed. [2025-10-15T18:57:58.313687] [INFO ] [MAIN ] FLR: Fetched primary data is valid. [2025-10-15T18:57:58.313755] [DEBUG] [LOCAL ] FLR: Saving primary data. [2025-10-15T18:57:58.315215] [DEBUG] [LOCAL ] FLR: Trimmed 76779 records to 53241 (keeping 200 days of data) [2025-10-15T18:57:58.517234] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-08. [2025-10-15T18:57:58.623318] [DEBUG] [LOCAL ] FLR: Primary data saved (53241 records). [2025-10-15T18:57:58.623596] [INFO ] [MAIN ] FLR: Full history saved. [2025-10-15T18:57:58.623822] [INFO ] [MAIN ] Update Progress: 845/2369 symbols completed. FLR took 32.7s. Estimated remaining: 3h 32m 38s. Rate: 7.2 symbols/min [2025-10-15T18:57:58.818244] [INFO ] [MAIN ] FLXR: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:57:58.821046] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-15T18:57:58.851583] [DEBUG] [LOCAL ] FLXR: Loaded 20956 existing records from primary storage. [2025-10-15T18:57:58.851847] [INFO ] [MAIN ] FLXR: Loaded 20956 existing records. [2025-10-15T18:57:59.029785] [WARN ] [MAIN ] FLXR: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:57:59.030202] [INFO ] [MAIN ] FLXR: Wiping existing primary data before full refresh. [2025-10-15T18:57:59.030355] [INFO ] [LOCAL ] FLXR: Starting deletion of primary data. [2025-10-15T18:57:59.030679] [DEBUG] [LOCAL ] FLXR: Deleted primary data file. [2025-10-15T18:57:59.030737] [INFO ] [MAIN ] FLXR: Starting full primary refresh. [2025-10-15T18:57:59.334699] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-05. [2025-10-15T18:57:59.400173] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-15T18:57:59.436389] [INFO ] [REMOTE ] FLXR: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:57:59.929406] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-15T18:58:00.114042] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-09. [2025-10-15T18:58:00.592721] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-15T18:58:00.914010] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-06. [2025-10-15T18:58:01.562227] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-15T18:58:01.714048] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-01. [2025-10-15T18:58:02.265524] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-15T18:58:02.514071] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-07. [2025-10-15T18:58:03.011326] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-15T18:58:03.314006] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-02. [2025-10-15T18:58:04.114043] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-10. [2025-10-15T18:58:04.315804] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-15T18:58:04.914037] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-08. [2025-10-15T18:58:04.966778] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-15T18:58:05.713969] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-03. [2025-10-15T18:58:05.862606] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-15T18:58:05.868924] [INFO ] [REMOTE ] FLG: Full fetch complete (77431 records). [2025-10-15T18:58:05.869027] [DEBUG] [VALIDATOR ] FLG: Validating primary data. [2025-10-15T18:58:06.266047] [DEBUG] [VALIDATOR ] FLG: All expected trading days are present. [2025-10-15T18:58:06.266144] [DEBUG] [VALIDATOR ] FLG: Primary data validation passed. [2025-10-15T18:58:06.267966] [INFO ] [MAIN ] FLG: Fetched primary data is valid. [2025-10-15T18:58:06.268034] [DEBUG] [LOCAL ] FLG: Saving primary data. [2025-10-15T18:58:06.269621] [DEBUG] [LOCAL ] FLG: Trimmed 77431 records to 53327 (keeping 200 days of data) [2025-10-15T18:58:06.514016] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2024-12. [2025-10-15T18:58:06.601241] [DEBUG] [LOCAL ] FLG: Primary data saved (53327 records). [2025-10-15T18:58:06.601530] [INFO ] [MAIN ] FLG: Full history saved. [2025-10-15T18:58:06.601670] [INFO ] [MAIN ] Update Progress: 846/2369 symbols completed. FLG took 53.2s. Estimated remaining: 3h 32m 29s. Rate: 7.2 symbols/min [2025-10-15T18:58:06.735190] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-15T18:58:06.824971] [INFO ] [MAIN ] FMC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:58:06.873557] [DEBUG] [LOCAL ] FMC: Loaded 51832 existing records from primary storage. [2025-10-15T18:58:06.873921] [INFO ] [MAIN ] FMC: Loaded 51832 existing records. [2025-10-15T18:58:07.055215] [WARN ] [MAIN ] FMC: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:58:07.055559] [INFO ] [MAIN ] FMC: Wiping existing primary data before full refresh. [2025-10-15T18:58:07.055699] [INFO ] [LOCAL ] FMC: Starting deletion of primary data. [2025-10-15T18:58:07.056102] [DEBUG] [LOCAL ] FMC: Deleted primary data file. [2025-10-15T18:58:07.056157] [INFO ] [MAIN ] FMC: Starting full primary refresh. [2025-10-15T18:58:07.172577] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-10-15T18:58:07.320998] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-09. [2025-10-15T18:58:07.426284] [INFO ] [REMOTE ] FMC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:58:07.505633] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-15T18:58:08.114007] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-01. [2025-10-15T18:58:08.866734] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-15T18:58:08.913976] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-02. [2025-10-15T18:58:09.094440] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-15T18:58:09.414720] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-10-15T18:58:09.713992] [INFO ] [REMOTE ] FMC: Fetching primary data for 2024-12. [2025-10-15T18:58:10.514015] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-10. [2025-10-15T18:58:11.313974] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-04. [2025-10-15T18:58:11.393484] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-15T18:58:12.114054] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-03. [2025-10-15T18:58:12.763467] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-10 (2.25 seconds). [2025-10-15T18:58:12.774609] [INFO ] [REMOTE ] FLS: Full fetch complete (72308 records). [2025-10-15T18:58:12.774881] [DEBUG] [VALIDATOR ] FLS: Validating primary data. [2025-10-15T18:58:12.930105] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-01. [2025-10-15T18:58:13.142933] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-15T18:58:13.235580] [DEBUG] [VALIDATOR ] FLS: All expected trading days are present. [2025-10-15T18:58:13.235774] [DEBUG] [VALIDATOR ] FLS: Primary data validation passed. [2025-10-15T18:58:13.236746] [INFO ] [MAIN ] FLS: Fetched primary data is valid. [2025-10-15T18:58:13.236879] [DEBUG] [LOCAL ] FLS: Saving primary data. [2025-10-15T18:58:13.238337] [DEBUG] [LOCAL ] FLS: Trimmed 72308 records to 50373 (keeping 200 days of data) [2025-10-15T18:58:13.370630] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-10-15T18:58:13.579086] [DEBUG] [LOCAL ] FLS: Primary data saved (50373 records). [2025-10-15T18:58:13.579215] [INFO ] [MAIN ] FLS: Full history saved. [2025-10-15T18:58:13.579294] [INFO ] [MAIN ] Update Progress: 847/2369 symbols completed. FLS took 30.8s. Estimated remaining: 3h 32m 19s. Rate: 7.2 symbols/min [2025-10-15T18:58:13.722402] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-05. [2025-10-15T18:58:13.748412] [INFO ] [MAIN ] FMN: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:58:13.756730] [DEBUG] [LOCAL ] FMN: Loaded 5384 existing records from primary storage. [2025-10-15T18:58:13.756926] [INFO ] [MAIN ] FMN: Loaded 5384 existing records. [2025-10-15T18:58:13.929091] [WARN ] [MAIN ] FMN: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:58:13.929284] [INFO ] [MAIN ] FMN: Wiping existing primary data before full refresh. [2025-10-15T18:58:13.929334] [INFO ] [LOCAL ] FMN: Starting deletion of primary data. [2025-10-15T18:58:13.929469] [DEBUG] [LOCAL ] FMN: Deleted primary data file. [2025-10-15T18:58:13.929506] [INFO ] [MAIN ] FMN: Starting full primary refresh. [2025-10-15T18:58:14.277774] [INFO ] [REMOTE ] FMN: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:58:14.513969] [INFO ] [REMOTE ] FMN: Fetching primary data for 2024-12. [2025-10-15T18:58:14.613058] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-15T18:58:15.251354] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-10-15T18:58:15.313964] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-01. [2025-10-15T18:58:15.578238] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-15T18:58:16.102520] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-15T18:58:16.113948] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-02. [2025-10-15T18:58:16.701339] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-15T18:58:16.914022] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-06. [2025-10-15T18:58:17.714021] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-02. [2025-10-15T18:58:18.300591] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-15T18:58:18.514008] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-04. [2025-10-15T18:58:19.314009] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-07. [2025-10-15T18:58:19.652603] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-10-15T18:58:19.702922] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-15T18:58:20.114020] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-03. [2025-10-15T18:58:20.759607] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-15T18:58:20.913972] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-05. [2025-10-15T18:58:21.248249] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-15T18:58:21.713978] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-08. [2025-10-15T18:58:21.947261] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-15T18:58:22.513994] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-06. [2025-10-15T18:58:23.313972] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-03. [2025-10-15T18:58:23.517440] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-15T18:58:23.713873] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-10-15T18:58:24.113970] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-07. [2025-10-15T18:58:24.796151] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-10-15T18:58:24.834228] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-15T18:58:24.913967] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-08. [2025-10-15T18:58:25.714004] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-09. [2025-10-15T18:58:26.004760] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-15T18:58:26.514029] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-04. [2025-10-15T18:58:27.313972] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-09. [2025-10-15T18:58:27.364354] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-15T18:58:28.113970] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-04. [2025-10-15T18:58:28.357897] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-15T18:58:28.357225] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-15T18:58:28.588265] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-10-15T18:58:28.913988] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-05. [2025-10-15T18:58:29.714001] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-10. [2025-10-15T18:58:30.514026] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-10. [2025-10-15T18:58:30.680032] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-15T18:58:30.890895] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-15T18:58:30.894877] [INFO ] [REMOTE ] FLXR: Full fetch complete (26806 records). [2025-10-15T18:58:30.895010] [DEBUG] [VALIDATOR ] FLXR: Validating primary data. [2025-10-15T18:58:31.269446] [DEBUG] [VALIDATOR ] FLXR: All expected trading days are present. [2025-10-15T18:58:31.269520] [DEBUG] [VALIDATOR ] FLXR: Primary data validation passed. [2025-10-15T18:58:31.270150] [INFO ] [MAIN ] FLXR: Fetched primary data is valid. [2025-10-15T18:58:31.270212] [DEBUG] [LOCAL ] FLXR: Saving primary data. [2025-10-15T18:58:31.270958] [DEBUG] [LOCAL ] FLXR: Trimmed 26806 records to 21029 (keeping 200 days of data) [2025-10-15T18:58:31.322632] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-06. [2025-10-15T18:58:31.399600] [DEBUG] [LOCAL ] FLXR: Primary data saved (21029 records). [2025-10-15T18:58:31.399746] [INFO ] [MAIN ] FLXR: Full history saved. [2025-10-15T18:58:31.399829] [INFO ] [MAIN ] Update Progress: 848/2369 symbols completed. FLXR took 32.8s. Estimated remaining: 3h 32m 27s. Rate: 7.2 symbols/min [2025-10-15T18:58:31.573697] [INFO ] [MAIN ] FMS: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:58:31.605401] [DEBUG] [LOCAL ] FMS: Loaded 30222 existing records from primary storage. [2025-10-15T18:58:31.605674] [INFO ] [MAIN ] FMS: Loaded 30222 existing records. [2025-10-15T18:58:31.783044] [WARN ] [MAIN ] FMS: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:58:31.783295] [INFO ] [MAIN ] FMS: Wiping existing primary data before full refresh. [2025-10-15T18:58:31.783341] [INFO ] [LOCAL ] FMS: Starting deletion of primary data. [2025-10-15T18:58:31.783786] [DEBUG] [LOCAL ] FMS: Deleted primary data file. [2025-10-15T18:58:31.783842] [INFO ] [MAIN ] FMS: Starting full primary refresh. [2025-10-15T18:58:32.130151] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-05. [2025-10-15T18:58:32.160053] [INFO ] [REMOTE ] FMS: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:58:32.294299] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-15T18:58:32.300735] [INFO ] [REMOTE ] FLUT: Full fetch complete (73277 records). [2025-10-15T18:58:32.300867] [DEBUG] [VALIDATOR ] FLUT: Validating primary data. [2025-10-15T18:58:32.598353] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-15T18:58:32.694139] [DEBUG] [VALIDATOR ] FLUT: All expected trading days are present. [2025-10-15T18:58:32.694377] [DEBUG] [VALIDATOR ] FLUT: Primary data validation passed. [2025-10-15T18:58:32.695452] [INFO ] [MAIN ] FLUT: Fetched primary data is valid. [2025-10-15T18:58:32.695540] [DEBUG] [LOCAL ] FLUT: Saving primary data. [2025-10-15T18:58:32.697478] [DEBUG] [LOCAL ] FLUT: Trimmed 73277 records to 50758 (keeping 200 days of data) [2025-10-15T18:58:32.816198] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-15T18:58:32.921715] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-06. [2025-10-15T18:58:33.058920] [DEBUG] [LOCAL ] FLUT: Primary data saved (50758 records). [2025-10-15T18:58:33.059068] [INFO ] [MAIN ] FLUT: Full history saved. [2025-10-15T18:58:33.059936] [INFO ] [MAIN ] Update Progress: 849/2369 symbols completed. FLUT took 40.7s. Estimated remaining: 3h 32m 7s. Rate: 7.2 symbols/min [2025-10-15T18:58:33.246291] [INFO ] [MAIN ] FMX: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:58:33.293909] [DEBUG] [LOCAL ] FMX: Loaded 40494 existing records from primary storage. [2025-10-15T18:58:33.294253] [INFO ] [MAIN ] FMX: Loaded 40494 existing records. [2025-10-15T18:58:33.499221] [WARN ] [MAIN ] FMX: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:58:33.499423] [INFO ] [MAIN ] FMX: Wiping existing primary data before full refresh. [2025-10-15T18:58:33.499472] [INFO ] [LOCAL ] FMX: Starting deletion of primary data. [2025-10-15T18:58:33.500115] [DEBUG] [LOCAL ] FMX: Deleted primary data file. [2025-10-15T18:58:33.500171] [INFO ] [MAIN ] FMX: Starting full primary refresh. [2025-10-15T18:58:33.623728] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-15T18:58:33.719531] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-07. [2025-10-15T18:58:33.924374] [INFO ] [REMOTE ] FMX: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:58:34.514016] [INFO ] [REMOTE ] FMX: Fetching primary data for 2024-12. [2025-10-15T18:58:35.313997] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-07. [2025-10-15T18:58:35.500069] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-15T18:58:35.832972] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-15T18:58:35.936470] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-15T18:58:36.114001] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-08. [2025-10-15T18:58:36.912357] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-15T18:58:36.914439] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-09. [2025-10-15T18:58:37.504462] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-15T18:58:37.713977] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-10. [2025-10-15T18:58:38.514057] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-08. [2025-10-15T18:58:38.636772] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-15T18:58:38.638332] [INFO ] [REMOTE ] FMN: Full fetch complete (10137 records). [2025-10-15T18:58:38.638410] [DEBUG] [VALIDATOR ] FMN: Validating primary data. [2025-10-15T18:58:38.996029] [DEBUG] [VALIDATOR ] FMN: All expected trading days are present. [2025-10-15T18:58:38.996177] [DEBUG] [VALIDATOR ] FMN: Primary data validation passed. [2025-10-15T18:58:38.996441] [INFO ] [MAIN ] FMN: Fetched primary data is valid. [2025-10-15T18:58:38.996485] [DEBUG] [LOCAL ] FMN: Saving primary data. [2025-10-15T18:58:38.996944] [DEBUG] [LOCAL ] FMN: Trimmed 10137 records to 5431 (keeping 200 days of data) [2025-10-15T18:58:39.029856] [DEBUG] [LOCAL ] FMN: Primary data saved (5431 records). [2025-10-15T18:58:39.029979] [INFO ] [MAIN ] FMN: Full history saved. [2025-10-15T18:58:39.030060] [INFO ] [MAIN ] Update Progress: 850/2369 symbols completed. FMN took 25.5s. Estimated remaining: 3h 31m 54s. Rate: 7.2 symbols/min [2025-10-15T18:58:39.222802] [INFO ] [MAIN ] FMY: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:58:39.226296] [DEBUG] [LOCAL ] FMY: Loaded 1390 existing records from primary storage. [2025-10-15T18:58:39.226434] [INFO ] [MAIN ] FMY: Loaded 1390 existing records. [2025-10-15T18:58:39.321185] [INFO ] [REMOTE ] FMS: Fetching primary data for 2024-12. [2025-10-15T18:58:39.404963] [WARN ] [MAIN ] FMY: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:58:39.405217] [INFO ] [MAIN ] FMY: Wiping existing primary data before full refresh. [2025-10-15T18:58:39.405266] [INFO ] [LOCAL ] FMY: Starting deletion of primary data. [2025-10-15T18:58:39.405431] [DEBUG] [LOCAL ] FMY: Deleted primary data file. [2025-10-15T18:58:39.405487] [INFO ] [MAIN ] FMY: Starting full primary refresh. [2025-10-15T18:58:39.753274] [INFO ] [REMOTE ] FMY: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:58:40.113983] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-01. [2025-10-15T18:58:40.224896] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-15T18:58:40.279708] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-10-15T18:58:40.914015] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-09. [2025-10-15T18:58:41.469839] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-15T18:58:41.714063] [INFO ] [REMOTE ] FMY: Fetching primary data for 2024-12. [2025-10-15T18:58:42.032844] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2024-12 (0.32 seconds). [2025-10-15T18:58:42.514048] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-01. [2025-10-15T18:58:42.700747] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-15T18:58:43.314053] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-02. [2025-10-15T18:58:43.653849] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-15T18:58:44.113986] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-01. [2025-10-15T18:58:44.478839] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-01 (0.36 seconds). [2025-10-15T18:58:44.749614] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-15T18:58:44.914019] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-03. [2025-10-15T18:58:45.714044] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-02. [2025-10-15T18:58:46.162131] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-15T18:58:46.453157] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-15T18:58:46.513966] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-04. [2025-10-15T18:58:47.314040] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-03. [2025-10-15T18:58:47.675364] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-10-15T18:58:48.013627] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-15T18:58:48.113972] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-04. [2025-10-15T18:58:48.547612] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-10-15T18:58:48.914056] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-05. [2025-10-15T18:58:49.263610] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-10-15T18:58:49.713998] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-06. [2025-10-15T18:58:50.076333] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-10-15T18:58:50.514018] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-07. [2025-10-15T18:58:51.009547] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-10-15T18:58:51.313984] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-05. [2025-10-15T18:58:52.114026] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-10. [2025-10-15T18:58:52.731597] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-15T18:58:52.914017] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-02. [2025-10-15T18:58:53.703358] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-15T18:58:53.713947] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-03. [2025-10-15T18:58:53.868982] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-15T18:58:53.875518] [INFO ] [REMOTE ] FMC: Full fetch complete (75348 records). [2025-10-15T18:58:53.875636] [DEBUG] [VALIDATOR ] FMC: Validating primary data. [2025-10-15T18:58:54.288660] [DEBUG] [VALIDATOR ] FMC: All expected trading days are present. [2025-10-15T18:58:54.288762] [DEBUG] [VALIDATOR ] FMC: Primary data validation passed. [2025-10-15T18:58:54.289985] [INFO ] [MAIN ] FMC: Fetched primary data is valid. [2025-10-15T18:58:54.290051] [DEBUG] [LOCAL ] FMC: Saving primary data. [2025-10-15T18:58:54.291818] [DEBUG] [LOCAL ] FMC: Trimmed 75348 records to 51849 (keeping 200 days of data) [2025-10-15T18:58:54.519251] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-06. [2025-10-15T18:58:54.610359] [DEBUG] [LOCAL ] FMC: Primary data saved (51849 records). [2025-10-15T18:58:54.610493] [INFO ] [MAIN ] FMC: Full history saved. [2025-10-15T18:58:54.610964] [INFO ] [MAIN ] Update Progress: 851/2369 symbols completed. FMC took 48.0s. Estimated remaining: 3h 31m 59s. Rate: 7.2 symbols/min [2025-10-15T18:58:54.777621] [INFO ] [MAIN ] FN: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:58:54.815139] [DEBUG] [LOCAL ] FN: Loaded 37848 existing records from primary storage. [2025-10-15T18:58:54.815428] [INFO ] [MAIN ] FN: Loaded 37848 existing records. [2025-10-15T18:58:54.990529] [WARN ] [MAIN ] FN: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:58:54.990846] [INFO ] [MAIN ] FN: Wiping existing primary data before full refresh. [2025-10-15T18:58:54.990925] [INFO ] [LOCAL ] FN: Starting deletion of primary data. [2025-10-15T18:58:54.999492] [DEBUG] [LOCAL ] FN: Deleted primary data file. [2025-10-15T18:58:54.999595] [INFO ] [MAIN ] FN: Starting full primary refresh. [2025-10-15T18:58:55.096362] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-15T18:58:55.319157] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-08. [2025-10-15T18:58:55.371471] [INFO ] [REMOTE ] FN: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:58:55.805791] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-10-15T18:58:55.899083] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-15T18:58:56.113997] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-04. [2025-10-15T18:58:56.913996] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-09. [2025-10-15T18:58:57.363178] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-10-15T18:58:57.649552] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-15T18:58:57.713979] [INFO ] [REMOTE ] FN: Fetching primary data for 2024-12. [2025-10-15T18:58:58.513989] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-10. [2025-10-15T18:58:58.902686] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-10 (0.39 seconds). [2025-10-15T18:58:58.903401] [INFO ] [REMOTE ] FMY: Full fetch complete (1967 records). [2025-10-15T18:58:58.903469] [DEBUG] [VALIDATOR ] FMY: Validating primary data. [2025-10-15T18:58:59.259718] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-15T18:58:59.296473] [DEBUG] [VALIDATOR ] FMY: All expected trading days are present. [2025-10-15T18:58:59.296543] [DEBUG] [VALIDATOR ] FMY: Primary data validation passed. [2025-10-15T18:58:59.296666] [INFO ] [MAIN ] FMY: Fetched primary data is valid. [2025-10-15T18:58:59.296727] [DEBUG] [LOCAL ] FMY: Saving primary data. [2025-10-15T18:58:59.297053] [DEBUG] [LOCAL ] FMY: Trimmed 1967 records to 1388 (keeping 200 days of data) [2025-10-15T18:58:59.305802] [DEBUG] [LOCAL ] FMY: Primary data saved (1388 records). [2025-10-15T18:58:59.305870] [INFO ] [MAIN ] FMY: Full history saved. [2025-10-15T18:58:59.305945] [INFO ] [MAIN ] Update Progress: 852/2369 symbols completed. FMY took 20.3s. Estimated remaining: 3h 31m 44s. Rate: 7.2 symbols/min [2025-10-15T18:58:59.319134] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-05. [2025-10-15T18:58:59.476783] [INFO ] [MAIN ] FNB: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:58:59.526854] [DEBUG] [LOCAL ] FNB: Loaded 52591 existing records from primary storage. [2025-10-15T18:58:59.527178] [INFO ] [MAIN ] FNB: Loaded 52591 existing records. [2025-10-15T18:58:59.703917] [WARN ] [MAIN ] FNB: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:58:59.704164] [INFO ] [MAIN ] FNB: Wiping existing primary data before full refresh. [2025-10-15T18:58:59.704223] [INFO ] [LOCAL ] FNB: Starting deletion of primary data. [2025-10-15T18:58:59.704597] [DEBUG] [LOCAL ] FNB: Deleted primary data file. [2025-10-15T18:58:59.704709] [INFO ] [MAIN ] FNB: Starting full primary refresh. [2025-10-15T18:59:00.049411] [INFO ] [REMOTE ] FNB: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:59:00.113956] [INFO ] [REMOTE ] FNB: Fetching primary data for 2024-12. [2025-10-15T18:59:00.886981] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-15T18:59:00.913967] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-06. [2025-10-15T18:59:01.376503] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-15T18:59:01.713976] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-07. [2025-10-15T18:59:02.267385] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-15T18:59:02.514047] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-01. [2025-10-15T18:59:03.000204] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-15T18:59:03.314040] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-01. [2025-10-15T18:59:03.819332] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-15T18:59:04.114051] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-02. [2025-10-15T18:59:04.914046] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-08. [2025-10-15T18:59:05.079707] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-15T18:59:05.666822] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-15T18:59:05.714033] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-03. [2025-10-15T18:59:06.241197] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-15T18:59:06.513997] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-09. [2025-10-15T18:59:06.962382] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-15T18:59:07.313989] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-02. [2025-10-15T18:59:07.823109] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-15T18:59:08.114025] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-10. [2025-10-15T18:59:08.919432] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-07. [2025-10-15T18:59:08.925677] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-15T18:59:09.518153] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-15T18:59:09.522557] [INFO ] [REMOTE ] FMX: Full fetch complete (57807 records). [2025-10-15T18:59:09.522680] [DEBUG] [VALIDATOR ] FMX: Validating primary data. [2025-10-15T18:59:09.719121] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-04. [2025-10-15T18:59:09.915385] [DEBUG] [VALIDATOR ] FMX: All expected trading days are present. [2025-10-15T18:59:09.915538] [DEBUG] [VALIDATOR ] FMX: Primary data validation passed. [2025-10-15T18:59:09.916400] [INFO ] [MAIN ] FMX: Fetched primary data is valid. [2025-10-15T18:59:09.916547] [DEBUG] [LOCAL ] FMX: Saving primary data. [2025-10-15T18:59:09.932916] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-15T18:59:09.938838] [DEBUG] [LOCAL ] FMX: Trimmed 57807 records to 40547 (keeping 200 days of data) [2025-10-15T18:59:10.180635] [DEBUG] [LOCAL ] FMX: Primary data saved (40547 records). [2025-10-15T18:59:10.180787] [INFO ] [MAIN ] FMX: Full history saved. [2025-10-15T18:59:10.180895] [INFO ] [MAIN ] Update Progress: 853/2369 symbols completed. FMX took 37.1s. Estimated remaining: 3h 31m 40s. Rate: 7.2 symbols/min [2025-10-15T18:59:10.344880] [INFO ] [MAIN ] FND: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:59:10.393706] [DEBUG] [LOCAL ] FND: Loaded 52153 existing records from primary storage. [2025-10-15T18:59:10.394074] [INFO ] [MAIN ] FND: Loaded 52153 existing records. [2025-10-15T18:59:10.527617] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-03. [2025-10-15T18:59:10.571754] [WARN ] [MAIN ] FND: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:59:10.571942] [INFO ] [MAIN ] FND: Wiping existing primary data before full refresh. [2025-10-15T18:59:10.572016] [INFO ] [LOCAL ] FND: Starting deletion of primary data. [2025-10-15T18:59:10.572431] [DEBUG] [LOCAL ] FND: Deleted primary data file. [2025-10-15T18:59:10.572486] [INFO ] [MAIN ] FND: Starting full primary refresh. [2025-10-15T18:59:10.914484] [INFO ] [REMOTE ] FND: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:59:11.313974] [INFO ] [REMOTE ] FND: Fetching primary data for 2024-12. [2025-10-15T18:59:11.454292] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-15T18:59:12.043355] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-15T18:59:12.113982] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-04. [2025-10-15T18:59:12.914000] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-05. [2025-10-15T18:59:13.017926] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-15T18:59:13.676726] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-15T18:59:13.713949] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-05. [2025-10-15T18:59:14.519125] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-08. [2025-10-15T18:59:14.523487] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-15T18:59:15.313971] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-01. [2025-10-15T18:59:15.455874] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-15T18:59:15.495030] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-15T18:59:16.114025] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-06. [2025-10-15T18:59:16.618540] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-15T18:59:16.914035] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-02. [2025-10-15T18:59:17.572112] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-15T18:59:17.713951] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-07. [2025-10-15T18:59:18.514065] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-09. [2025-10-15T18:59:18.603614] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-15T18:59:19.096249] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-15T18:59:19.313989] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-03. [2025-10-15T18:59:19.719497] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-15T18:59:20.114010] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-08. [2025-10-15T18:59:20.913989] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-10. [2025-10-15T18:59:21.114593] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-15T18:59:21.669889] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-15T18:59:21.714028] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-04. [2025-10-15T18:59:22.257037] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-15T18:59:22.260957] [INFO ] [REMOTE ] FMS: Full fetch complete (42602 records). [2025-10-15T18:59:22.261044] [DEBUG] [VALIDATOR ] FMS: Validating primary data. [2025-10-15T18:59:22.522849] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-09. [2025-10-15T18:59:22.648801] [DEBUG] [VALIDATOR ] FMS: All expected trading days are present. [2025-10-15T18:59:22.648903] [DEBUG] [VALIDATOR ] FMS: Primary data validation passed. [2025-10-15T18:59:22.649770] [INFO ] [MAIN ] FMS: Fetched primary data is valid. [2025-10-15T18:59:22.649835] [DEBUG] [LOCAL ] FMS: Saving primary data. [2025-10-15T18:59:22.650971] [DEBUG] [LOCAL ] FMS: Trimmed 42602 records to 30232 (keeping 200 days of data) [2025-10-15T18:59:22.838303] [DEBUG] [LOCAL ] FMS: Primary data saved (30232 records). [2025-10-15T18:59:22.838451] [INFO ] [MAIN ] FMS: Full history saved. [2025-10-15T18:59:22.838537] [INFO ] [MAIN ] Update Progress: 854/2369 symbols completed. FMS took 51.4s. Estimated remaining: 3h 31m 39s. Rate: 7.2 symbols/min [2025-10-15T18:59:23.016369] [INFO ] [MAIN ] FNF: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:59:23.063849] [DEBUG] [LOCAL ] FNF: Loaded 48980 existing records from primary storage. [2025-10-15T18:59:23.064329] [INFO ] [MAIN ] FNF: Loaded 48980 existing records. [2025-10-15T18:59:23.245099] [WARN ] [MAIN ] FNF: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:59:23.245558] [INFO ] [MAIN ] FNF: Wiping existing primary data before full refresh. [2025-10-15T18:59:23.245722] [INFO ] [LOCAL ] FNF: Starting deletion of primary data. [2025-10-15T18:59:23.246292] [DEBUG] [LOCAL ] FNF: Deleted primary data file. [2025-10-15T18:59:23.246407] [INFO ] [MAIN ] FNF: Starting full primary refresh. [2025-10-15T18:59:23.314686] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-06. [2025-10-15T18:59:23.587277] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-15T18:59:23.651837] [INFO ] [REMOTE ] FNF: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:59:24.119110] [INFO ] [REMOTE ] FNF: Fetching primary data for 2024-12. [2025-10-15T18:59:24.131163] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-15T18:59:24.913975] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-10. [2025-10-15T18:59:24.989237] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-15T18:59:25.625023] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-15T18:59:25.713954] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-01. [2025-10-15T18:59:26.008702] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-15T18:59:26.012542] [INFO ] [REMOTE ] FN: Full fetch complete (56075 records). [2025-10-15T18:59:26.012691] [DEBUG] [VALIDATOR ] FN: Validating primary data. [2025-10-15T18:59:26.406815] [DEBUG] [VALIDATOR ] FN: All expected trading days are present. [2025-10-15T18:59:26.406906] [DEBUG] [VALIDATOR ] FN: Primary data validation passed. [2025-10-15T18:59:26.407829] [INFO ] [MAIN ] FN: Fetched primary data is valid. [2025-10-15T18:59:26.407896] [DEBUG] [LOCAL ] FN: Saving primary data. [2025-10-15T18:59:26.409165] [DEBUG] [LOCAL ] FN: Trimmed 56075 records to 37711 (keeping 200 days of data) [2025-10-15T18:59:26.514012] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-07. [2025-10-15T18:59:26.636372] [DEBUG] [LOCAL ] FN: Primary data saved (37711 records). [2025-10-15T18:59:26.636521] [INFO ] [MAIN ] FN: Full history saved. [2025-10-15T18:59:26.636840] [INFO ] [MAIN ] Update Progress: 855/2369 symbols completed. FN took 32.0s. Estimated remaining: 3h 31m 22s. Rate: 7.2 symbols/min [2025-10-15T18:59:26.810766] [INFO ] [MAIN ] FNV: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:59:26.857923] [DEBUG] [LOCAL ] FNV: Loaded 46127 existing records from primary storage. [2025-10-15T18:59:26.858275] [INFO ] [MAIN ] FNV: Loaded 46127 existing records. [2025-10-15T18:59:27.042847] [WARN ] [MAIN ] FNV: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:59:27.043120] [INFO ] [MAIN ] FNV: Wiping existing primary data before full refresh. [2025-10-15T18:59:27.043199] [INFO ] [LOCAL ] FNV: Starting deletion of primary data. [2025-10-15T18:59:27.043693] [DEBUG] [LOCAL ] FNV: Deleted primary data file. [2025-10-15T18:59:27.043799] [INFO ] [MAIN ] FNV: Starting full primary refresh. [2025-10-15T18:59:27.168040] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-15T18:59:27.319074] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-05. [2025-10-15T18:59:27.435134] [INFO ] [REMOTE ] FNV: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:59:28.114026] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-02. [2025-10-15T18:59:28.237829] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-15T18:59:28.695725] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-15T18:59:28.913999] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-08. [2025-10-15T18:59:29.672622] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-15T18:59:29.713960] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-03. [2025-10-15T18:59:30.514003] [INFO ] [REMOTE ] FNV: Fetching primary data for 2024-12. [2025-10-15T18:59:30.625836] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-15T18:59:31.313994] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-09. [2025-10-15T18:59:31.388183] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-15T18:59:31.996522] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-15T18:59:32.114000] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-01. [2025-10-15T18:59:32.883442] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-15T18:59:32.913973] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-10. [2025-10-15T18:59:33.236944] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-15T18:59:33.714034] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-04. [2025-10-15T18:59:34.514009] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-02. [2025-10-15T18:59:34.627061] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-15T18:59:34.634148] [INFO ] [REMOTE ] FNB: Full fetch complete (76128 records). [2025-10-15T18:59:34.634321] [DEBUG] [VALIDATOR ] FNB: Validating primary data. [2025-10-15T18:59:35.043339] [DEBUG] [VALIDATOR ] FNB: All expected trading days are present. [2025-10-15T18:59:35.043460] [DEBUG] [VALIDATOR ] FNB: Primary data validation passed. [2025-10-15T18:59:35.045226] [INFO ] [MAIN ] FNB: Fetched primary data is valid. [2025-10-15T18:59:35.045474] [DEBUG] [LOCAL ] FNB: Saving primary data. [2025-10-15T18:59:35.047579] [DEBUG] [LOCAL ] FNB: Trimmed 76128 records to 52596 (keeping 200 days of data) [2025-10-15T18:59:35.356574] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-06. [2025-10-15T18:59:35.408310] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-15T18:59:35.443737] [DEBUG] [LOCAL ] FNB: Primary data saved (52596 records). [2025-10-15T18:59:35.443970] [INFO ] [MAIN ] FNB: Full history saved. [2025-10-15T18:59:35.444118] [INFO ] [MAIN ] Update Progress: 856/2369 symbols completed. FNB took 36.1s. Estimated remaining: 3h 31m 15s. Rate: 7.2 symbols/min [2025-10-15T18:59:35.625461] [INFO ] [MAIN ] FOA: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:59:35.641358] [DEBUG] [LOCAL ] FOA: Loaded 13105 existing records from primary storage. [2025-10-15T18:59:35.641737] [INFO ] [MAIN ] FOA: Loaded 13105 existing records. [2025-10-15T18:59:35.825114] [WARN ] [MAIN ] FOA: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:59:35.825390] [INFO ] [MAIN ] FOA: Wiping existing primary data before full refresh. [2025-10-15T18:59:35.825477] [INFO ] [LOCAL ] FOA: Starting deletion of primary data. [2025-10-15T18:59:35.825771] [DEBUG] [LOCAL ] FOA: Deleted primary data file. [2025-10-15T18:59:35.825829] [INFO ] [MAIN ] FOA: Starting full primary refresh. [2025-10-15T18:59:36.115807] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-05. [2025-10-15T18:59:36.218478] [INFO ] [REMOTE ] FOA: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:59:36.242871] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-15T18:59:36.914014] [INFO ] [REMOTE ] FOA: Fetching primary data for 2024-12. [2025-10-15T18:59:36.952094] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-15T18:59:37.713993] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-07. [2025-10-15T18:59:37.776123] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-10-15T18:59:37.885597] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-15T18:59:38.514042] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-06. [2025-10-15T18:59:39.314028] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-03. [2025-10-15T18:59:39.429457] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-15T18:59:39.701483] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-15T18:59:40.114019] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-08. [2025-10-15T18:59:40.914041] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-07. [2025-10-15T18:59:41.035236] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-15T18:59:41.422123] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-15T18:59:41.714046] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-04. [2025-10-15T18:59:42.193324] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-15T18:59:42.514006] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-01. [2025-10-15T18:59:43.271362] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-15T18:59:43.313975] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-08. [2025-10-15T18:59:43.520948] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-15T18:59:44.114014] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-09. [2025-10-15T18:59:44.862817] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-15T18:59:44.914041] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-02. [2025-10-15T18:59:45.714011] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-05. [2025-10-15T18:59:45.833886] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-15T18:59:45.859105] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-15T18:59:46.514056] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-10. [2025-10-15T18:59:47.121963] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-15T18:59:47.314072] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-06. [2025-10-15T18:59:48.113984] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-09. [2025-10-15T18:59:48.277367] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-15T18:59:48.284625] [INFO ] [REMOTE ] FND: Full fetch complete (74976 records). [2025-10-15T18:59:48.284882] [DEBUG] [VALIDATOR ] FND: Validating primary data. [2025-10-15T18:59:48.713619] [DEBUG] [VALIDATOR ] FND: All expected trading days are present. [2025-10-15T18:59:48.713804] [DEBUG] [VALIDATOR ] FND: Primary data validation passed. [2025-10-15T18:59:48.715299] [INFO ] [MAIN ] FND: Fetched primary data is valid. [2025-10-15T18:59:48.715385] [DEBUG] [LOCAL ] FND: Saving primary data. [2025-10-15T18:59:48.745928] [DEBUG] [LOCAL ] FND: Trimmed 74976 records to 52150 (keeping 200 days of data) [2025-10-15T18:59:48.745757] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-15T18:59:48.939505] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-03. [2025-10-15T18:59:49.096416] [DEBUG] [LOCAL ] FND: Primary data saved (52150 records). [2025-10-15T18:59:49.096629] [INFO ] [MAIN ] FND: Full history saved. [2025-10-15T18:59:49.097730] [INFO ] [MAIN ] Update Progress: 857/2369 symbols completed. FND took 38.9s. Estimated remaining: 3h 31m 16s. Rate: 7.2 symbols/min [2025-10-15T18:59:49.273316] [INFO ] [MAIN ] FOF: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:59:49.287224] [DEBUG] [LOCAL ] FOF: Loaded 8607 existing records from primary storage. [2025-10-15T18:59:49.287530] [INFO ] [MAIN ] FOF: Loaded 8607 existing records. [2025-10-15T18:59:49.477046] [WARN ] [MAIN ] FOF: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:59:49.477432] [INFO ] [MAIN ] FOF: Wiping existing primary data before full refresh. [2025-10-15T18:59:49.477995] [INFO ] [LOCAL ] FOF: Starting deletion of primary data. [2025-10-15T18:59:49.478398] [DEBUG] [LOCAL ] FOF: Deleted primary data file. [2025-10-15T18:59:49.478490] [INFO ] [MAIN ] FOF: Starting full primary refresh. [2025-10-15T18:59:49.729431] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-07. [2025-10-15T18:59:49.751114] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-15T18:59:49.908546] [INFO ] [REMOTE ] FOF: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:59:50.000801] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-15T18:59:50.514011] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-04. [2025-10-15T18:59:51.313991] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-10. [2025-10-15T18:59:51.518815] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-15T18:59:51.541843] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-15T18:59:52.114029] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-05. [2025-10-15T18:59:52.754856] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-15T18:59:52.761132] [INFO ] [REMOTE ] FNF: Full fetch complete (69901 records). [2025-10-15T18:59:52.761342] [DEBUG] [VALIDATOR ] FNF: Validating primary data. [2025-10-15T18:59:52.914968] [INFO ] [REMOTE ] FOF: Fetching primary data for 2024-12. [2025-10-15T18:59:53.059273] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-15T18:59:53.195844] [DEBUG] [VALIDATOR ] FNF: All expected trading days are present. [2025-10-15T18:59:53.195963] [DEBUG] [VALIDATOR ] FNF: Primary data validation passed. [2025-10-15T18:59:53.197256] [INFO ] [MAIN ] FNF: Fetched primary data is valid. [2025-10-15T18:59:53.197326] [DEBUG] [LOCAL ] FNF: Saving primary data. [2025-10-15T18:59:53.199383] [DEBUG] [LOCAL ] FNF: Trimmed 69901 records to 48942 (keeping 200 days of data) [2025-10-15T18:59:53.537785] [DEBUG] [LOCAL ] FNF: Primary data saved (48942 records). [2025-10-15T18:59:53.537999] [INFO ] [MAIN ] FNF: Full history saved. [2025-10-15T18:59:53.538119] [INFO ] [MAIN ] Update Progress: 858/2369 symbols completed. FNF took 30.7s. Estimated remaining: 3h 31m 0s. Rate: 7.2 symbols/min [2025-10-15T18:59:53.718702] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-08. [2025-10-15T18:59:53.749636] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-10-15T18:59:53.749077] [INFO ] [MAIN ] FOR: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:59:53.776946] [DEBUG] [LOCAL ] FOR: Loaded 19838 existing records from primary storage. [2025-10-15T18:59:53.777293] [INFO ] [MAIN ] FOR: Loaded 19838 existing records. [2025-10-15T18:59:53.959069] [WARN ] [MAIN ] FOR: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:59:53.959326] [INFO ] [MAIN ] FOR: Wiping existing primary data before full refresh. [2025-10-15T18:59:53.959376] [INFO ] [LOCAL ] FOR: Starting deletion of primary data. [2025-10-15T18:59:53.959570] [DEBUG] [LOCAL ] FOR: Deleted primary data file. [2025-10-15T18:59:53.959608] [INFO ] [MAIN ] FOR: Starting full primary refresh. [2025-10-15T18:59:54.342039] [INFO ] [REMOTE ] FOR: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T18:59:54.514008] [INFO ] [REMOTE ] FOR: Fetching primary data for 2024-12. [2025-10-15T18:59:55.081592] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-10-15T18:59:55.314043] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-01. [2025-10-15T18:59:55.399516] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-15T18:59:56.114037] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-01. [2025-10-15T18:59:56.477222] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-15T18:59:56.812344] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-15T18:59:56.914044] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-02. [2025-10-15T18:59:57.714107] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-06. [2025-10-15T18:59:57.951554] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-15T18:59:58.443791] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-15T18:59:58.514263] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-09. [2025-10-15T18:59:58.625508] [DEBUG] [REMOTE ] FNV: Error fetching primary data for 2025-09: 'API call returned an empty response.' [2025-10-15T18:59:58.626271] [WARN ] [REMOTE ] FNV: No data returned for month 2025-09 [2025-10-15T18:59:58.626398] [FATAL] [REMOTE ] FNV: API call failed - aborting fetch to avoid wasting further API calls [2025-10-15T18:59:58.626517] [FATAL] [MAIN ] FNV: Failed to fetch primary data. [2025-10-15T18:59:58.626583] [WARN ] [MAIN ] FNV: Deleting existing primary and derivative data due to fetch failure. [2025-10-15T18:59:58.626686] [INFO ] [LOCAL ] FNV: Starting deletion of primary data. [2025-10-15T18:59:58.626777] [DEBUG] [LOCAL ] FNV: No primary data file found to delete. [2025-10-15T18:59:58.626908] [INFO ] [LOCAL ] FNV: Starting deletion of derivative data. [2025-10-15T18:59:58.627308] [DEBUG] [LOCAL ] FNV: Deleted derivative data file. [2025-10-15T18:59:58.628038] [INFO ] [MAIN ] Update Progress: 859/2369 symbols completed. FNV took 32.0s. Estimated remaining: 3h 30m 46s. Rate: 7.2 symbols/min [2025-10-15T18:59:58.807631] [INFO ] [MAIN ] FOUR: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T18:59:58.856024] [DEBUG] [LOCAL ] FOUR: Loaded 49680 existing records from primary storage. [2025-10-15T18:59:58.856366] [INFO ] [MAIN ] FOUR: Loaded 49680 existing records. [2025-10-15T18:59:59.034160] [WARN ] [MAIN ] FOUR: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T18:59:59.034413] [INFO ] [MAIN ] FOUR: Wiping existing primary data before full refresh. [2025-10-15T18:59:59.034473] [INFO ] [LOCAL ] FOUR: Starting deletion of primary data. [2025-10-15T18:59:59.034888] [DEBUG] [LOCAL ] FOUR: Deleted primary data file. [2025-10-15T18:59:59.034946] [INFO ] [MAIN ] FOUR: Starting full primary refresh. [2025-10-15T18:59:59.319214] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-03. [2025-10-15T18:59:59.405903] [INFO ] [REMOTE ] FOUR: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:00:00.114029] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2024-12. [2025-10-15T19:00:00.229755] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-15T19:00:00.914027] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-04. [2025-10-15T19:00:01.714017] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-02. [2025-10-15T19:00:02.050356] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-15T19:00:02.172299] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2024-12 (2.06 seconds). [2025-10-15T19:00:02.514028] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-05. [2025-10-15T19:00:02.609263] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-15T19:00:03.314035] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-03. [2025-10-15T19:00:03.636516] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-15T19:00:04.114024] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-07. [2025-10-15T19:00:04.188193] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-15T19:00:04.756824] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-10-15T19:00:04.914022] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-04. [2025-10-15T19:00:05.714071] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-01. [2025-10-15T19:00:05.739585] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-15T19:00:06.514031] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-06. [2025-10-15T19:00:07.313979] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-05. [2025-10-15T19:00:07.418629] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-15T19:00:07.634909] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-15T19:00:07.808788] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-15T19:00:08.114039] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-06. [2025-10-15T19:00:08.909429] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-15T19:00:08.913945] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-07. [2025-10-15T19:00:09.612416] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-15T19:00:09.713972] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-07. [2025-10-15T19:00:10.513972] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-08. [2025-10-15T19:00:10.727945] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-15T19:00:11.314004] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-02. [2025-10-15T19:00:11.469193] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-15T19:00:12.114018] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-08. [2025-10-15T19:00:12.722878] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-15T19:00:12.913996] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-08. [2025-10-15T19:00:13.126588] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-15T19:00:13.646355] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-15T19:00:13.713993] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-09. [2025-10-15T19:00:14.514002] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-09. [2025-10-15T19:00:15.033686] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-15T19:00:15.224966] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-15T19:00:15.313991] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-10. [2025-10-15T19:00:16.113987] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-09. [2025-10-15T19:00:16.352967] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-15T19:00:16.354474] [INFO ] [REMOTE ] FOF: Full fetch complete (11913 records). [2025-10-15T19:00:16.354569] [DEBUG] [VALIDATOR ] FOF: Validating primary data. [2025-10-15T19:00:16.714541] [DEBUG] [VALIDATOR ] FOF: All expected trading days are present. [2025-10-15T19:00:16.714616] [DEBUG] [VALIDATOR ] FOF: Primary data validation passed. [2025-10-15T19:00:16.714944] [INFO ] [MAIN ] FOF: Fetched primary data is valid. [2025-10-15T19:00:16.714999] [DEBUG] [LOCAL ] FOF: Saving primary data. [2025-10-15T19:00:16.715447] [DEBUG] [LOCAL ] FOF: Trimmed 11913 records to 8595 (keeping 200 days of data) [2025-10-15T19:00:16.768947] [DEBUG] [LOCAL ] FOF: Primary data saved (8595 records). [2025-10-15T19:00:16.769061] [INFO ] [MAIN ] FOF: Full history saved. [2025-10-15T19:00:16.769136] [INFO ] [MAIN ] Update Progress: 860/2369 symbols completed. FOF took 27.7s. Estimated remaining: 3h 30m 55s. Rate: 7.2 symbols/min [2025-10-15T19:00:16.917897] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-03. [2025-10-15T19:00:16.944800] [INFO ] [MAIN ] FPF: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:00:16.958915] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-15T19:00:16.981033] [DEBUG] [LOCAL ] FPF: Loaded 18807 existing records from primary storage. [2025-10-15T19:00:16.981304] [INFO ] [MAIN ] FPF: Loaded 18807 existing records. [2025-10-15T19:00:17.177359] [WARN ] [MAIN ] FPF: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:00:17.177587] [INFO ] [MAIN ] FPF: Wiping existing primary data before full refresh. [2025-10-15T19:00:17.177635] [INFO ] [LOCAL ] FPF: Starting deletion of primary data. [2025-10-15T19:00:17.177867] [DEBUG] [LOCAL ] FPF: Deleted primary data file. [2025-10-15T19:00:17.177915] [INFO ] [MAIN ] FPF: Starting full primary refresh. [2025-10-15T19:00:17.575561] [INFO ] [REMOTE ] FPF: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:00:17.713997] [INFO ] [REMOTE ] FPF: Fetching primary data for 2024-12. [2025-10-15T19:00:18.514022] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-10. [2025-10-15T19:00:18.643620] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-15T19:00:18.746011] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-15T19:00:19.188394] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-15T19:00:19.190545] [INFO ] [REMOTE ] FOA: Full fetch complete (21747 records). [2025-10-15T19:00:19.190628] [DEBUG] [VALIDATOR ] FOA: Validating primary data. [2025-10-15T19:00:19.319155] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-01. [2025-10-15T19:00:19.586067] [DEBUG] [VALIDATOR ] FOA: All expected trading days are present. [2025-10-15T19:00:19.586143] [DEBUG] [VALIDATOR ] FOA: Primary data validation passed. [2025-10-15T19:00:19.586668] [INFO ] [MAIN ] FOA: Fetched primary data is valid. [2025-10-15T19:00:19.586730] [DEBUG] [LOCAL ] FOA: Saving primary data. [2025-10-15T19:00:19.587280] [DEBUG] [LOCAL ] FOA: Trimmed 21747 records to 13050 (keeping 200 days of data) [2025-10-15T19:00:19.668956] [DEBUG] [LOCAL ] FOA: Primary data saved (13050 records). [2025-10-15T19:00:19.669090] [INFO ] [MAIN ] FOA: Full history saved. [2025-10-15T19:00:19.669173] [INFO ] [MAIN ] Update Progress: 861/2369 symbols completed. FOA took 44.2s. Estimated remaining: 3h 30m 37s. Rate: 7.2 symbols/min [2025-10-15T19:00:19.840508] [INFO ] [MAIN ] FPH: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:00:19.861852] [DEBUG] [LOCAL ] FPH: Loaded 19342 existing records from primary storage. [2025-10-15T19:00:19.862130] [INFO ] [MAIN ] FPH: Loaded 19342 existing records. [2025-10-15T19:00:20.037253] [WARN ] [MAIN ] FPH: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:00:20.037454] [INFO ] [MAIN ] FPH: Wiping existing primary data before full refresh. [2025-10-15T19:00:20.037504] [INFO ] [LOCAL ] FPH: Starting deletion of primary data. [2025-10-15T19:00:20.037750] [DEBUG] [LOCAL ] FPH: Deleted primary data file. [2025-10-15T19:00:20.037842] [INFO ] [MAIN ] FPH: Starting full primary refresh. [2025-10-15T19:00:20.119115] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-10. [2025-10-15T19:00:20.381521] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-15T19:00:20.423921] [INFO ] [REMOTE ] FPH: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:00:20.914005] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-02. [2025-10-15T19:00:21.272112] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-15T19:00:21.274581] [INFO ] [REMOTE ] FOR: Full fetch complete (29832 records). [2025-10-15T19:00:21.274692] [DEBUG] [VALIDATOR ] FOR: Validating primary data. [2025-10-15T19:00:21.642354] [DEBUG] [VALIDATOR ] FOR: All expected trading days are present. [2025-10-15T19:00:21.642447] [DEBUG] [VALIDATOR ] FOR: Primary data validation passed. [2025-10-15T19:00:21.643072] [INFO ] [MAIN ] FOR: Fetched primary data is valid. [2025-10-15T19:00:21.643135] [DEBUG] [LOCAL ] FOR: Saving primary data. [2025-10-15T19:00:21.644001] [DEBUG] [LOCAL ] FOR: Trimmed 29832 records to 19813 (keeping 200 days of data) [2025-10-15T19:00:21.727373] [INFO ] [REMOTE ] FPH: Fetching primary data for 2024-12. [2025-10-15T19:00:21.763283] [DEBUG] [LOCAL ] FOR: Primary data saved (19813 records). [2025-10-15T19:00:21.763440] [INFO ] [MAIN ] FOR: Full history saved. [2025-10-15T19:00:21.763523] [INFO ] [MAIN ] Update Progress: 862/2369 symbols completed. FOR took 28.2s. Estimated remaining: 3h 30m 18s. Rate: 7.2 symbols/min [2025-10-15T19:00:21.925319] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-15T19:00:21.956487] [INFO ] [MAIN ] FPI: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:00:21.993595] [DEBUG] [LOCAL ] FPI: Loaded 31275 existing records from primary storage. [2025-10-15T19:00:21.993905] [INFO ] [MAIN ] FPI: Loaded 31275 existing records. [2025-10-15T19:00:22.164154] [WARN ] [MAIN ] FPI: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:00:22.164359] [INFO ] [MAIN ] FPI: Wiping existing primary data before full refresh. [2025-10-15T19:00:22.164405] [INFO ] [LOCAL ] FPI: Starting deletion of primary data. [2025-10-15T19:00:22.164701] [DEBUG] [LOCAL ] FPI: Deleted primary data file. [2025-10-15T19:00:22.164758] [INFO ] [MAIN ] FPI: Starting full primary refresh. [2025-10-15T19:00:22.505637] [INFO ] [REMOTE ] FPI: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:00:22.513950] [INFO ] [REMOTE ] FPI: Fetching primary data for 2024-12. [2025-10-15T19:00:22.782105] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-15T19:00:23.314030] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-04. [2025-10-15T19:00:23.825070] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-15T19:00:24.113993] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-03. [2025-10-15T19:00:24.914021] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-01. [2025-10-15T19:00:25.039706] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-15T19:00:25.093900] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-15T19:00:25.714025] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-05. [2025-10-15T19:00:26.110447] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-15T19:00:26.513999] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-04. [2025-10-15T19:00:27.124715] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-15T19:00:27.208455] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-15T19:00:27.313975] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-05. [2025-10-15T19:00:28.113987] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-06. [2025-10-15T19:00:28.233704] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-15T19:00:28.914002] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-06. [2025-10-15T19:00:29.601898] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-15T19:00:29.713954] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-07. [2025-10-15T19:00:29.884337] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-15T19:00:30.514005] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-01. [2025-10-15T19:00:31.178772] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-15T19:00:31.313985] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-08. [2025-10-15T19:00:31.758353] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-15T19:00:32.113993] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-07. [2025-10-15T19:00:32.894228] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-15T19:00:32.913953] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-09. [2025-10-15T19:00:33.228188] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-15T19:00:33.714010] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-02. [2025-10-15T19:00:34.519062] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-08. [2025-10-15T19:00:34.537713] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-15T19:00:34.870419] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-15T19:00:35.313959] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-02. [2025-10-15T19:00:35.550864] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-15T19:00:36.114001] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-03. [2025-10-15T19:00:36.443080] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-15T19:00:36.913968] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-03. [2025-10-15T19:00:37.358692] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-15T19:00:37.714027] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-10. [2025-10-15T19:00:37.929718] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-15T19:00:38.514013] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-09. [2025-10-15T19:00:39.313966] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-04. [2025-10-15T19:00:39.554417] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-15T19:00:39.699107] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-10 (1.99 seconds). [2025-10-15T19:00:39.705341] [INFO ] [REMOTE ] FOUR: Full fetch complete (72228 records). [2025-10-15T19:00:39.705478] [DEBUG] [VALIDATOR ] FOUR: Validating primary data. [2025-10-15T19:00:40.116404] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-04. [2025-10-15T19:00:40.116742] [DEBUG] [VALIDATOR ] FOUR: All expected trading days are present. [2025-10-15T19:00:40.116882] [DEBUG] [VALIDATOR ] FOUR: Primary data validation passed. [2025-10-15T19:00:40.118798] [INFO ] [MAIN ] FOUR: Fetched primary data is valid. [2025-10-15T19:00:40.118959] [DEBUG] [LOCAL ] FOUR: Saving primary data. [2025-10-15T19:00:40.120377] [DEBUG] [LOCAL ] FOUR: Trimmed 72228 records to 49718 (keeping 200 days of data) [2025-10-15T19:00:40.397499] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-15T19:00:40.431957] [DEBUG] [LOCAL ] FOUR: Primary data saved (49718 records). [2025-10-15T19:00:40.432066] [INFO ] [MAIN ] FOUR: Full history saved. [2025-10-15T19:00:40.432349] [INFO ] [MAIN ] Update Progress: 863/2369 symbols completed. FOUR took 41.8s. Estimated remaining: 3h 30m 27s. Rate: 7.2 symbols/min [2025-10-15T19:00:40.604947] [INFO ] [MAIN ] FR: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:00:40.648549] [DEBUG] [LOCAL ] FR: Loaded 46500 existing records from primary storage. [2025-10-15T19:00:40.648870] [INFO ] [MAIN ] FR: Loaded 46500 existing records. [2025-10-15T19:00:40.835950] [WARN ] [MAIN ] FR: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:00:40.836200] [INFO ] [MAIN ] FR: Wiping existing primary data before full refresh. [2025-10-15T19:00:40.836263] [INFO ] [LOCAL ] FR: Starting deletion of primary data. [2025-10-15T19:00:40.836713] [DEBUG] [LOCAL ] FR: Deleted primary data file. [2025-10-15T19:00:40.836784] [INFO ] [MAIN ] FR: Starting full primary refresh. [2025-10-15T19:00:40.926593] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-05. [2025-10-15T19:00:41.253037] [INFO ] [REMOTE ] FR: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:00:41.397585] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-15T19:00:41.714039] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-10. [2025-10-15T19:00:41.865464] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-15T19:00:42.514025] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-05. [2025-10-15T19:00:42.919544] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-15T19:00:42.923256] [INFO ] [REMOTE ] FPF: Full fetch complete (26718 records). [2025-10-15T19:00:42.923402] [DEBUG] [VALIDATOR ] FPF: Validating primary data. [2025-10-15T19:00:43.307869] [DEBUG] [VALIDATOR ] FPF: All expected trading days are present. [2025-10-15T19:00:43.307952] [DEBUG] [VALIDATOR ] FPF: Primary data validation passed. [2025-10-15T19:00:43.308541] [INFO ] [MAIN ] FPF: Fetched primary data is valid. [2025-10-15T19:00:43.308581] [DEBUG] [LOCAL ] FPF: Saving primary data. [2025-10-15T19:00:43.309257] [DEBUG] [LOCAL ] FPF: Trimmed 26718 records to 18844 (keeping 200 days of data) [2025-10-15T19:00:43.359632] [INFO ] [REMOTE ] FR: Fetching primary data for 2024-12. [2025-10-15T19:00:43.428712] [DEBUG] [LOCAL ] FPF: Primary data saved (18844 records). [2025-10-15T19:00:43.428871] [INFO ] [MAIN ] FPF: Full history saved. [2025-10-15T19:00:43.428957] [INFO ] [MAIN ] Update Progress: 864/2369 symbols completed. FPF took 26.7s. Estimated remaining: 3h 30m 9s. Rate: 7.2 symbols/min [2025-10-15T19:00:43.597110] [INFO ] [MAIN ] FRA: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:00:43.617005] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-15T19:00:43.637025] [DEBUG] [LOCAL ] FRA: Loaded 14371 existing records from primary storage. [2025-10-15T19:00:43.637270] [INFO ] [MAIN ] FRA: Loaded 14371 existing records. [2025-10-15T19:00:43.813079] [WARN ] [MAIN ] FRA: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:00:43.813691] [INFO ] [MAIN ] FRA: Wiping existing primary data before full refresh. [2025-10-15T19:00:43.813749] [INFO ] [LOCAL ] FRA: Starting deletion of primary data. [2025-10-15T19:00:43.814066] [DEBUG] [LOCAL ] FRA: Deleted primary data file. [2025-10-15T19:00:43.814121] [INFO ] [MAIN ] FRA: Starting full primary refresh. [2025-10-15T19:00:44.119092] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-06. [2025-10-15T19:00:44.157504] [INFO ] [REMOTE ] FRA: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:00:44.480255] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-15T19:00:44.914016] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-01. [2025-10-15T19:00:45.442840] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-15T19:00:45.714016] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-06. [2025-10-15T19:00:46.283431] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-15T19:00:46.514052] [INFO ] [REMOTE ] FRA: Fetching primary data for 2024-12. [2025-10-15T19:00:46.612601] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-15T19:00:47.205854] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-10-15T19:00:47.313972] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-01. [2025-10-15T19:00:48.114035] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-07. [2025-10-15T19:00:48.457955] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-15T19:00:48.914016] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-02. [2025-10-15T19:00:48.997511] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-15T19:00:49.713973] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-08. [2025-10-15T19:00:49.871464] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-15T19:00:50.442026] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-15T19:00:50.514046] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-07. [2025-10-15T19:00:51.314056] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-03. [2025-10-15T19:00:51.851533] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-15T19:00:52.114020] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-08. [2025-10-15T19:00:52.258328] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-15T19:00:52.914046] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-02. [2025-10-15T19:00:53.095011] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-15T19:00:53.714057] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-09. [2025-10-15T19:00:54.186519] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-15T19:00:54.514025] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-03. [2025-10-15T19:00:54.631669] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-15T19:00:55.314067] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-04. [2025-10-15T19:00:55.866078] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-15T19:00:56.113988] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-09. [2025-10-15T19:00:56.327218] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-15T19:00:56.913976] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-10. [2025-10-15T19:00:57.003223] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-15T19:00:57.714043] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-04. [2025-10-15T19:00:58.224510] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-15T19:00:58.229073] [INFO ] [REMOTE ] FPI: Full fetch complete (43905 records). [2025-10-15T19:00:58.229184] [DEBUG] [VALIDATOR ] FPI: Validating primary data. [2025-10-15T19:00:58.514581] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-05. [2025-10-15T19:00:58.608610] [DEBUG] [VALIDATOR ] FPI: All expected trading days are present. [2025-10-15T19:00:58.608718] [DEBUG] [VALIDATOR ] FPI: Primary data validation passed. [2025-10-15T19:00:58.609663] [INFO ] [MAIN ] FPI: Fetched primary data is valid. [2025-10-15T19:00:58.609723] [DEBUG] [LOCAL ] FPI: Saving primary data. [2025-10-15T19:00:58.610617] [DEBUG] [LOCAL ] FPI: Trimmed 43905 records to 31359 (keeping 200 days of data) [2025-10-15T19:00:58.796951] [DEBUG] [LOCAL ] FPI: Primary data saved (31359 records). [2025-10-15T19:00:58.797109] [INFO ] [MAIN ] FPI: Full history saved. [2025-10-15T19:00:58.797193] [INFO ] [MAIN ] Update Progress: 865/2369 symbols completed. FPI took 37.0s. Estimated remaining: 3h 30m 13s. Rate: 7.2 symbols/min [2025-10-15T19:00:58.963955] [INFO ] [MAIN ] FRGE: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:00:58.982314] [DEBUG] [LOCAL ] FRGE: Loaded 16201 existing records from primary storage. [2025-10-15T19:00:58.982590] [INFO ] [MAIN ] FRGE: Loaded 16201 existing records. [2025-10-15T19:00:59.160950] [WARN ] [MAIN ] FRGE: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:00:59.161221] [INFO ] [MAIN ] FRGE: Wiping existing primary data before full refresh. [2025-10-15T19:00:59.161278] [INFO ] [LOCAL ] FRGE: Starting deletion of primary data. [2025-10-15T19:00:59.161526] [DEBUG] [LOCAL ] FRGE: Deleted primary data file. [2025-10-15T19:00:59.161584] [INFO ] [MAIN ] FRGE: Starting full primary refresh. [2025-10-15T19:00:59.321777] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-10. [2025-10-15T19:00:59.488318] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-15T19:00:59.576318] [INFO ] [REMOTE ] FRGE: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:00:59.605404] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-15T19:01:00.114026] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-06. [2025-10-15T19:01:00.439755] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-15T19:01:00.442212] [INFO ] [REMOTE ] FPH: Full fetch complete (31187 records). [2025-10-15T19:01:00.442281] [DEBUG] [VALIDATOR ] FPH: Validating primary data. [2025-10-15T19:01:00.802528] [DEBUG] [VALIDATOR ] FPH: All expected trading days are present. [2025-10-15T19:01:00.802623] [DEBUG] [VALIDATOR ] FPH: Primary data validation passed. [2025-10-15T19:01:00.803260] [INFO ] [MAIN ] FPH: Fetched primary data is valid. [2025-10-15T19:01:00.803319] [DEBUG] [LOCAL ] FPH: Saving primary data. [2025-10-15T19:01:00.804010] [DEBUG] [LOCAL ] FPH: Trimmed 31187 records to 19325 (keeping 200 days of data) [2025-10-15T19:01:00.908269] [DEBUG] [LOCAL ] FPH: Primary data saved (19325 records). [2025-10-15T19:01:00.908401] [INFO ] [MAIN ] FPH: Full history saved. [2025-10-15T19:01:00.908480] [INFO ] [MAIN ] Update Progress: 866/2369 symbols completed. FPH took 41.2s. Estimated remaining: 3h 29m 54s. Rate: 7.2 symbols/min [2025-10-15T19:01:00.919789] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2024-12. [2025-10-15T19:01:01.078227] [INFO ] [MAIN ] FRO: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:01:01.127132] [DEBUG] [LOCAL ] FRO: Loaded 51699 existing records from primary storage. [2025-10-15T19:01:01.127465] [INFO ] [MAIN ] FRO: Loaded 51699 existing records. [2025-10-15T19:01:01.313560] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-15T19:01:01.318842] [WARN ] [MAIN ] FRO: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:01:01.322874] [INFO ] [MAIN ] FRO: Wiping existing primary data before full refresh. [2025-10-15T19:01:01.323193] [INFO ] [LOCAL ] FRO: Starting deletion of primary data. [2025-10-15T19:01:01.323743] [DEBUG] [LOCAL ] FRO: Deleted primary data file. [2025-10-15T19:01:01.323802] [INFO ] [MAIN ] FRO: Starting full primary refresh. [2025-10-15T19:01:01.662360] [INFO ] [REMOTE ] FRO: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:01:01.714036] [INFO ] [REMOTE ] FRO: Fetching primary data for 2024-12. [2025-10-15T19:01:02.513970] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-05. [2025-10-15T19:01:02.658472] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-15T19:01:03.314003] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-01. [2025-10-15T19:01:03.616246] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-10-15T19:01:03.742622] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-15T19:01:04.113964] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-06. [2025-10-15T19:01:04.421685] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-15T19:01:04.913999] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-02. [2025-10-15T19:01:05.604062] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-15T19:01:05.714009] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-07. [2025-10-15T19:01:05.982489] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-15T19:01:06.513986] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-01. [2025-10-15T19:01:06.636771] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-15T19:01:07.314000] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-03. [2025-10-15T19:01:08.114076] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-08. [2025-10-15T19:01:08.527356] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-10-15T19:01:08.729119] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-15T19:01:08.913985] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-07. [2025-10-15T19:01:08.993011] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-15T19:01:09.714008] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-09. [2025-10-15T19:01:10.514058] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-02. [2025-10-15T19:01:10.515145] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-15T19:01:10.609919] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-15T19:01:11.314038] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-10. [2025-10-15T19:01:12.114047] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-04. [2025-10-15T19:01:12.269118] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-15T19:01:12.325742] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-15T19:01:12.328452] [INFO ] [REMOTE ] FRA: Full fetch complete (23704 records). [2025-10-15T19:01:12.328624] [DEBUG] [VALIDATOR ] FRA: Validating primary data. [2025-10-15T19:01:12.729140] [DEBUG] [VALIDATOR ] FRA: All expected trading days are present. [2025-10-15T19:01:12.729264] [DEBUG] [VALIDATOR ] FRA: Primary data validation passed. [2025-10-15T19:01:12.730280] [INFO ] [MAIN ] FRA: Fetched primary data is valid. [2025-10-15T19:01:12.730355] [DEBUG] [LOCAL ] FRA: Saving primary data. [2025-10-15T19:01:12.731737] [DEBUG] [LOCAL ] FRA: Trimmed 23704 records to 14294 (keeping 200 days of data) [2025-10-15T19:01:12.829953] [DEBUG] [LOCAL ] FRA: Primary data saved (14294 records). [2025-10-15T19:01:12.830171] [INFO ] [MAIN ] FRA: Full history saved. [2025-10-15T19:01:12.830333] [INFO ] [MAIN ] Update Progress: 867/2369 symbols completed. FRA took 29.4s. Estimated remaining: 3h 29m 52s. Rate: 7.2 symbols/min [2025-10-15T19:01:12.924086] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-08. [2025-10-15T19:01:13.015040] [INFO ] [MAIN ] FRT: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:01:13.059899] [DEBUG] [LOCAL ] FRT: Loaded 41743 existing records from primary storage. [2025-10-15T19:01:13.060297] [INFO ] [MAIN ] FRT: Loaded 41743 existing records. [2025-10-15T19:01:13.249786] [WARN ] [MAIN ] FRT: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:01:13.265553] [INFO ] [MAIN ] FRT: Wiping existing primary data before full refresh. [2025-10-15T19:01:13.265773] [INFO ] [LOCAL ] FRT: Starting deletion of primary data. [2025-10-15T19:01:13.266977] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-15T19:01:13.272946] [DEBUG] [LOCAL ] FRT: Deleted primary data file. [2025-10-15T19:01:13.273287] [INFO ] [MAIN ] FRT: Starting full primary refresh. [2025-10-15T19:01:13.657995] [INFO ] [REMOTE ] FRT: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:01:13.713978] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-05. [2025-10-15T19:01:14.464110] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-15T19:01:14.513953] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-09. [2025-10-15T19:01:14.576286] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-15T19:01:15.314025] [INFO ] [REMOTE ] FRT: Fetching primary data for 2024-12. [2025-10-15T19:01:15.894256] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-15T19:01:16.113972] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-10. [2025-10-15T19:01:16.811816] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-15T19:01:16.913990] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-01. [2025-10-15T19:01:17.715251] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-03. [2025-10-15T19:01:17.716995] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-15T19:01:17.723168] [INFO ] [REMOTE ] FR: Full fetch complete (66981 records). [2025-10-15T19:01:17.723290] [DEBUG] [VALIDATOR ] FR: Validating primary data. [2025-10-15T19:01:18.122174] [DEBUG] [VALIDATOR ] FR: All expected trading days are present. [2025-10-15T19:01:18.122298] [DEBUG] [VALIDATOR ] FR: Primary data validation passed. [2025-10-15T19:01:18.123418] [INFO ] [MAIN ] FR: Fetched primary data is valid. [2025-10-15T19:01:18.123547] [DEBUG] [LOCAL ] FR: Saving primary data. [2025-10-15T19:01:18.125514] [DEBUG] [LOCAL ] FR: Trimmed 66981 records to 46546 (keeping 200 days of data) [2025-10-15T19:01:18.247515] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-15T19:01:18.440507] [DEBUG] [LOCAL ] FR: Primary data saved (46546 records). [2025-10-15T19:01:18.440637] [INFO ] [MAIN ] FR: Full history saved. [2025-10-15T19:01:18.440907] [INFO ] [MAIN ] Update Progress: 868/2369 symbols completed. FR took 38.0s. Estimated remaining: 3h 29m 39s. Rate: 7.2 symbols/min [2025-10-15T19:01:18.519567] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-06. [2025-10-15T19:01:18.633136] [INFO ] [MAIN ] FSCO: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:01:18.675378] [DEBUG] [LOCAL ] FSCO: Loaded 38493 existing records from primary storage. [2025-10-15T19:01:18.675698] [INFO ] [MAIN ] FSCO: Loaded 38493 existing records. [2025-10-15T19:01:18.883727] [WARN ] [MAIN ] FSCO: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:01:18.883963] [INFO ] [MAIN ] FSCO: Wiping existing primary data before full refresh. [2025-10-15T19:01:18.884014] [INFO ] [LOCAL ] FSCO: Starting deletion of primary data. [2025-10-15T19:01:18.884304] [DEBUG] [LOCAL ] FSCO: Deleted primary data file. [2025-10-15T19:01:18.884360] [INFO ] [MAIN ] FSCO: Starting full primary refresh. [2025-10-15T19:01:19.232251] [INFO ] [REMOTE ] FSCO: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:01:19.313956] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2024-12. [2025-10-15T19:01:19.387103] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-15T19:01:19.720290] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-10-15T19:01:20.114039] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-07. [2025-10-15T19:01:20.710153] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-15T19:01:20.891807] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-15T19:01:20.913944] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-08. [2025-10-15T19:01:21.714058] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-04. [2025-10-15T19:01:21.888188] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-15T19:01:22.514018] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-09. [2025-10-15T19:01:23.198035] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-15T19:01:23.314049] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-02. [2025-10-15T19:01:23.505870] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-15T19:01:24.114048] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-01. [2025-10-15T19:01:24.669071] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-15T19:01:24.913991] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-05. [2025-10-15T19:01:25.560721] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-15T19:01:25.713959] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-02. [2025-10-15T19:01:26.478111] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-15T19:01:26.513977] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-10. [2025-10-15T19:01:26.974180] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-15T19:01:27.313964] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-06. [2025-10-15T19:01:27.358722] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-15T19:01:27.360545] [INFO ] [REMOTE ] FRGE: Full fetch complete (31070 records). [2025-10-15T19:01:27.360618] [DEBUG] [VALIDATOR ] FRGE: Validating primary data. [2025-10-15T19:01:27.718263] [DEBUG] [VALIDATOR ] FRGE: All expected trading days are present. [2025-10-15T19:01:27.718402] [DEBUG] [VALIDATOR ] FRGE: Primary data validation passed. [2025-10-15T19:01:27.719122] [INFO ] [MAIN ] FRGE: Fetched primary data is valid. [2025-10-15T19:01:27.719187] [DEBUG] [LOCAL ] FRGE: Saving primary data. [2025-10-15T19:01:27.720903] [DEBUG] [LOCAL ] FRGE: Trimmed 31070 records to 16119 (keeping 200 days of data) [2025-10-15T19:01:27.813849] [DEBUG] [LOCAL ] FRGE: Primary data saved (16119 records). [2025-10-15T19:01:27.813990] [INFO ] [MAIN ] FRGE: Full history saved. [2025-10-15T19:01:27.814070] [INFO ] [MAIN ] Update Progress: 869/2369 symbols completed. FRGE took 29.0s. Estimated remaining: 3h 29m 32s. Rate: 7.2 symbols/min [2025-10-15T19:01:27.980722] [INFO ] [MAIN ] FSK: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:01:28.028833] [DEBUG] [LOCAL ] FSK: Loaded 49496 existing records from primary storage. [2025-10-15T19:01:28.029131] [INFO ] [MAIN ] FSK: Loaded 49496 existing records. [2025-10-15T19:01:28.122720] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-03. [2025-10-15T19:01:28.213943] [WARN ] [MAIN ] FSK: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:01:28.214139] [INFO ] [MAIN ] FSK: Wiping existing primary data before full refresh. [2025-10-15T19:01:28.214196] [INFO ] [LOCAL ] FSK: Starting deletion of primary data. [2025-10-15T19:01:28.214460] [DEBUG] [LOCAL ] FSK: Deleted primary data file. [2025-10-15T19:01:28.214515] [INFO ] [MAIN ] FSK: Starting full primary refresh. [2025-10-15T19:01:28.564899] [INFO ] [REMOTE ] FSK: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:01:28.914081] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-03. [2025-10-15T19:01:29.059534] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-15T19:01:29.498493] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-15T19:01:29.713990] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-07. [2025-10-15T19:01:30.340293] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-15T19:01:30.514008] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-04. [2025-10-15T19:01:31.313963] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-04. [2025-10-15T19:01:31.533673] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-15T19:01:31.981038] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-15T19:01:32.113956] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-05. [2025-10-15T19:01:32.580508] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-15T19:01:32.914007] [INFO ] [REMOTE ] FSK: Fetching primary data for 2024-12. [2025-10-15T19:01:33.526997] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-15T19:01:33.713997] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-08. [2025-10-15T19:01:34.513983] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-06. [2025-10-15T19:01:34.553332] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-15T19:01:35.314092] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-01. [2025-10-15T19:01:35.951812] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-08 (2.24 seconds). [2025-10-15T19:01:36.013943] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-15T19:01:36.113981] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-07. [2025-10-15T19:01:36.920165] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-09. [2025-10-15T19:01:36.940493] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-15T19:01:37.539630] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-15T19:01:37.713985] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-08. [2025-10-15T19:01:38.525904] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-02. [2025-10-15T19:01:38.531977] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-15T19:01:39.062908] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-15T19:01:39.313991] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-05. [2025-10-15T19:01:40.107472] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-15T19:01:40.116665] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-09. [2025-10-15T19:01:40.919491] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-03. [2025-10-15T19:01:40.931742] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-15T19:01:41.645114] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-15T19:01:41.713989] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-10. [2025-10-15T19:01:42.514100] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-10. [2025-10-15T19:01:42.692426] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-15T19:01:42.834083] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-15T19:01:42.839798] [INFO ] [REMOTE ] FSCO: Full fetch complete (55216 records). [2025-10-15T19:01:42.839933] [DEBUG] [VALIDATOR ] FSCO: Validating primary data. [2025-10-15T19:01:43.226544] [DEBUG] [VALIDATOR ] FSCO: All expected trading days are present. [2025-10-15T19:01:43.226634] [DEBUG] [VALIDATOR ] FSCO: Primary data validation passed. [2025-10-15T19:01:43.227503] [INFO ] [MAIN ] FSCO: Fetched primary data is valid. [2025-10-15T19:01:43.227561] [DEBUG] [LOCAL ] FSCO: Saving primary data. [2025-10-15T19:01:43.228827] [DEBUG] [LOCAL ] FSCO: Trimmed 55216 records to 38487 (keeping 200 days of data) [2025-10-15T19:01:43.317929] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-06. [2025-10-15T19:01:43.469668] [DEBUG] [LOCAL ] FSCO: Primary data saved (38487 records). [2025-10-15T19:01:43.469831] [INFO ] [MAIN ] FSCO: Full history saved. [2025-10-15T19:01:43.470150] [INFO ] [MAIN ] Update Progress: 870/2369 symbols completed. FSCO took 25.0s. Estimated remaining: 3h 29m 36s. Rate: 7.2 symbols/min [2025-10-15T19:01:43.637494] [INFO ] [MAIN ] FSLY: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:01:43.689997] [DEBUG] [LOCAL ] FSLY: Loaded 51306 existing records from primary storage. [2025-10-15T19:01:43.690357] [INFO ] [MAIN ] FSLY: Loaded 51306 existing records. [2025-10-15T19:01:43.868327] [WARN ] [MAIN ] FSLY: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:01:43.868524] [INFO ] [MAIN ] FSLY: Wiping existing primary data before full refresh. [2025-10-15T19:01:43.868597] [INFO ] [LOCAL ] FSLY: Starting deletion of primary data. [2025-10-15T19:01:43.868943] [DEBUG] [LOCAL ] FSLY: Deleted primary data file. [2025-10-15T19:01:43.869017] [INFO ] [MAIN ] FSLY: Starting full primary refresh. [2025-10-15T19:01:44.129416] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-04. [2025-10-15T19:01:44.239602] [INFO ] [REMOTE ] FSLY: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:01:44.289141] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-15T19:01:44.295588] [INFO ] [REMOTE ] FRO: Full fetch complete (75374 records). [2025-10-15T19:01:44.295814] [DEBUG] [VALIDATOR ] FRO: Validating primary data. [2025-10-15T19:01:44.689590] [DEBUG] [VALIDATOR ] FRO: All expected trading days are present. [2025-10-15T19:01:44.689893] [DEBUG] [VALIDATOR ] FRO: Primary data validation passed. [2025-10-15T19:01:44.690920] [INFO ] [MAIN ] FRO: Fetched primary data is valid. [2025-10-15T19:01:44.691004] [DEBUG] [LOCAL ] FRO: Saving primary data. [2025-10-15T19:01:44.692531] [DEBUG] [LOCAL ] FRO: Trimmed 75374 records to 51696 (keeping 200 days of data) [2025-10-15T19:01:44.836461] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-15T19:01:44.937735] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-07. [2025-10-15T19:01:45.044783] [DEBUG] [LOCAL ] FRO: Primary data saved (51696 records). [2025-10-15T19:01:45.044930] [INFO ] [MAIN ] FRO: Full history saved. [2025-10-15T19:01:45.045011] [INFO ] [MAIN ] Update Progress: 871/2369 symbols completed. FRO took 44.1s. Estimated remaining: 3h 29m 16s. Rate: 7.2 symbols/min [2025-10-15T19:01:45.210508] [INFO ] [MAIN ] FSM: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:01:45.259825] [DEBUG] [LOCAL ] FSM: Loaded 53300 existing records from primary storage. [2025-10-15T19:01:45.260144] [INFO ] [MAIN ] FSM: Loaded 53300 existing records. [2025-10-15T19:01:45.440442] [WARN ] [MAIN ] FSM: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:01:45.440705] [INFO ] [MAIN ] FSM: Wiping existing primary data before full refresh. [2025-10-15T19:01:45.440765] [INFO ] [LOCAL ] FSM: Starting deletion of primary data. [2025-10-15T19:01:45.441038] [DEBUG] [LOCAL ] FSM: Deleted primary data file. [2025-10-15T19:01:45.441078] [INFO ] [MAIN ] FSM: Starting full primary refresh. [2025-10-15T19:01:45.716433] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2024-12. [2025-10-15T19:01:45.823085] [INFO ] [REMOTE ] FSM: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:01:45.984064] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-15T19:01:46.154549] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-15T19:01:46.514014] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-08. [2025-10-15T19:01:47.314024] [INFO ] [REMOTE ] FSM: Fetching primary data for 2024-12. [2025-10-15T19:01:47.474830] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-15T19:01:48.073565] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-15T19:01:48.113961] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-09. [2025-10-15T19:01:48.913966] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-01. [2025-10-15T19:01:49.020199] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-15T19:01:49.625781] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-15T19:01:49.713962] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-10. [2025-10-15T19:01:50.499734] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-15T19:01:50.513945] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-02. [2025-10-15T19:01:51.020326] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-15T19:01:51.027341] [INFO ] [REMOTE ] FRT: Full fetch complete (60509 records). [2025-10-15T19:01:51.027463] [DEBUG] [VALIDATOR ] FRT: Validating primary data. [2025-10-15T19:01:51.319176] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-01. [2025-10-15T19:01:51.445801] [DEBUG] [VALIDATOR ] FRT: All expected trading days are present. [2025-10-15T19:01:51.445885] [DEBUG] [VALIDATOR ] FRT: Primary data validation passed. [2025-10-15T19:01:51.446748] [INFO ] [MAIN ] FRT: Fetched primary data is valid. [2025-10-15T19:01:51.446810] [DEBUG] [LOCAL ] FRT: Saving primary data. [2025-10-15T19:01:51.448047] [DEBUG] [LOCAL ] FRT: Trimmed 60509 records to 41709 (keeping 200 days of data) [2025-10-15T19:01:51.705372] [DEBUG] [LOCAL ] FRT: Primary data saved (41709 records). [2025-10-15T19:01:51.705500] [INFO ] [MAIN ] FRT: Full history saved. [2025-10-15T19:01:51.705577] [INFO ] [MAIN ] Update Progress: 872/2369 symbols completed. FRT took 38.9s. Estimated remaining: 3h 29m 5s. Rate: 7.2 symbols/min [2025-10-15T19:01:51.870805] [INFO ] [MAIN ] FSS: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:01:51.905941] [DEBUG] [LOCAL ] FSS: Loaded 33656 existing records from primary storage. [2025-10-15T19:01:51.906214] [INFO ] [MAIN ] FSS: Loaded 33656 existing records. [2025-10-15T19:01:52.087978] [WARN ] [MAIN ] FSS: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:01:52.088238] [INFO ] [MAIN ] FSS: Wiping existing primary data before full refresh. [2025-10-15T19:01:52.088310] [INFO ] [LOCAL ] FSS: Starting deletion of primary data. [2025-10-15T19:01:52.088849] [DEBUG] [LOCAL ] FSS: Deleted primary data file. [2025-10-15T19:01:52.088906] [INFO ] [MAIN ] FSS: Starting full primary refresh. [2025-10-15T19:01:52.119121] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-05. [2025-10-15T19:01:52.482979] [INFO ] [REMOTE ] FSS: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:01:52.485006] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-10-15T19:01:52.618148] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-15T19:01:52.914064] [INFO ] [REMOTE ] FSS: Fetching primary data for 2024-12. [2025-10-15T19:01:53.713977] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-03. [2025-10-15T19:01:53.786997] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-15T19:01:54.043481] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-15T19:01:54.514068] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-01. [2025-10-15T19:01:55.162375] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-15T19:01:55.314013] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-02. [2025-10-15T19:01:55.839367] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-15T19:01:56.114006] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-04. [2025-10-15T19:01:56.735434] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-15T19:01:56.914047] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-02. [2025-10-15T19:01:57.714012] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-03. [2025-10-15T19:01:57.860605] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-15T19:01:57.918670] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-15T19:01:58.514017] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-06. [2025-10-15T19:01:59.314026] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-05. [2025-10-15T19:01:59.384785] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-15T19:02:00.056521] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-15T19:02:00.114014] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-07. [2025-10-15T19:02:00.914056] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-03. [2025-10-15T19:02:01.338524] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-10-15T19:02:01.714097] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-06. [2025-10-15T19:02:01.980927] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-15T19:02:02.480277] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-15T19:02:02.514054] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-08. [2025-10-15T19:02:03.218994] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-15T19:02:03.314048] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-07. [2025-10-15T19:02:03.986609] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-15T19:02:04.114008] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-04. [2025-10-15T19:02:04.914058] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-04. [2025-10-15T19:02:05.241585] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-15T19:02:05.722485] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-08. [2025-10-15T19:02:05.729355] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-15T19:02:06.505078] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-15T19:02:06.517376] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-09. [2025-10-15T19:02:07.314055] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-05. [2025-10-15T19:02:07.503764] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-15T19:02:08.114034] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-05. [2025-10-15T19:02:08.366923] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-15T19:02:08.536819] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-15T19:02:08.914004] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-10. [2025-10-15T19:02:09.714013] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-06. [2025-10-15T19:02:09.952119] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-15T19:02:10.501880] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-15T19:02:10.508316] [INFO ] [REMOTE ] FSK: Full fetch complete (72006 records). [2025-10-15T19:02:10.508443] [DEBUG] [VALIDATOR ] FSK: Validating primary data. [2025-10-15T19:02:10.520270] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-09. [2025-10-15T19:02:10.904681] [DEBUG] [VALIDATOR ] FSK: All expected trading days are present. [2025-10-15T19:02:10.904795] [DEBUG] [VALIDATOR ] FSK: Primary data validation passed. [2025-10-15T19:02:10.906731] [INFO ] [MAIN ] FSK: Fetched primary data is valid. [2025-10-15T19:02:10.906861] [DEBUG] [LOCAL ] FSK: Saving primary data. [2025-10-15T19:02:10.908464] [DEBUG] [LOCAL ] FSK: Trimmed 72006 records to 49506 (keeping 200 days of data) [2025-10-15T19:02:11.150496] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-15T19:02:11.274477] [DEBUG] [LOCAL ] FSK: Primary data saved (49506 records). [2025-10-15T19:02:11.274686] [INFO ] [MAIN ] FSK: Full history saved. [2025-10-15T19:02:11.274812] [INFO ] [MAIN ] Update Progress: 873/2369 symbols completed. FSK took 43.5s. Estimated remaining: 3h 29m 15s. Rate: 7.1 symbols/min [2025-10-15T19:02:11.319180] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-07. [2025-10-15T19:02:11.475406] [INFO ] [MAIN ] FT: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:02:11.486172] [DEBUG] [LOCAL ] FT: Loaded 6802 existing records from primary storage. [2025-10-15T19:02:11.486462] [INFO ] [MAIN ] FT: Loaded 6802 existing records. [2025-10-15T19:02:11.663995] [WARN ] [MAIN ] FT: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:02:11.664218] [INFO ] [MAIN ] FT: Wiping existing primary data before full refresh. [2025-10-15T19:02:11.664266] [INFO ] [LOCAL ] FT: Starting deletion of primary data. [2025-10-15T19:02:11.664461] [DEBUG] [LOCAL ] FT: Deleted primary data file. [2025-10-15T19:02:11.664530] [INFO ] [MAIN ] FT: Starting full primary refresh. [2025-10-15T19:02:12.070612] [INFO ] [REMOTE ] FT: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:02:12.100410] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-15T19:02:12.113952] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-06. [2025-10-15T19:02:12.914018] [INFO ] [REMOTE ] FT: Fetching primary data for 2024-12. [2025-10-15T19:02:12.941324] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-15T19:02:13.527965] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-10-15T19:02:13.561869] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-15T19:02:13.713988] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-07. [2025-10-15T19:02:14.514017] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-10. [2025-10-15T19:02:15.314053] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-08. [2025-10-15T19:02:15.446054] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-15T19:02:16.113990] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-08. [2025-10-15T19:02:16.449467] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-10 (1.94 seconds). [2025-10-15T19:02:16.456454] [INFO ] [REMOTE ] FSLY: Full fetch complete (74999 records). [2025-10-15T19:02:16.456630] [DEBUG] [VALIDATOR ] FSLY: Validating primary data. [2025-10-15T19:02:16.772282] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-15T19:02:16.903107] [DEBUG] [VALIDATOR ] FSLY: All expected trading days are present. [2025-10-15T19:02:16.903208] [DEBUG] [VALIDATOR ] FSLY: Primary data validation passed. [2025-10-15T19:02:16.904246] [INFO ] [MAIN ] FSLY: Fetched primary data is valid. [2025-10-15T19:02:16.904327] [DEBUG] [LOCAL ] FSLY: Saving primary data. [2025-10-15T19:02:16.905839] [DEBUG] [LOCAL ] FSLY: Trimmed 74999 records to 51325 (keeping 200 days of data) [2025-10-15T19:02:16.953324] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-09. [2025-10-15T19:02:17.213208] [DEBUG] [LOCAL ] FSLY: Primary data saved (51325 records). [2025-10-15T19:02:17.213358] [INFO ] [MAIN ] FSLY: Full history saved. [2025-10-15T19:02:17.213833] [INFO ] [MAIN ] Update Progress: 874/2369 symbols completed. FSLY took 33.7s. Estimated remaining: 3h 29m 3s. Rate: 7.2 symbols/min [2025-10-15T19:02:17.392588] [INFO ] [MAIN ] FTHY: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:02:17.407962] [DEBUG] [LOCAL ] FTHY: Loaded 12287 existing records from primary storage. [2025-10-15T19:02:17.408217] [INFO ] [MAIN ] FTHY: Loaded 12287 existing records. [2025-10-15T19:02:17.598202] [WARN ] [MAIN ] FTHY: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:02:17.598711] [INFO ] [MAIN ] FTHY: Wiping existing primary data before full refresh. [2025-10-15T19:02:17.598770] [INFO ] [LOCAL ] FTHY: Starting deletion of primary data. [2025-10-15T19:02:17.598959] [DEBUG] [LOCAL ] FTHY: Deleted primary data file. [2025-10-15T19:02:17.599042] [INFO ] [MAIN ] FTHY: Starting full primary refresh. [2025-10-15T19:02:17.714038] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-01. [2025-10-15T19:02:17.999098] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-15T19:02:18.032118] [INFO ] [REMOTE ] FTHY: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:02:18.293201] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-15T19:02:18.387240] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-15T19:02:18.514008] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-09. [2025-10-15T19:02:19.314021] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-10. [2025-10-15T19:02:20.113999] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2024-12. [2025-10-15T19:02:20.355938] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-15T19:02:20.646326] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-15T19:02:20.650487] [INFO ] [REMOTE ] FSS: Full fetch complete (48543 records). [2025-10-15T19:02:20.650577] [DEBUG] [VALIDATOR ] FSS: Validating primary data. [2025-10-15T19:02:20.914747] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-10. [2025-10-15T19:02:21.039257] [DEBUG] [VALIDATOR ] FSS: All expected trading days are present. [2025-10-15T19:02:21.039378] [DEBUG] [VALIDATOR ] FSS: Primary data validation passed. [2025-10-15T19:02:21.040257] [INFO ] [MAIN ] FSS: Fetched primary data is valid. [2025-10-15T19:02:21.040355] [DEBUG] [LOCAL ] FSS: Saving primary data. [2025-10-15T19:02:21.052222] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-10-15T19:02:21.056988] [DEBUG] [LOCAL ] FSS: Trimmed 48543 records to 33666 (keeping 200 days of data) [2025-10-15T19:02:21.282673] [DEBUG] [LOCAL ] FSS: Primary data saved (33666 records). [2025-10-15T19:02:21.282823] [INFO ] [MAIN ] FSS: Full history saved. [2025-10-15T19:02:21.282903] [INFO ] [MAIN ] Update Progress: 875/2369 symbols completed. FSS took 29.6s. Estimated remaining: 3h 28m 47s. Rate: 7.2 symbols/min [2025-10-15T19:02:21.449524] [INFO ] [MAIN ] FTI: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:02:21.504112] [DEBUG] [LOCAL ] FTI: Loaded 53300 existing records from primary storage. [2025-10-15T19:02:21.504407] [INFO ] [MAIN ] FTI: Loaded 53300 existing records. [2025-10-15T19:02:21.676336] [WARN ] [MAIN ] FTI: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:02:21.676501] [INFO ] [MAIN ] FTI: Wiping existing primary data before full refresh. [2025-10-15T19:02:21.676567] [INFO ] [LOCAL ] FTI: Starting deletion of primary data. [2025-10-15T19:02:21.677122] [DEBUG] [LOCAL ] FTI: Deleted primary data file. [2025-10-15T19:02:21.677181] [INFO ] [MAIN ] FTI: Starting full primary refresh. [2025-10-15T19:02:21.719380] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-01. [2025-10-15T19:02:22.026186] [INFO ] [REMOTE ] FTI: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:02:22.513973] [INFO ] [REMOTE ] FTI: Fetching primary data for 2024-12. [2025-10-15T19:02:22.691817] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-15T19:02:22.894694] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-10 (1.98 seconds). [2025-10-15T19:02:22.905268] [INFO ] [REMOTE ] FSM: Full fetch complete (77069 records). [2025-10-15T19:02:22.905477] [DEBUG] [VALIDATOR ] FSM: Validating primary data. [2025-10-15T19:02:23.320741] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-02. [2025-10-15T19:02:23.321888] [DEBUG] [VALIDATOR ] FSM: All expected trading days are present. [2025-10-15T19:02:23.323399] [DEBUG] [VALIDATOR ] FSM: Primary data validation passed. [2025-10-15T19:02:23.324609] [INFO ] [MAIN ] FSM: Fetched primary data is valid. [2025-10-15T19:02:23.324813] [DEBUG] [LOCAL ] FSM: Saving primary data. [2025-10-15T19:02:23.326279] [DEBUG] [LOCAL ] FSM: Trimmed 77069 records to 53301 (keeping 200 days of data) [2025-10-15T19:02:23.649729] [DEBUG] [LOCAL ] FSM: Primary data saved (53301 records). [2025-10-15T19:02:23.649868] [INFO ] [MAIN ] FSM: Full history saved. [2025-10-15T19:02:23.649947] [INFO ] [MAIN ] Update Progress: 876/2369 symbols completed. FSM took 38.6s. Estimated remaining: 3h 28m 28s. Rate: 7.2 symbols/min [2025-10-15T19:02:23.832283] [INFO ] [MAIN ] FTK: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:02:23.864964] [DEBUG] [LOCAL ] FTK: Loaded 32864 existing records from primary storage. [2025-10-15T19:02:23.865250] [INFO ] [MAIN ] FTK: Loaded 32864 existing records. [2025-10-15T19:02:23.994258] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-15T19:02:24.081029] [WARN ] [MAIN ] FTK: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:02:24.081279] [INFO ] [MAIN ] FTK: Wiping existing primary data before full refresh. [2025-10-15T19:02:24.081419] [INFO ] [LOCAL ] FTK: Starting deletion of primary data. [2025-10-15T19:02:24.081710] [DEBUG] [LOCAL ] FTK: Deleted primary data file. [2025-10-15T19:02:24.081767] [INFO ] [MAIN ] FTK: Starting full primary refresh. [2025-10-15T19:02:24.119118] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-03. [2025-10-15T19:02:24.273822] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-15T19:02:24.562169] [INFO ] [REMOTE ] FTK: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:02:24.766740] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-15T19:02:24.914022] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-01. [2025-10-15T19:02:25.713989] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-02. [2025-10-15T19:02:26.465728] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-15T19:02:26.513948] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-03. [2025-10-15T19:02:26.742585] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-15T19:02:27.208248] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-15T19:02:27.313948] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-04. [2025-10-15T19:02:28.114001] [INFO ] [REMOTE ] FTK: Fetching primary data for 2024-12. [2025-10-15T19:02:28.261494] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-15T19:02:28.913965] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-05. [2025-10-15T19:02:29.247834] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-15T19:02:29.666159] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-15T19:02:29.714011] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-01. [2025-10-15T19:02:30.514008] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-02. [2025-10-15T19:02:30.750218] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-15T19:02:31.314041] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-02. [2025-10-15T19:02:32.113993] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-06. [2025-10-15T19:02:32.148604] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-15T19:02:32.179534] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-15T19:02:32.530889] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-10-15T19:02:32.914015] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-03. [2025-10-15T19:02:33.713974] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-03. [2025-10-15T19:02:34.125344] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-15T19:02:34.514026] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-04. [2025-10-15T19:02:35.214593] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-15T19:02:35.314048] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-07. [2025-10-15T19:02:35.726167] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-15T19:02:36.085819] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-15T19:02:36.113986] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-08. [2025-10-15T19:02:36.909181] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-15T19:02:36.913953] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-09. [2025-10-15T19:02:37.671111] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-15T19:02:37.713995] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-10. [2025-10-15T19:02:38.514033] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-04. [2025-10-15T19:02:38.627478] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-15T19:02:38.630940] [INFO ] [REMOTE ] FTHY: Full fetch complete (17358 records). [2025-10-15T19:02:38.631101] [DEBUG] [VALIDATOR ] FTHY: Validating primary data. [2025-10-15T19:02:39.048346] [DEBUG] [VALIDATOR ] FTHY: All expected trading days are present. [2025-10-15T19:02:39.048430] [DEBUG] [VALIDATOR ] FTHY: Primary data validation passed. [2025-10-15T19:02:39.048860] [INFO ] [MAIN ] FTHY: Fetched primary data is valid. [2025-10-15T19:02:39.048922] [DEBUG] [LOCAL ] FTHY: Saving primary data. [2025-10-15T19:02:39.049521] [DEBUG] [LOCAL ] FTHY: Trimmed 17358 records to 12336 (keeping 200 days of data) [2025-10-15T19:02:39.128196] [DEBUG] [LOCAL ] FTHY: Primary data saved (12336 records). [2025-10-15T19:02:39.128348] [INFO ] [MAIN ] FTHY: Full history saved. [2025-10-15T19:02:39.128431] [INFO ] [MAIN ] Update Progress: 877/2369 symbols completed. FTHY took 21.9s. Estimated remaining: 3h 28m 32s. Rate: 7.2 symbols/min [2025-10-15T19:02:39.314026] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-05. [2025-10-15T19:02:40.114081] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-04. [2025-10-15T19:02:40.306260] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-15T19:02:40.756186] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-15T19:02:40.769677] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-15T19:02:40.914056] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-05. [2025-10-15T19:02:41.630988] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-15T19:02:41.714067] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-05. [2025-10-15T19:02:42.514091] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-06. [2025-10-15T19:02:43.092036] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-15T19:02:43.314091] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-06. [2025-10-15T19:02:43.560073] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-15T19:02:44.114036] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-07. [2025-10-15T19:02:44.558404] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-15T19:02:44.754071] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-10-15T19:02:44.914062] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-07. [2025-10-15T19:02:45.714108] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-08. [2025-10-15T19:02:46.361398] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-15T19:02:46.432004] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-15T19:02:46.514034] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-09. [2025-10-15T19:02:46.992869] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-10-15T19:02:47.314020] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-06. [2025-10-15T19:02:48.114073] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-08. [2025-10-15T19:02:48.914102] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-10. [2025-10-15T19:02:49.010406] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-15T19:02:49.432069] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-15T19:02:49.434160] [INFO ] [REMOTE ] FT: Full fetch complete (9305 records). [2025-10-15T19:02:49.440991] [DEBUG] [VALIDATOR ] FT: Validating primary data. [2025-10-15T19:02:49.453859] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-15T19:02:49.719149] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-09. [2025-10-15T19:02:49.826392] [DEBUG] [VALIDATOR ] FT: All expected trading days are present. [2025-10-15T19:02:49.826469] [DEBUG] [VALIDATOR ] FT: Primary data validation passed. [2025-10-15T19:02:49.826736] [INFO ] [MAIN ] FT: Fetched primary data is valid. [2025-10-15T19:02:49.826798] [DEBUG] [LOCAL ] FT: Saving primary data. [2025-10-15T19:02:49.827217] [DEBUG] [LOCAL ] FT: Trimmed 9305 records to 6804 (keeping 200 days of data) [2025-10-15T19:02:49.867014] [DEBUG] [LOCAL ] FT: Primary data saved (6804 records). [2025-10-15T19:02:49.867160] [INFO ] [MAIN ] FT: Full history saved. [2025-10-15T19:02:49.867241] [INFO ] [MAIN ] Update Progress: 878/2369 symbols completed. FT took 38.6s. Estimated remaining: 3h 28m 28s. Rate: 7.2 symbols/min [2025-10-15T19:02:50.514080] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-07. [2025-10-15T19:02:51.076007] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-15T19:02:51.314064] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-10. [2025-10-15T19:02:52.293588] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-15T19:02:52.305316] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-08. [2025-10-15T19:02:52.633169] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-15T19:02:52.638122] [INFO ] [REMOTE ] FTK: Full fetch complete (44059 records). [2025-10-15T19:02:52.638261] [DEBUG] [VALIDATOR ] FTK: Validating primary data. [2025-10-15T19:02:53.045347] [DEBUG] [VALIDATOR ] FTK: All expected trading days are present. [2025-10-15T19:02:53.045460] [DEBUG] [VALIDATOR ] FTK: Primary data validation passed. [2025-10-15T19:02:53.046203] [INFO ] [MAIN ] FTK: Fetched primary data is valid. [2025-10-15T19:02:53.046312] [DEBUG] [LOCAL ] FTK: Saving primary data. [2025-10-15T19:02:53.047376] [DEBUG] [LOCAL ] FTK: Trimmed 44059 records to 32908 (keeping 200 days of data) [2025-10-15T19:02:53.237426] [DEBUG] [LOCAL ] FTK: Primary data saved (32908 records). [2025-10-15T19:02:53.237567] [INFO ] [MAIN ] FTK: Full history saved. [2025-10-15T19:02:53.237667] [INFO ] [MAIN ] Update Progress: 879/2369 symbols completed. FTK took 29.6s. Estimated remaining: 3h 28m 11s. Rate: 7.2 symbols/min [2025-10-15T19:02:54.068256] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-15T19:02:54.085579] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-09. [2025-10-15T19:02:55.903727] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-15T19:02:55.916566] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-10. [2025-10-15T19:02:57.799083] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-10 (1.88 seconds). [2025-10-15T19:02:57.808853] [INFO ] [REMOTE ] FTI: Full fetch complete (77302 records). [2025-10-15T19:02:57.809045] [DEBUG] [VALIDATOR ] FTI: Validating primary data. [2025-10-15T19:02:58.214617] [DEBUG] [VALIDATOR ] FTI: All expected trading days are present. [2025-10-15T19:02:58.214762] [DEBUG] [VALIDATOR ] FTI: Primary data validation passed. [2025-10-15T19:02:58.215789] [INFO ] [MAIN ] FTI: Fetched primary data is valid. [2025-10-15T19:02:58.215850] [DEBUG] [LOCAL ] FTI: Saving primary data. [2025-10-15T19:02:58.217779] [DEBUG] [LOCAL ] FTI: Trimmed 77302 records to 53296 (keeping 200 days of data) [2025-10-15T19:02:58.551608] [DEBUG] [LOCAL ] FTI: Primary data saved (53296 records). [2025-10-15T19:02:58.551789] [INFO ] [MAIN ] FTI: Full history saved. [2025-10-15T19:02:58.552671] [INFO ] [MAIN ] Update Progress: 880/2369 symbols completed. FTI took 37.3s. Estimated remaining: 3h 27m 57s. Rate: 7.2 symbols/min [2025-10-15T19:02:59.218924] [INFO ] [MAIN ] FTS: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:02:59.335510] [INFO ] [MAIN ] FUBO: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:02:59.317252] [INFO ] [MAIN ] FTV: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:02:59.341604] [INFO ] [MAIN ] FTWO: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:02:59.349944] [DEBUG] [LOCAL ] FTWO: Loaded 1904 existing records from primary storage. [2025-10-15T19:02:59.350492] [INFO ] [MAIN ] FTWO: Loaded 1904 existing records. [2025-10-15T19:02:59.583096] [WARN ] [MAIN ] FTWO: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:02:59.584719] [INFO ] [MAIN ] FTWO: Wiping existing primary data before full refresh. [2025-10-15T19:02:59.585834] [DEBUG] [LOCAL ] FTS: Loaded 42555 existing records from primary storage. [2025-10-15T19:02:59.584800] [INFO ] [LOCAL ] FTWO: Starting deletion of primary data. [2025-10-15T19:02:59.600571] [DEBUG] [LOCAL ] FTWO: Deleted primary data file. [2025-10-15T19:02:59.600510] [INFO ] [MAIN ] FTS: Loaded 42555 existing records. [2025-10-15T19:02:59.600721] [INFO ] [MAIN ] FTWO: Starting full primary refresh. [2025-10-15T19:02:59.812191] [DEBUG] [LOCAL ] FTV: Loaded 53038 existing records from primary storage. [2025-10-15T19:02:59.793711] [DEBUG] [LOCAL ] FUBO: Loaded 53718 existing records from primary storage. [2025-10-15T19:02:59.831944] [INFO ] [MAIN ] FUBO: Loaded 53718 existing records. [2025-10-15T19:02:59.832096] [INFO ] [MAIN ] FTV: Loaded 53038 existing records. [2025-10-15T19:03:00.192001] [WARN ] [MAIN ] FTS: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:03:00.207987] [INFO ] [MAIN ] FTS: Wiping existing primary data before full refresh. [2025-10-15T19:03:00.264112] [INFO ] [LOCAL ] FTS: Starting deletion of primary data. [2025-10-15T19:03:00.380819] [DEBUG] [LOCAL ] FTS: Deleted primary data file. [2025-10-15T19:03:00.414111] [INFO ] [MAIN ] FTS: Starting full primary refresh. [2025-10-15T19:03:00.532711] [WARN ] [MAIN ] FTV: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:03:00.577184] [INFO ] [MAIN ] FTV: Wiping existing primary data before full refresh. [2025-10-15T19:03:00.683792] [WARN ] [MAIN ] FUBO: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:03:00.689071] [INFO ] [LOCAL ] FTV: Starting deletion of primary data. [2025-10-15T19:03:00.720344] [INFO ] [MAIN ] FUBO: Wiping existing primary data before full refresh. [2025-10-15T19:03:00.756752] [DEBUG] [LOCAL ] FTV: Deleted primary data file. [2025-10-15T19:03:00.725630] [INFO ] [LOCAL ] FUBO: Starting deletion of primary data. [2025-10-15T19:03:00.782965] [INFO ] [MAIN ] FTV: Starting full primary refresh. [2025-10-15T19:03:00.789419] [DEBUG] [LOCAL ] FUBO: Deleted primary data file. [2025-10-15T19:03:00.792225] [INFO ] [MAIN ] FUBO: Starting full primary refresh. [2025-10-15T19:03:00.852435] [INFO ] [REMOTE ] FTWO: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:03:01.098857] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2024-12. [2025-10-15T19:03:01.724771] [INFO ] [REMOTE ] FTS: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:03:01.801078] [INFO ] [REMOTE ] FTS: Fetching primary data for 2024-12. [2025-10-15T19:03:01.882903] [INFO ] [REMOTE ] FTV: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:03:01.907580] [INFO ] [REMOTE ] FTV: Fetching primary data for 2024-12. [2025-10-15T19:03:01.959621] [INFO ] [REMOTE ] FUBO: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:03:01.960019] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2024-12. [2025-10-15T19:03:01.965193] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-10-15T19:03:01.966857] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-01. [2025-10-15T19:03:02.582971] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-15T19:03:02.584549] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-02. [2025-10-15T19:03:03.036152] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-15T19:03:03.037410] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-03. [2025-10-15T19:03:03.201289] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-15T19:03:03.210880] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-01. [2025-10-15T19:03:03.293714] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-15T19:03:03.304799] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-01. [2025-10-15T19:03:03.412195] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-10-15T19:03:03.414050] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-04. [2025-10-15T19:03:03.751735] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-04 (0.34 seconds). [2025-10-15T19:03:03.753079] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-05. [2025-10-15T19:03:03.801886] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-15T19:03:03.813504] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-01. [2025-10-15T19:03:04.097850] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-10-15T19:03:04.113955] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-06. [2025-10-15T19:03:04.579406] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-10-15T19:03:04.788408] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-15T19:03:04.895745] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-15T19:03:04.913963] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-02. [2025-10-15T19:03:05.714081] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-07. [2025-10-15T19:03:06.174087] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-10-15T19:03:06.179424] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-01 (2.37 seconds). [2025-10-15T19:03:06.252583] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-15T19:03:06.514067] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-02. [2025-10-15T19:03:07.314020] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-03. [2025-10-15T19:03:07.898055] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-15T19:03:08.113988] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-03. [2025-10-15T19:03:08.914018] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-08. [2025-10-15T19:03:09.025482] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-15T19:03:09.188815] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-15T19:03:09.341780] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-10-15T19:03:09.714013] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-04. [2025-10-15T19:03:10.514008] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-04. [2025-10-15T19:03:11.229235] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-15T19:03:11.314027] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-05. [2025-10-15T19:03:12.114047] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-02. [2025-10-15T19:03:12.308170] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-15T19:03:12.702285] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-15T19:03:12.914051] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-06. [2025-10-15T19:03:13.714035] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-05. [2025-10-15T19:03:14.164166] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-02 (2.05 seconds). [2025-10-15T19:03:14.441315] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-15T19:03:14.514012] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-07. [2025-10-15T19:03:15.249881] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-15T19:03:15.314001] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-09. [2025-10-15T19:03:15.781782] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-10-15T19:03:15.785912] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-15T19:03:16.114030] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-08. [2025-10-15T19:03:16.914013] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-10. [2025-10-15T19:03:17.407503] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-15T19:03:17.429771] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-15T19:03:17.430751] [INFO ] [REMOTE ] FTWO: Full fetch complete (3329 records). [2025-10-15T19:03:17.430820] [DEBUG] [VALIDATOR ] FTWO: Validating primary data. [2025-10-15T19:03:17.719205] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-06. [2025-10-15T19:03:17.814377] [DEBUG] [VALIDATOR ] FTWO: All expected trading days are present. [2025-10-15T19:03:17.814451] [DEBUG] [VALIDATOR ] FTWO: Primary data validation passed. [2025-10-15T19:03:17.814589] [INFO ] [MAIN ] FTWO: Fetched primary data is valid. [2025-10-15T19:03:17.814671] [DEBUG] [LOCAL ] FTWO: Saving primary data. [2025-10-15T19:03:17.815028] [DEBUG] [LOCAL ] FTWO: Trimmed 3329 records to 1915 (keeping 200 days of data) [2025-10-15T19:03:17.827144] [DEBUG] [LOCAL ] FTWO: Primary data saved (1915 records). [2025-10-15T19:03:17.827278] [INFO ] [MAIN ] FTWO: Full history saved. [2025-10-15T19:03:17.827418] [INFO ] [MAIN ] Update Progress: 881/2369 symbols completed. FTWO took 19.3s. Estimated remaining: 3h 28m 7s. Rate: 7.1 symbols/min [2025-10-15T19:03:18.013117] [INFO ] [MAIN ] FUL: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:03:18.044668] [DEBUG] [LOCAL ] FUL: Loaded 32507 existing records from primary storage. [2025-10-15T19:03:18.044973] [INFO ] [MAIN ] FUL: Loaded 32507 existing records. [2025-10-15T19:03:18.223251] [WARN ] [MAIN ] FUL: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:03:18.223468] [INFO ] [MAIN ] FUL: Wiping existing primary data before full refresh. [2025-10-15T19:03:18.223533] [INFO ] [LOCAL ] FUL: Starting deletion of primary data. [2025-10-15T19:03:18.223879] [DEBUG] [LOCAL ] FUL: Deleted primary data file. [2025-10-15T19:03:18.223947] [INFO ] [MAIN ] FUL: Starting full primary refresh. [2025-10-15T19:03:18.519104] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-03. [2025-10-15T19:03:18.594937] [INFO ] [REMOTE ] FUL: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:03:19.314002] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-09. [2025-10-15T19:03:19.404304] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-15T19:03:20.113981] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-07. [2025-10-15T19:03:20.789091] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-03 (2.27 seconds). [2025-10-15T19:03:20.824702] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-15T19:03:20.913992] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-10. [2025-10-15T19:03:21.713974] [INFO ] [REMOTE ] FUL: Fetching primary data for 2024-12. [2025-10-15T19:03:21.894665] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-15T19:03:22.156094] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-15T19:03:22.161586] [INFO ] [REMOTE ] FTS: Full fetch complete (60575 records). [2025-10-15T19:03:22.161770] [DEBUG] [VALIDATOR ] FTS: Validating primary data. [2025-10-15T19:03:22.517632] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-08. [2025-10-15T19:03:22.565209] [DEBUG] [VALIDATOR ] FTS: All expected trading days are present. [2025-10-15T19:03:22.565567] [DEBUG] [VALIDATOR ] FTS: Primary data validation passed. [2025-10-15T19:03:22.566676] [INFO ] [MAIN ] FTS: Fetched primary data is valid. [2025-10-15T19:03:22.566840] [DEBUG] [LOCAL ] FTS: Saving primary data. [2025-10-15T19:03:22.573958] [DEBUG] [LOCAL ] FTS: Trimmed 60575 records to 42538 (keeping 200 days of data) [2025-10-15T19:03:22.585207] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-10-15T19:03:22.854116] [DEBUG] [LOCAL ] FTS: Primary data saved (42538 records). [2025-10-15T19:03:22.854248] [INFO ] [MAIN ] FTS: Full history saved. [2025-10-15T19:03:22.854973] [INFO ] [MAIN ] Update Progress: 882/2369 symbols completed. FTS took 24.3s. Estimated remaining: 3h 27m 53s. Rate: 7.2 symbols/min [2025-10-15T19:03:23.031745] [INFO ] [MAIN ] FUN: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:03:23.087249] [DEBUG] [LOCAL ] FUN: Loaded 51869 existing records from primary storage. [2025-10-15T19:03:23.087627] [INFO ] [MAIN ] FUN: Loaded 51869 existing records. [2025-10-15T19:03:23.290761] [WARN ] [MAIN ] FUN: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:03:23.290965] [INFO ] [MAIN ] FUN: Wiping existing primary data before full refresh. [2025-10-15T19:03:23.291012] [INFO ] [LOCAL ] FUN: Starting deletion of primary data. [2025-10-15T19:03:23.291209] [DEBUG] [LOCAL ] FUN: Deleted primary data file. [2025-10-15T19:03:23.291263] [INFO ] [MAIN ] FUN: Starting full primary refresh. [2025-10-15T19:03:23.320895] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-04. [2025-10-15T19:03:23.726032] [INFO ] [REMOTE ] FUN: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:03:24.114039] [INFO ] [REMOTE ] FUN: Fetching primary data for 2024-12. [2025-10-15T19:03:24.268695] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-15T19:03:24.914003] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-01. [2025-10-15T19:03:25.436206] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-10-15T19:03:25.521907] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-15T19:03:25.714005] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-09. [2025-10-15T19:03:25.829449] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-15T19:03:26.514064] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-02. [2025-10-15T19:03:27.313991] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-01. [2025-10-15T19:03:27.479134] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-15T19:03:27.836370] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-15T19:03:28.114038] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-10. [2025-10-15T19:03:28.698338] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-15T19:03:28.913999] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-05. [2025-10-15T19:03:29.714035] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-02. [2025-10-15T19:03:29.890556] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-15T19:03:29.897162] [INFO ] [REMOTE ] FTV: Full fetch complete (76635 records). [2025-10-15T19:03:29.897323] [DEBUG] [VALIDATOR ] FTV: Validating primary data. [2025-10-15T19:03:30.289419] [DEBUG] [VALIDATOR ] FTV: All expected trading days are present. [2025-10-15T19:03:30.289500] [DEBUG] [VALIDATOR ] FTV: Primary data validation passed. [2025-10-15T19:03:30.290482] [INFO ] [MAIN ] FTV: Fetched primary data is valid. [2025-10-15T19:03:30.290543] [DEBUG] [LOCAL ] FTV: Saving primary data. [2025-10-15T19:03:30.292322] [DEBUG] [LOCAL ] FTV: Trimmed 76635 records to 53067 (keeping 200 days of data) [2025-10-15T19:03:30.514224] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-03. [2025-10-15T19:03:30.620398] [DEBUG] [LOCAL ] FTV: Primary data saved (53067 records). [2025-10-15T19:03:30.620524] [INFO ] [MAIN ] FTV: Full history saved. [2025-10-15T19:03:30.620600] [INFO ] [MAIN ] Update Progress: 883/2369 symbols completed. FTV took 32.1s. Estimated remaining: 3h 27m 44s. Rate: 7.2 symbols/min [2025-10-15T19:03:30.795272] [INFO ] [MAIN ] FVR: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:03:30.817496] [DEBUG] [LOCAL ] FVR: Loaded 21188 existing records from primary storage. [2025-10-15T19:03:30.817770] [INFO ] [MAIN ] FVR: Loaded 21188 existing records. [2025-10-15T19:03:31.008364] [WARN ] [MAIN ] FVR: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:03:31.008910] [INFO ] [MAIN ] FVR: Wiping existing primary data before full refresh. [2025-10-15T19:03:31.009273] [INFO ] [LOCAL ] FVR: Starting deletion of primary data. [2025-10-15T19:03:31.034311] [DEBUG] [LOCAL ] FVR: Deleted primary data file. [2025-10-15T19:03:31.034551] [INFO ] [MAIN ] FVR: Starting full primary refresh. [2025-10-15T19:03:31.084355] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-05 (2.17 seconds). [2025-10-15T19:03:31.317976] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-06. [2025-10-15T19:03:31.444701] [INFO ] [REMOTE ] FVR: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:03:31.446216] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-15T19:03:32.001415] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-15T19:03:32.113963] [INFO ] [REMOTE ] FVR: Fetching primary data for 2024-12. [2025-10-15T19:03:32.914074] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-04. [2025-10-15T19:03:33.205105] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-15T19:03:33.387715] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-06 (2.07 seconds). [2025-10-15T19:03:33.714012] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-01. [2025-10-15T19:03:34.371086] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-15T19:03:34.514015] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-05. [2025-10-15T19:03:34.676555] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-15T19:03:35.314036] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-02. [2025-10-15T19:03:35.520902] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-15T19:03:36.117744] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-03. [2025-10-15T19:03:36.121357] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-15T19:03:36.914061] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-03. [2025-10-15T19:03:37.714064] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-07. [2025-10-15T19:03:37.762992] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-15T19:03:37.798714] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-15T19:03:38.513985] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-04. [2025-10-15T19:03:39.314006] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-06. [2025-10-15T19:03:39.796073] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-10-15T19:03:40.118034] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-08. [2025-10-15T19:03:40.126705] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-15T19:03:40.178728] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-15T19:03:40.914008] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-04. [2025-10-15T19:03:41.713992] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-05. [2025-10-15T19:03:41.960395] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-15T19:03:42.158394] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-10-15T19:03:42.514006] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-05. [2025-10-15T19:03:43.314049] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-09. [2025-10-15T19:03:43.731927] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-15T19:03:44.008606] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-05 (2.29 seconds). [2025-10-15T19:03:44.114018] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-07. [2025-10-15T19:03:44.914061] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-06. [2025-10-15T19:03:45.714074] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-06. [2025-10-15T19:03:46.223834] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-15T19:03:46.384292] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-07 (2.27 seconds). [2025-10-15T19:03:46.519074] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-07. [2025-10-15T19:03:46.541253] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-09 (3.23 seconds). [2025-10-15T19:03:47.314085] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-08. [2025-10-15T19:03:47.414572] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-15T19:03:47.582584] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-15T19:03:48.114075] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-10. [2025-10-15T19:03:48.578905] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-15T19:03:48.914029] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-08. [2025-10-15T19:03:49.714018] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-07. [2025-10-15T19:03:49.977064] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-15T19:03:50.361672] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-10 (2.25 seconds). [2025-10-15T19:03:50.368169] [INFO ] [REMOTE ] FUBO: Full fetch complete (77867 records). [2025-10-15T19:03:50.368313] [DEBUG] [VALIDATOR ] FUBO: Validating primary data. [2025-10-15T19:03:50.519091] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-09. [2025-10-15T19:03:50.760088] [DEBUG] [VALIDATOR ] FUBO: All expected trading days are present. [2025-10-15T19:03:50.760186] [DEBUG] [VALIDATOR ] FUBO: Primary data validation passed. [2025-10-15T19:03:50.761169] [INFO ] [MAIN ] FUBO: Fetched primary data is valid. [2025-10-15T19:03:50.761234] [DEBUG] [LOCAL ] FUBO: Saving primary data. [2025-10-15T19:03:50.762796] [DEBUG] [LOCAL ] FUBO: Trimmed 77867 records to 53718 (keeping 200 days of data) [2025-10-15T19:03:51.075471] [DEBUG] [LOCAL ] FUBO: Primary data saved (53718 records). [2025-10-15T19:03:51.075632] [INFO ] [MAIN ] FUBO: Full history saved. [2025-10-15T19:03:51.075778] [INFO ] [MAIN ] Update Progress: 884/2369 symbols completed. FUBO took 52.5s. Estimated remaining: 3h 27m 56s. Rate: 7.1 symbols/min [2025-10-15T19:03:51.245721] [INFO ] [MAIN ] FVRR: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:03:51.278972] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-15T19:03:51.321394] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-08. [2025-10-15T19:03:51.323912] [DEBUG] [LOCAL ] FVRR: Loaded 40624 existing records from primary storage. [2025-10-15T19:03:51.324262] [INFO ] [MAIN ] FVRR: Loaded 40624 existing records. [2025-10-15T19:03:51.506065] [WARN ] [MAIN ] FVRR: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:03:51.506372] [INFO ] [MAIN ] FVRR: Wiping existing primary data before full refresh. [2025-10-15T19:03:51.506434] [INFO ] [LOCAL ] FVRR: Starting deletion of primary data. [2025-10-15T19:03:51.506778] [DEBUG] [LOCAL ] FVRR: Deleted primary data file. [2025-10-15T19:03:51.506849] [INFO ] [MAIN ] FVRR: Starting full primary refresh. [2025-10-15T19:03:51.629291] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-15T19:03:51.875775] [INFO ] [REMOTE ] FVRR: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:03:52.114002] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-10. [2025-10-15T19:03:52.914015] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2024-12. [2025-10-15T19:03:53.046054] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-15T19:03:53.048460] [INFO ] [REMOTE ] FVR: Full fetch complete (29573 records). [2025-10-15T19:03:53.048536] [DEBUG] [VALIDATOR ] FVR: Validating primary data. [2025-10-15T19:03:53.371379] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-08 (2.05 seconds). [2025-10-15T19:03:53.474708] [DEBUG] [VALIDATOR ] FVR: All expected trading days are present. [2025-10-15T19:03:53.474817] [DEBUG] [VALIDATOR ] FVR: Primary data validation passed. [2025-10-15T19:03:53.475562] [INFO ] [MAIN ] FVR: Fetched primary data is valid. [2025-10-15T19:03:53.475664] [DEBUG] [LOCAL ] FVR: Saving primary data. [2025-10-15T19:03:53.476880] [DEBUG] [LOCAL ] FVR: Trimmed 29573 records to 21190 (keeping 200 days of data) [2025-10-15T19:03:53.630406] [DEBUG] [LOCAL ] FVR: Primary data saved (21190 records). [2025-10-15T19:03:53.630547] [INFO ] [MAIN ] FVR: Full history saved. [2025-10-15T19:03:53.630637] [INFO ] [MAIN ] Update Progress: 885/2369 symbols completed. FVR took 23.0s. Estimated remaining: 3h 27m 37s. Rate: 7.1 symbols/min [2025-10-15T19:03:53.719106] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-09. [2025-10-15T19:03:53.797163] [INFO ] [MAIN ] FXED: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:03:53.800727] [DEBUG] [LOCAL ] FXED: Loaded 1253 existing records from primary storage. [2025-10-15T19:03:53.800861] [INFO ] [MAIN ] FXED: Loaded 1253 existing records. [2025-10-15T19:03:53.973034] [WARN ] [MAIN ] FXED: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:03:53.973211] [INFO ] [MAIN ] FXED: Wiping existing primary data before full refresh. [2025-10-15T19:03:53.973257] [INFO ] [LOCAL ] FXED: Starting deletion of primary data. [2025-10-15T19:03:53.973375] [DEBUG] [LOCAL ] FXED: Deleted primary data file. [2025-10-15T19:03:53.973412] [INFO ] [MAIN ] FXED: Starting full primary refresh. [2025-10-15T19:03:54.346013] [INFO ] [REMOTE ] FXED: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:03:54.349808] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-15T19:03:54.513960] [INFO ] [REMOTE ] FXED: Fetching primary data for 2024-12. [2025-10-15T19:03:54.859121] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2024-12 (0.35 seconds). [2025-10-15T19:03:55.314007] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-01. [2025-10-15T19:03:55.535774] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-15T19:03:55.723946] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-01 (0.41 seconds). [2025-10-15T19:03:56.114102] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-02. [2025-10-15T19:03:56.449955] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-10-15T19:03:56.914004] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-09. [2025-10-15T19:03:57.714003] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-10. [2025-10-15T19:03:57.932462] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-15T19:03:58.514018] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-03. [2025-10-15T19:03:58.917797] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-03 (0.40 seconds). [2025-10-15T19:03:59.313957] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-01. [2025-10-15T19:03:59.391972] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-15T19:03:59.398406] [INFO ] [REMOTE ] FUN: Full fetch complete (73326 records). [2025-10-15T19:03:59.398556] [DEBUG] [VALIDATOR ] FUN: Validating primary data. [2025-10-15T19:03:59.823717] [DEBUG] [VALIDATOR ] FUN: All expected trading days are present. [2025-10-15T19:03:59.823819] [DEBUG] [VALIDATOR ] FUN: Primary data validation passed. [2025-10-15T19:03:59.824801] [INFO ] [MAIN ] FUN: Fetched primary data is valid. [2025-10-15T19:03:59.824889] [DEBUG] [LOCAL ] FUN: Saving primary data. [2025-10-15T19:03:59.826391] [DEBUG] [LOCAL ] FUN: Trimmed 73326 records to 51916 (keeping 200 days of data) [2025-10-15T19:04:00.114697] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-10. [2025-10-15T19:04:00.126667] [DEBUG] [LOCAL ] FUN: Primary data saved (51916 records). [2025-10-15T19:04:00.126753] [INFO ] [MAIN ] FUN: Full history saved. [2025-10-15T19:04:00.127022] [INFO ] [MAIN ] Update Progress: 886/2369 symbols completed. FUN took 37.3s. Estimated remaining: 3h 27m 26s. Rate: 7.1 symbols/min [2025-10-15T19:04:00.292579] [INFO ] [MAIN ] G: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:04:00.337231] [DEBUG] [LOCAL ] G: Loaded 50036 existing records from primary storage. [2025-10-15T19:04:00.337544] [INFO ] [MAIN ] G: Loaded 50036 existing records. [2025-10-15T19:04:00.511378] [WARN ] [MAIN ] G: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:04:00.511572] [INFO ] [MAIN ] G: Wiping existing primary data before full refresh. [2025-10-15T19:04:00.511618] [INFO ] [LOCAL ] G: Starting deletion of primary data. [2025-10-15T19:04:00.512025] [DEBUG] [LOCAL ] G: Deleted primary data file. [2025-10-15T19:04:00.512074] [INFO ] [MAIN ] G: Starting full primary refresh. [2025-10-15T19:04:00.867731] [INFO ] [REMOTE ] G: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:04:00.889688] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-15T19:04:00.913945] [INFO ] [REMOTE ] G: Fetching primary data for 2024-12. [2025-10-15T19:04:01.502998] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-15T19:04:01.507044] [INFO ] [REMOTE ] FUL: Full fetch complete (47828 records). [2025-10-15T19:04:01.507163] [DEBUG] [VALIDATOR ] FUL: Validating primary data. [2025-10-15T19:04:01.724730] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-02. [2025-10-15T19:04:01.891296] [DEBUG] [VALIDATOR ] FUL: All expected trading days are present. [2025-10-15T19:04:01.891390] [DEBUG] [VALIDATOR ] FUL: Primary data validation passed. [2025-10-15T19:04:01.892178] [INFO ] [MAIN ] FUL: Fetched primary data is valid. [2025-10-15T19:04:01.892244] [DEBUG] [LOCAL ] FUL: Saving primary data. [2025-10-15T19:04:01.893385] [DEBUG] [LOCAL ] FUL: Trimmed 47828 records to 32393 (keeping 200 days of data) [2025-10-15T19:04:02.090522] [DEBUG] [LOCAL ] FUL: Primary data saved (32393 records). [2025-10-15T19:04:02.090708] [INFO ] [MAIN ] FUL: Full history saved. [2025-10-15T19:04:02.090805] [INFO ] [MAIN ] Update Progress: 887/2369 symbols completed. FUL took 44.3s. Estimated remaining: 3h 27m 7s. Rate: 7.2 symbols/min [2025-10-15T19:04:02.268202] [INFO ] [MAIN ] GAB: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:04:02.297920] [DEBUG] [LOCAL ] GAB: Loaded 27719 existing records from primary storage. [2025-10-15T19:04:02.298259] [INFO ] [MAIN ] GAB: Loaded 27719 existing records. [2025-10-15T19:04:02.508423] [WARN ] [MAIN ] GAB: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:04:02.509020] [INFO ] [MAIN ] GAB: Wiping existing primary data before full refresh. [2025-10-15T19:04:02.509229] [INFO ] [LOCAL ] GAB: Starting deletion of primary data. [2025-10-15T19:04:02.509523] [DEBUG] [LOCAL ] GAB: Deleted primary data file. [2025-10-15T19:04:02.509600] [INFO ] [MAIN ] GAB: Starting full primary refresh. [2025-10-15T19:04:02.531268] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-04. [2025-10-15T19:04:02.740943] [INFO ] [REMOTE ] G: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-15T19:04:02.961890] [INFO ] [REMOTE ] GAB: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:04:03.291639] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-15T19:04:03.314753] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-05. [2025-10-15T19:04:03.319274] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-15T19:04:03.690401] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-10-15T19:04:04.114055] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-03. [2025-10-15T19:04:04.914055] [INFO ] [REMOTE ] GAB: Fetching primary data for 2024-12. [2025-10-15T19:04:05.579450] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-15T19:04:05.714000] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-04. [2025-10-15T19:04:06.149431] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-15T19:04:06.514046] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-01. [2025-10-15T19:04:07.158636] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-15T19:04:07.313970] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-05. [2025-10-15T19:04:07.408808] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-15T19:04:08.113994] [INFO ] [REMOTE ] G: Fetching primary data for 2025-01. [2025-10-15T19:04:08.855451] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-15T19:04:08.914028] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-06. [2025-10-15T19:04:09.668494] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-15T19:04:09.714007] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-06. [2025-10-15T19:04:10.037195] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-06 (0.32 seconds). [2025-10-15T19:04:10.156026] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-15T19:04:10.513990] [INFO ] [REMOTE ] G: Fetching primary data for 2025-02. [2025-10-15T19:04:11.314012] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-02. [2025-10-15T19:04:12.108586] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-15T19:04:12.119400] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-07. [2025-10-15T19:04:12.302905] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-15T19:04:12.914001] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-03. [2025-10-15T19:04:13.725175] [INFO ] [REMOTE ] G: Fetching primary data for 2025-03. [2025-10-15T19:04:13.751222] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-15T19:04:13.816507] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-15T19:04:14.514062] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-07. [2025-10-15T19:04:14.935090] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-10-15T19:04:15.314041] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-08. [2025-10-15T19:04:15.372565] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-15T19:04:16.114012] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-08. [2025-10-15T19:04:16.537014] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-10-15T19:04:16.913992] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-09. [2025-10-15T19:04:16.943073] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-15T19:04:17.348879] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-10-15T19:04:17.714007] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-04. [2025-10-15T19:04:18.514029] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-10. [2025-10-15T19:04:18.910704] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-10 (0.40 seconds). [2025-10-15T19:04:18.912370] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-15T19:04:18.913514] [INFO ] [REMOTE ] FXED: Full fetch complete (1796 records). [2025-10-15T19:04:18.913707] [DEBUG] [VALIDATOR ] FXED: Validating primary data. [2025-10-15T19:04:19.273240] [DEBUG] [VALIDATOR ] FXED: All expected trading days are present. [2025-10-15T19:04:19.273314] [DEBUG] [VALIDATOR ] FXED: Primary data validation passed. [2025-10-15T19:04:19.273404] [INFO ] [MAIN ] FXED: Fetched primary data is valid. [2025-10-15T19:04:19.273441] [DEBUG] [LOCAL ] FXED: Saving primary data. [2025-10-15T19:04:19.273788] [DEBUG] [LOCAL ] FXED: Trimmed 1796 records to 1246 (keeping 200 days of data) [2025-10-15T19:04:19.281689] [DEBUG] [LOCAL ] FXED: Primary data saved (1246 records). [2025-10-15T19:04:19.281747] [INFO ] [MAIN ] FXED: Full history saved. [2025-10-15T19:04:19.281807] [INFO ] [MAIN ] Update Progress: 888/2369 symbols completed. FXED took 25.7s. Estimated remaining: 3h 27m 13s. Rate: 7.1 symbols/min [2025-10-15T19:04:19.319205] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-09. [2025-10-15T19:04:19.450010] [INFO ] [MAIN ] GAM: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:04:19.456938] [DEBUG] [LOCAL ] GAM: Loaded 3927 existing records from primary storage. [2025-10-15T19:04:19.457183] [INFO ] [MAIN ] GAM: Loaded 3927 existing records. [2025-10-15T19:04:19.627679] [WARN ] [MAIN ] GAM: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:04:19.627871] [INFO ] [MAIN ] GAM: Wiping existing primary data before full refresh. [2025-10-15T19:04:19.627919] [INFO ] [LOCAL ] GAM: Starting deletion of primary data. [2025-10-15T19:04:19.628081] [DEBUG] [LOCAL ] GAM: Deleted primary data file. [2025-10-15T19:04:19.628149] [INFO ] [MAIN ] GAM: Starting full primary refresh. [2025-10-15T19:04:19.964161] [INFO ] [REMOTE ] GAM: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:04:20.113947] [INFO ] [REMOTE ] GAM: Fetching primary data for 2024-12. [2025-10-15T19:04:20.902295] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-15T19:04:20.913949] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-10. [2025-10-15T19:04:21.090160] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-10-15T19:04:21.714085] [INFO ] [REMOTE ] G: Fetching primary data for 2025-04. [2025-10-15T19:04:22.514103] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-05. [2025-10-15T19:04:22.650933] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-15T19:04:22.658482] [INFO ] [REMOTE ] FVRR: Full fetch complete (59304 records). [2025-10-15T19:04:22.658712] [DEBUG] [VALIDATOR ] FVRR: Validating primary data. [2025-10-15T19:04:23.104020] [DEBUG] [VALIDATOR ] FVRR: All expected trading days are present. [2025-10-15T19:04:23.104181] [DEBUG] [VALIDATOR ] FVRR: Primary data validation passed. [2025-10-15T19:04:23.105320] [INFO ] [MAIN ] FVRR: Fetched primary data is valid. [2025-10-15T19:04:23.105386] [DEBUG] [LOCAL ] FVRR: Saving primary data. [2025-10-15T19:04:23.106707] [DEBUG] [LOCAL ] FVRR: Trimmed 59304 records to 40631 (keeping 200 days of data) [2025-10-15T19:04:23.314864] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-01. [2025-10-15T19:04:23.353926] [DEBUG] [LOCAL ] FVRR: Primary data saved (40631 records). [2025-10-15T19:04:23.354128] [INFO ] [MAIN ] FVRR: Full history saved. [2025-10-15T19:04:23.354217] [INFO ] [MAIN ] Update Progress: 889/2369 symbols completed. FVRR took 32.3s. Estimated remaining: 3h 26m 57s. Rate: 7.2 symbols/min [2025-10-15T19:04:23.531355] [INFO ] [MAIN ] GAP: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:04:23.547427] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-15T19:04:23.582409] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-15T19:04:23.636148] [DEBUG] [LOCAL ] GAP: Loaded 53653 existing records from primary storage. [2025-10-15T19:04:23.636489] [INFO ] [MAIN ] GAP: Loaded 53653 existing records. [2025-10-15T19:04:23.815723] [WARN ] [MAIN ] GAP: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:04:23.815978] [INFO ] [MAIN ] GAP: Wiping existing primary data before full refresh. [2025-10-15T19:04:23.816047] [INFO ] [LOCAL ] GAP: Starting deletion of primary data. [2025-10-15T19:04:23.816508] [DEBUG] [LOCAL ] GAP: Deleted primary data file. [2025-10-15T19:04:23.816568] [INFO ] [MAIN ] GAP: Starting full primary refresh. [2025-10-15T19:04:23.965400] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-15T19:04:24.119209] [INFO ] [REMOTE ] G: Fetching primary data for 2025-05. [2025-10-15T19:04:24.232567] [INFO ] [REMOTE ] GAP: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:04:24.914063] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-02. [2025-10-15T19:04:25.584757] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-15T19:04:25.713962] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-03. [2025-10-15T19:04:25.853509] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-15T19:04:26.378729] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-10-15T19:04:26.513967] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-06. [2025-10-15T19:04:27.313976] [INFO ] [REMOTE ] G: Fetching primary data for 2025-06. [2025-10-15T19:04:27.741238] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-15T19:04:28.114010] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-04. [2025-10-15T19:04:28.703915] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-15T19:04:28.919184] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-05. [2025-10-15T19:04:28.936425] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-15T19:04:29.564115] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-15T19:04:29.714057] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-07. [2025-10-15T19:04:30.514074] [INFO ] [REMOTE ] G: Fetching primary data for 2025-07. [2025-10-15T19:04:31.123306] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-15T19:04:31.314030] [INFO ] [REMOTE ] GAP: Fetching primary data for 2024-12. [2025-10-15T19:04:31.851221] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-15T19:04:32.114056] [INFO ] [REMOTE ] G: Fetching primary data for 2025-08. [2025-10-15T19:04:32.913971] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-06. [2025-10-15T19:04:33.123967] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-15T19:04:33.714013] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-08. [2025-10-15T19:04:33.794827] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-15T19:04:33.796527] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-15T19:04:34.513965] [INFO ] [REMOTE ] G: Fetching primary data for 2025-09. [2025-10-15T19:04:34.695031] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-15T19:04:35.314053] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-07. [2025-10-15T19:04:35.847729] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-15T19:04:35.899240] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-10-15T19:04:36.114021] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-01. [2025-10-15T19:04:36.914086] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-09. [2025-10-15T19:04:37.714048] [INFO ] [REMOTE ] G: Fetching primary data for 2025-10. [2025-10-15T19:04:37.847095] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-15T19:04:38.346678] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-15T19:04:38.514051] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-08. [2025-10-15T19:04:38.979250] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-10-15T19:04:39.230203] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-15T19:04:39.237493] [INFO ] [REMOTE ] G: Full fetch complete (72078 records). [2025-10-15T19:04:39.237725] [DEBUG] [VALIDATOR ] G: Validating primary data. [2025-10-15T19:04:39.319232] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-10. [2025-10-15T19:04:39.653963] [DEBUG] [VALIDATOR ] G: All expected trading days are present. [2025-10-15T19:04:39.654053] [DEBUG] [VALIDATOR ] G: Primary data validation passed. [2025-10-15T19:04:39.655084] [INFO ] [MAIN ] G: Fetched primary data is valid. [2025-10-15T19:04:39.655146] [DEBUG] [LOCAL ] G: Saving primary data. [2025-10-15T19:04:39.656554] [DEBUG] [LOCAL ] G: Trimmed 72078 records to 50051 (keeping 200 days of data) [2025-10-15T19:04:39.960963] [DEBUG] [LOCAL ] G: Primary data saved (50051 records). [2025-10-15T19:04:39.961099] [INFO ] [MAIN ] G: Full history saved. [2025-10-15T19:04:39.961178] [INFO ] [MAIN ] Update Progress: 890/2369 symbols completed. G took 39.8s. Estimated remaining: 3h 27m 3s. Rate: 7.1 symbols/min [2025-10-15T19:04:40.116086] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-02. [2025-10-15T19:04:40.136778] [INFO ] [MAIN ] GATX: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:04:40.156862] [DEBUG] [LOCAL ] GATX: Loaded 18097 existing records from primary storage. [2025-10-15T19:04:40.157154] [INFO ] [MAIN ] GATX: Loaded 18097 existing records. [2025-10-15T19:04:40.336132] [WARN ] [MAIN ] GATX: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:04:40.336355] [INFO ] [MAIN ] GATX: Wiping existing primary data before full refresh. [2025-10-15T19:04:40.336402] [INFO ] [LOCAL ] GATX: Starting deletion of primary data. [2025-10-15T19:04:40.336730] [DEBUG] [LOCAL ] GATX: Deleted primary data file. [2025-10-15T19:04:40.336786] [INFO ] [MAIN ] GATX: Starting full primary refresh. [2025-10-15T19:04:40.699666] [INFO ] [REMOTE ] GATX: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:04:40.710035] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-15T19:04:40.713770] [INFO ] [REMOTE ] GAB: Full fetch complete (39356 records). [2025-10-15T19:04:40.713911] [DEBUG] [VALIDATOR ] GAB: Validating primary data. [2025-10-15T19:04:40.924493] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-09. [2025-10-15T19:04:41.075849] [DEBUG] [VALIDATOR ] GAB: All expected trading days are present. [2025-10-15T19:04:41.075921] [DEBUG] [VALIDATOR ] GAB: Primary data validation passed. [2025-10-15T19:04:41.076547] [INFO ] [MAIN ] GAB: Fetched primary data is valid. [2025-10-15T19:04:41.076586] [DEBUG] [LOCAL ] GAB: Saving primary data. [2025-10-15T19:04:41.077406] [DEBUG] [LOCAL ] GAB: Trimmed 39356 records to 27709 (keeping 200 days of data) [2025-10-15T19:04:41.231506] [DEBUG] [LOCAL ] GAB: Primary data saved (27709 records). [2025-10-15T19:04:41.231634] [INFO ] [MAIN ] GAB: Full history saved. [2025-10-15T19:04:41.231752] [INFO ] [MAIN ] Update Progress: 891/2369 symbols completed. GAB took 39.1s. Estimated remaining: 3h 26m 42s. Rate: 7.2 symbols/min [2025-10-15T19:04:41.399786] [INFO ] [MAIN ] GBAB: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:04:41.416341] [DEBUG] [LOCAL ] GBAB: Loaded 12962 existing records from primary storage. [2025-10-15T19:04:41.416553] [INFO ] [MAIN ] GBAB: Loaded 12962 existing records. [2025-10-15T19:04:41.509291] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-15T19:04:41.595717] [WARN ] [MAIN ] GBAB: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:04:41.595927] [INFO ] [MAIN ] GBAB: Wiping existing primary data before full refresh. [2025-10-15T19:04:41.595973] [INFO ] [LOCAL ] GBAB: Starting deletion of primary data. [2025-10-15T19:04:41.596250] [DEBUG] [LOCAL ] GBAB: Deleted primary data file. [2025-10-15T19:04:41.596307] [INFO ] [MAIN ] GBAB: Starting full primary refresh. [2025-10-15T19:04:41.714585] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-10. [2025-10-15T19:04:41.946885] [INFO ] [REMOTE ] GBAB: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:04:41.974461] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-10-15T19:04:42.319989] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-15T19:04:42.321365] [INFO ] [REMOTE ] GAM: Full fetch complete (6552 records). [2025-10-15T19:04:42.321443] [DEBUG] [VALIDATOR ] GAM: Validating primary data. [2025-10-15T19:04:42.523397] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-03. [2025-10-15T19:04:42.714842] [DEBUG] [VALIDATOR ] GAM: All expected trading days are present. [2025-10-15T19:04:42.714946] [DEBUG] [VALIDATOR ] GAM: Primary data validation passed. [2025-10-15T19:04:42.715230] [INFO ] [MAIN ] GAM: Fetched primary data is valid. [2025-10-15T19:04:42.715293] [DEBUG] [LOCAL ] GAM: Saving primary data. [2025-10-15T19:04:42.715902] [DEBUG] [LOCAL ] GAM: Trimmed 6552 records to 3926 (keeping 200 days of data) [2025-10-15T19:04:42.743762] [DEBUG] [LOCAL ] GAM: Primary data saved (3926 records). [2025-10-15T19:04:42.743949] [INFO ] [MAIN ] GAM: Full history saved. [2025-10-15T19:04:42.744047] [INFO ] [MAIN ] Update Progress: 892/2369 symbols completed. GAM took 23.5s. Estimated remaining: 3h 26m 23s. Rate: 7.2 symbols/min [2025-10-15T19:04:42.923039] [INFO ] [MAIN ] GBCI: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:04:42.962179] [DEBUG] [LOCAL ] GBCI: Loaded 40713 existing records from primary storage. [2025-10-15T19:04:42.962533] [INFO ] [MAIN ] GBCI: Loaded 40713 existing records. [2025-10-15T19:04:43.143853] [WARN ] [MAIN ] GBCI: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:04:43.144088] [INFO ] [MAIN ] GBCI: Wiping existing primary data before full refresh. [2025-10-15T19:04:43.144182] [INFO ] [LOCAL ] GBCI: Starting deletion of primary data. [2025-10-15T19:04:43.144450] [DEBUG] [LOCAL ] GBCI: Deleted primary data file. [2025-10-15T19:04:43.144508] [INFO ] [MAIN ] GBCI: Starting full primary refresh. [2025-10-15T19:04:43.327238] [INFO ] [REMOTE ] GATX: Fetching primary data for 2024-12. [2025-10-15T19:04:43.507530] [INFO ] [REMOTE ] GBCI: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:04:44.113975] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2024-12. [2025-10-15T19:04:44.215403] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-10-15T19:04:44.715920] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-03 (2.19 seconds). [2025-10-15T19:04:44.913978] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2024-12. [2025-10-15T19:04:45.520353] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-15T19:04:45.600513] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-10-15T19:04:45.713980] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-01. [2025-10-15T19:04:46.514035] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-01. [2025-10-15T19:04:46.580141] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-15T19:04:47.314025] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-04. [2025-10-15T19:04:47.942261] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-15T19:04:48.114000] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-02. [2025-10-15T19:04:48.913986] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-01. [2025-10-15T19:04:49.224217] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-15T19:04:49.502808] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-15T19:04:49.714060] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-05. [2025-10-15T19:04:49.884241] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-15T19:04:50.514014] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-02. [2025-10-15T19:04:51.313979] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-02. [2025-10-15T19:04:51.428295] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-15T19:04:51.663819] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-15T19:04:52.102598] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-15T19:04:52.113987] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-03. [2025-10-15T19:04:52.914002] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-06. [2025-10-15T19:04:53.077935] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-15T19:04:53.714034] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-04. [2025-10-15T19:04:54.513994] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-03. [2025-10-15T19:04:54.807676] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-15T19:04:54.854633] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-15T19:04:55.063542] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-10-15T19:04:55.314014] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-05. [2025-10-15T19:04:56.114052] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-03. [2025-10-15T19:04:56.391235] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-15T19:04:56.913969] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-06. [2025-10-15T19:04:57.590180] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-15T19:04:57.722573] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-04. [2025-10-15T19:04:57.724372] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-15T19:04:58.514005] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-04. [2025-10-15T19:04:58.646908] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-15T19:04:59.314051] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-07. [2025-10-15T19:04:59.998150] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-15T19:05:00.114000] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-05. [2025-10-15T19:05:00.914022] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-05. [2025-10-15T19:05:01.418540] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-10-15T19:05:01.486966] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-15T19:05:01.653593] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-15T19:05:01.714010] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-07. [2025-10-15T19:05:02.513993] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-06. [2025-10-15T19:05:02.718601] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-15T19:05:03.314008] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-08. [2025-10-15T19:05:03.832437] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-15T19:05:04.114012] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-08. [2025-10-15T19:05:04.367967] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-15T19:05:04.914017] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-09. [2025-10-15T19:05:05.713979] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-07. [2025-10-15T19:05:06.029941] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-15T19:05:06.053721] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-15T19:05:06.514047] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-09. [2025-10-15T19:05:07.294770] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-15T19:05:07.313969] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-06. [2025-10-15T19:05:08.114021] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-08. [2025-10-15T19:05:08.301097] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-15T19:05:08.490668] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-15T19:05:08.914056] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-07. [2025-10-15T19:05:09.615938] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-15T19:05:09.713974] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-09. [2025-10-15T19:05:09.843434] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-15T19:05:10.513990] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-10. [2025-10-15T19:05:11.168014] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-15T19:05:11.313996] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-10. [2025-10-15T19:05:12.113983] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-08. [2025-10-15T19:05:12.261883] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-15T19:05:12.264033] [INFO ] [REMOTE ] GATX: Full fetch complete (24901 records). [2025-10-15T19:05:12.264110] [DEBUG] [VALIDATOR ] GATX: Validating primary data. [2025-10-15T19:05:12.643432] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-10 (2.13 seconds). [2025-10-15T19:05:12.659393] [DEBUG] [VALIDATOR ] GATX: All expected trading days are present. [2025-10-15T19:05:12.659628] [DEBUG] [VALIDATOR ] GATX: Primary data validation passed. [2025-10-15T19:05:12.660433] [INFO ] [MAIN ] GATX: Fetched primary data is valid. [2025-10-15T19:05:12.660512] [DEBUG] [LOCAL ] GATX: Saving primary data. [2025-10-15T19:05:12.661186] [INFO ] [REMOTE ] GAP: Full fetch complete (77805 records). [2025-10-15T19:05:12.661378] [DEBUG] [VALIDATOR ] GAP: Validating primary data. [2025-10-15T19:05:12.661871] [DEBUG] [LOCAL ] GATX: Trimmed 24901 records to 18079 (keeping 200 days of data) [2025-10-15T19:05:12.882205] [DEBUG] [LOCAL ] GATX: Primary data saved (18079 records). [2025-10-15T19:05:12.898360] [INFO ] [MAIN ] GATX: Full history saved. [2025-10-15T19:05:12.923095] [INFO ] [MAIN ] Update Progress: 893/2369 symbols completed. GATX took 33.0s. Estimated remaining: 3h 26m 50s. Rate: 7.1 symbols/min [2025-10-15T19:05:12.928399] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-10. [2025-10-15T19:05:13.120365] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-15T19:05:13.333293] [INFO ] [MAIN ] GBLI: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:05:13.340579] [DEBUG] [LOCAL ] GBLI: No existing data file found in primary storage. [2025-10-15T19:05:13.341886] [WARN ] [MAIN ] GBLI: No existing data found, performing full refresh instead. [2025-10-15T19:05:13.361379] [INFO ] [MAIN ] GBLI: Wiping existing primary data before full refresh. [2025-10-15T19:05:13.380332] [DEBUG] [VALIDATOR ] GAP: All expected trading days are present. [2025-10-15T19:05:13.380240] [INFO ] [LOCAL ] GBLI: Starting deletion of primary data. [2025-10-15T19:05:13.380506] [DEBUG] [LOCAL ] GBLI: No primary data file found to delete. [2025-10-15T19:05:13.380408] [DEBUG] [VALIDATOR ] GAP: Primary data validation passed. [2025-10-15T19:05:13.380567] [INFO ] [MAIN ] GBLI: Starting full primary refresh. [2025-10-15T19:05:13.413431] [INFO ] [MAIN ] GAP: Fetched primary data is valid. [2025-10-15T19:05:13.425308] [DEBUG] [LOCAL ] GAP: Saving primary data. [2025-10-15T19:05:13.495257] [DEBUG] [LOCAL ] GAP: Trimmed 77805 records to 53653 (keeping 200 days of data) [2025-10-15T19:05:13.722635] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-09. [2025-10-15T19:05:13.858232] [INFO ] [REMOTE ] GBLI: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:05:14.087186] [DEBUG] [LOCAL ] GAP: Primary data saved (53653 records). [2025-10-15T19:05:14.087335] [INFO ] [MAIN ] GAP: Full history saved. [2025-10-15T19:05:14.088472] [INFO ] [MAIN ] Update Progress: 894/2369 symbols completed. GAP took 50.7s. Estimated remaining: 3h 26m 30s. Rate: 7.1 symbols/min [2025-10-15T19:05:14.254885] [INFO ] [MAIN ] GBTG: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:05:14.298885] [DEBUG] [LOCAL ] GBTG: Loaded 40171 existing records from primary storage. [2025-10-15T19:05:14.299260] [INFO ] [MAIN ] GBTG: Loaded 40171 existing records. [2025-10-15T19:05:14.483193] [WARN ] [MAIN ] GBTG: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:05:14.483415] [INFO ] [MAIN ] GBTG: Wiping existing primary data before full refresh. [2025-10-15T19:05:14.483473] [INFO ] [LOCAL ] GBTG: Starting deletion of primary data. [2025-10-15T19:05:14.483935] [DEBUG] [LOCAL ] GBTG: Deleted primary data file. [2025-10-15T19:05:14.483992] [INFO ] [MAIN ] GBTG: Starting full primary refresh. [2025-10-15T19:05:14.515243] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2024-12. [2025-10-15T19:05:14.771298] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-15T19:05:14.783525] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-15T19:05:14.803599] [INFO ] [REMOTE ] GBCI: Full fetch complete (58927 records). [2025-10-15T19:05:14.819831] [DEBUG] [VALIDATOR ] GBCI: Validating primary data. [2025-10-15T19:05:14.966322] [INFO ] [REMOTE ] GBTG: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:05:15.026298] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2024-12 (0.51 seconds). [2025-10-15T19:05:15.290985] [DEBUG] [VALIDATOR ] GBCI: All expected trading days are present. [2025-10-15T19:05:15.291060] [DEBUG] [VALIDATOR ] GBCI: Primary data validation passed. [2025-10-15T19:05:15.291860] [INFO ] [MAIN ] GBCI: Fetched primary data is valid. [2025-10-15T19:05:15.291920] [DEBUG] [LOCAL ] GBCI: Saving primary data. [2025-10-15T19:05:15.293037] [DEBUG] [LOCAL ] GBCI: Trimmed 58927 records to 40856 (keeping 200 days of data) [2025-10-15T19:05:15.345050] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2024-12. [2025-10-15T19:05:15.536145] [DEBUG] [LOCAL ] GBCI: Primary data saved (40856 records). [2025-10-15T19:05:15.536266] [INFO ] [MAIN ] GBCI: Full history saved. [2025-10-15T19:05:15.536369] [INFO ] [MAIN ] Update Progress: 895/2369 symbols completed. GBCI took 32.8s. Estimated remaining: 3h 26m 10s. Rate: 7.1 symbols/min [2025-10-15T19:05:15.709010] [INFO ] [MAIN ] GBX: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:05:15.742222] [DEBUG] [LOCAL ] GBX: Loaded 28986 existing records from primary storage. [2025-10-15T19:05:15.742473] [INFO ] [MAIN ] GBX: Loaded 28986 existing records. [2025-10-15T19:05:15.913454] [WARN ] [MAIN ] GBX: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:05:15.913620] [INFO ] [MAIN ] GBX: Wiping existing primary data before full refresh. [2025-10-15T19:05:15.913696] [INFO ] [LOCAL ] GBX: Starting deletion of primary data. [2025-10-15T19:05:15.913962] [DEBUG] [LOCAL ] GBX: Deleted primary data file. [2025-10-15T19:05:15.914000] [INFO ] [MAIN ] GBX: Starting full primary refresh. [2025-10-15T19:05:16.124127] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-10. [2025-10-15T19:05:16.255639] [INFO ] [REMOTE ] GBX: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:05:16.697031] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-15T19:05:16.913986] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-01. [2025-10-15T19:05:16.943442] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-15T19:05:16.945165] [INFO ] [REMOTE ] GBAB: Full fetch complete (18994 records). [2025-10-15T19:05:16.945233] [DEBUG] [VALIDATOR ] GBAB: Validating primary data. [2025-10-15T19:05:17.307819] [DEBUG] [VALIDATOR ] GBAB: All expected trading days are present. [2025-10-15T19:05:17.307894] [DEBUG] [VALIDATOR ] GBAB: Primary data validation passed. [2025-10-15T19:05:17.308340] [INFO ] [MAIN ] GBAB: Fetched primary data is valid. [2025-10-15T19:05:17.308380] [DEBUG] [LOCAL ] GBAB: Saving primary data. [2025-10-15T19:05:17.308944] [DEBUG] [LOCAL ] GBAB: Trimmed 18994 records to 12868 (keeping 200 days of data) [2025-10-15T19:05:17.386379] [DEBUG] [LOCAL ] GBAB: Primary data saved (12868 records). [2025-10-15T19:05:17.386502] [INFO ] [MAIN ] GBAB: Full history saved. [2025-10-15T19:05:17.386580] [INFO ] [MAIN ] Update Progress: 896/2369 symbols completed. GBAB took 36.2s. Estimated remaining: 3h 25m 51s. Rate: 7.2 symbols/min [2025-10-15T19:05:17.551968] [INFO ] [MAIN ] GCI: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:05:17.590328] [DEBUG] [LOCAL ] GCI: Loaded 43904 existing records from primary storage. [2025-10-15T19:05:17.590614] [INFO ] [MAIN ] GCI: Loaded 43904 existing records. [2025-10-15T19:05:17.726302] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-01. [2025-10-15T19:05:17.766723] [WARN ] [MAIN ] GCI: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:05:17.767599] [INFO ] [MAIN ] GCI: Wiping existing primary data before full refresh. [2025-10-15T19:05:17.767673] [INFO ] [LOCAL ] GCI: Starting deletion of primary data. [2025-10-15T19:05:17.768204] [DEBUG] [LOCAL ] GCI: Deleted primary data file. [2025-10-15T19:05:17.768330] [INFO ] [MAIN ] GCI: Starting full primary refresh. [2025-10-15T19:05:18.133149] [INFO ] [REMOTE ] GCI: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:05:18.165932] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-10-15T19:05:18.220264] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-15T19:05:18.513994] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-02. [2025-10-15T19:05:19.314024] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-02. [2025-10-15T19:05:19.573360] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-02 (0.26 seconds). [2025-10-15T19:05:19.754414] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-15T19:05:20.113997] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-03. [2025-10-15T19:05:20.914036] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-03. [2025-10-15T19:05:21.239232] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-15T19:05:21.322842] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-10-15T19:05:21.714098] [INFO ] [REMOTE ] GBX: Fetching primary data for 2024-12. [2025-10-15T19:05:22.514003] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-04. [2025-10-15T19:05:22.702834] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-10-15T19:05:23.314001] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-01. [2025-10-15T19:05:23.982628] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-15T19:05:24.113992] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-04. [2025-10-15T19:05:24.532578] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-10-15T19:05:24.688317] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-15T19:05:24.914028] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-02. [2025-10-15T19:05:25.714013] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-05. [2025-10-15T19:05:26.164159] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-15T19:05:26.514062] [INFO ] [REMOTE ] GCI: Fetching primary data for 2024-12. [2025-10-15T19:05:27.156189] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-15T19:05:27.314013] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-06. [2025-10-15T19:05:27.975888] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-15T19:05:28.113956] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-01. [2025-10-15T19:05:28.731055] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-15T19:05:28.914012] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-03. [2025-10-15T19:05:29.531081] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-15T19:05:29.713977] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-07. [2025-10-15T19:05:30.079261] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-15T19:05:30.514006] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-04. [2025-10-15T19:05:31.170105] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-15T19:05:31.313994] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-02. [2025-10-15T19:05:32.113972] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-05. [2025-10-15T19:05:32.158822] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-15T19:05:32.470261] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-15T19:05:32.496427] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-10-15T19:05:32.913991] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-08. [2025-10-15T19:05:33.713986] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-06. [2025-10-15T19:05:33.948218] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-06 (0.23 seconds). [2025-10-15T19:05:34.296548] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-15T19:05:34.513986] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-09. [2025-10-15T19:05:35.314009] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-03. [2025-10-15T19:05:35.892727] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-15T19:05:36.114022] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-05. [2025-10-15T19:05:36.812622] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-15T19:05:36.913986] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-04. [2025-10-15T19:05:37.227551] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-15T19:05:37.714066] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-06. [2025-10-15T19:05:38.372390] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-15T19:05:38.513954] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-05. [2025-10-15T19:05:38.761957] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-15T19:05:39.314095] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-07. [2025-10-15T19:05:40.113981] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-10. [2025-10-15T19:05:40.161376] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-15T19:05:40.819618] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-15T19:05:40.914018] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-08. [2025-10-15T19:05:41.541723] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-15T19:05:41.546608] [INFO ] [REMOTE ] GBTG: Full fetch complete (56693 records). [2025-10-15T19:05:41.546774] [DEBUG] [VALIDATOR ] GBTG: Validating primary data. [2025-10-15T19:05:41.718276] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-07. [2025-10-15T19:05:41.996871] [DEBUG] [VALIDATOR ] GBTG: All expected trading days are present. [2025-10-15T19:05:41.997555] [DEBUG] [VALIDATOR ] GBTG: Primary data validation passed. [2025-10-15T19:05:41.998446] [INFO ] [MAIN ] GBTG: Fetched primary data is valid. [2025-10-15T19:05:41.999375] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-15T19:05:42.004355] [DEBUG] [LOCAL ] GBTG: Saving primary data. [2025-10-15T19:05:42.007502] [DEBUG] [LOCAL ] GBTG: Trimmed 56693 records to 40255 (keeping 200 days of data) [2025-10-15T19:05:42.180137] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-10-15T19:05:42.242034] [DEBUG] [LOCAL ] GBTG: Primary data saved (40255 records). [2025-10-15T19:05:42.242163] [INFO ] [MAIN ] GBTG: Full history saved. [2025-10-15T19:05:42.242240] [INFO ] [MAIN ] Update Progress: 897/2369 symbols completed. GBTG took 28.2s. Estimated remaining: 3h 26m 10s. Rate: 7.1 symbols/min [2025-10-15T19:05:42.418053] [INFO ] [MAIN ] GCO: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:05:42.418211] [DEBUG] [LOCAL ] GCO: No existing data file found in primary storage. [2025-10-15T19:05:42.418250] [WARN ] [MAIN ] GCO: No existing data found, performing full refresh instead. [2025-10-15T19:05:42.418397] [INFO ] [MAIN ] GCO: Wiping existing primary data before full refresh. [2025-10-15T19:05:42.418446] [INFO ] [LOCAL ] GCO: Starting deletion of primary data. [2025-10-15T19:05:42.418490] [DEBUG] [LOCAL ] GCO: No primary data file found to delete. [2025-10-15T19:05:42.418522] [INFO ] [MAIN ] GCO: Starting full primary refresh. [2025-10-15T19:05:42.519179] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-09. [2025-10-15T19:05:42.779093] [INFO ] [REMOTE ] GCO: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:05:43.314006] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-06. [2025-10-15T19:05:43.797417] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-15T19:05:44.113985] [INFO ] [REMOTE ] GCO: Fetching primary data for 2024-12. [2025-10-15T19:05:44.884704] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-15T19:05:44.914042] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-10. [2025-10-15T19:05:45.308347] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-15T19:05:45.714040] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-07. [2025-10-15T19:05:46.275545] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-15T19:05:46.279854] [INFO ] [REMOTE ] GBX: Full fetch complete (42855 records). [2025-10-15T19:05:46.280025] [DEBUG] [VALIDATOR ] GBX: Validating primary data. [2025-10-15T19:05:46.519231] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-01. [2025-10-15T19:05:46.667705] [DEBUG] [VALIDATOR ] GBX: All expected trading days are present. [2025-10-15T19:05:46.667797] [DEBUG] [VALIDATOR ] GBX: Primary data validation passed. [2025-10-15T19:05:46.668526] [INFO ] [MAIN ] GBX: Fetched primary data is valid. [2025-10-15T19:05:46.668567] [DEBUG] [LOCAL ] GBX: Saving primary data. [2025-10-15T19:05:46.669448] [DEBUG] [LOCAL ] GBX: Trimmed 42855 records to 28929 (keeping 200 days of data) [2025-10-15T19:05:46.841068] [DEBUG] [LOCAL ] GBX: Primary data saved (28929 records). [2025-10-15T19:05:46.841204] [INFO ] [MAIN ] GBX: Full history saved. [2025-10-15T19:05:46.841287] [INFO ] [MAIN ] Update Progress: 898/2369 symbols completed. GBX took 31.3s. Estimated remaining: 3h 25m 55s. Rate: 7.1 symbols/min [2025-10-15T19:05:47.007747] [INFO ] [MAIN ] GCTS: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:05:47.028711] [DEBUG] [LOCAL ] GCTS: Loaded 20462 existing records from primary storage. [2025-10-15T19:05:47.029036] [INFO ] [MAIN ] GCTS: Loaded 20462 existing records. [2025-10-15T19:05:47.206053] [WARN ] [MAIN ] GCTS: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:05:47.206396] [INFO ] [MAIN ] GCTS: Wiping existing primary data before full refresh. [2025-10-15T19:05:47.206638] [INFO ] [LOCAL ] GCTS: Starting deletion of primary data. [2025-10-15T19:05:47.206967] [DEBUG] [LOCAL ] GCTS: Deleted primary data file. [2025-10-15T19:05:47.207030] [INFO ] [MAIN ] GCTS: Starting full primary refresh. [2025-10-15T19:05:47.315688] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-08. [2025-10-15T19:05:47.399324] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-15T19:05:47.608072] [INFO ] [REMOTE ] GCTS: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:05:47.647192] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-15T19:05:47.848150] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-10-15T19:05:48.113998] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-08. [2025-10-15T19:05:48.914005] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-02. [2025-10-15T19:05:49.552764] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-15T19:05:49.713991] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-09. [2025-10-15T19:05:49.889093] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-15T19:05:50.514061] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2024-12. [2025-10-15T19:05:51.060381] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-15T19:05:51.254076] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-10-15T19:05:51.314006] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-10. [2025-10-15T19:05:52.114078] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-09. [2025-10-15T19:05:52.478329] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-09 (0.36 seconds). [2025-10-15T19:05:52.873256] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-15T19:05:52.879836] [INFO ] [REMOTE ] GCI: Full fetch complete (63375 records). [2025-10-15T19:05:52.880090] [DEBUG] [VALIDATOR ] GCI: Validating primary data. [2025-10-15T19:05:52.919242] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-10. [2025-10-15T19:05:53.259961] [DEBUG] [VALIDATOR ] GCI: All expected trading days are present. [2025-10-15T19:05:53.260046] [DEBUG] [VALIDATOR ] GCI: Primary data validation passed. [2025-10-15T19:05:53.260822] [INFO ] [MAIN ] GCI: Fetched primary data is valid. [2025-10-15T19:05:53.260886] [DEBUG] [LOCAL ] GCI: Saving primary data. [2025-10-15T19:05:53.262109] [DEBUG] [LOCAL ] GCI: Trimmed 63375 records to 43878 (keeping 200 days of data) [2025-10-15T19:05:53.354539] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-10 (0.44 seconds). [2025-10-15T19:05:53.355887] [INFO ] [REMOTE ] GBLI: Full fetch complete (1280 records). [2025-10-15T19:05:53.355974] [DEBUG] [VALIDATOR ] GBLI: Validating primary data. [2025-10-15T19:05:53.542347] [WARN ] [VALIDATOR ] GBLI: Validation failed - insufficient historical data. Have 172 unique days, need 200 days [2025-10-15T19:05:53.545638] [FATAL] [MAIN ] GBLI: Fetched primary data is invalid. Refusing to save it. [2025-10-15T19:05:53.547875] [WARN ] [MAIN ] GBLI: Deleting existing primary and derivative data due to validation failure. [2025-10-15T19:05:53.547974] [INFO ] [LOCAL ] GBLI: Starting deletion of primary data. [2025-10-15T19:05:53.551908] [DEBUG] [LOCAL ] GBLI: No primary data file found to delete. [2025-10-15T19:05:53.552463] [INFO ] [LOCAL ] GBLI: Starting deletion of derivative data. [2025-10-15T19:05:53.556414] [DEBUG] [LOCAL ] GBLI: No derivative data file found to delete. [2025-10-15T19:05:53.556499] [INFO ] [MAIN ] Update Progress: 899/2369 symbols completed. GBLI took 40.6s. Estimated remaining: 3h 25m 44s. Rate: 7.1 symbols/min [2025-10-15T19:05:53.714702] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-01. [2025-10-15T19:05:53.825546] [INFO ] [MAIN ] GCV: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:05:53.844372] [DEBUG] [LOCAL ] GCV: Loaded 7738 existing records from primary storage. [2025-10-15T19:05:53.845369] [INFO ] [MAIN ] GCV: Loaded 7738 existing records. [2025-10-15T19:05:54.052571] [WARN ] [MAIN ] GCV: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:05:54.058280] [DEBUG] [LOCAL ] GCI: Primary data saved (43878 records). [2025-10-15T19:05:54.058425] [INFO ] [MAIN ] GCI: Full history saved. [2025-10-15T19:05:54.058554] [INFO ] [MAIN ] GCV: Wiping existing primary data before full refresh. [2025-10-15T19:05:54.058724] [INFO ] [MAIN ] Update Progress: 900/2369 symbols completed. GCI took 36.7s. Estimated remaining: 3h 25m 23s. Rate: 7.2 symbols/min [2025-10-15T19:05:54.058614] [INFO ] [LOCAL ] GCV: Starting deletion of primary data. [2025-10-15T19:05:54.089513] [DEBUG] [LOCAL ] GCV: Deleted primary data file. [2025-10-15T19:05:54.125957] [INFO ] [MAIN ] GCV: Starting full primary refresh. [2025-10-15T19:05:54.364833] [INFO ] [MAIN ] GD: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:05:54.524829] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-03. [2025-10-15T19:05:54.664397] [INFO ] [REMOTE ] GCV: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:05:54.682380] [DEBUG] [LOCAL ] GD: Loaded 46751 existing records from primary storage. [2025-10-15T19:05:54.682785] [INFO ] [MAIN ] GD: Loaded 46751 existing records. [2025-10-15T19:05:54.789676] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-15T19:05:54.894770] [WARN ] [MAIN ] GD: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:05:54.894981] [INFO ] [MAIN ] GD: Wiping existing primary data before full refresh. [2025-10-15T19:05:54.895030] [INFO ] [LOCAL ] GD: Starting deletion of primary data. [2025-10-15T19:05:54.896038] [DEBUG] [LOCAL ] GD: Deleted primary data file. [2025-10-15T19:05:54.896097] [INFO ] [MAIN ] GD: Starting full primary refresh. [2025-10-15T19:05:55.235427] [INFO ] [REMOTE ] GD: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:05:55.313958] [INFO ] [REMOTE ] GD: Fetching primary data for 2024-12. [2025-10-15T19:05:55.910185] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-15T19:05:56.113990] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-02. [2025-10-15T19:05:56.914000] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-04. [2025-10-15T19:05:57.156242] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-15T19:05:57.221574] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-10-15T19:05:57.714036] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-03. [2025-10-15T19:05:58.042721] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-15T19:05:58.514046] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-05. [2025-10-15T19:05:58.668338] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-15T19:05:59.314047] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-04. [2025-10-15T19:05:59.649738] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-15T19:06:00.114053] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-06. [2025-10-15T19:06:00.412555] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-15T19:06:00.914076] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-05. [2025-10-15T19:06:01.453226] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-15T19:06:01.714086] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-07. [2025-10-15T19:06:02.514065] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-01. [2025-10-15T19:06:03.117900] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-05 (2.20 seconds). [2025-10-15T19:06:03.314005] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-06. [2025-10-15T19:06:03.798260] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-10-15T19:06:04.114033] [INFO ] [REMOTE ] GCV: Fetching primary data for 2024-12. [2025-10-15T19:06:04.650868] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2024-12 (0.54 seconds). [2025-10-15T19:06:04.732713] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-01 (2.22 seconds). [2025-10-15T19:06:04.790779] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-15T19:06:04.914003] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-07. [2025-10-15T19:06:05.713984] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-02. [2025-10-15T19:06:06.034119] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-15T19:06:06.514006] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-08. [2025-10-15T19:06:07.287790] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-15T19:06:07.314056] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-01. [2025-10-15T19:06:07.328385] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-15T19:06:07.893258] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-15T19:06:08.114045] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-03. [2025-10-15T19:06:08.914087] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-02. [2025-10-15T19:06:09.456193] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-10-15T19:06:09.714005] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-08. [2025-10-15T19:06:09.882295] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-15T19:06:10.514044] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-03. [2025-10-15T19:06:10.869600] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-15T19:06:11.098239] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-15T19:06:11.313994] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-09. [2025-10-15T19:06:12.113994] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-09. [2025-10-15T19:06:12.432879] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-15T19:06:12.913992] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-04. [2025-10-15T19:06:13.185237] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-15T19:06:13.713993] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-10. [2025-10-15T19:06:14.513983] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-10. [2025-10-15T19:06:14.799024] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-15T19:06:14.849191] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-15T19:06:14.852282] [INFO ] [REMOTE ] GCTS: Full fetch complete (26984 records). [2025-10-15T19:06:14.852402] [DEBUG] [VALIDATOR ] GCTS: Validating primary data. [2025-10-15T19:06:15.213886] [DEBUG] [VALIDATOR ] GCTS: All expected trading days are present. [2025-10-15T19:06:15.213960] [DEBUG] [VALIDATOR ] GCTS: Primary data validation passed. [2025-10-15T19:06:15.214480] [INFO ] [MAIN ] GCTS: Fetched primary data is valid. [2025-10-15T19:06:15.214521] [DEBUG] [LOCAL ] GCTS: Saving primary data. [2025-10-15T19:06:15.215182] [DEBUG] [LOCAL ] GCTS: Trimmed 26984 records to 20465 (keeping 200 days of data) [2025-10-15T19:06:15.315922] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-05. [2025-10-15T19:06:15.330945] [DEBUG] [LOCAL ] GCTS: Primary data saved (20465 records). [2025-10-15T19:06:15.331146] [INFO ] [MAIN ] GCTS: Full history saved. [2025-10-15T19:06:15.331359] [INFO ] [MAIN ] Update Progress: 901/2369 symbols completed. GCTS took 28.5s. Estimated remaining: 3h 25m 35s. Rate: 7.1 symbols/min [2025-10-15T19:06:15.427573] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-15T19:06:15.456570] [INFO ] [REMOTE ] GCO: Full fetch complete (35142 records). [2025-10-15T19:06:15.467016] [DEBUG] [VALIDATOR ] GCO: Validating primary data. [2025-10-15T19:06:15.619317] [INFO ] [MAIN ] GDDY: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:06:15.922528] [DEBUG] [VALIDATOR ] GCO: All expected trading days are present. [2025-10-15T19:06:15.922680] [DEBUG] [VALIDATOR ] GCO: Primary data validation passed. [2025-10-15T19:06:15.923434] [INFO ] [MAIN ] GCO: Fetched primary data is valid. [2025-10-15T19:06:15.923540] [DEBUG] [LOCAL ] GCO: Saving primary data. [2025-10-15T19:06:15.924254] [DEBUG] [LOCAL ] GDDY: Loaded 49797 existing records from primary storage. [2025-10-15T19:06:15.924934] [INFO ] [MAIN ] GDDY: Loaded 49797 existing records. [2025-10-15T19:06:16.004086] [DEBUG] [LOCAL ] GCO: Trimmed 35142 records to 23651 (keeping 200 days of data) [2025-10-15T19:06:16.136542] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-04. [2025-10-15T19:06:16.197908] [WARN ] [MAIN ] GDDY: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:06:16.202258] [INFO ] [MAIN ] GDDY: Wiping existing primary data before full refresh. [2025-10-15T19:06:16.202898] [INFO ] [LOCAL ] GDDY: Starting deletion of primary data. [2025-10-15T19:06:16.205752] [DEBUG] [LOCAL ] GDDY: Deleted primary data file. [2025-10-15T19:06:16.208245] [INFO ] [MAIN ] GDDY: Starting full primary refresh. [2025-10-15T19:06:16.593348] [DEBUG] [LOCAL ] GCO: Primary data saved (23651 records). [2025-10-15T19:06:16.595571] [INFO ] [MAIN ] GCO: Full history saved. [2025-10-15T19:06:16.614910] [INFO ] [REMOTE ] GDDY: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:06:16.615026] [INFO ] [MAIN ] Update Progress: 902/2369 symbols completed. GCO took 34.4s. Estimated remaining: 3h 25m 15s. Rate: 7.1 symbols/min [2025-10-15T19:06:16.783306] [INFO ] [MAIN ] GDIV: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:06:16.789361] [DEBUG] [LOCAL ] GDIV: Loaded 3599 existing records from primary storage. [2025-10-15T19:06:16.789532] [INFO ] [MAIN ] GDIV: Loaded 3599 existing records. [2025-10-15T19:06:16.914244] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2024-12. [2025-10-15T19:06:16.968378] [WARN ] [MAIN ] GDIV: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:06:16.968955] [INFO ] [MAIN ] GDIV: Wiping existing primary data before full refresh. [2025-10-15T19:06:16.975073] [INFO ] [LOCAL ] GDIV: Starting deletion of primary data. [2025-10-15T19:06:16.975890] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-15T19:06:16.976867] [DEBUG] [LOCAL ] GDIV: Deleted primary data file. [2025-10-15T19:06:16.978806] [INFO ] [MAIN ] GDIV: Starting full primary refresh. [2025-10-15T19:06:17.360605] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-10-15T19:06:17.359366] [INFO ] [REMOTE ] GDIV: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:06:17.713994] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2024-12. [2025-10-15T19:06:18.188221] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2024-12 (0.47 seconds). [2025-10-15T19:06:18.327756] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-15T19:06:18.513954] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-01. [2025-10-15T19:06:19.314066] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-05. [2025-10-15T19:06:19.893454] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-15T19:06:20.113958] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-01. [2025-10-15T19:06:20.259373] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-15T19:06:20.681045] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-15T19:06:20.914004] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-06. [2025-10-15T19:06:21.714030] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-06. [2025-10-15T19:06:22.329821] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-15T19:06:22.509202] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-15T19:06:22.518152] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-02. [2025-10-15T19:06:23.313994] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-07. [2025-10-15T19:06:24.062748] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-15T19:06:24.113958] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-03. [2025-10-15T19:06:24.914014] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-07. [2025-10-15T19:06:25.209810] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-15T19:06:25.417177] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-10-15T19:06:25.714010] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-08. [2025-10-15T19:06:25.861801] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-15T19:06:26.180746] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-10-15T19:06:26.514004] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-04. [2025-10-15T19:06:27.313997] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-02. [2025-10-15T19:06:27.775598] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-10-15T19:06:28.058344] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-15T19:06:28.113999] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-08. [2025-10-15T19:06:28.914053] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-09. [2025-10-15T19:06:29.558082] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-15T19:06:29.637785] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-15T19:06:29.714041] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-05. [2025-10-15T19:06:30.514047] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-09. [2025-10-15T19:06:31.313997] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-10. [2025-10-15T19:06:31.413922] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-15T19:06:31.778557] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-15T19:06:32.114001] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-06. [2025-10-15T19:06:32.152397] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-15T19:06:32.154177] [INFO ] [REMOTE ] GCV: Full fetch complete (9823 records). [2025-10-15T19:06:32.154244] [DEBUG] [VALIDATOR ] GCV: Validating primary data. [2025-10-15T19:06:32.512480] [DEBUG] [VALIDATOR ] GCV: All expected trading days are present. [2025-10-15T19:06:32.512591] [DEBUG] [VALIDATOR ] GCV: Primary data validation passed. [2025-10-15T19:06:32.512863] [INFO ] [MAIN ] GCV: Fetched primary data is valid. [2025-10-15T19:06:32.512923] [DEBUG] [LOCAL ] GCV: Saving primary data. [2025-10-15T19:06:32.513335] [DEBUG] [LOCAL ] GCV: Trimmed 9823 records to 7804 (keeping 200 days of data) [2025-10-15T19:06:32.557553] [DEBUG] [LOCAL ] GCV: Primary data saved (7804 records). [2025-10-15T19:06:32.557895] [INFO ] [MAIN ] GCV: Full history saved. [2025-10-15T19:06:32.558128] [INFO ] [MAIN ] Update Progress: 903/2369 symbols completed. GCV took 39.0s. Estimated remaining: 3h 25m 19s. Rate: 7.1 symbols/min [2025-10-15T19:06:32.726792] [INFO ] [MAIN ] GDL: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:06:32.730758] [DEBUG] [LOCAL ] GDL: Loaded 2513 existing records from primary storage. [2025-10-15T19:06:32.730920] [INFO ] [MAIN ] GDL: Loaded 2513 existing records. [2025-10-15T19:06:32.910442] [WARN ] [MAIN ] GDL: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:06:32.910760] [INFO ] [MAIN ] GDL: Wiping existing primary data before full refresh. [2025-10-15T19:06:32.910819] [INFO ] [LOCAL ] GDL: Starting deletion of primary data. [2025-10-15T19:06:32.911004] [DEBUG] [LOCAL ] GDL: Deleted primary data file. [2025-10-15T19:06:32.911061] [INFO ] [MAIN ] GDL: Starting full primary refresh. [2025-10-15T19:06:32.922140] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-03. [2025-10-15T19:06:33.267770] [INFO ] [REMOTE ] GDL: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:06:33.405474] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-15T19:06:33.531694] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-15T19:06:33.713973] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-07. [2025-10-15T19:06:34.514062] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-04. [2025-10-15T19:06:35.060354] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-15T19:06:35.120567] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-15T19:06:35.314073] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-10. [2025-10-15T19:06:36.114048] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-05. [2025-10-15T19:06:36.722821] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-15T19:06:36.913969] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-06. [2025-10-15T19:06:36.963302] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-15T19:06:36.968609] [INFO ] [REMOTE ] GD: Full fetch complete (69848 records). [2025-10-15T19:06:36.968740] [DEBUG] [VALIDATOR ] GD: Validating primary data. [2025-10-15T19:06:37.352070] [DEBUG] [VALIDATOR ] GD: All expected trading days are present. [2025-10-15T19:06:37.352146] [DEBUG] [VALIDATOR ] GD: Primary data validation passed. [2025-10-15T19:06:37.353054] [INFO ] [MAIN ] GD: Fetched primary data is valid. [2025-10-15T19:06:37.353234] [DEBUG] [LOCAL ] GD: Saving primary data. [2025-10-15T19:06:37.354605] [DEBUG] [LOCAL ] GD: Trimmed 69848 records to 46735 (keeping 200 days of data) [2025-10-15T19:06:37.572719] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-15T19:06:37.651286] [DEBUG] [LOCAL ] GD: Primary data saved (46735 records). [2025-10-15T19:06:37.651413] [INFO ] [MAIN ] GD: Full history saved. [2025-10-15T19:06:37.651490] [INFO ] [MAIN ] Update Progress: 904/2369 symbols completed. GD took 43.6s. Estimated remaining: 3h 25m 5s. Rate: 7.1 symbols/min [2025-10-15T19:06:37.719097] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-08. [2025-10-15T19:06:37.821906] [INFO ] [MAIN ] GDO: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:06:37.828840] [DEBUG] [LOCAL ] GDO: Loaded 5877 existing records from primary storage. [2025-10-15T19:06:37.829012] [INFO ] [MAIN ] GDO: Loaded 5877 existing records. [2025-10-15T19:06:38.003629] [WARN ] [MAIN ] GDO: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:06:38.003890] [INFO ] [MAIN ] GDO: Wiping existing primary data before full refresh. [2025-10-15T19:06:38.003938] [INFO ] [LOCAL ] GDO: Starting deletion of primary data. [2025-10-15T19:06:38.004171] [DEBUG] [LOCAL ] GDO: Deleted primary data file. [2025-10-15T19:06:38.004226] [INFO ] [MAIN ] GDO: Starting full primary refresh. [2025-10-15T19:06:38.372598] [INFO ] [REMOTE ] GDO: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:06:38.513962] [INFO ] [REMOTE ] GDO: Fetching primary data for 2024-12. [2025-10-15T19:06:39.249519] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-10-15T19:06:39.314018] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-07. [2025-10-15T19:06:39.544931] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-15T19:06:39.857368] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-10-15T19:06:40.113998] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-09. [2025-10-15T19:06:40.914082] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-08. [2025-10-15T19:06:41.366361] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-15T19:06:41.586967] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-15T19:06:41.713991] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-10. [2025-10-15T19:06:42.514061] [INFO ] [REMOTE ] GDL: Fetching primary data for 2024-12. [2025-10-15T19:06:43.056318] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2024-12 (0.54 seconds). [2025-10-15T19:06:43.314063] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-01. [2025-10-15T19:06:43.526194] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-15T19:06:43.538553] [INFO ] [REMOTE ] GDDY: Full fetch complete (72073 records). [2025-10-15T19:06:43.538981] [DEBUG] [VALIDATOR ] GDDY: Validating primary data. [2025-10-15T19:06:43.977190] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-10-15T19:06:44.138104] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-09. [2025-10-15T19:06:44.164118] [DEBUG] [VALIDATOR ] GDDY: All expected trading days are present. [2025-10-15T19:06:44.164216] [DEBUG] [VALIDATOR ] GDDY: Primary data validation passed. [2025-10-15T19:06:44.165211] [INFO ] [MAIN ] GDDY: Fetched primary data is valid. [2025-10-15T19:06:44.165378] [DEBUG] [LOCAL ] GDDY: Saving primary data. [2025-10-15T19:06:44.166897] [DEBUG] [LOCAL ] GDDY: Trimmed 72073 records to 49776 (keeping 200 days of data) [2025-10-15T19:06:44.481966] [DEBUG] [LOCAL ] GDDY: Primary data saved (49776 records). [2025-10-15T19:06:44.482114] [INFO ] [MAIN ] GDDY: Full history saved. [2025-10-15T19:06:44.482200] [INFO ] [MAIN ] Update Progress: 905/2369 symbols completed. GDDY took 29.2s. Estimated remaining: 3h 24m 54s. Rate: 7.1 symbols/min [2025-10-15T19:06:44.667285] [INFO ] [MAIN ] GDOT: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:06:44.689750] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-15T19:06:44.706088] [DEBUG] [LOCAL ] GDOT: Loaded 37743 existing records from primary storage. [2025-10-15T19:06:44.706409] [INFO ] [MAIN ] GDOT: Loaded 37743 existing records. [2025-10-15T19:06:44.894113] [WARN ] [MAIN ] GDOT: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:06:44.894353] [INFO ] [MAIN ] GDOT: Wiping existing primary data before full refresh. [2025-10-15T19:06:44.894404] [INFO ] [LOCAL ] GDOT: Starting deletion of primary data. [2025-10-15T19:06:44.895099] [DEBUG] [LOCAL ] GDOT: Deleted primary data file. [2025-10-15T19:06:44.895161] [INFO ] [MAIN ] GDOT: Starting full primary refresh. [2025-10-15T19:06:44.919116] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-01. [2025-10-15T19:06:45.267413] [INFO ] [REMOTE ] GDOT: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:06:45.714014] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-10. [2025-10-15T19:06:45.734025] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-15T19:06:46.235554] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-15T19:06:46.236484] [INFO ] [REMOTE ] GDIV: Full fetch complete (5432 records). [2025-10-15T19:06:46.236571] [DEBUG] [VALIDATOR ] GDIV: Validating primary data. [2025-10-15T19:06:46.519249] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2024-12. [2025-10-15T19:06:46.598886] [DEBUG] [VALIDATOR ] GDIV: All expected trading days are present. [2025-10-15T19:06:46.598957] [DEBUG] [VALIDATOR ] GDIV: Primary data validation passed. [2025-10-15T19:06:46.599115] [INFO ] [MAIN ] GDIV: Fetched primary data is valid. [2025-10-15T19:06:46.599152] [DEBUG] [LOCAL ] GDIV: Saving primary data. [2025-10-15T19:06:46.599515] [DEBUG] [LOCAL ] GDIV: Trimmed 5432 records to 3598 (keeping 200 days of data) [2025-10-15T19:06:46.621252] [DEBUG] [LOCAL ] GDIV: Primary data saved (3598 records). [2025-10-15T19:06:46.621326] [INFO ] [MAIN ] GDIV: Full history saved. [2025-10-15T19:06:46.621395] [INFO ] [MAIN ] Update Progress: 906/2369 symbols completed. GDIV took 30.0s. Estimated remaining: 3h 24m 36s. Rate: 7.2 symbols/min [2025-10-15T19:06:46.797476] [INFO ] [MAIN ] GDV: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:06:46.816133] [DEBUG] [LOCAL ] GDV: Loaded 19583 existing records from primary storage. [2025-10-15T19:06:46.816377] [INFO ] [MAIN ] GDV: Loaded 19583 existing records. [2025-10-15T19:06:46.994522] [WARN ] [MAIN ] GDV: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:06:46.994770] [INFO ] [MAIN ] GDV: Wiping existing primary data before full refresh. [2025-10-15T19:06:46.994820] [INFO ] [LOCAL ] GDV: Starting deletion of primary data. [2025-10-15T19:06:46.995230] [DEBUG] [LOCAL ] GDV: Deleted primary data file. [2025-10-15T19:06:46.995286] [INFO ] [MAIN ] GDV: Starting full primary refresh. [2025-10-15T19:06:47.319096] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-02. [2025-10-15T19:06:47.358369] [INFO ] [REMOTE ] GDV: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:06:47.721136] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-15T19:06:47.843862] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-10-15T19:06:48.114023] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-02. [2025-10-15T19:06:48.750998] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-15T19:06:48.914017] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-03. [2025-10-15T19:06:49.506717] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-15T19:06:49.714022] [INFO ] [REMOTE ] GDV: Fetching primary data for 2024-12. [2025-10-15T19:06:50.470924] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-10-15T19:06:50.513979] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-01. [2025-10-15T19:06:51.314009] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-04. [2025-10-15T19:06:51.544541] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-15T19:06:51.885561] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-15T19:06:52.114067] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-05. [2025-10-15T19:06:52.724325] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-15T19:06:52.914059] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-03. [2025-10-15T19:06:53.210011] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-03 (0.30 seconds). [2025-10-15T19:06:53.714007] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-02. [2025-10-15T19:06:54.513991] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-06. [2025-10-15T19:06:54.672412] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-15T19:06:55.073348] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-15T19:06:55.314009] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-03. [2025-10-15T19:06:56.114027] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-04. [2025-10-15T19:06:56.313208] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-15T19:06:56.574455] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-10-15T19:06:56.914007] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-04. [2025-10-15T19:06:57.714027] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-01. [2025-10-15T19:06:57.986918] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-15T19:06:58.513967] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-07. [2025-10-15T19:06:58.989213] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-15T19:06:59.110301] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-15T19:06:59.314003] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-05. [2025-10-15T19:06:59.737447] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-10-15T19:07:00.114054] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-08. [2025-10-15T19:07:00.667998] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-15T19:07:00.913963] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-02. [2025-10-15T19:07:01.713989] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-06. [2025-10-15T19:07:02.146540] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-15T19:07:02.156274] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-10-15T19:07:02.514032] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-05. [2025-10-15T19:07:03.313972] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-03. [2025-10-15T19:07:03.455933] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-15T19:07:04.114042] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-09. [2025-10-15T19:07:04.653471] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-10-15T19:07:04.857361] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-15T19:07:04.913995] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-04. [2025-10-15T19:07:05.714065] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-07. [2025-10-15T19:07:06.182468] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-10-15T19:07:06.439707] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-15T19:07:06.513992] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-05. [2025-10-15T19:07:07.313990] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-10. [2025-10-15T19:07:07.873388] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-15T19:07:07.874667] [INFO ] [REMOTE ] GDO: Full fetch complete (8606 records). [2025-10-15T19:07:07.874752] [DEBUG] [VALIDATOR ] GDO: Validating primary data. [2025-10-15T19:07:08.122977] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-06. [2025-10-15T19:07:08.153151] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-15T19:07:08.301809] [DEBUG] [VALIDATOR ] GDO: All expected trading days are present. [2025-10-15T19:07:08.301884] [DEBUG] [VALIDATOR ] GDO: Primary data validation passed. [2025-10-15T19:07:08.302088] [INFO ] [MAIN ] GDO: Fetched primary data is valid. [2025-10-15T19:07:08.302126] [DEBUG] [LOCAL ] GDO: Saving primary data. [2025-10-15T19:07:08.302512] [DEBUG] [LOCAL ] GDO: Trimmed 8606 records to 5849 (keeping 200 days of data) [2025-10-15T19:07:08.337514] [DEBUG] [LOCAL ] GDO: Primary data saved (5849 records). [2025-10-15T19:07:08.337667] [INFO ] [MAIN ] GDO: Full history saved. [2025-10-15T19:07:08.337788] [INFO ] [MAIN ] Update Progress: 907/2369 symbols completed. GDO took 30.7s. Estimated remaining: 3h 24m 49s. Rate: 7.1 symbols/min [2025-10-15T19:07:08.500754] [INFO ] [MAIN ] GE: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:07:08.549824] [DEBUG] [LOCAL ] GE: Loaded 53701 existing records from primary storage. [2025-10-15T19:07:08.550141] [INFO ] [MAIN ] GE: Loaded 53701 existing records. [2025-10-15T19:07:08.724824] [WARN ] [MAIN ] GE: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:07:08.725026] [INFO ] [MAIN ] GE: Wiping existing primary data before full refresh. [2025-10-15T19:07:08.725075] [INFO ] [LOCAL ] GE: Starting deletion of primary data. [2025-10-15T19:07:08.726230] [DEBUG] [LOCAL ] GE: Deleted primary data file. [2025-10-15T19:07:08.726289] [INFO ] [MAIN ] GE: Starting full primary refresh. [2025-10-15T19:07:08.920138] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-06. [2025-10-15T19:07:09.079841] [INFO ] [REMOTE ] GE: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:07:09.173494] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-15T19:07:09.713997] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-07. [2025-10-15T19:07:10.369705] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-15T19:07:10.513989] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-08. [2025-10-15T19:07:10.770037] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-15T19:07:10.966217] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-15T19:07:11.313986] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-07. [2025-10-15T19:07:12.114006] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-09. [2025-10-15T19:07:12.619309] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-10-15T19:07:12.662550] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-15T19:07:12.914018] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-08. [2025-10-15T19:07:13.714053] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-10. [2025-10-15T19:07:14.292478] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-15T19:07:14.326984] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-15T19:07:14.328074] [INFO ] [REMOTE ] GDL: Full fetch complete (3489 records). [2025-10-15T19:07:14.328151] [DEBUG] [VALIDATOR ] GDL: Validating primary data. [2025-10-15T19:07:14.521934] [INFO ] [REMOTE ] GE: Fetching primary data for 2024-12. [2025-10-15T19:07:14.725539] [DEBUG] [VALIDATOR ] GDL: All expected trading days are present. [2025-10-15T19:07:14.725690] [DEBUG] [VALIDATOR ] GDL: Primary data validation passed. [2025-10-15T19:07:14.725879] [INFO ] [MAIN ] GDL: Fetched primary data is valid. [2025-10-15T19:07:14.725924] [DEBUG] [LOCAL ] GDL: Saving primary data. [2025-10-15T19:07:14.726370] [DEBUG] [LOCAL ] GDL: Trimmed 3489 records to 2523 (keeping 200 days of data) [2025-10-15T19:07:14.742457] [DEBUG] [LOCAL ] GDL: Primary data saved (2523 records). [2025-10-15T19:07:14.742590] [INFO ] [MAIN ] GDL: Full history saved. [2025-10-15T19:07:14.742711] [INFO ] [MAIN ] Update Progress: 908/2369 symbols completed. GDL took 42.2s. Estimated remaining: 3h 24m 37s. Rate: 7.1 symbols/min [2025-10-15T19:07:14.927867] [INFO ] [MAIN ] GEF: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:07:14.952097] [DEBUG] [LOCAL ] GEF: Loaded 20792 existing records from primary storage. [2025-10-15T19:07:14.952421] [INFO ] [MAIN ] GEF: Loaded 20792 existing records. [2025-10-15T19:07:15.134845] [WARN ] [MAIN ] GEF: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:07:15.135260] [INFO ] [MAIN ] GEF: Wiping existing primary data before full refresh. [2025-10-15T19:07:15.135326] [INFO ] [LOCAL ] GEF: Starting deletion of primary data. [2025-10-15T19:07:15.135949] [DEBUG] [LOCAL ] GEF: Deleted primary data file. [2025-10-15T19:07:15.136013] [INFO ] [MAIN ] GEF: Starting full primary refresh. [2025-10-15T19:07:15.314728] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-08. [2025-10-15T19:07:15.503442] [INFO ] [REMOTE ] GEF: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:07:16.113982] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-09. [2025-10-15T19:07:16.223821] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-15T19:07:16.919121] [INFO ] [REMOTE ] GEF: Fetching primary data for 2024-12. [2025-10-15T19:07:16.950483] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2024-12 (2.43 seconds). [2025-10-15T19:07:17.214798] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-15T19:07:17.713975] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-09. [2025-10-15T19:07:18.013021] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-15T19:07:18.514036] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-10. [2025-10-15T19:07:18.551735] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-15T19:07:19.314068] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-10. [2025-10-15T19:07:19.682144] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-15T19:07:19.687012] [INFO ] [REMOTE ] GDOT: Full fetch complete (53450 records). [2025-10-15T19:07:19.687109] [DEBUG] [VALIDATOR ] GDOT: Validating primary data. [2025-10-15T19:07:20.056728] [DEBUG] [VALIDATOR ] GDOT: All expected trading days are present. [2025-10-15T19:07:20.056842] [DEBUG] [VALIDATOR ] GDOT: Primary data validation passed. [2025-10-15T19:07:20.057628] [INFO ] [MAIN ] GDOT: Fetched primary data is valid. [2025-10-15T19:07:20.057720] [DEBUG] [LOCAL ] GDOT: Saving primary data. [2025-10-15T19:07:20.058806] [DEBUG] [LOCAL ] GDOT: Trimmed 53450 records to 37755 (keeping 200 days of data) [2025-10-15T19:07:20.139763] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-01. [2025-10-15T19:07:20.274717] [DEBUG] [LOCAL ] GDOT: Primary data saved (37755 records). [2025-10-15T19:07:20.274863] [INFO ] [MAIN ] GDOT: Full history saved. [2025-10-15T19:07:20.274946] [INFO ] [MAIN ] Update Progress: 909/2369 symbols completed. GDOT took 35.8s. Estimated remaining: 3h 24m 24s. Rate: 7.1 symbols/min [2025-10-15T19:07:20.448342] [INFO ] [MAIN ] GEL: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:07:20.449318] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-15T19:07:20.452568] [INFO ] [REMOTE ] GDV: Full fetch complete (28494 records). [2025-10-15T19:07:20.452663] [DEBUG] [VALIDATOR ] GDV: Validating primary data. [2025-10-15T19:07:20.679372] [DEBUG] [LOCAL ] GEL: Loaded 31852 existing records from primary storage. [2025-10-15T19:07:20.716101] [INFO ] [MAIN ] GEL: Loaded 31852 existing records. [2025-10-15T19:07:20.917990] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-01. [2025-10-15T19:07:21.088490] [WARN ] [MAIN ] GEL: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:07:21.089084] [INFO ] [MAIN ] GEL: Wiping existing primary data before full refresh. [2025-10-15T19:07:21.089383] [INFO ] [LOCAL ] GEL: Starting deletion of primary data. [2025-10-15T19:07:21.089244] [DEBUG] [VALIDATOR ] GDV: All expected trading days are present. [2025-10-15T19:07:21.089619] [DEBUG] [VALIDATOR ] GDV: Primary data validation passed. [2025-10-15T19:07:21.090680] [DEBUG] [LOCAL ] GEL: Deleted primary data file. [2025-10-15T19:07:21.090606] [INFO ] [MAIN ] GDV: Fetched primary data is valid. [2025-10-15T19:07:21.090974] [DEBUG] [LOCAL ] GDV: Saving primary data. [2025-10-15T19:07:21.090901] [INFO ] [MAIN ] GEL: Starting full primary refresh. [2025-10-15T19:07:21.171828] [DEBUG] [LOCAL ] GDV: Trimmed 28494 records to 19531 (keeping 200 days of data) [2025-10-15T19:07:21.456321] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-15T19:07:21.502196] [DEBUG] [LOCAL ] GDV: Primary data saved (19531 records). [2025-10-15T19:07:21.515357] [INFO ] [MAIN ] GDV: Full history saved. [2025-10-15T19:07:21.526533] [INFO ] [MAIN ] Update Progress: 910/2369 symbols completed. GDV took 34.9s. Estimated remaining: 3h 24m 4s. Rate: 7.1 symbols/min [2025-10-15T19:07:21.744012] [INFO ] [REMOTE ] GEL: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:07:21.714252] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-02. [2025-10-15T19:07:21.797311] [INFO ] [MAIN ] GENI: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:07:21.847290] [DEBUG] [LOCAL ] GENI: Loaded 52934 existing records from primary storage. [2025-10-15T19:07:21.847602] [INFO ] [MAIN ] GENI: Loaded 52934 existing records. [2025-10-15T19:07:22.025949] [WARN ] [MAIN ] GENI: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:07:22.026114] [INFO ] [MAIN ] GENI: Wiping existing primary data before full refresh. [2025-10-15T19:07:22.026162] [INFO ] [LOCAL ] GENI: Starting deletion of primary data. [2025-10-15T19:07:22.027035] [DEBUG] [LOCAL ] GENI: Deleted primary data file. [2025-10-15T19:07:22.027098] [INFO ] [MAIN ] GENI: Starting full primary refresh. [2025-10-15T19:07:22.390255] [INFO ] [REMOTE ] GENI: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:07:22.514041] [INFO ] [REMOTE ] GEL: Fetching primary data for 2024-12. [2025-10-15T19:07:22.679789] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-15T19:07:23.170618] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-01 (2.25 seconds). [2025-10-15T19:07:23.314006] [INFO ] [REMOTE ] GENI: Fetching primary data for 2024-12. [2025-10-15T19:07:23.478125] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-10-15T19:07:24.114009] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-01. [2025-10-15T19:07:24.914008] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-02. [2025-10-15T19:07:24.976262] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-15T19:07:25.041764] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-15T19:07:25.714037] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-02. [2025-10-15T19:07:26.520076] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-01. [2025-10-15T19:07:26.532579] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-15T19:07:27.004578] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-15T19:07:27.314062] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-03. [2025-10-15T19:07:28.113981] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-03. [2025-10-15T19:07:28.250963] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-15T19:07:28.914077] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-02. [2025-10-15T19:07:29.321831] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-10-15T19:07:29.356830] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-15T19:07:29.714044] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-04. [2025-10-15T19:07:30.085397] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-15T19:07:30.514037] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-04. [2025-10-15T19:07:31.314060] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-03. [2025-10-15T19:07:31.818578] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-10-15T19:07:31.867267] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-15T19:07:32.114024] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-05. [2025-10-15T19:07:32.914007] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-05. [2025-10-15T19:07:33.106255] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-15T19:07:33.714137] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-04. [2025-10-15T19:07:34.086676] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-15T19:07:34.415785] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-05 (2.30 seconds). [2025-10-15T19:07:34.514048] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-06. [2025-10-15T19:07:35.055842] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-15T19:07:35.314048] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-06. [2025-10-15T19:07:36.114174] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-05. [2025-10-15T19:07:36.590366] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-15T19:07:36.712761] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-06 (2.20 seconds). [2025-10-15T19:07:36.914027] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-07. [2025-10-15T19:07:37.713986] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-03. [2025-10-15T19:07:37.978877] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-15T19:07:38.514062] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-06. [2025-10-15T19:07:38.729521] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-15T19:07:38.764820] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-15T19:07:39.314065] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-08. [2025-10-15T19:07:39.926151] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-15T19:07:40.114011] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-04. [2025-10-15T19:07:40.914034] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-07. [2025-10-15T19:07:40.981208] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-15T19:07:41.539299] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-08 (2.23 seconds). [2025-10-15T19:07:41.713989] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-09. [2025-10-15T19:07:42.514008] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-07. [2025-10-15T19:07:42.747003] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-15T19:07:43.314014] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-08. [2025-10-15T19:07:43.444122] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-15T19:07:43.891924] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-09 (2.18 seconds). [2025-10-15T19:07:44.114004] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-08. [2025-10-15T19:07:44.914057] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-10. [2025-10-15T19:07:44.989865] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-15T19:07:45.454006] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-15T19:07:45.720139] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-05. [2025-10-15T19:07:45.724869] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-15T19:07:45.731781] [INFO ] [REMOTE ] GE: Full fetch complete (77862 records). [2025-10-15T19:07:45.731911] [DEBUG] [VALIDATOR ] GE: Validating primary data. [2025-10-15T19:07:46.116452] [DEBUG] [VALIDATOR ] GE: All expected trading days are present. [2025-10-15T19:07:46.116558] [DEBUG] [VALIDATOR ] GE: Primary data validation passed. [2025-10-15T19:07:46.117658] [INFO ] [MAIN ] GE: Fetched primary data is valid. [2025-10-15T19:07:46.117769] [DEBUG] [LOCAL ] GE: Saving primary data. [2025-10-15T19:07:46.119460] [DEBUG] [LOCAL ] GE: Trimmed 77862 records to 53699 (keeping 200 days of data) [2025-10-15T19:07:46.453672] [DEBUG] [LOCAL ] GE: Primary data saved (53699 records). [2025-10-15T19:07:46.453816] [INFO ] [MAIN ] GE: Full history saved. [2025-10-15T19:07:46.453948] [INFO ] [MAIN ] Update Progress: 911/2369 symbols completed. GE took 38.1s. Estimated remaining: 3h 24m 22s. Rate: 7.1 symbols/min [2025-10-15T19:07:46.519193] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-09. [2025-10-15T19:07:46.621929] [INFO ] [MAIN ] GEO: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:07:46.667621] [DEBUG] [LOCAL ] GEO: Loaded 51866 existing records from primary storage. [2025-10-15T19:07:46.667968] [INFO ] [MAIN ] GEO: Loaded 51866 existing records. [2025-10-15T19:07:46.846052] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-15T19:07:46.858943] [WARN ] [MAIN ] GEO: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:07:46.863755] [INFO ] [MAIN ] GEO: Wiping existing primary data before full refresh. [2025-10-15T19:07:46.864232] [INFO ] [LOCAL ] GEO: Starting deletion of primary data. [2025-10-15T19:07:46.865169] [DEBUG] [LOCAL ] GEO: Deleted primary data file. [2025-10-15T19:07:46.865230] [INFO ] [MAIN ] GEO: Starting full primary refresh. [2025-10-15T19:07:47.211484] [INFO ] [REMOTE ] GEO: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:07:47.313947] [INFO ] [REMOTE ] GEO: Fetching primary data for 2024-12. [2025-10-15T19:07:47.714834] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-15T19:07:48.114054] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-10. [2025-10-15T19:07:48.913971] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-06. [2025-10-15T19:07:49.024003] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-15T19:07:49.027373] [INFO ] [REMOTE ] GEL: Full fetch complete (48191 records). [2025-10-15T19:07:49.027458] [DEBUG] [VALIDATOR ] GEL: Validating primary data. [2025-10-15T19:07:49.244700] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-10-15T19:07:49.454542] [DEBUG] [VALIDATOR ] GEL: All expected trading days are present. [2025-10-15T19:07:49.454625] [DEBUG] [VALIDATOR ] GEL: Primary data validation passed. [2025-10-15T19:07:49.455382] [INFO ] [MAIN ] GEL: Fetched primary data is valid. [2025-10-15T19:07:49.455433] [DEBUG] [LOCAL ] GEL: Saving primary data. [2025-10-15T19:07:49.456411] [DEBUG] [LOCAL ] GEL: Trimmed 48191 records to 31836 (keeping 200 days of data) [2025-10-15T19:07:49.646417] [DEBUG] [LOCAL ] GEL: Primary data saved (31836 records). [2025-10-15T19:07:49.646619] [INFO ] [MAIN ] GEL: Full history saved. [2025-10-15T19:07:49.646901] [INFO ] [MAIN ] Update Progress: 912/2369 symbols completed. GEL took 29.4s. Estimated remaining: 3h 24m 6s. Rate: 7.1 symbols/min [2025-10-15T19:07:49.716885] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-01. [2025-10-15T19:07:49.792277] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-15T19:07:49.843414] [INFO ] [MAIN ] GES: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:07:49.885183] [DEBUG] [LOCAL ] GES: Loaded 38327 existing records from primary storage. [2025-10-15T19:07:49.885497] [INFO ] [MAIN ] GES: Loaded 38327 existing records. [2025-10-15T19:07:50.068953] [WARN ] [MAIN ] GES: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:07:50.069189] [INFO ] [MAIN ] GES: Wiping existing primary data before full refresh. [2025-10-15T19:07:50.069237] [INFO ] [LOCAL ] GES: Starting deletion of primary data. [2025-10-15T19:07:50.069891] [DEBUG] [LOCAL ] GES: Deleted primary data file. [2025-10-15T19:07:50.069948] [INFO ] [MAIN ] GES: Starting full primary refresh. [2025-10-15T19:07:50.418008] [INFO ] [REMOTE ] GES: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:07:50.514030] [INFO ] [REMOTE ] GES: Fetching primary data for 2024-12. [2025-10-15T19:07:51.314066] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-09. [2025-10-15T19:07:51.691125] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-10-15T19:07:52.096133] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-15T19:07:52.113960] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-01. [2025-10-15T19:07:52.800354] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-15T19:07:52.913987] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-10. [2025-10-15T19:07:53.227681] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-15T19:07:53.713995] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-02. [2025-10-15T19:07:54.514008] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-07. [2025-10-15T19:07:54.607890] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-15T19:07:54.614182] [INFO ] [REMOTE ] GENI: Full fetch complete (75948 records). [2025-10-15T19:07:54.614296] [DEBUG] [VALIDATOR ] GENI: Validating primary data. [2025-10-15T19:07:54.995724] [DEBUG] [VALIDATOR ] GENI: All expected trading days are present. [2025-10-15T19:07:54.995841] [DEBUG] [VALIDATOR ] GENI: Primary data validation passed. [2025-10-15T19:07:54.996980] [INFO ] [MAIN ] GENI: Fetched primary data is valid. [2025-10-15T19:07:54.997103] [DEBUG] [LOCAL ] GENI: Saving primary data. [2025-10-15T19:07:54.998635] [DEBUG] [LOCAL ] GENI: Trimmed 75948 records to 52942 (keeping 200 days of data) [2025-10-15T19:07:55.230892] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-15T19:07:55.324857] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-03. [2025-10-15T19:07:55.347529] [DEBUG] [LOCAL ] GENI: Primary data saved (52942 records). [2025-10-15T19:07:55.347616] [INFO ] [MAIN ] GENI: Full history saved. [2025-10-15T19:07:55.347734] [INFO ] [MAIN ] Update Progress: 913/2369 symbols completed. GENI took 33.8s. Estimated remaining: 3h 23m 53s. Rate: 7.1 symbols/min [2025-10-15T19:07:55.515220] [INFO ] [MAIN ] GETY: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:07:55.547040] [DEBUG] [LOCAL ] GETY: Loaded 35043 existing records from primary storage. [2025-10-15T19:07:55.547401] [INFO ] [MAIN ] GETY: Loaded 35043 existing records. [2025-10-15T19:07:55.766814] [WARN ] [MAIN ] GETY: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:07:55.768296] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-15T19:07:55.773514] [INFO ] [MAIN ] GETY: Wiping existing primary data before full refresh. [2025-10-15T19:07:55.774410] [INFO ] [LOCAL ] GETY: Starting deletion of primary data. [2025-10-15T19:07:55.775080] [DEBUG] [LOCAL ] GETY: Deleted primary data file. [2025-10-15T19:07:55.775140] [INFO ] [MAIN ] GETY: Starting full primary refresh. [2025-10-15T19:07:56.119446] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-08. [2025-10-15T19:07:56.125004] [INFO ] [REMOTE ] GETY: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:07:56.914031] [INFO ] [REMOTE ] GETY: Fetching primary data for 2024-12. [2025-10-15T19:07:57.026921] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-15T19:07:57.049583] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-15T19:07:57.714049] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-02. [2025-10-15T19:07:58.043765] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-15T19:07:58.513987] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-04. [2025-10-15T19:07:59.209468] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-15T19:07:59.314057] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-09. [2025-10-15T19:08:00.114016] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-03. [2025-10-15T19:08:00.300025] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-15T19:08:00.437018] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-15T19:08:00.914019] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-10. [2025-10-15T19:08:01.714081] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-05. [2025-10-15T19:08:01.870784] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-15T19:08:01.997384] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-15T19:08:02.000414] [INFO ] [REMOTE ] GEF: Full fetch complete (29357 records). [2025-10-15T19:08:02.000508] [DEBUG] [VALIDATOR ] GEF: Validating primary data. [2025-10-15T19:08:02.362313] [DEBUG] [VALIDATOR ] GEF: All expected trading days are present. [2025-10-15T19:08:02.362400] [DEBUG] [VALIDATOR ] GEF: Primary data validation passed. [2025-10-15T19:08:02.363005] [INFO ] [MAIN ] GEF: Fetched primary data is valid. [2025-10-15T19:08:02.363066] [DEBUG] [LOCAL ] GEF: Saving primary data. [2025-10-15T19:08:02.363845] [DEBUG] [LOCAL ] GEF: Trimmed 29357 records to 20790 (keeping 200 days of data) [2025-10-15T19:08:02.488257] [DEBUG] [LOCAL ] GEF: Primary data saved (20790 records). [2025-10-15T19:08:02.488384] [INFO ] [MAIN ] GEF: Full history saved. [2025-10-15T19:08:02.488468] [INFO ] [MAIN ] Update Progress: 914/2369 symbols completed. GEF took 47.7s. Estimated remaining: 3h 23m 43s. Rate: 7.1 symbols/min [2025-10-15T19:08:02.519141] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-01. [2025-10-15T19:08:02.700687] [INFO ] [MAIN ] GEV: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:08:02.752557] [DEBUG] [LOCAL ] GEV: Loaded 52998 existing records from primary storage. [2025-10-15T19:08:02.752939] [INFO ] [MAIN ] GEV: Loaded 52998 existing records. [2025-10-15T19:08:02.934142] [WARN ] [MAIN ] GEV: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:08:02.934367] [INFO ] [MAIN ] GEV: Wiping existing primary data before full refresh. [2025-10-15T19:08:02.934420] [INFO ] [LOCAL ] GEV: Starting deletion of primary data. [2025-10-15T19:08:02.935092] [DEBUG] [LOCAL ] GEV: Deleted primary data file. [2025-10-15T19:08:02.935150] [INFO ] [MAIN ] GEV: Starting full primary refresh. [2025-10-15T19:08:03.293019] [INFO ] [REMOTE ] GEV: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:08:03.313955] [INFO ] [REMOTE ] GEV: Fetching primary data for 2024-12. [2025-10-15T19:08:03.551145] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-15T19:08:04.113989] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-06. [2025-10-15T19:08:04.482867] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-10-15T19:08:04.914011] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-04. [2025-10-15T19:08:05.403601] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2024-12 (2.09 seconds). [2025-10-15T19:08:05.714026] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-01. [2025-10-15T19:08:05.862450] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-15T19:08:06.271625] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-15T19:08:06.514017] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-02. [2025-10-15T19:08:07.314057] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-07. [2025-10-15T19:08:08.038028] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-01 (2.32 seconds). [2025-10-15T19:08:08.106743] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-15T19:08:08.115054] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-05. [2025-10-15T19:08:08.913969] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-02. [2025-10-15T19:08:09.089097] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-15T19:08:09.622064] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-15T19:08:09.713962] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-06. [2025-10-15T19:08:10.513970] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-08. [2025-10-15T19:08:10.969555] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-02 (2.06 seconds). [2025-10-15T19:08:11.040367] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-15T19:08:11.313992] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-07. [2025-10-15T19:08:12.113972] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-03. [2025-10-15T19:08:12.276451] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-15T19:08:12.578176] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-15T19:08:12.913996] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-09. [2025-10-15T19:08:13.714051] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-03. [2025-10-15T19:08:14.027460] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-15T19:08:14.513978] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-08. [2025-10-15T19:08:14.677188] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-15T19:08:15.270622] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-15T19:08:15.313960] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-04. [2025-10-15T19:08:15.745562] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-15T19:08:16.114016] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-10. [2025-10-15T19:08:16.741262] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-15T19:08:16.913972] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-04. [2025-10-15T19:08:17.552053] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-15T19:08:17.558090] [INFO ] [REMOTE ] GEO: Full fetch complete (75575 records). [2025-10-15T19:08:17.558197] [DEBUG] [VALIDATOR ] GEO: Validating primary data. [2025-10-15T19:08:17.726533] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-05. [2025-10-15T19:08:17.949804] [DEBUG] [VALIDATOR ] GEO: All expected trading days are present. [2025-10-15T19:08:17.949905] [DEBUG] [VALIDATOR ] GEO: Primary data validation passed. [2025-10-15T19:08:17.950860] [INFO ] [MAIN ] GEO: Fetched primary data is valid. [2025-10-15T19:08:17.950921] [DEBUG] [LOCAL ] GEO: Saving primary data. [2025-10-15T19:08:17.952340] [DEBUG] [LOCAL ] GEO: Trimmed 75575 records to 51820 (keeping 200 days of data) [2025-10-15T19:08:18.245052] [DEBUG] [LOCAL ] GEO: Primary data saved (51820 records). [2025-10-15T19:08:18.245175] [INFO ] [MAIN ] GEO: Full history saved. [2025-10-15T19:08:18.245251] [INFO ] [MAIN ] Update Progress: 915/2369 symbols completed. GEO took 31.8s. Estimated remaining: 3h 23m 46s. Rate: 7.1 symbols/min [2025-10-15T19:08:18.408734] [INFO ] [MAIN ] GF: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:08:18.412802] [DEBUG] [LOCAL ] GF: Loaded 2706 existing records from primary storage. [2025-10-15T19:08:18.412958] [INFO ] [MAIN ] GF: Loaded 2706 existing records. [2025-10-15T19:08:18.521062] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-09. [2025-10-15T19:08:18.591444] [WARN ] [MAIN ] GF: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:08:18.591606] [INFO ] [MAIN ] GF: Wiping existing primary data before full refresh. [2025-10-15T19:08:18.591687] [INFO ] [LOCAL ] GF: Starting deletion of primary data. [2025-10-15T19:08:18.591900] [DEBUG] [LOCAL ] GF: Deleted primary data file. [2025-10-15T19:08:18.591956] [INFO ] [MAIN ] GF: Starting full primary refresh. [2025-10-15T19:08:18.935293] [INFO ] [REMOTE ] GF: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:08:19.157368] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-15T19:08:19.287546] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-04 (2.37 seconds). [2025-10-15T19:08:19.313953] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-05. [2025-10-15T19:08:19.923950] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-15T19:08:20.114059] [INFO ] [REMOTE ] GF: Fetching primary data for 2024-12. [2025-10-15T19:08:20.694922] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2024-12 (0.58 seconds). [2025-10-15T19:08:20.914031] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-10. [2025-10-15T19:08:21.122530] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-15T19:08:21.714052] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-06. [2025-10-15T19:08:22.241342] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-15T19:08:22.245486] [INFO ] [REMOTE ] GES: Full fetch complete (58767 records). [2025-10-15T19:08:22.245575] [DEBUG] [VALIDATOR ] GES: Validating primary data. [2025-10-15T19:08:22.522311] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-01. [2025-10-15T19:08:22.638621] [DEBUG] [VALIDATOR ] GES: All expected trading days are present. [2025-10-15T19:08:22.638725] [DEBUG] [VALIDATOR ] GES: Primary data validation passed. [2025-10-15T19:08:22.639541] [INFO ] [MAIN ] GES: Fetched primary data is valid. [2025-10-15T19:08:22.639582] [DEBUG] [LOCAL ] GES: Saving primary data. [2025-10-15T19:08:22.640697] [DEBUG] [LOCAL ] GES: Trimmed 58767 records to 38288 (keeping 200 days of data) [2025-10-15T19:08:22.866721] [DEBUG] [LOCAL ] GES: Primary data saved (38288 records). [2025-10-15T19:08:22.866851] [INFO ] [MAIN ] GES: Full history saved. [2025-10-15T19:08:22.866930] [INFO ] [MAIN ] Update Progress: 916/2369 symbols completed. GES took 33.2s. Estimated remaining: 3h 23m 31s. Rate: 7.1 symbols/min [2025-10-15T19:08:23.037403] [INFO ] [MAIN ] GFF: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:08:23.060108] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-10-15T19:08:23.072614] [DEBUG] [LOCAL ] GFF: Loaded 30024 existing records from primary storage. [2025-10-15T19:08:23.072892] [INFO ] [MAIN ] GFF: Loaded 30024 existing records. [2025-10-15T19:08:23.245064] [WARN ] [MAIN ] GFF: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:08:23.245321] [INFO ] [MAIN ] GFF: Wiping existing primary data before full refresh. [2025-10-15T19:08:23.245379] [INFO ] [LOCAL ] GFF: Starting deletion of primary data. [2025-10-15T19:08:23.245616] [DEBUG] [LOCAL ] GFF: Deleted primary data file. [2025-10-15T19:08:23.245717] [INFO ] [MAIN ] GFF: Starting full primary refresh. [2025-10-15T19:08:23.319228] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-06. [2025-10-15T19:08:23.599709] [INFO ] [REMOTE ] GFF: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:08:23.947791] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-06 (2.23 seconds). [2025-10-15T19:08:24.114000] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-07. [2025-10-15T19:08:24.913986] [INFO ] [REMOTE ] GFF: Fetching primary data for 2024-12. [2025-10-15T19:08:24.916669] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-15T19:08:25.714032] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-02. [2025-10-15T19:08:26.126941] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-15T19:08:26.127550] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-10-15T19:08:26.402168] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-07 (2.29 seconds). [2025-10-15T19:08:26.513958] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-08. [2025-10-15T19:08:27.314027] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-01. [2025-10-15T19:08:28.114044] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-07. [2025-10-15T19:08:28.491939] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-15T19:08:28.531755] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-10-15T19:08:28.914059] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-03. [2025-10-15T19:08:29.147080] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-15T19:08:29.608685] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-15T19:08:29.714017] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-09. [2025-10-15T19:08:30.513985] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-04. [2025-10-15T19:08:31.061388] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-10-15T19:08:31.314046] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-02. [2025-10-15T19:08:31.870615] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-09 (2.16 seconds). [2025-10-15T19:08:32.114012] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-10. [2025-10-15T19:08:32.654272] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-15T19:08:32.914035] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-08. [2025-10-15T19:08:33.714042] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-03. [2025-10-15T19:08:34.332625] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-15T19:08:34.513970] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-05. [2025-10-15T19:08:34.552986] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-10 (2.44 seconds). [2025-10-15T19:08:34.559619] [INFO ] [REMOTE ] GEV: Full fetch complete (77013 records). [2025-10-15T19:08:34.559759] [DEBUG] [VALIDATOR ] GEV: Validating primary data. [2025-10-15T19:08:34.983222] [DEBUG] [VALIDATOR ] GEV: All expected trading days are present. [2025-10-15T19:08:34.983409] [DEBUG] [VALIDATOR ] GEV: Primary data validation passed. [2025-10-15T19:08:34.984570] [INFO ] [MAIN ] GEV: Fetched primary data is valid. [2025-10-15T19:08:34.984697] [DEBUG] [LOCAL ] GEV: Saving primary data. [2025-10-15T19:08:34.986255] [DEBUG] [LOCAL ] GEV: Trimmed 77013 records to 53000 (keeping 200 days of data) [2025-10-15T19:08:35.139018] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-15T19:08:35.137917] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-15T19:08:35.315986] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-06. [2025-10-15T19:08:35.358306] [DEBUG] [LOCAL ] GEV: Primary data saved (53000 records). [2025-10-15T19:08:35.358430] [INFO ] [MAIN ] GEV: Full history saved. [2025-10-15T19:08:35.358784] [INFO ] [MAIN ] Update Progress: 917/2369 symbols completed. GEV took 32.9s. Estimated remaining: 3h 23m 30s. Rate: 7.1 symbols/min [2025-10-15T19:08:35.795896] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-10-15T19:08:36.114047] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-07. [2025-10-15T19:08:36.555040] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-10-15T19:08:36.913995] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-08. [2025-10-15T19:08:37.385997] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-10-15T19:08:37.714057] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-09. [2025-10-15T19:08:38.066326] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-09 (0.35 seconds). [2025-10-15T19:08:38.513999] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-10. [2025-10-15T19:08:38.969259] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-15T19:08:38.970071] [INFO ] [REMOTE ] GF: Full fetch complete (4985 records). [2025-10-15T19:08:38.970140] [DEBUG] [VALIDATOR ] GF: Validating primary data. [2025-10-15T19:08:39.317186] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-04. [2025-10-15T19:08:39.317483] [DEBUG] [VALIDATOR ] GF: All expected trading days are present. [2025-10-15T19:08:39.317809] [DEBUG] [VALIDATOR ] GF: Primary data validation passed. [2025-10-15T19:08:39.318685] [INFO ] [MAIN ] GF: Fetched primary data is valid. [2025-10-15T19:08:39.318754] [DEBUG] [LOCAL ] GF: Saving primary data. [2025-10-15T19:08:39.319160] [DEBUG] [LOCAL ] GF: Trimmed 4985 records to 2697 (keeping 200 days of data) [2025-10-15T19:08:39.337173] [DEBUG] [LOCAL ] GF: Primary data saved (2697 records). [2025-10-15T19:08:39.337372] [INFO ] [MAIN ] GF: Full history saved. [2025-10-15T19:08:39.337460] [INFO ] [MAIN ] Update Progress: 918/2369 symbols completed. GF took 21.1s. Estimated remaining: 3h 23m 14s. Rate: 7.1 symbols/min [2025-10-15T19:08:40.114049] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-09. [2025-10-15T19:08:40.846936] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-15T19:08:40.913954] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-05. [2025-10-15T19:08:41.411223] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-15T19:08:41.713970] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-10. [2025-10-15T19:08:41.898006] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-15T19:08:42.514067] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-06. [2025-10-15T19:08:42.677841] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-15T19:08:42.682838] [INFO ] [REMOTE ] GETY: Full fetch complete (55501 records). [2025-10-15T19:08:42.683010] [DEBUG] [VALIDATOR ] GETY: Validating primary data. [2025-10-15T19:08:43.119422] [DEBUG] [VALIDATOR ] GETY: All expected trading days are present. [2025-10-15T19:08:43.119509] [DEBUG] [VALIDATOR ] GETY: Primary data validation passed. [2025-10-15T19:08:43.120555] [INFO ] [MAIN ] GETY: Fetched primary data is valid. [2025-10-15T19:08:43.120631] [DEBUG] [LOCAL ] GETY: Saving primary data. [2025-10-15T19:08:43.122005] [DEBUG] [LOCAL ] GETY: Trimmed 55501 records to 34990 (keeping 200 days of data) [2025-10-15T19:08:43.334537] [DEBUG] [LOCAL ] GETY: Primary data saved (34990 records). [2025-10-15T19:08:43.334712] [INFO ] [MAIN ] GETY: Full history saved. [2025-10-15T19:08:43.334833] [INFO ] [MAIN ] Update Progress: 919/2369 symbols completed. GETY took 48.0s. Estimated remaining: 3h 22m 59s. Rate: 7.1 symbols/min [2025-10-15T19:08:43.701823] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-15T19:08:43.708782] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-07. [2025-10-15T19:08:44.703465] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-15T19:08:44.714770] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-08. [2025-10-15T19:08:46.031919] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-15T19:08:46.039979] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-09. [2025-10-15T19:08:47.177452] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-15T19:08:47.183563] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-10. [2025-10-15T19:08:48.424365] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-15T19:08:48.427830] [INFO ] [REMOTE ] GFF: Full fetch complete (44092 records). [2025-10-15T19:08:48.427929] [DEBUG] [VALIDATOR ] GFF: Validating primary data. [2025-10-15T19:08:48.795928] [DEBUG] [VALIDATOR ] GFF: All expected trading days are present. [2025-10-15T19:08:48.796011] [DEBUG] [VALIDATOR ] GFF: Primary data validation passed. [2025-10-15T19:08:48.796772] [INFO ] [MAIN ] GFF: Fetched primary data is valid. [2025-10-15T19:08:48.796835] [DEBUG] [LOCAL ] GFF: Saving primary data. [2025-10-15T19:08:48.797930] [DEBUG] [LOCAL ] GFF: Trimmed 44092 records to 30002 (keeping 200 days of data) [2025-10-15T19:08:48.980383] [DEBUG] [LOCAL ] GFF: Primary data saved (30002 records). [2025-10-15T19:08:48.980528] [INFO ] [MAIN ] GFF: Full history saved. [2025-10-15T19:08:48.980628] [INFO ] [MAIN ] Update Progress: 920/2369 symbols completed. GFF took 26.1s. Estimated remaining: 3h 22m 46s. Rate: 7.1 symbols/min [2025-10-15T19:08:49.506207] [INFO ] [MAIN ] GFL: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:08:49.602349] [INFO ] [MAIN ] GFR: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:08:49.683264] [INFO ] [MAIN ] GGB: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:08:49.661402] [INFO ] [MAIN ] GFI: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:08:49.691563] [DEBUG] [LOCAL ] GFR: Loaded 7814 existing records from primary storage. [2025-10-15T19:08:49.691865] [INFO ] [MAIN ] GFR: Loaded 7814 existing records. [2025-10-15T19:08:49.887253] [WARN ] [MAIN ] GFR: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:08:49.926385] [INFO ] [MAIN ] GFR: Wiping existing primary data before full refresh. [2025-10-15T19:08:49.926479] [INFO ] [LOCAL ] GFR: Starting deletion of primary data. [2025-10-15T19:08:49.927202] [DEBUG] [LOCAL ] GFL: Loaded 47717 existing records from primary storage. [2025-10-15T19:08:49.927503] [DEBUG] [LOCAL ] GFR: Deleted primary data file. [2025-10-15T19:08:49.927720] [INFO ] [MAIN ] GFR: Starting full primary refresh. [2025-10-15T19:08:49.927632] [INFO ] [MAIN ] GFL: Loaded 47717 existing records. [2025-10-15T19:08:50.072855] [DEBUG] [LOCAL ] GGB: Loaded 51393 existing records from primary storage. [2025-10-15T19:08:50.126960] [INFO ] [MAIN ] GGB: Loaded 51393 existing records. [2025-10-15T19:08:50.171226] [DEBUG] [LOCAL ] GFI: Loaded 53117 existing records from primary storage. [2025-10-15T19:08:50.252827] [INFO ] [MAIN ] GFI: Loaded 53117 existing records. [2025-10-15T19:08:50.529123] [WARN ] [MAIN ] GFL: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:08:50.578724] [INFO ] [MAIN ] GFL: Wiping existing primary data before full refresh. [2025-10-15T19:08:50.621005] [INFO ] [LOCAL ] GFL: Starting deletion of primary data. [2025-10-15T19:08:50.745023] [DEBUG] [LOCAL ] GFL: Deleted primary data file. [2025-10-15T19:08:50.768074] [INFO ] [MAIN ] GFL: Starting full primary refresh. [2025-10-15T19:08:50.744942] [WARN ] [MAIN ] GGB: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:08:50.786974] [INFO ] [MAIN ] GGB: Wiping existing primary data before full refresh. [2025-10-15T19:08:50.862773] [WARN ] [MAIN ] GFI: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:08:50.895511] [INFO ] [LOCAL ] GGB: Starting deletion of primary data. [2025-10-15T19:08:50.921960] [INFO ] [MAIN ] GFI: Wiping existing primary data before full refresh. [2025-10-15T19:08:50.955581] [INFO ] [LOCAL ] GFI: Starting deletion of primary data. [2025-10-15T19:08:50.960901] [DEBUG] [LOCAL ] GGB: Deleted primary data file. [2025-10-15T19:08:51.015609] [INFO ] [MAIN ] GGB: Starting full primary refresh. [2025-10-15T19:08:51.010360] [DEBUG] [LOCAL ] GFI: Deleted primary data file. [2025-10-15T19:08:51.038363] [INFO ] [REMOTE ] GFR: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:08:51.038717] [INFO ] [REMOTE ] GFR: Fetching primary data for 2024-12. [2025-10-15T19:08:51.064480] [INFO ] [MAIN ] GFI: Starting full primary refresh. [2025-10-15T19:08:51.771291] [INFO ] [REMOTE ] GFL: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:08:51.817206] [INFO ] [REMOTE ] GFL: Fetching primary data for 2024-12. [2025-10-15T19:08:51.910638] [INFO ] [REMOTE ] GGB: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:08:51.931896] [INFO ] [REMOTE ] GGB: Fetching primary data for 2024-12. [2025-10-15T19:08:51.992136] [INFO ] [REMOTE ] GFI: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:08:51.992581] [INFO ] [REMOTE ] GFI: Fetching primary data for 2024-12. [2025-10-15T19:08:52.025304] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-10-15T19:08:52.028727] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-01. [2025-10-15T19:08:52.607190] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-15T19:08:52.609610] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-02. [2025-10-15T19:08:52.850683] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-15T19:08:52.859470] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-01. [2025-10-15T19:08:53.272710] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-15T19:08:53.275217] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-03. [2025-10-15T19:08:53.484124] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-15T19:08:53.494526] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-01. [2025-10-15T19:08:53.646372] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-15T19:08:53.714031] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-01. [2025-10-15T19:08:54.007914] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-15T19:08:54.330332] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-15T19:08:54.514018] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-02. [2025-10-15T19:08:54.989051] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-15T19:08:55.314009] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-04. [2025-10-15T19:08:55.627879] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-15T19:08:55.917400] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-15T19:08:56.102169] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-15T19:08:56.113981] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-05. [2025-10-15T19:08:56.874630] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-15T19:08:56.913992] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-06. [2025-10-15T19:08:57.377388] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-10-15T19:08:57.714026] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-07. [2025-10-15T19:08:58.288742] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-15T19:08:58.514021] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-02. [2025-10-15T19:08:59.313997] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-02. [2025-10-15T19:09:00.114072] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-08. [2025-10-15T19:09:00.249902] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-15T19:09:00.703180] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-15T19:09:00.771337] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-15T19:09:00.914044] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-09. [2025-10-15T19:09:01.713987] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-03. [2025-10-15T19:09:01.753738] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-15T19:09:02.513997] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-03. [2025-10-15T19:09:03.314018] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-03. [2025-10-15T19:09:03.558242] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-15T19:09:04.113978] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-10. [2025-10-15T19:09:04.223372] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-15T19:09:04.223931] [DEBUG] [REMOTE ] GFR: Error fetching primary data for 2025-10: 'API call returned an empty response.' [2025-10-15T19:09:04.227826] [WARN ] [REMOTE ] GFR: No data returned for month 2025-10 [2025-10-15T19:09:04.233931] [FATAL] [REMOTE ] GFR: API call failed - aborting fetch to avoid wasting further API calls [2025-10-15T19:09:04.234280] [FATAL] [MAIN ] GFR: Failed to fetch primary data. [2025-10-15T19:09:04.234533] [WARN ] [MAIN ] GFR: Deleting existing primary and derivative data due to fetch failure. [2025-10-15T19:09:04.234748] [INFO ] [LOCAL ] GFR: Starting deletion of primary data. [2025-10-15T19:09:04.235128] [DEBUG] [LOCAL ] GFR: No primary data file found to delete. [2025-10-15T19:09:04.235199] [INFO ] [LOCAL ] GFR: Starting deletion of derivative data. [2025-10-15T19:09:04.235446] [DEBUG] [LOCAL ] GFR: Deleted derivative data file. [2025-10-15T19:09:04.235542] [INFO ] [MAIN ] Update Progress: 921/2369 symbols completed. GFR took 15.3s. Estimated remaining: 3h 22m 48s. Rate: 7.1 symbols/min [2025-10-15T19:09:04.410393] [INFO ] [MAIN ] GGG: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:09:04.447397] [DEBUG] [LOCAL ] GGG: Loaded 40713 existing records from primary storage. [2025-10-15T19:09:04.447744] [INFO ] [MAIN ] GGG: Loaded 40713 existing records. [2025-10-15T19:09:04.658584] [WARN ] [MAIN ] GGG: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:09:04.658907] [INFO ] [MAIN ] GGG: Wiping existing primary data before full refresh. [2025-10-15T19:09:04.658959] [INFO ] [LOCAL ] GGG: Starting deletion of primary data. [2025-10-15T19:09:04.659336] [DEBUG] [LOCAL ] GGG: Deleted primary data file. [2025-10-15T19:09:04.659392] [INFO ] [MAIN ] GGG: Starting full primary refresh. [2025-10-15T19:09:04.918121] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-04. [2025-10-15T19:09:05.033134] [INFO ] [REMOTE ] GGG: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:09:05.066111] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-15T19:09:05.714030] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-04. [2025-10-15T19:09:06.514003] [INFO ] [REMOTE ] GGG: Fetching primary data for 2024-12. [2025-10-15T19:09:06.596742] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-15T19:09:07.313996] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-04. [2025-10-15T19:09:07.502422] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-15T19:09:07.866301] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-15T19:09:08.114021] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-01. [2025-10-15T19:09:08.862846] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-15T19:09:08.914019] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-05. [2025-10-15T19:09:09.636691] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-15T19:09:09.714017] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-05. [2025-10-15T19:09:10.514030] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-02. [2025-10-15T19:09:10.663002] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-15T19:09:11.314008] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-05. [2025-10-15T19:09:11.473025] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-15T19:09:11.679893] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-15T19:09:12.114026] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-06. [2025-10-15T19:09:12.913971] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-03. [2025-10-15T19:09:12.996203] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-15T19:09:13.714068] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-06. [2025-10-15T19:09:14.004142] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-15T19:09:14.043055] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-15T19:09:14.513997] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-04. [2025-10-15T19:09:15.104925] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-15T19:09:15.314048] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-06. [2025-10-15T19:09:15.852558] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-15T19:09:16.114005] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-07. [2025-10-15T19:09:16.913976] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-07. [2025-10-15T19:09:17.035164] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-15T19:09:17.714067] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-05. [2025-10-15T19:09:18.118953] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-10-15T19:09:18.379154] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-15T19:09:18.514044] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-08. [2025-10-15T19:09:19.106510] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-15T19:09:19.314059] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-07. [2025-10-15T19:09:20.114062] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-08. [2025-10-15T19:09:20.320507] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-15T19:09:20.914031] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-06. [2025-10-15T19:09:21.139117] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-15T19:09:21.237258] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-15T19:09:21.714062] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-09. [2025-10-15T19:09:22.331378] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-15T19:09:22.514008] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-08. [2025-10-15T19:09:23.314031] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-09. [2025-10-15T19:09:23.684282] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-10-15T19:09:24.078749] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-15T19:09:24.113969] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-09. [2025-10-15T19:09:24.518723] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-15T19:09:24.914010] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-07. [2025-10-15T19:09:25.674131] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-15T19:09:25.713991] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-10. [2025-10-15T19:09:26.405943] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-15T19:09:26.513975] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-08. [2025-10-15T19:09:27.313970] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-10. [2025-10-15T19:09:27.514158] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-15T19:09:27.520494] [INFO ] [REMOTE ] GGB: Full fetch complete (74329 records). [2025-10-15T19:09:27.520619] [DEBUG] [VALIDATOR ] GGB: Validating primary data. [2025-10-15T19:09:27.921393] [DEBUG] [VALIDATOR ] GGB: All expected trading days are present. [2025-10-15T19:09:27.921595] [DEBUG] [VALIDATOR ] GGB: Primary data validation passed. [2025-10-15T19:09:27.922829] [INFO ] [MAIN ] GGB: Fetched primary data is valid. [2025-10-15T19:09:27.932589] [DEBUG] [LOCAL ] GGB: Saving primary data. [2025-10-15T19:09:27.952491] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-15T19:09:27.961760] [DEBUG] [LOCAL ] GGB: Trimmed 74329 records to 51471 (keeping 200 days of data) [2025-10-15T19:09:28.126678] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-09. [2025-10-15T19:09:28.267608] [DEBUG] [LOCAL ] GGB: Primary data saved (51471 records). [2025-10-15T19:09:28.267794] [INFO ] [MAIN ] GGB: Full history saved. [2025-10-15T19:09:28.267885] [INFO ] [MAIN ] Update Progress: 922/2369 symbols completed. GGB took 39.3s. Estimated remaining: 3h 23m 5s. Rate: 7.1 symbols/min [2025-10-15T19:09:28.433397] [INFO ] [MAIN ] GGT: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:09:28.448639] [DEBUG] [LOCAL ] GGT: Loaded 14418 existing records from primary storage. [2025-10-15T19:09:28.448927] [INFO ] [MAIN ] GGT: Loaded 14418 existing records. [2025-10-15T19:09:28.627167] [WARN ] [MAIN ] GGT: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:09:28.627421] [INFO ] [MAIN ] GGT: Wiping existing primary data before full refresh. [2025-10-15T19:09:28.627519] [INFO ] [LOCAL ] GGT: Starting deletion of primary data. [2025-10-15T19:09:28.627802] [DEBUG] [LOCAL ] GGT: Deleted primary data file. [2025-10-15T19:09:28.627859] [INFO ] [MAIN ] GGT: Starting full primary refresh. [2025-10-15T19:09:28.916533] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-10. [2025-10-15T19:09:28.996591] [INFO ] [REMOTE ] GGT: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:09:29.012004] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-15T19:09:29.018586] [INFO ] [REMOTE ] GFL: Full fetch complete (69416 records). [2025-10-15T19:09:29.018785] [DEBUG] [VALIDATOR ] GFL: Validating primary data. [2025-10-15T19:09:29.435404] [DEBUG] [VALIDATOR ] GFL: All expected trading days are present. [2025-10-15T19:09:29.435733] [DEBUG] [VALIDATOR ] GFL: Primary data validation passed. [2025-10-15T19:09:29.438292] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-15T19:09:29.437162] [INFO ] [MAIN ] GFL: Fetched primary data is valid. [2025-10-15T19:09:29.438455] [DEBUG] [LOCAL ] GFL: Saving primary data. [2025-10-15T19:09:29.448066] [DEBUG] [LOCAL ] GFL: Trimmed 69416 records to 47671 (keeping 200 days of data) [2025-10-15T19:09:29.714808] [INFO ] [REMOTE ] GGT: Fetching primary data for 2024-12. [2025-10-15T19:09:29.743689] [DEBUG] [LOCAL ] GFL: Primary data saved (47671 records). [2025-10-15T19:09:29.743866] [INFO ] [MAIN ] GFL: Full history saved. [2025-10-15T19:09:29.743976] [INFO ] [MAIN ] Update Progress: 923/2369 symbols completed. GFL took 40.8s. Estimated remaining: 3h 22m 45s. Rate: 7.1 symbols/min [2025-10-15T19:09:29.908761] [INFO ] [MAIN ] GGZ: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:09:29.913781] [DEBUG] [LOCAL ] GGZ: Loaded 2407 existing records from primary storage. [2025-10-15T19:09:29.913943] [INFO ] [MAIN ] GGZ: Loaded 2407 existing records. [2025-10-15T19:09:30.084022] [WARN ] [MAIN ] GGZ: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:09:30.084223] [INFO ] [MAIN ] GGZ: Wiping existing primary data before full refresh. [2025-10-15T19:09:30.084271] [INFO ] [LOCAL ] GGZ: Starting deletion of primary data. [2025-10-15T19:09:30.084431] [DEBUG] [LOCAL ] GGZ: Deleted primary data file. [2025-10-15T19:09:30.084486] [INFO ] [MAIN ] GGZ: Starting full primary refresh. [2025-10-15T19:09:30.439066] [INFO ] [REMOTE ] GGZ: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:09:30.514021] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2024-12. [2025-10-15T19:09:30.558721] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-10-15T19:09:30.658126] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-15T19:09:30.664507] [INFO ] [REMOTE ] GFI: Full fetch complete (76755 records). [2025-10-15T19:09:30.664628] [DEBUG] [VALIDATOR ] GFI: Validating primary data. [2025-10-15T19:09:30.966952] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2024-12 (0.45 seconds). [2025-10-15T19:09:31.059042] [DEBUG] [VALIDATOR ] GFI: All expected trading days are present. [2025-10-15T19:09:31.059127] [DEBUG] [VALIDATOR ] GFI: Primary data validation passed. [2025-10-15T19:09:31.060208] [INFO ] [MAIN ] GFI: Fetched primary data is valid. [2025-10-15T19:09:31.060277] [DEBUG] [LOCAL ] GFI: Saving primary data. [2025-10-15T19:09:31.061772] [DEBUG] [LOCAL ] GFI: Trimmed 76755 records to 53116 (keeping 200 days of data) [2025-10-15T19:09:31.338278] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-01. [2025-10-15T19:09:31.385302] [DEBUG] [LOCAL ] GFI: Primary data saved (53116 records). [2025-10-15T19:09:31.385452] [INFO ] [MAIN ] GFI: Full history saved. [2025-10-15T19:09:31.385533] [INFO ] [MAIN ] Update Progress: 924/2369 symbols completed. GFI took 42.4s. Estimated remaining: 3h 22m 26s. Rate: 7.1 symbols/min [2025-10-15T19:09:31.549217] [INFO ] [MAIN ] GHC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:09:31.554613] [DEBUG] [LOCAL ] GHC: Loaded 2917 existing records from primary storage. [2025-10-15T19:09:31.554811] [INFO ] [MAIN ] GHC: Loaded 2917 existing records. [2025-10-15T19:09:31.753079] [WARN ] [MAIN ] GHC: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:09:31.753324] [INFO ] [MAIN ] GHC: Wiping existing primary data before full refresh. [2025-10-15T19:09:31.753374] [INFO ] [LOCAL ] GHC: Starting deletion of primary data. [2025-10-15T19:09:31.753610] [DEBUG] [LOCAL ] GHC: Deleted primary data file. [2025-10-15T19:09:31.753708] [INFO ] [MAIN ] GHC: Starting full primary refresh. [2025-10-15T19:09:32.106683] [INFO ] [REMOTE ] GHC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:09:32.113953] [INFO ] [REMOTE ] GHC: Fetching primary data for 2024-12. [2025-10-15T19:09:32.146144] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-15T19:09:32.411666] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2024-12 (0.30 seconds). [2025-10-15T19:09:32.913961] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-01. [2025-10-15T19:09:33.431852] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-10-15T19:09:33.714023] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-02. [2025-10-15T19:09:34.514049] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-01. [2025-10-15T19:09:34.535518] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-15T19:09:35.212573] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-15T19:09:35.314016] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-02. [2025-10-15T19:09:35.904008] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-15T19:09:36.114004] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-02. [2025-10-15T19:09:36.913968] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-03. [2025-10-15T19:09:37.066318] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-15T19:09:37.428999] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-10-15T19:09:37.714061] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-10. [2025-10-15T19:09:38.514057] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-04. [2025-10-15T19:09:39.167766] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-10-15T19:09:39.180935] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-15T19:09:39.185804] [INFO ] [REMOTE ] GGG: Full fetch complete (59470 records). [2025-10-15T19:09:39.185899] [DEBUG] [VALIDATOR ] GGG: Validating primary data. [2025-10-15T19:09:39.325291] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-05. [2025-10-15T19:09:39.569757] [DEBUG] [VALIDATOR ] GGG: All expected trading days are present. [2025-10-15T19:09:39.569881] [DEBUG] [VALIDATOR ] GGG: Primary data validation passed. [2025-10-15T19:09:39.570798] [INFO ] [MAIN ] GGG: Fetched primary data is valid. [2025-10-15T19:09:39.570863] [DEBUG] [LOCAL ] GGG: Saving primary data. [2025-10-15T19:09:39.572159] [DEBUG] [LOCAL ] GGG: Trimmed 59470 records to 40679 (keeping 200 days of data) [2025-10-15T19:09:39.816217] [DEBUG] [LOCAL ] GGG: Primary data saved (40679 records). [2025-10-15T19:09:39.816335] [INFO ] [MAIN ] GGG: Full history saved. [2025-10-15T19:09:39.816433] [INFO ] [MAIN ] Update Progress: 925/2369 symbols completed. GGG took 35.6s. Estimated remaining: 3h 22m 18s. Rate: 7.1 symbols/min [2025-10-15T19:09:39.987874] [INFO ] [MAIN ] GHG: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:09:39.991153] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-15T19:09:39.997284] [DEBUG] [LOCAL ] GHG: Loaded 3280 existing records from primary storage. [2025-10-15T19:09:39.997440] [INFO ] [MAIN ] GHG: Loaded 3280 existing records. [2025-10-15T19:09:40.119159] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-03. [2025-10-15T19:09:40.173244] [WARN ] [MAIN ] GHG: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:09:40.173458] [INFO ] [MAIN ] GHG: Wiping existing primary data before full refresh. [2025-10-15T19:09:40.173538] [INFO ] [LOCAL ] GHG: Starting deletion of primary data. [2025-10-15T19:09:40.173724] [DEBUG] [LOCAL ] GHG: Deleted primary data file. [2025-10-15T19:09:40.173780] [INFO ] [MAIN ] GHG: Starting full primary refresh. [2025-10-15T19:09:40.524975] [INFO ] [REMOTE ] GHG: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:09:40.577892] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-10-15T19:09:40.914053] [INFO ] [REMOTE ] GHG: Fetching primary data for 2024-12. [2025-10-15T19:09:41.328339] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2024-12 (0.41 seconds). [2025-10-15T19:09:41.714057] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-04. [2025-10-15T19:09:42.082159] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-04 (0.37 seconds). [2025-10-15T19:09:42.514048] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-01. [2025-10-15T19:09:42.881956] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-01 (0.37 seconds). [2025-10-15T19:09:43.313994] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-02. [2025-10-15T19:09:43.674772] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-02 (0.36 seconds). [2025-10-15T19:09:44.113995] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-03. [2025-10-15T19:09:44.505449] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-03 (0.39 seconds). [2025-10-15T19:09:44.914049] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-06. [2025-10-15T19:09:45.381948] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-10-15T19:09:45.713998] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-07. [2025-10-15T19:09:46.318314] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-15T19:09:46.514013] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-04. [2025-10-15T19:09:47.044136] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-10-15T19:09:47.314098] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-08. [2025-10-15T19:09:47.875129] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-15T19:09:48.113994] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-09. [2025-10-15T19:09:48.616880] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-10-15T19:09:48.914182] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-05. [2025-10-15T19:09:49.499018] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-15T19:09:49.713975] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-03. [2025-10-15T19:09:50.495773] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-15T19:09:50.513950] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-04. [2025-10-15T19:09:51.314006] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-10. [2025-10-15T19:09:51.371614] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-15T19:09:51.881680] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-15T19:09:51.882781] [INFO ] [REMOTE ] GHC: Full fetch complete (3607 records). [2025-10-15T19:09:51.882849] [DEBUG] [VALIDATOR ] GHC: Validating primary data. [2025-10-15T19:09:52.124033] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-06. [2025-10-15T19:09:52.246252] [DEBUG] [VALIDATOR ] GHC: All expected trading days are present. [2025-10-15T19:09:52.246326] [DEBUG] [VALIDATOR ] GHC: Primary data validation passed. [2025-10-15T19:09:52.246449] [INFO ] [MAIN ] GHC: Fetched primary data is valid. [2025-10-15T19:09:52.246488] [DEBUG] [LOCAL ] GHC: Saving primary data. [2025-10-15T19:09:52.246857] [DEBUG] [LOCAL ] GHC: Trimmed 3607 records to 2926 (keeping 200 days of data) [2025-10-15T19:09:52.270553] [DEBUG] [LOCAL ] GHC: Primary data saved (2926 records). [2025-10-15T19:09:52.270953] [INFO ] [MAIN ] GHC: Full history saved. [2025-10-15T19:09:52.271056] [INFO ] [MAIN ] Update Progress: 926/2369 symbols completed. GHC took 20.9s. Estimated remaining: 3h 22m 16s. Rate: 7.1 symbols/min [2025-10-15T19:09:52.452039] [INFO ] [MAIN ] GHI: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:09:52.462722] [DEBUG] [LOCAL ] GHI: Loaded 7296 existing records from primary storage. [2025-10-15T19:09:52.462919] [INFO ] [MAIN ] GHI: Loaded 7296 existing records. [2025-10-15T19:09:52.644009] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-10-15T19:09:52.647565] [WARN ] [MAIN ] GHI: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:09:52.649068] [INFO ] [MAIN ] GHI: Wiping existing primary data before full refresh. [2025-10-15T19:09:52.649123] [INFO ] [LOCAL ] GHI: Starting deletion of primary data. [2025-10-15T19:09:52.649560] [DEBUG] [LOCAL ] GHI: Deleted primary data file. [2025-10-15T19:09:52.649617] [INFO ] [MAIN ] GHI: Starting full primary refresh. [2025-10-15T19:09:52.921322] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-05. [2025-10-15T19:09:53.004048] [INFO ] [REMOTE ] GHI: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:09:53.713964] [INFO ] [REMOTE ] GHI: Fetching primary data for 2024-12. [2025-10-15T19:09:53.927401] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-15T19:09:54.514006] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-06. [2025-10-15T19:09:54.634469] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-10-15T19:09:55.133291] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-15T19:09:55.314005] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-07. [2025-10-15T19:09:55.747870] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-10-15T19:09:56.113968] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-07. [2025-10-15T19:09:56.865001] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-15T19:09:56.914001] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-01. [2025-10-15T19:09:57.714001] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-08. [2025-10-15T19:09:57.763122] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-15T19:09:58.152196] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-10-15T19:09:58.514028] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-02. [2025-10-15T19:09:59.183166] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-15T19:09:59.313985] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-03. [2025-10-15T19:10:00.071152] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-15T19:10:00.114010] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-05. [2025-10-15T19:10:00.671727] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-15T19:10:00.913993] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-06. [2025-10-15T19:10:01.501959] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-15T19:10:01.714014] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-09. [2025-10-15T19:10:02.294622] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-15T19:10:02.514019] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-10. [2025-10-15T19:10:03.031940] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-15T19:10:03.032814] [INFO ] [REMOTE ] GGZ: Full fetch complete (3980 records). [2025-10-15T19:10:03.032884] [DEBUG] [VALIDATOR ] GGZ: Validating primary data. [2025-10-15T19:10:03.315630] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-04. [2025-10-15T19:10:03.396258] [DEBUG] [VALIDATOR ] GGZ: All expected trading days are present. [2025-10-15T19:10:03.396327] [DEBUG] [VALIDATOR ] GGZ: Primary data validation passed. [2025-10-15T19:10:03.396460] [INFO ] [MAIN ] GGZ: Fetched primary data is valid. [2025-10-15T19:10:03.396501] [DEBUG] [LOCAL ] GGZ: Saving primary data. [2025-10-15T19:10:03.396881] [DEBUG] [LOCAL ] GGZ: Trimmed 3980 records to 2401 (keeping 200 days of data) [2025-10-15T19:10:03.411586] [DEBUG] [LOCAL ] GGZ: Primary data saved (2401 records). [2025-10-15T19:10:03.411669] [INFO ] [MAIN ] GGZ: Full history saved. [2025-10-15T19:10:03.411770] [INFO ] [MAIN ] Update Progress: 927/2369 symbols completed. GGZ took 33.7s. Estimated remaining: 3h 22m 12s. Rate: 7.1 symbols/min [2025-10-15T19:10:03.576096] [INFO ] [MAIN ] GHLD: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:10:03.582403] [DEBUG] [LOCAL ] GHLD: Loaded 4238 existing records from primary storage. [2025-10-15T19:10:03.582569] [INFO ] [MAIN ] GHLD: Loaded 4238 existing records. [2025-10-15T19:10:03.755775] [WARN ] [MAIN ] GHLD: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:10:03.756010] [INFO ] [MAIN ] GHLD: Wiping existing primary data before full refresh. [2025-10-15T19:10:03.756058] [INFO ] [LOCAL ] GHLD: Starting deletion of primary data. [2025-10-15T19:10:03.756213] [DEBUG] [LOCAL ] GHLD: Deleted primary data file. [2025-10-15T19:10:03.756268] [INFO ] [MAIN ] GHLD: Starting full primary refresh. [2025-10-15T19:10:04.105514] [INFO ] [REMOTE ] GHLD: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:10:04.112520] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-15T19:10:04.114534] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2024-12. [2025-10-15T19:10:04.480622] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2024-12 (0.37 seconds). [2025-10-15T19:10:04.914025] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-05. [2025-10-15T19:10:05.695321] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-15T19:10:05.713966] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-06. [2025-10-15T19:10:06.451395] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-15T19:10:06.513996] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-08. [2025-10-15T19:10:07.313995] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-07. [2025-10-15T19:10:07.436929] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-15T19:10:07.871448] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-15T19:10:08.114008] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-07. [2025-10-15T19:10:08.854632] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-15T19:10:08.913960] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-08. [2025-10-15T19:10:09.713970] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-08. [2025-10-15T19:10:09.738126] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-15T19:10:10.108279] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-08 (0.39 seconds). [2025-10-15T19:10:10.513987] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-09. [2025-10-15T19:10:11.096943] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-15T19:10:11.314002] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-01. [2025-10-15T19:10:11.679827] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-01 (0.37 seconds). [2025-10-15T19:10:12.114038] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-09. [2025-10-15T19:10:12.913971] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-02. [2025-10-15T19:10:13.065238] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-15T19:10:13.295857] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-02 (0.38 seconds). [2025-10-15T19:10:13.714007] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-10. [2025-10-15T19:10:14.359417] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-15T19:10:14.360517] [INFO ] [REMOTE ] GHG: Full fetch complete (4175 records). [2025-10-15T19:10:14.360608] [DEBUG] [VALIDATOR ] GHG: Validating primary data. [2025-10-15T19:10:14.519187] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-03. [2025-10-15T19:10:14.732598] [DEBUG] [VALIDATOR ] GHG: All expected trading days are present. [2025-10-15T19:10:14.732702] [DEBUG] [VALIDATOR ] GHG: Primary data validation passed. [2025-10-15T19:10:14.732860] [INFO ] [MAIN ] GHG: Fetched primary data is valid. [2025-10-15T19:10:14.732898] [DEBUG] [LOCAL ] GHG: Saving primary data. [2025-10-15T19:10:14.733242] [DEBUG] [LOCAL ] GHG: Trimmed 4175 records to 3296 (keeping 200 days of data) [2025-10-15T19:10:14.751241] [DEBUG] [LOCAL ] GHG: Primary data saved (3296 records). [2025-10-15T19:10:14.751344] [INFO ] [MAIN ] GHG: Full history saved. [2025-10-15T19:10:14.751465] [INFO ] [MAIN ] Update Progress: 928/2369 symbols completed. GHG took 34.9s. Estimated remaining: 3h 22m 8s. Rate: 7.1 symbols/min [2025-10-15T19:10:14.920857] [INFO ] [MAIN ] GHM: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:10:14.936364] [DEBUG] [LOCAL ] GHM: Loaded 14325 existing records from primary storage. [2025-10-15T19:10:14.936615] [INFO ] [MAIN ] GHM: Loaded 14325 existing records. [2025-10-15T19:10:15.103864] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-15T19:10:15.116977] [WARN ] [MAIN ] GHM: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:10:15.119536] [INFO ] [MAIN ] GHM: Wiping existing primary data before full refresh. [2025-10-15T19:10:15.119590] [INFO ] [LOCAL ] GHM: Starting deletion of primary data. [2025-10-15T19:10:15.119789] [DEBUG] [LOCAL ] GHM: Deleted primary data file. [2025-10-15T19:10:15.119849] [INFO ] [MAIN ] GHM: Starting full primary refresh. [2025-10-15T19:10:15.314022] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-10. [2025-10-15T19:10:15.471919] [INFO ] [REMOTE ] GHM: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:10:16.114079] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-04. [2025-10-15T19:10:16.379681] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-15T19:10:16.382237] [INFO ] [REMOTE ] GGT: Full fetch complete (18914 records). [2025-10-15T19:10:16.382343] [DEBUG] [VALIDATOR ] GGT: Validating primary data. [2025-10-15T19:10:16.741436] [DEBUG] [VALIDATOR ] GGT: All expected trading days are present. [2025-10-15T19:10:16.741515] [DEBUG] [VALIDATOR ] GGT: Primary data validation passed. [2025-10-15T19:10:16.741954] [INFO ] [MAIN ] GGT: Fetched primary data is valid. [2025-10-15T19:10:16.742014] [DEBUG] [LOCAL ] GGT: Saving primary data. [2025-10-15T19:10:16.742572] [DEBUG] [LOCAL ] GGT: Trimmed 18914 records to 14408 (keeping 200 days of data) [2025-10-15T19:10:16.787546] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-10-15T19:10:16.833717] [DEBUG] [LOCAL ] GGT: Primary data saved (14408 records). [2025-10-15T19:10:16.833874] [INFO ] [MAIN ] GGT: Full history saved. [2025-10-15T19:10:16.833960] [INFO ] [MAIN ] Update Progress: 929/2369 symbols completed. GGT took 48.6s. Estimated remaining: 3h 21m 49s. Rate: 7.1 symbols/min [2025-10-15T19:10:16.919140] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-09. [2025-10-15T19:10:17.012045] [INFO ] [MAIN ] GHY: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:10:17.035702] [DEBUG] [LOCAL ] GHY: Loaded 20943 existing records from primary storage. [2025-10-15T19:10:17.035975] [INFO ] [MAIN ] GHY: Loaded 20943 existing records. [2025-10-15T19:10:17.264557] [WARN ] [MAIN ] GHY: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:10:17.264817] [INFO ] [MAIN ] GHY: Wiping existing primary data before full refresh. [2025-10-15T19:10:17.264873] [INFO ] [LOCAL ] GHY: Starting deletion of primary data. [2025-10-15T19:10:17.265083] [DEBUG] [LOCAL ] GHY: Deleted primary data file. [2025-10-15T19:10:17.265140] [INFO ] [MAIN ] GHY: Starting full primary refresh. [2025-10-15T19:10:17.611734] [INFO ] [REMOTE ] GHY: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:10:17.653819] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-15T19:10:17.713973] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-10. [2025-10-15T19:10:18.514008] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-05. [2025-10-15T19:10:18.559453] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-15T19:10:18.561444] [INFO ] [REMOTE ] GHI: Full fetch complete (11305 records). [2025-10-15T19:10:18.561521] [DEBUG] [VALIDATOR ] GHI: Validating primary data. [2025-10-15T19:10:18.950250] [DEBUG] [VALIDATOR ] GHI: All expected trading days are present. [2025-10-15T19:10:18.950515] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-10-15T19:10:18.950609] [DEBUG] [VALIDATOR ] GHI: Primary data validation passed. [2025-10-15T19:10:18.952723] [INFO ] [MAIN ] GHI: Fetched primary data is valid. [2025-10-15T19:10:18.952804] [DEBUG] [LOCAL ] GHI: Saving primary data. [2025-10-15T19:10:18.953415] [DEBUG] [LOCAL ] GHI: Trimmed 11305 records to 7364 (keeping 200 days of data) [2025-10-15T19:10:19.009309] [DEBUG] [LOCAL ] GHI: Primary data saved (7364 records). [2025-10-15T19:10:19.009577] [INFO ] [MAIN ] GHI: Full history saved. [2025-10-15T19:10:19.009725] [INFO ] [MAIN ] Update Progress: 930/2369 symbols completed. GHI took 26.7s. Estimated remaining: 3h 21m 31s. Rate: 7.1 symbols/min [2025-10-15T19:10:19.186191] [INFO ] [MAIN ] GIB: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:10:19.224070] [DEBUG] [LOCAL ] GIB: Loaded 31638 existing records from primary storage. [2025-10-15T19:10:19.224449] [INFO ] [MAIN ] GIB: Loaded 31638 existing records. [2025-10-15T19:10:19.319359] [INFO ] [REMOTE ] GHY: Fetching primary data for 2024-12. [2025-10-15T19:10:19.420293] [WARN ] [MAIN ] GIB: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:10:19.420612] [INFO ] [MAIN ] GIB: Wiping existing primary data before full refresh. [2025-10-15T19:10:19.420722] [INFO ] [LOCAL ] GIB: Starting deletion of primary data. [2025-10-15T19:10:19.421049] [DEBUG] [LOCAL ] GIB: Deleted primary data file. [2025-10-15T19:10:19.421111] [INFO ] [MAIN ] GIB: Starting full primary refresh. [2025-10-15T19:10:19.803405] [INFO ] [REMOTE ] GIB: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:10:20.114046] [INFO ] [REMOTE ] GHM: Fetching primary data for 2024-12. [2025-10-15T19:10:20.416154] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-15T19:10:20.914046] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-06. [2025-10-15T19:10:20.945142] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-10-15T19:10:21.553790] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-15T19:10:21.714026] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-01. [2025-10-15T19:10:22.514079] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-07. [2025-10-15T19:10:23.036502] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-15T19:10:23.093985] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-15T19:10:23.313982] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-08. [2025-10-15T19:10:23.785314] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-10-15T19:10:24.113995] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-09. [2025-10-15T19:10:24.689717] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-15T19:10:24.913995] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-10. [2025-10-15T19:10:25.426023] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-15T19:10:25.427096] [INFO ] [REMOTE ] GHLD: Full fetch complete (4991 records). [2025-10-15T19:10:25.427164] [DEBUG] [VALIDATOR ] GHLD: Validating primary data. [2025-10-15T19:10:25.719084] [INFO ] [REMOTE ] GIB: Fetching primary data for 2024-12. [2025-10-15T19:10:25.775030] [DEBUG] [VALIDATOR ] GHLD: All expected trading days are present. [2025-10-15T19:10:25.775112] [DEBUG] [VALIDATOR ] GHLD: Primary data validation passed. [2025-10-15T19:10:25.775278] [INFO ] [MAIN ] GHLD: Fetched primary data is valid. [2025-10-15T19:10:25.775332] [DEBUG] [LOCAL ] GHLD: Saving primary data. [2025-10-15T19:10:25.775717] [DEBUG] [LOCAL ] GHLD: Trimmed 4991 records to 4222 (keeping 200 days of data) [2025-10-15T19:10:25.803256] [DEBUG] [LOCAL ] GHLD: Primary data saved (4222 records). [2025-10-15T19:10:25.803353] [INFO ] [MAIN ] GHLD: Full history saved. [2025-10-15T19:10:25.803427] [INFO ] [MAIN ] Update Progress: 931/2369 symbols completed. GHLD took 22.4s. Estimated remaining: 3h 21m 21s. Rate: 7.1 symbols/min [2025-10-15T19:10:25.966397] [INFO ] [MAIN ] GIC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:10:25.980366] [DEBUG] [LOCAL ] GIC: Loaded 13431 existing records from primary storage. [2025-10-15T19:10:25.980579] [INFO ] [MAIN ] GIC: Loaded 13431 existing records. [2025-10-15T19:10:26.154186] [WARN ] [MAIN ] GIC: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:10:26.154437] [INFO ] [MAIN ] GIC: Wiping existing primary data before full refresh. [2025-10-15T19:10:26.154507] [INFO ] [LOCAL ] GIC: Starting deletion of primary data. [2025-10-15T19:10:26.154805] [DEBUG] [LOCAL ] GIC: Deleted primary data file. [2025-10-15T19:10:26.154883] [INFO ] [MAIN ] GIC: Starting full primary refresh. [2025-10-15T19:10:26.510272] [INFO ] [REMOTE ] GIC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:10:26.513955] [INFO ] [REMOTE ] GIC: Fetching primary data for 2024-12. [2025-10-15T19:10:26.897761] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-15T19:10:27.242879] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-10-15T19:10:27.313964] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-01. [2025-10-15T19:10:28.114017] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-01. [2025-10-15T19:10:28.269938] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-15T19:10:28.914024] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-01. [2025-10-15T19:10:29.065738] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-15T19:10:29.714003] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-02. [2025-10-15T19:10:30.514065] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-02. [2025-10-15T19:10:30.722159] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-15T19:10:30.893768] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-15T19:10:31.314084] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-02. [2025-10-15T19:10:31.777861] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-15T19:10:32.113974] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-03. [2025-10-15T19:10:32.299889] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-15T19:10:32.914056] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-02. [2025-10-15T19:10:33.257255] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-15T19:10:33.714067] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-03. [2025-10-15T19:10:34.251291] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-15T19:10:34.514037] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-04. [2025-10-15T19:10:34.663500] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-15T19:10:35.314002] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-03. [2025-10-15T19:10:35.739403] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-15T19:10:36.114014] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-03. [2025-10-15T19:10:36.671122] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-15T19:10:36.914062] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-04. [2025-10-15T19:10:37.104527] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-15T19:10:37.714022] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-04. [2025-10-15T19:10:38.388324] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-15T19:10:38.514064] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-04. [2025-10-15T19:10:38.619303] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-15T19:10:39.281002] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-15T19:10:39.313956] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-05. [2025-10-15T19:10:40.048137] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-15T19:10:40.113980] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-06. [2025-10-15T19:10:40.837621] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-15T19:10:40.914057] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-07. [2025-10-15T19:10:41.713430] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-15T19:10:41.716256] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-05. [2025-10-15T19:10:42.514017] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-08. [2025-10-15T19:10:42.976384] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-15T19:10:43.314015] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-06. [2025-10-15T19:10:43.494382] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-15T19:10:44.113997] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-09. [2025-10-15T19:10:44.705244] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-15T19:10:44.913976] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-07. [2025-10-15T19:10:45.062783] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-15T19:10:45.714017] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-05. [2025-10-15T19:10:46.265167] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-15T19:10:46.504177] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-15T19:10:46.513945] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-06. [2025-10-15T19:10:47.313991] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-08. [2025-10-15T19:10:47.341629] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-15T19:10:48.114016] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-10. [2025-10-15T19:10:48.412604] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-15T19:10:48.913990] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-05. [2025-10-15T19:10:48.950616] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-15T19:10:48.952424] [INFO ] [REMOTE ] GIC: Full fetch complete (19957 records). [2025-10-15T19:10:48.952498] [DEBUG] [VALIDATOR ] GIC: Validating primary data. [2025-10-15T19:10:49.356442] [DEBUG] [VALIDATOR ] GIC: All expected trading days are present. [2025-10-15T19:10:49.356529] [DEBUG] [VALIDATOR ] GIC: Primary data validation passed. [2025-10-15T19:10:49.357035] [INFO ] [MAIN ] GIC: Fetched primary data is valid. [2025-10-15T19:10:49.357097] [DEBUG] [LOCAL ] GIC: Saving primary data. [2025-10-15T19:10:49.357761] [DEBUG] [LOCAL ] GIC: Trimmed 19957 records to 13411 (keeping 200 days of data) [2025-10-15T19:10:49.445631] [DEBUG] [LOCAL ] GIC: Primary data saved (13411 records). [2025-10-15T19:10:49.445799] [INFO ] [MAIN ] GIC: Full history saved. [2025-10-15T19:10:49.445884] [INFO ] [MAIN ] Update Progress: 932/2369 symbols completed. GIC took 23.6s. Estimated remaining: 3h 21m 36s. Rate: 7.1 symbols/min [2025-10-15T19:10:49.648526] [INFO ] [MAIN ] GIL: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:10:49.692471] [DEBUG] [LOCAL ] GIL: Loaded 43802 existing records from primary storage. [2025-10-15T19:10:49.692859] [INFO ] [MAIN ] GIL: Loaded 43802 existing records. [2025-10-15T19:10:49.719098] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-09. [2025-10-15T19:10:49.829686] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-15T19:10:49.923688] [WARN ] [MAIN ] GIL: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:10:49.923901] [INFO ] [MAIN ] GIL: Wiping existing primary data before full refresh. [2025-10-15T19:10:49.923952] [INFO ] [LOCAL ] GIL: Starting deletion of primary data. [2025-10-15T19:10:49.924200] [DEBUG] [LOCAL ] GIL: Deleted primary data file. [2025-10-15T19:10:49.924258] [INFO ] [MAIN ] GIL: Starting full primary refresh. [2025-10-15T19:10:50.294929] [INFO ] [REMOTE ] GIL: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:10:50.513979] [INFO ] [REMOTE ] GIL: Fetching primary data for 2024-12. [2025-10-15T19:10:51.171702] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-15T19:10:51.314000] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-10. [2025-10-15T19:10:51.852163] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-15T19:10:52.114049] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-07. [2025-10-15T19:10:52.638305] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-15T19:10:52.642135] [INFO ] [REMOTE ] GIB: Full fetch complete (46011 records). [2025-10-15T19:10:52.642239] [DEBUG] [VALIDATOR ] GIB: Validating primary data. [2025-10-15T19:10:52.919076] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-06. [2025-10-15T19:10:53.032810] [DEBUG] [VALIDATOR ] GIB: All expected trading days are present. [2025-10-15T19:10:53.032892] [DEBUG] [VALIDATOR ] GIB: Primary data validation passed. [2025-10-15T19:10:53.033668] [INFO ] [MAIN ] GIB: Fetched primary data is valid. [2025-10-15T19:10:53.033730] [DEBUG] [LOCAL ] GIB: Saving primary data. [2025-10-15T19:10:53.034755] [DEBUG] [LOCAL ] GIB: Trimmed 46011 records to 31659 (keeping 200 days of data) [2025-10-15T19:10:53.155392] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-15T19:10:53.265896] [DEBUG] [LOCAL ] GIB: Primary data saved (31659 records). [2025-10-15T19:10:53.266048] [INFO ] [MAIN ] GIB: Full history saved. [2025-10-15T19:10:53.266143] [INFO ] [MAIN ] Update Progress: 933/2369 symbols completed. GIB took 34.3s. Estimated remaining: 3h 21m 20s. Rate: 7.1 symbols/min [2025-10-15T19:10:53.441535] [INFO ] [MAIN ] GIS: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:10:53.496990] [DEBUG] [LOCAL ] GIS: Loaded 53673 existing records from primary storage. [2025-10-15T19:10:53.497412] [INFO ] [MAIN ] GIS: Loaded 53673 existing records. [2025-10-15T19:10:53.714345] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-01. [2025-10-15T19:10:53.746080] [WARN ] [MAIN ] GIS: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:10:53.746411] [INFO ] [MAIN ] GIS: Wiping existing primary data before full refresh. [2025-10-15T19:10:53.746463] [INFO ] [LOCAL ] GIS: Starting deletion of primary data. [2025-10-15T19:10:53.746810] [DEBUG] [LOCAL ] GIS: Deleted primary data file. [2025-10-15T19:10:53.746867] [INFO ] [MAIN ] GIS: Starting full primary refresh. [2025-10-15T19:10:53.860151] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-15T19:10:54.112075] [INFO ] [REMOTE ] GIS: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:10:54.514012] [INFO ] [REMOTE ] GIS: Fetching primary data for 2024-12. [2025-10-15T19:10:55.076174] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-15T19:10:55.313984] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-02. [2025-10-15T19:10:56.113999] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-08. [2025-10-15T19:10:56.272616] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-15T19:10:56.776129] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-15T19:10:56.914033] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-01. [2025-10-15T19:10:56.936503] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-15T19:10:57.713995] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-07. [2025-10-15T19:10:58.513986] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-03. [2025-10-15T19:10:58.820772] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-15T19:10:58.857580] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-15T19:10:59.314003] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-09. [2025-10-15T19:10:59.651313] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-15T19:11:00.116929] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-15T19:11:00.115929] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-02. [2025-10-15T19:11:00.914028] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-08. [2025-10-15T19:11:01.713978] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-04. [2025-10-15T19:11:01.805396] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-15T19:11:01.874401] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-15T19:11:02.513991] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-03. [2025-10-15T19:11:02.968223] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-15T19:11:03.313990] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-09. [2025-10-15T19:11:04.114004] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-10. [2025-10-15T19:11:04.351944] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-15T19:11:04.377472] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-15T19:11:04.913991] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-04. [2025-10-15T19:11:05.103715] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-15T19:11:05.106214] [INFO ] [REMOTE ] GHM: Full fetch complete (22092 records). [2025-10-15T19:11:05.106297] [DEBUG] [VALIDATOR ] GHM: Validating primary data. [2025-10-15T19:11:05.471185] [DEBUG] [VALIDATOR ] GHM: All expected trading days are present. [2025-10-15T19:11:05.471263] [DEBUG] [VALIDATOR ] GHM: Primary data validation passed. [2025-10-15T19:11:05.471786] [INFO ] [MAIN ] GHM: Fetched primary data is valid. [2025-10-15T19:11:05.471847] [DEBUG] [LOCAL ] GHM: Saving primary data. [2025-10-15T19:11:05.472488] [DEBUG] [LOCAL ] GHM: Trimmed 22092 records to 14368 (keeping 200 days of data) [2025-10-15T19:11:05.555430] [DEBUG] [LOCAL ] GHM: Primary data saved (14368 records). [2025-10-15T19:11:05.555590] [INFO ] [MAIN ] GHM: Full history saved. [2025-10-15T19:11:05.555706] [INFO ] [MAIN ] Update Progress: 934/2369 symbols completed. GHM took 50.8s. Estimated remaining: 3h 21m 18s. Rate: 7.1 symbols/min [2025-10-15T19:11:05.721755] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-05. [2025-10-15T19:11:05.724137] [INFO ] [MAIN ] GKOS: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:11:05.777277] [DEBUG] [LOCAL ] GKOS: Loaded 42609 existing records from primary storage. [2025-10-15T19:11:05.777561] [INFO ] [MAIN ] GKOS: Loaded 42609 existing records. [2025-10-15T19:11:05.951334] [WARN ] [MAIN ] GKOS: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:11:05.951581] [INFO ] [MAIN ] GKOS: Wiping existing primary data before full refresh. [2025-10-15T19:11:05.951628] [INFO ] [LOCAL ] GKOS: Starting deletion of primary data. [2025-10-15T19:11:05.951911] [DEBUG] [LOCAL ] GKOS: Deleted primary data file. [2025-10-15T19:11:05.951960] [INFO ] [MAIN ] GKOS: Starting full primary refresh. [2025-10-15T19:11:06.306226] [INFO ] [REMOTE ] GKOS: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:11:06.513976] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2024-12. [2025-10-15T19:11:06.737451] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-15T19:11:06.914334] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-15T19:11:07.314008] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-05. [2025-10-15T19:11:07.971833] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-15T19:11:08.113956] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-01. [2025-10-15T19:11:08.914031] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-10. [2025-10-15T19:11:09.268249] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-15T19:11:09.480026] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-15T19:11:09.713977] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-02. [2025-10-15T19:11:09.979887] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-15T19:11:09.983807] [INFO ] [REMOTE ] GHY: Full fetch complete (32514 records). [2025-10-15T19:11:09.983899] [DEBUG] [VALIDATOR ] GHY: Validating primary data. [2025-10-15T19:11:10.343957] [DEBUG] [VALIDATOR ] GHY: All expected trading days are present. [2025-10-15T19:11:10.344030] [DEBUG] [VALIDATOR ] GHY: Primary data validation passed. [2025-10-15T19:11:10.344523] [INFO ] [MAIN ] GHY: Fetched primary data is valid. [2025-10-15T19:11:10.344561] [DEBUG] [LOCAL ] GHY: Saving primary data. [2025-10-15T19:11:10.345288] [DEBUG] [LOCAL ] GHY: Trimmed 32514 records to 20928 (keeping 200 days of data) [2025-10-15T19:11:10.468632] [DEBUG] [LOCAL ] GHY: Primary data saved (20928 records). [2025-10-15T19:11:10.468780] [INFO ] [MAIN ] GHY: Full history saved. [2025-10-15T19:11:10.468899] [INFO ] [MAIN ] Update Progress: 935/2369 symbols completed. GHY took 53.6s. Estimated remaining: 3h 21m 4s. Rate: 7.1 symbols/min [2025-10-15T19:11:10.522665] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-06. [2025-10-15T19:11:10.638974] [INFO ] [MAIN ] GL: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:11:10.677665] [DEBUG] [LOCAL ] GL: Loaded 37678 existing records from primary storage. [2025-10-15T19:11:10.677955] [INFO ] [MAIN ] GL: Loaded 37678 existing records. [2025-10-15T19:11:10.850701] [WARN ] [MAIN ] GL: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:11:10.850868] [INFO ] [MAIN ] GL: Wiping existing primary data before full refresh. [2025-10-15T19:11:10.850913] [INFO ] [LOCAL ] GL: Starting deletion of primary data. [2025-10-15T19:11:10.851089] [DEBUG] [LOCAL ] GL: Deleted primary data file. [2025-10-15T19:11:10.851126] [INFO ] [MAIN ] GL: Starting full primary refresh. [2025-10-15T19:11:11.206946] [INFO ] [REMOTE ] GL: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:11:11.227324] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-15T19:11:11.313947] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-03. [2025-10-15T19:11:12.113982] [INFO ] [REMOTE ] GL: Fetching primary data for 2024-12. [2025-10-15T19:11:12.651105] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-06 (2.13 seconds). [2025-10-15T19:11:12.915491] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-06. [2025-10-15T19:11:12.921767] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-15T19:11:13.719127] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-07. [2025-10-15T19:11:13.733005] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-15T19:11:14.354307] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-15T19:11:14.514034] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-04. [2025-10-15T19:11:15.314037] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-07. [2025-10-15T19:11:15.582227] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-15T19:11:16.064686] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-15T19:11:16.114013] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-05. [2025-10-15T19:11:16.914979] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-01. [2025-10-15T19:11:16.917534] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-15T19:11:17.614276] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-15T19:11:17.713980] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-08. [2025-10-15T19:11:18.388999] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-15T19:11:18.514056] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-08. [2025-10-15T19:11:19.078847] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-15T19:11:19.314039] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-02. [2025-10-15T19:11:20.114032] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-09. [2025-10-15T19:11:20.453813] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-15T19:11:20.852499] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-15T19:11:20.913959] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-03. [2025-10-15T19:11:21.657979] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-15T19:11:21.713956] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-10. [2025-10-15T19:11:22.136080] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-15T19:11:22.514064] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-06. [2025-10-15T19:11:23.283678] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-15T19:11:23.289393] [INFO ] [REMOTE ] GIL: Full fetch complete (62226 records). [2025-10-15T19:11:23.289546] [DEBUG] [VALIDATOR ] GIL: Validating primary data. [2025-10-15T19:11:23.319744] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-04. [2025-10-15T19:11:23.881203] [DEBUG] [VALIDATOR ] GIL: All expected trading days are present. [2025-10-15T19:11:23.881430] [DEBUG] [VALIDATOR ] GIL: Primary data validation passed. [2025-10-15T19:11:23.883501] [INFO ] [MAIN ] GIL: Fetched primary data is valid. [2025-10-15T19:11:23.883773] [DEBUG] [LOCAL ] GIL: Saving primary data. [2025-10-15T19:11:23.885832] [DEBUG] [LOCAL ] GIL: Trimmed 62226 records to 43829 (keeping 200 days of data) [2025-10-15T19:11:24.064814] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-15T19:11:24.160961] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-09. [2025-10-15T19:11:24.315841] [DEBUG] [LOCAL ] GIL: Primary data saved (43829 records). [2025-10-15T19:11:24.316021] [INFO ] [MAIN ] GIL: Full history saved. [2025-10-15T19:11:24.316139] [INFO ] [MAIN ] Update Progress: 936/2369 symbols completed. GIL took 34.9s. Estimated remaining: 3h 21m 4s. Rate: 7.1 symbols/min [2025-10-15T19:11:24.546821] [INFO ] [MAIN ] GLOB: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:11:24.592965] [DEBUG] [LOCAL ] GLOB: Loaded 47979 existing records from primary storage. [2025-10-15T19:11:24.593256] [INFO ] [MAIN ] GLOB: Loaded 47979 existing records. [2025-10-15T19:11:24.769874] [WARN ] [MAIN ] GLOB: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:11:24.770121] [INFO ] [MAIN ] GLOB: Wiping existing primary data before full refresh. [2025-10-15T19:11:24.770392] [INFO ] [LOCAL ] GLOB: Starting deletion of primary data. [2025-10-15T19:11:24.770752] [DEBUG] [LOCAL ] GLOB: Deleted primary data file. [2025-10-15T19:11:24.770855] [INFO ] [MAIN ] GLOB: Starting full primary refresh. [2025-10-15T19:11:24.919241] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-07. [2025-10-15T19:11:25.052845] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-15T19:11:25.161369] [INFO ] [REMOTE ] GLOB: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:11:25.714061] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2024-12. [2025-10-15T19:11:26.240080] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-10-15T19:11:26.514013] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-05. [2025-10-15T19:11:26.648534] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-15T19:11:26.728311] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-10-15T19:11:27.314015] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-01. [2025-10-15T19:11:27.703525] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-15T19:11:28.114082] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-06. [2025-10-15T19:11:28.663519] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-15T19:11:28.914007] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-10. [2025-10-15T19:11:29.586018] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-15T19:11:29.717374] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-02. [2025-10-15T19:11:29.723337] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-15T19:11:29.732565] [INFO ] [REMOTE ] GIS: Full fetch complete (77832 records). [2025-10-15T19:11:29.732750] [DEBUG] [VALIDATOR ] GIS: Validating primary data. [2025-10-15T19:11:30.148505] [DEBUG] [VALIDATOR ] GIS: All expected trading days are present. [2025-10-15T19:11:30.148589] [DEBUG] [VALIDATOR ] GIS: Primary data validation passed. [2025-10-15T19:11:30.149567] [INFO ] [MAIN ] GIS: Fetched primary data is valid. [2025-10-15T19:11:30.149633] [DEBUG] [LOCAL ] GIS: Saving primary data. [2025-10-15T19:11:30.151103] [DEBUG] [LOCAL ] GIS: Trimmed 77832 records to 53673 (keeping 200 days of data) [2025-10-15T19:11:30.475409] [DEBUG] [LOCAL ] GIS: Primary data saved (53673 records). [2025-10-15T19:11:30.475556] [INFO ] [MAIN ] GIS: Full history saved. [2025-10-15T19:11:30.475967] [INFO ] [MAIN ] Update Progress: 937/2369 symbols completed. GIS took 37.2s. Estimated remaining: 3h 20m 52s. Rate: 7.1 symbols/min [2025-10-15T19:11:30.519152] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-07. [2025-10-15T19:11:30.647851] [INFO ] [MAIN ] GLP: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:11:30.659292] [DEBUG] [LOCAL ] GLP: Loaded 9246 existing records from primary storage. [2025-10-15T19:11:30.659517] [INFO ] [MAIN ] GLP: Loaded 9246 existing records. [2025-10-15T19:11:30.839593] [WARN ] [MAIN ] GLP: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:11:30.839987] [INFO ] [MAIN ] GLP: Wiping existing primary data before full refresh. [2025-10-15T19:11:30.840054] [INFO ] [LOCAL ] GLP: Starting deletion of primary data. [2025-10-15T19:11:30.840278] [DEBUG] [LOCAL ] GLP: Deleted primary data file. [2025-10-15T19:11:30.840397] [INFO ] [MAIN ] GLP: Starting full primary refresh. [2025-10-15T19:11:31.122077] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-15T19:11:31.257287] [INFO ] [REMOTE ] GLP: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:11:31.314053] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-03. [2025-10-15T19:11:31.678557] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-15T19:11:32.114024] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-08. [2025-10-15T19:11:32.913995] [INFO ] [REMOTE ] GLP: Fetching primary data for 2024-12. [2025-10-15T19:11:33.046041] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-15T19:11:33.119853] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-15T19:11:33.346262] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2024-12 (0.43 seconds). [2025-10-15T19:11:33.714007] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-08. [2025-10-15T19:11:34.514003] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-09. [2025-10-15T19:11:35.086618] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-15T19:11:35.313971] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-01. [2025-10-15T19:11:35.360998] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-15T19:11:35.928483] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-15T19:11:36.114015] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-09. [2025-10-15T19:11:36.914012] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-02. [2025-10-15T19:11:37.300966] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-15T19:11:37.673534] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-15T19:11:37.713995] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-10. [2025-10-15T19:11:38.514038] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-03. [2025-10-15T19:11:39.028086] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-15T19:11:39.032908] [INFO ] [REMOTE ] GL: Full fetch complete (55185 records). [2025-10-15T19:11:39.033023] [DEBUG] [VALIDATOR ] GL: Validating primary data. [2025-10-15T19:11:39.162120] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-15T19:11:39.319207] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-10. [2025-10-15T19:11:39.425707] [DEBUG] [VALIDATOR ] GL: All expected trading days are present. [2025-10-15T19:11:39.425789] [DEBUG] [VALIDATOR ] GL: Primary data validation passed. [2025-10-15T19:11:39.426581] [INFO ] [MAIN ] GL: Fetched primary data is valid. [2025-10-15T19:11:39.426620] [DEBUG] [LOCAL ] GL: Saving primary data. [2025-10-15T19:11:39.427735] [DEBUG] [LOCAL ] GL: Trimmed 55185 records to 37640 (keeping 200 days of data) [2025-10-15T19:11:39.672785] [DEBUG] [LOCAL ] GL: Primary data saved (37640 records). [2025-10-15T19:11:39.672963] [INFO ] [MAIN ] GL: Full history saved. [2025-10-15T19:11:39.673066] [INFO ] [MAIN ] Update Progress: 938/2369 symbols completed. GL took 29.2s. Estimated remaining: 3h 20m 45s. Rate: 7.1 symbols/min [2025-10-15T19:11:39.840549] [INFO ] [MAIN ] GLW: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:11:39.891635] [DEBUG] [LOCAL ] GLW: Loaded 53636 existing records from primary storage. [2025-10-15T19:11:39.891958] [INFO ] [MAIN ] GLW: Loaded 53636 existing records. [2025-10-15T19:11:40.063982] [WARN ] [MAIN ] GLW: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:11:40.064207] [INFO ] [MAIN ] GLW: Wiping existing primary data before full refresh. [2025-10-15T19:11:40.064254] [INFO ] [LOCAL ] GLW: Starting deletion of primary data. [2025-10-15T19:11:40.064752] [DEBUG] [LOCAL ] GLW: Deleted primary data file. [2025-10-15T19:11:40.064808] [INFO ] [MAIN ] GLW: Starting full primary refresh. [2025-10-15T19:11:40.125785] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-04. [2025-10-15T19:11:40.420716] [INFO ] [REMOTE ] GLW: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:11:40.814978] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-15T19:11:40.819978] [INFO ] [REMOTE ] GKOS: Full fetch complete (60356 records). [2025-10-15T19:11:40.820113] [DEBUG] [VALIDATOR ] GKOS: Validating primary data. [2025-10-15T19:11:40.914756] [INFO ] [REMOTE ] GLW: Fetching primary data for 2024-12. [2025-10-15T19:11:40.927794] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-15T19:11:41.211310] [DEBUG] [VALIDATOR ] GKOS: All expected trading days are present. [2025-10-15T19:11:41.211386] [DEBUG] [VALIDATOR ] GKOS: Primary data validation passed. [2025-10-15T19:11:41.212237] [INFO ] [MAIN ] GKOS: Fetched primary data is valid. [2025-10-15T19:11:41.212298] [DEBUG] [LOCAL ] GKOS: Saving primary data. [2025-10-15T19:11:41.215473] [DEBUG] [LOCAL ] GKOS: Trimmed 60356 records to 42541 (keeping 200 days of data) [2025-10-15T19:11:41.463241] [DEBUG] [LOCAL ] GKOS: Primary data saved (42541 records). [2025-10-15T19:11:41.463364] [INFO ] [MAIN ] GKOS: Full history saved. [2025-10-15T19:11:41.463439] [INFO ] [MAIN ] Update Progress: 939/2369 symbols completed. GKOS took 35.9s. Estimated remaining: 3h 20m 26s. Rate: 7.1 symbols/min [2025-10-15T19:11:41.652767] [INFO ] [MAIN ] GM: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:11:41.704611] [DEBUG] [LOCAL ] GM: Loaded 53729 existing records from primary storage. [2025-10-15T19:11:41.704936] [INFO ] [MAIN ] GM: Loaded 53729 existing records. [2025-10-15T19:11:41.719161] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-05. [2025-10-15T19:11:41.908886] [WARN ] [MAIN ] GM: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:11:41.909161] [INFO ] [MAIN ] GM: Wiping existing primary data before full refresh. [2025-10-15T19:11:41.909219] [INFO ] [LOCAL ] GM: Starting deletion of primary data. [2025-10-15T19:11:41.909617] [DEBUG] [LOCAL ] GM: Deleted primary data file. [2025-10-15T19:11:41.909708] [INFO ] [MAIN ] GM: Starting full primary refresh. [2025-10-15T19:11:42.257994] [INFO ] [REMOTE ] GM: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:11:42.513967] [INFO ] [REMOTE ] GM: Fetching primary data for 2024-12. [2025-10-15T19:11:42.577229] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-15T19:11:42.578006] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-15T19:11:43.314008] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-01. [2025-10-15T19:11:44.114030] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-06. [2025-10-15T19:11:44.647599] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2024-12 (2.13 seconds). [2025-10-15T19:11:44.664804] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-10-15T19:11:44.913953] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-07. [2025-10-15T19:11:45.027805] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-15T19:11:45.547575] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-15T19:11:45.714080] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-01. [2025-10-15T19:11:46.514046] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-02. [2025-10-15T19:11:47.314074] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-08. [2025-10-15T19:11:47.544167] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-15T19:11:47.765538] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-15T19:11:48.113970] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-04. [2025-10-15T19:11:48.318330] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-15T19:11:48.913988] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-03. [2025-10-15T19:11:49.715505] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-15T19:11:49.714386] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-09. [2025-10-15T19:11:50.284048] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-15T19:11:50.319984] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-15T19:11:50.513998] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-10. [2025-10-15T19:11:51.286543] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-15T19:11:51.288185] [INFO ] [REMOTE ] GLP: Full fetch complete (14262 records). [2025-10-15T19:11:51.288252] [DEBUG] [VALIDATOR ] GLP: Validating primary data. [2025-10-15T19:11:51.319171] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-02. [2025-10-15T19:11:51.650302] [DEBUG] [VALIDATOR ] GLP: All expected trading days are present. [2025-10-15T19:11:51.650378] [DEBUG] [VALIDATOR ] GLP: Primary data validation passed. [2025-10-15T19:11:51.650717] [INFO ] [MAIN ] GLP: Fetched primary data is valid. [2025-10-15T19:11:51.650776] [DEBUG] [LOCAL ] GLP: Saving primary data. [2025-10-15T19:11:51.651247] [DEBUG] [LOCAL ] GLP: Trimmed 14262 records to 9278 (keeping 200 days of data) [2025-10-15T19:11:51.706499] [DEBUG] [LOCAL ] GLP: Primary data saved (9278 records). [2025-10-15T19:11:51.706623] [INFO ] [MAIN ] GLP: Full history saved. [2025-10-15T19:11:51.706734] [INFO ] [MAIN ] Update Progress: 940/2369 symbols completed. GLP took 21.2s. Estimated remaining: 3h 20m 21s. Rate: 7.1 symbols/min [2025-10-15T19:11:51.875099] [INFO ] [MAIN ] GME: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:11:51.926449] [DEBUG] [LOCAL ] GME: Loaded 53782 existing records from primary storage. [2025-10-15T19:11:51.926787] [INFO ] [MAIN ] GME: Loaded 53782 existing records. [2025-10-15T19:11:52.102034] [WARN ] [MAIN ] GME: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:11:52.102273] [INFO ] [MAIN ] GME: Wiping existing primary data before full refresh. [2025-10-15T19:11:52.102326] [INFO ] [LOCAL ] GME: Starting deletion of primary data. [2025-10-15T19:11:52.102851] [DEBUG] [LOCAL ] GME: Deleted primary data file. [2025-10-15T19:11:52.102909] [INFO ] [MAIN ] GME: Starting full primary refresh. [2025-10-15T19:11:52.122672] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-04. [2025-10-15T19:11:52.452949] [INFO ] [REMOTE ] GME: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:11:52.914008] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-05. [2025-10-15T19:11:53.306839] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-10-15T19:11:53.714015] [INFO ] [REMOTE ] GME: Fetching primary data for 2024-12. [2025-10-15T19:11:54.171896] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-10-15T19:11:54.222879] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-15T19:11:54.513983] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-05. [2025-10-15T19:11:55.314067] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-06. [2025-10-15T19:11:56.114202] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-03. [2025-10-15T19:11:56.432134] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-15T19:11:56.449318] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2024-12 (2.74 seconds). [2025-10-15T19:11:56.853587] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-15T19:11:56.913966] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-06. [2025-10-15T19:11:57.714001] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-07. [2025-10-15T19:11:58.245818] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-03 (2.13 seconds). [2025-10-15T19:11:58.514014] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-01. [2025-10-15T19:11:58.605823] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-15T19:11:59.019299] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-15T19:11:59.314021] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-04. [2025-10-15T19:12:00.114046] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-07. [2025-10-15T19:12:00.913983] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-08. [2025-10-15T19:12:01.359242] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-01 (2.85 seconds). [2025-10-15T19:12:01.435591] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-10-15T19:12:01.713977] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-05. [2025-10-15T19:12:02.022353] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-15T19:12:02.514005] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-08. [2025-10-15T19:12:02.597518] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-15T19:12:03.313968] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-09. [2025-10-15T19:12:03.357984] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-15T19:12:04.114014] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-02. [2025-10-15T19:12:04.480038] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-10-15T19:12:04.914005] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-09. [2025-10-15T19:12:05.047511] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-15T19:12:05.714038] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-06. [2025-10-15T19:12:06.513993] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-10. [2025-10-15T19:12:06.592189] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-02 (2.48 seconds). [2025-10-15T19:12:06.775713] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-15T19:12:07.313999] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-03. [2025-10-15T19:12:07.450025] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-15T19:12:08.114025] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-07. [2025-10-15T19:12:08.131919] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-15T19:12:08.138697] [INFO ] [REMOTE ] GLOB: Full fetch complete (65479 records). [2025-10-15T19:12:08.138893] [DEBUG] [VALIDATOR ] GLOB: Validating primary data. [2025-10-15T19:12:08.545438] [DEBUG] [VALIDATOR ] GLOB: All expected trading days are present. [2025-10-15T19:12:08.545547] [DEBUG] [VALIDATOR ] GLOB: Primary data validation passed. [2025-10-15T19:12:08.546461] [INFO ] [MAIN ] GLOB: Fetched primary data is valid. [2025-10-15T19:12:08.546527] [DEBUG] [LOCAL ] GLOB: Saving primary data. [2025-10-15T19:12:08.547939] [DEBUG] [LOCAL ] GLOB: Trimmed 65479 records to 47983 (keeping 200 days of data) [2025-10-15T19:12:08.854594] [DEBUG] [LOCAL ] GLOB: Primary data saved (47983 records). [2025-10-15T19:12:08.854765] [INFO ] [MAIN ] GLOB: Full history saved. [2025-10-15T19:12:08.854854] [INFO ] [MAIN ] Update Progress: 941/2369 symbols completed. GLOB took 44.5s. Estimated remaining: 3h 20m 25s. Rate: 7.1 symbols/min [2025-10-15T19:12:08.921863] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-10. [2025-10-15T19:12:09.021831] [INFO ] [MAIN ] GMED: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:12:09.064636] [DEBUG] [LOCAL ] GMED: Loaded 48308 existing records from primary storage. [2025-10-15T19:12:09.064971] [INFO ] [MAIN ] GMED: Loaded 48308 existing records. [2025-10-15T19:12:09.241095] [WARN ] [MAIN ] GMED: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:12:09.241329] [INFO ] [MAIN ] GMED: Wiping existing primary data before full refresh. [2025-10-15T19:12:09.241383] [INFO ] [LOCAL ] GMED: Starting deletion of primary data. [2025-10-15T19:12:09.241621] [DEBUG] [LOCAL ] GMED: Deleted primary data file. [2025-10-15T19:12:09.241704] [INFO ] [MAIN ] GMED: Starting full primary refresh. [2025-10-15T19:12:09.596660] [INFO ] [REMOTE ] GMED: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:12:09.688620] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-15T19:12:09.696225] [INFO ] [REMOTE ] GLW: Full fetch complete (77789 records). [2025-10-15T19:12:09.696354] [DEBUG] [VALIDATOR ] GLW: Validating primary data. [2025-10-15T19:12:09.721923] [INFO ] [REMOTE ] GMED: Fetching primary data for 2024-12. [2025-10-15T19:12:10.046178] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-03 (2.73 seconds). [2025-10-15T19:12:10.175990] [DEBUG] [VALIDATOR ] GLW: All expected trading days are present. [2025-10-15T19:12:10.176092] [DEBUG] [VALIDATOR ] GLW: Primary data validation passed. [2025-10-15T19:12:10.177098] [INFO ] [MAIN ] GLW: Fetched primary data is valid. [2025-10-15T19:12:10.177182] [DEBUG] [LOCAL ] GLW: Saving primary data. [2025-10-15T19:12:10.213554] [DEBUG] [LOCAL ] GLW: Trimmed 77789 records to 53636 (keeping 200 days of data) [2025-10-15T19:12:10.215361] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-10-15T19:12:10.523080] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-08. [2025-10-15T19:12:10.549169] [DEBUG] [LOCAL ] GLW: Primary data saved (53636 records). [2025-10-15T19:12:10.549315] [INFO ] [MAIN ] GLW: Full history saved. [2025-10-15T19:12:10.549439] [INFO ] [MAIN ] Update Progress: 942/2369 symbols completed. GLW took 30.9s. Estimated remaining: 3h 20m 7s. Rate: 7.1 symbols/min [2025-10-15T19:12:10.714877] [INFO ] [MAIN ] GMRE: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:12:10.754004] [DEBUG] [LOCAL ] GMRE: Loaded 37032 existing records from primary storage. [2025-10-15T19:12:10.754313] [INFO ] [MAIN ] GMRE: Loaded 37032 existing records. [2025-10-15T19:12:10.930267] [WARN ] [MAIN ] GMRE: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:12:10.930613] [INFO ] [MAIN ] GMRE: Wiping existing primary data before full refresh. [2025-10-15T19:12:10.930702] [INFO ] [LOCAL ] GMRE: Starting deletion of primary data. [2025-10-15T19:12:10.930938] [DEBUG] [LOCAL ] GMRE: Deleted primary data file. [2025-10-15T19:12:10.930981] [INFO ] [MAIN ] GMRE: Starting full primary refresh. [2025-10-15T19:12:11.285369] [INFO ] [REMOTE ] GMRE: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:12:11.315854] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-04. [2025-10-15T19:12:11.318333] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-15T19:12:12.114026] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-01. [2025-10-15T19:12:12.914049] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2024-12. [2025-10-15T19:12:12.983693] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-08 (2.46 seconds). [2025-10-15T19:12:13.713983] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-09. [2025-10-15T19:12:13.806525] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-15T19:12:13.949567] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-04 (2.63 seconds). [2025-10-15T19:12:14.311747] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-15T19:12:14.514059] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-05. [2025-10-15T19:12:15.313990] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-01. [2025-10-15T19:12:15.690428] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-15T19:12:16.114051] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-10. [2025-10-15T19:12:16.421557] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-15T19:12:16.812915] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-15T19:12:16.913954] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-02. [2025-10-15T19:12:16.978506] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-15T19:12:16.984972] [INFO ] [REMOTE ] GM: Full fetch complete (77907 records). [2025-10-15T19:12:16.985100] [DEBUG] [VALIDATOR ] GM: Validating primary data. [2025-10-15T19:12:17.378610] [DEBUG] [VALIDATOR ] GM: All expected trading days are present. [2025-10-15T19:12:17.378719] [DEBUG] [VALIDATOR ] GM: Primary data validation passed. [2025-10-15T19:12:17.379820] [INFO ] [MAIN ] GM: Fetched primary data is valid. [2025-10-15T19:12:17.379883] [DEBUG] [LOCAL ] GM: Saving primary data. [2025-10-15T19:12:17.381424] [DEBUG] [LOCAL ] GM: Trimmed 77907 records to 53729 (keeping 200 days of data) [2025-10-15T19:12:17.714424] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-02. [2025-10-15T19:12:17.714329] [DEBUG] [LOCAL ] GM: Primary data saved (53729 records). [2025-10-15T19:12:17.714632] [INFO ] [MAIN ] GM: Full history saved. [2025-10-15T19:12:17.716543] [INFO ] [MAIN ] Update Progress: 943/2369 symbols completed. GM took 36.3s. Estimated remaining: 3h 19m 57s. Rate: 7.1 symbols/min [2025-10-15T19:12:17.889215] [INFO ] [MAIN ] GNE: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:12:17.911779] [DEBUG] [LOCAL ] GNE: Loaded 17991 existing records from primary storage. [2025-10-15T19:12:17.912023] [INFO ] [MAIN ] GNE: Loaded 17991 existing records. [2025-10-15T19:12:18.096476] [WARN ] [MAIN ] GNE: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:12:18.105251] [INFO ] [MAIN ] GNE: Wiping existing primary data before full refresh. [2025-10-15T19:12:18.105344] [INFO ] [LOCAL ] GNE: Starting deletion of primary data. [2025-10-15T19:12:18.115946] [DEBUG] [LOCAL ] GNE: Deleted primary data file. [2025-10-15T19:12:18.116036] [INFO ] [MAIN ] GNE: Starting full primary refresh. [2025-10-15T19:12:18.160170] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-15T19:12:18.477824] [INFO ] [REMOTE ] GNE: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:12:18.514003] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-03. [2025-10-15T19:12:19.308337] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-15T19:12:19.317365] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-06. [2025-10-15T19:12:19.829074] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-15T19:12:20.114048] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-04. [2025-10-15T19:12:20.914008] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-03. [2025-10-15T19:12:21.572300] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-15T19:12:21.676726] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-06 (2.36 seconds). [2025-10-15T19:12:21.713953] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-07. [2025-10-15T19:12:22.513972] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-05. [2025-10-15T19:12:22.597015] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-15T19:12:23.313995] [INFO ] [REMOTE ] GNE: Fetching primary data for 2024-12. [2025-10-15T19:12:23.564387] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-15T19:12:23.723271] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-10-15T19:12:24.113983] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-08. [2025-10-15T19:12:24.147059] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-10-15T19:12:24.914020] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-04. [2025-10-15T19:12:25.714052] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-01. [2025-10-15T19:12:26.196387] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-08 (2.08 seconds). [2025-10-15T19:12:26.488058] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-15T19:12:26.507439] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-15T19:12:26.513955] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-02. [2025-10-15T19:12:27.306234] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-15T19:12:27.313951] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-03. [2025-10-15T19:12:28.065101] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-15T19:12:28.114036] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-04. [2025-10-15T19:12:28.877012] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-15T19:12:28.913949] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-05. [2025-10-15T19:12:29.713967] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-09. [2025-10-15T19:12:29.864840] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-15T19:12:30.514065] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-06. [2025-10-15T19:12:31.314016] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-06. [2025-10-15T19:12:31.905781] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-09 (2.19 seconds). [2025-10-15T19:12:31.999705] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-15T19:12:32.113969] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-07. [2025-10-15T19:12:32.498600] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-15T19:12:32.914057] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-05. [2025-10-15T19:12:33.408354] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-15T19:12:33.713991] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-08. [2025-10-15T19:12:34.337608] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-15T19:12:34.513996] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-06. [2025-10-15T19:12:35.103236] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-15T19:12:35.314025] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-07. [2025-10-15T19:12:35.788719] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-15T19:12:36.114100] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-07. [2025-10-15T19:12:36.394318] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-15T19:12:36.914042] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-08. [2025-10-15T19:12:37.409392] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-15T19:12:37.714047] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-08. [2025-10-15T19:12:37.988473] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-15T19:12:38.514007] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-09. [2025-10-15T19:12:39.271127] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-15T19:12:39.313957] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-09. [2025-10-15T19:12:39.529764] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-15T19:12:40.114015] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-10. [2025-10-15T19:12:40.914056] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-10. [2025-10-15T19:12:40.958764] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-15T19:12:41.714028] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-10. [2025-10-15T19:12:42.488123] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-15T19:12:42.491722] [INFO ] [REMOTE ] GMRE: Full fetch complete (52705 records). [2025-10-15T19:12:42.491814] [DEBUG] [VALIDATOR ] GMRE: Validating primary data. [2025-10-15T19:12:42.524336] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-09. [2025-10-15T19:12:42.886793] [DEBUG] [VALIDATOR ] GMRE: All expected trading days are present. [2025-10-15T19:12:42.886978] [DEBUG] [VALIDATOR ] GMRE: Primary data validation passed. [2025-10-15T19:12:42.887846] [INFO ] [MAIN ] GMRE: Fetched primary data is valid. [2025-10-15T19:12:42.887930] [DEBUG] [LOCAL ] GMRE: Saving primary data. [2025-10-15T19:12:42.905869] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-10 (2.79 seconds). [2025-10-15T19:12:42.906043] [DEBUG] [LOCAL ] GMRE: Trimmed 52705 records to 37100 (keeping 200 days of data) [2025-10-15T19:12:42.913441] [INFO ] [REMOTE ] GME: Full fetch complete (77923 records). [2025-10-15T19:12:42.913614] [DEBUG] [VALIDATOR ] GME: Validating primary data. [2025-10-15T19:12:43.449817] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-15T19:12:43.460967] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-10. [2025-10-15T19:12:43.462047] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-15T19:12:43.461346] [DEBUG] [VALIDATOR ] GME: All expected trading days are present. [2025-10-15T19:12:43.463696] [DEBUG] [VALIDATOR ] GME: Primary data validation passed. [2025-10-15T19:12:43.470937] [INFO ] [MAIN ] GME: Fetched primary data is valid. [2025-10-15T19:12:43.471576] [DEBUG] [LOCAL ] GME: Saving primary data. [2025-10-15T19:12:43.473718] [INFO ] [REMOTE ] GMED: Full fetch complete (69981 records). [2025-10-15T19:12:43.475028] [DEBUG] [VALIDATOR ] GMED: Validating primary data. [2025-10-15T19:12:43.482334] [DEBUG] [LOCAL ] GME: Trimmed 77923 records to 53781 (keeping 200 days of data) [2025-10-15T19:12:44.319619] [DEBUG] [VALIDATOR ] GMED: All expected trading days are present. [2025-10-15T19:12:44.321115] [DEBUG] [VALIDATOR ] GMED: Primary data validation passed. [2025-10-15T19:12:44.322392] [INFO ] [MAIN ] GMED: Fetched primary data is valid. [2025-10-15T19:12:44.323607] [DEBUG] [LOCAL ] GMED: Saving primary data. [2025-10-15T19:12:44.332989] [DEBUG] [LOCAL ] GMED: Trimmed 69981 records to 48294 (keeping 200 days of data) [2025-10-15T19:12:44.340958] [DEBUG] [LOCAL ] GMRE: Primary data saved (37100 records). [2025-10-15T19:12:44.342613] [INFO ] [MAIN ] GMRE: Full history saved. [2025-10-15T19:12:44.343479] [INFO ] [MAIN ] Update Progress: 944/2369 symbols completed. GMRE took 33.8s. Estimated remaining: 3h 20m 16s. Rate: 7.1 symbols/min [2025-10-15T19:12:44.501117] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-15T19:12:44.516185] [INFO ] [REMOTE ] GNE: Full fetch complete (22492 records). [2025-10-15T19:12:44.539309] [DEBUG] [VALIDATOR ] GNE: Validating primary data. [2025-10-15T19:12:44.707594] [DEBUG] [LOCAL ] GME: Primary data saved (53781 records). [2025-10-15T19:12:44.753664] [INFO ] [MAIN ] GME: Full history saved. [2025-10-15T19:12:44.830086] [INFO ] [MAIN ] Update Progress: 945/2369 symbols completed. GME took 53.1s. Estimated remaining: 3h 19m 55s. Rate: 7.1 symbols/min [2025-10-15T19:12:44.899302] [INFO ] [MAIN ] GNK: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:12:45.259524] [DEBUG] [LOCAL ] GMED: Primary data saved (48294 records). [2025-10-15T19:12:45.274002] [INFO ] [MAIN ] GMED: Full history saved. [2025-10-15T19:12:45.274269] [INFO ] [MAIN ] Update Progress: 946/2369 symbols completed. GMED took 36.4s. Estimated remaining: 3h 19m 35s. Rate: 7.1 symbols/min [2025-10-15T19:12:45.377061] [INFO ] [MAIN ] GNL: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:12:45.531932] [DEBUG] [LOCAL ] GNK: Loaded 40176 existing records from primary storage. [2025-10-15T19:12:45.544561] [INFO ] [MAIN ] GNK: Loaded 40176 existing records. [2025-10-15T19:12:45.549948] [DEBUG] [VALIDATOR ] GNE: All expected trading days are present. [2025-10-15T19:12:45.592629] [DEBUG] [VALIDATOR ] GNE: Primary data validation passed. [2025-10-15T19:12:45.603455] [INFO ] [MAIN ] GNE: Fetched primary data is valid. [2025-10-15T19:12:45.618676] [DEBUG] [LOCAL ] GNE: Saving primary data. [2025-10-15T19:12:45.661586] [INFO ] [MAIN ] GNRC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:12:45.680733] [DEBUG] [LOCAL ] GNE: Trimmed 22492 records to 18040 (keeping 200 days of data) [2025-10-15T19:12:45.878639] [WARN ] [MAIN ] GNK: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:12:45.886343] [INFO ] [MAIN ] GNK: Wiping existing primary data before full refresh. [2025-10-15T19:12:45.910557] [INFO ] [LOCAL ] GNK: Starting deletion of primary data. [2025-10-15T19:12:45.926099] [DEBUG] [LOCAL ] GNL: Loaded 46702 existing records from primary storage. [2025-10-15T19:12:45.924923] [DEBUG] [LOCAL ] GNE: Primary data saved (18040 records). [2025-10-15T19:12:45.926617] [INFO ] [MAIN ] GNL: Loaded 46702 existing records. [2025-10-15T19:12:45.926809] [INFO ] [MAIN ] GNE: Full history saved. [2025-10-15T19:12:45.932576] [DEBUG] [LOCAL ] GNK: Deleted primary data file. [2025-10-15T19:12:45.932506] [INFO ] [MAIN ] Update Progress: 947/2369 symbols completed. GNE took 28.2s. Estimated remaining: 3h 19m 15s. Rate: 7.1 symbols/min [2025-10-15T19:12:45.938112] [INFO ] [MAIN ] GNK: Starting full primary refresh. [2025-10-15T19:12:46.231665] [DEBUG] [LOCAL ] GNRC: Loaded 45433 existing records from primary storage. [2025-10-15T19:12:46.302406] [INFO ] [MAIN ] GNRC: Loaded 45433 existing records. [2025-10-15T19:12:46.477294] [WARN ] [MAIN ] GNL: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:12:46.483941] [INFO ] [MAIN ] GNL: Wiping existing primary data before full refresh. [2025-10-15T19:12:46.521285] [INFO ] [LOCAL ] GNL: Starting deletion of primary data. [2025-10-15T19:12:46.570904] [INFO ] [MAIN ] GNT: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:12:46.562568] [DEBUG] [LOCAL ] GNL: Deleted primary data file. [2025-10-15T19:12:46.580618] [INFO ] [MAIN ] GNL: Starting full primary refresh. [2025-10-15T19:12:46.884114] [WARN ] [MAIN ] GNRC: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:12:46.933919] [INFO ] [MAIN ] GNRC: Wiping existing primary data before full refresh. [2025-10-15T19:12:46.939311] [INFO ] [LOCAL ] GNRC: Starting deletion of primary data. [2025-10-15T19:12:46.928529] [DEBUG] [LOCAL ] GNT: Loaded 8422 existing records from primary storage. [2025-10-15T19:12:46.963464] [INFO ] [MAIN ] GNT: Loaded 8422 existing records. [2025-10-15T19:12:46.996090] [DEBUG] [LOCAL ] GNRC: Deleted primary data file. [2025-10-15T19:12:47.064112] [INFO ] [MAIN ] GNRC: Starting full primary refresh. [2025-10-15T19:12:47.245964] [INFO ] [REMOTE ] GNK: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:12:47.303117] [INFO ] [REMOTE ] GNK: Fetching primary data for 2024-12. [2025-10-15T19:12:47.542707] [WARN ] [MAIN ] GNT: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:12:47.590788] [INFO ] [MAIN ] GNT: Wiping existing primary data before full refresh. [2025-10-15T19:12:47.593798] [INFO ] [REMOTE ] GNL: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:12:47.599154] [INFO ] [LOCAL ] GNT: Starting deletion of primary data. [2025-10-15T19:12:47.652825] [INFO ] [REMOTE ] GNL: Fetching primary data for 2024-12. [2025-10-15T19:12:47.652137] [DEBUG] [LOCAL ] GNT: Deleted primary data file. [2025-10-15T19:12:47.653290] [INFO ] [MAIN ] GNT: Starting full primary refresh. [2025-10-15T19:12:48.088067] [INFO ] [REMOTE ] GNRC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:12:48.122047] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2024-12. [2025-10-15T19:12:48.232011] [INFO ] [REMOTE ] GNT: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:12:48.232365] [INFO ] [REMOTE ] GNT: Fetching primary data for 2024-12. [2025-10-15T19:12:48.722708] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-15T19:12:48.729973] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-01. [2025-10-15T19:12:48.850392] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-10-15T19:12:48.852049] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-01. [2025-10-15T19:12:49.197137] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-15T19:12:49.207157] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-01. [2025-10-15T19:12:49.441036] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-15T19:12:49.714495] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-02. [2025-10-15T19:12:49.796440] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-15T19:12:49.828516] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-15T19:12:50.282515] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-15T19:12:50.513982] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-02. [2025-10-15T19:12:50.542122] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-15T19:12:51.313968] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-02. [2025-10-15T19:12:51.901636] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-15T19:12:52.113984] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-03. [2025-10-15T19:12:52.663383] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-10-15T19:12:52.688536] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-15T19:12:52.914041] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-04. [2025-10-15T19:12:53.513626] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-10-15T19:12:53.713991] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-05. [2025-10-15T19:12:54.436451] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-15T19:12:54.514004] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-03. [2025-10-15T19:12:55.314045] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-01. [2025-10-15T19:12:55.945269] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-15T19:12:56.114027] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-04. [2025-10-15T19:12:56.810206] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-15T19:12:56.913999] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-02. [2025-10-15T19:12:57.713996] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-03. [2025-10-15T19:12:57.774525] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-15T19:12:58.449105] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-15T19:12:58.513983] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-03. [2025-10-15T19:12:59.265020] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-15T19:12:59.313991] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-04. [2025-10-15T19:12:59.854695] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-15T19:13:00.114078] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-06. [2025-10-15T19:13:00.863457] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-15T19:13:00.913946] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-07. [2025-10-15T19:13:00.994862] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-15T19:13:01.712097] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-15T19:13:01.714824] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-05. [2025-10-15T19:13:02.514012] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-08. [2025-10-15T19:13:03.110447] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-15T19:13:03.294289] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-15T19:13:03.313951] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-06. [2025-10-15T19:13:04.114013] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-04. [2025-10-15T19:13:04.640855] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-15T19:13:04.913991] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-07. [2025-10-15T19:13:05.713994] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-09. [2025-10-15T19:13:05.867357] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-15T19:13:06.312925] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-15T19:13:06.498290] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-15T19:13:06.513951] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-10. [2025-10-15T19:13:07.284888] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-15T19:13:07.286596] [INFO ] [REMOTE ] GNT: Full fetch complete (11176 records). [2025-10-15T19:13:07.286689] [DEBUG] [VALIDATOR ] GNT: Validating primary data. [2025-10-15T19:13:07.321036] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-08. [2025-10-15T19:13:07.664528] [DEBUG] [VALIDATOR ] GNT: All expected trading days are present. [2025-10-15T19:13:07.664622] [DEBUG] [VALIDATOR ] GNT: Primary data validation passed. [2025-10-15T19:13:07.665110] [INFO ] [MAIN ] GNT: Fetched primary data is valid. [2025-10-15T19:13:07.665195] [DEBUG] [LOCAL ] GNT: Saving primary data. [2025-10-15T19:13:07.665837] [DEBUG] [LOCAL ] GNT: Trimmed 11176 records to 8426 (keeping 200 days of data) [2025-10-15T19:13:07.714633] [DEBUG] [LOCAL ] GNT: Primary data saved (8426 records). [2025-10-15T19:13:07.714807] [INFO ] [MAIN ] GNT: Full history saved. [2025-10-15T19:13:07.714891] [INFO ] [MAIN ] Update Progress: 948/2369 symbols completed. GNT took 21.7s. Estimated remaining: 3h 19m 26s. Rate: 7.1 symbols/min [2025-10-15T19:13:07.879179] [INFO ] [MAIN ] GNW: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:13:07.928237] [DEBUG] [LOCAL ] GNW: Loaded 51401 existing records from primary storage. [2025-10-15T19:13:07.928537] [INFO ] [MAIN ] GNW: Loaded 51401 existing records. [2025-10-15T19:13:08.105383] [WARN ] [MAIN ] GNW: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:13:08.105580] [INFO ] [MAIN ] GNW: Wiping existing primary data before full refresh. [2025-10-15T19:13:08.105632] [INFO ] [LOCAL ] GNW: Starting deletion of primary data. [2025-10-15T19:13:08.105912] [DEBUG] [LOCAL ] GNW: Deleted primary data file. [2025-10-15T19:13:08.105966] [INFO ] [MAIN ] GNW: Starting full primary refresh. [2025-10-15T19:13:08.119085] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-05. [2025-10-15T19:13:08.458369] [INFO ] [REMOTE ] GNW: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:13:08.772767] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-15T19:13:08.914000] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-09. [2025-10-15T19:13:09.693446] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-15T19:13:09.713950] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-06. [2025-10-15T19:13:10.345320] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-15T19:13:10.513985] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-10. [2025-10-15T19:13:11.278543] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-15T19:13:11.313956] [INFO ] [REMOTE ] GNW: Fetching primary data for 2024-12. [2025-10-15T19:13:11.792875] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-15T19:13:11.802387] [INFO ] [REMOTE ] GNL: Full fetch complete (68210 records). [2025-10-15T19:13:11.802707] [DEBUG] [VALIDATOR ] GNL: Validating primary data. [2025-10-15T19:13:12.119089] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-05. [2025-10-15T19:13:12.191054] [DEBUG] [VALIDATOR ] GNL: All expected trading days are present. [2025-10-15T19:13:12.191123] [DEBUG] [VALIDATOR ] GNL: Primary data validation passed. [2025-10-15T19:13:12.192129] [INFO ] [MAIN ] GNL: Fetched primary data is valid. [2025-10-15T19:13:12.192194] [DEBUG] [LOCAL ] GNL: Saving primary data. [2025-10-15T19:13:12.193570] [DEBUG] [LOCAL ] GNL: Trimmed 68210 records to 46728 (keeping 200 days of data) [2025-10-15T19:13:12.472014] [DEBUG] [LOCAL ] GNL: Primary data saved (46728 records). [2025-10-15T19:13:12.472117] [INFO ] [MAIN ] GNL: Full history saved. [2025-10-15T19:13:12.472198] [INFO ] [MAIN ] Update Progress: 949/2369 symbols completed. GNL took 27.6s. Estimated remaining: 3h 19m 12s. Rate: 7.1 symbols/min [2025-10-15T19:13:12.642902] [INFO ] [MAIN ] GOF: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:13:12.682829] [DEBUG] [LOCAL ] GOF: Loaded 42601 existing records from primary storage. [2025-10-15T19:13:12.683111] [INFO ] [MAIN ] GOF: Loaded 42601 existing records. [2025-10-15T19:13:12.858907] [WARN ] [MAIN ] GOF: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:13:12.859224] [INFO ] [MAIN ] GOF: Wiping existing primary data before full refresh. [2025-10-15T19:13:12.859364] [INFO ] [LOCAL ] GOF: Starting deletion of primary data. [2025-10-15T19:13:12.859793] [DEBUG] [LOCAL ] GOF: Deleted primary data file. [2025-10-15T19:13:12.859852] [INFO ] [MAIN ] GOF: Starting full primary refresh. [2025-10-15T19:13:12.921173] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-07. [2025-10-15T19:13:13.108221] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-15T19:13:13.307778] [INFO ] [REMOTE ] GOF: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:13:13.533213] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-15T19:13:13.714004] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-01. [2025-10-15T19:13:14.514016] [INFO ] [REMOTE ] GOF: Fetching primary data for 2024-12. [2025-10-15T19:13:14.861427] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-15T19:13:15.319347] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-08. [2025-10-15T19:13:15.339319] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-15T19:13:15.697055] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-15T19:13:16.114015] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-02. [2025-10-15T19:13:16.716548] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-15T19:13:16.913965] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-06. [2025-10-15T19:13:17.714476] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-01. [2025-10-15T19:13:17.719734] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-15T19:13:18.334690] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-15T19:13:18.513984] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-07. [2025-10-15T19:13:19.314021] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-09. [2025-10-15T19:13:19.356687] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-15T19:13:20.019873] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-15T19:13:20.114013] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-02. [2025-10-15T19:13:20.913997] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-08. [2025-10-15T19:13:20.993330] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-15T19:13:21.536980] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-15T19:13:21.714014] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-03. [2025-10-15T19:13:22.092410] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-15T19:13:22.514022] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-09. [2025-10-15T19:13:23.249616] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-15T19:13:23.313978] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-04. [2025-10-15T19:13:23.895306] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-15T19:13:24.114003] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-10. [2025-10-15T19:13:24.914016] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-03. [2025-10-15T19:13:25.047346] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-15T19:13:25.714050] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-10. [2025-10-15T19:13:25.829479] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-15T19:13:25.837014] [INFO ] [REMOTE ] GNRC: Full fetch complete (65705 records). [2025-10-15T19:13:25.837223] [DEBUG] [VALIDATOR ] GNRC: Validating primary data. [2025-10-15T19:13:26.276915] [DEBUG] [VALIDATOR ] GNRC: All expected trading days are present. [2025-10-15T19:13:26.277143] [DEBUG] [VALIDATOR ] GNRC: Primary data validation passed. [2025-10-15T19:13:26.278232] [INFO ] [MAIN ] GNRC: Fetched primary data is valid. [2025-10-15T19:13:26.278332] [DEBUG] [LOCAL ] GNRC: Saving primary data. [2025-10-15T19:13:26.279614] [DEBUG] [LOCAL ] GNRC: Trimmed 65705 records to 45508 (keeping 200 days of data) [2025-10-15T19:13:26.514123] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-05. [2025-10-15T19:13:26.600701] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-15T19:13:26.612949] [DEBUG] [LOCAL ] GNRC: Primary data saved (45508 records). [2025-10-15T19:13:26.613142] [INFO ] [MAIN ] GNRC: Full history saved. [2025-10-15T19:13:26.613366] [INFO ] [MAIN ] Update Progress: 950/2369 symbols completed. GNRC took 41.3s. Estimated remaining: 3h 19m 13s. Rate: 7.1 symbols/min [2025-10-15T19:13:26.792956] [INFO ] [MAIN ] GOLF: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:13:26.823663] [DEBUG] [LOCAL ] GOLF: Loaded 30957 existing records from primary storage. [2025-10-15T19:13:26.823946] [INFO ] [MAIN ] GOLF: Loaded 30957 existing records. [2025-10-15T19:13:26.999428] [WARN ] [MAIN ] GOLF: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:13:26.999680] [INFO ] [MAIN ] GOLF: Wiping existing primary data before full refresh. [2025-10-15T19:13:26.999738] [INFO ] [LOCAL ] GOLF: Starting deletion of primary data. [2025-10-15T19:13:26.999921] [DEBUG] [LOCAL ] GOLF: Deleted primary data file. [2025-10-15T19:13:26.999960] [INFO ] [MAIN ] GOLF: Starting full primary refresh. [2025-10-15T19:13:27.334269] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-04. [2025-10-15T19:13:27.358084] [INFO ] [REMOTE ] GOLF: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:13:27.376741] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-15T19:13:27.382785] [INFO ] [REMOTE ] GNK: Full fetch complete (57342 records). [2025-10-15T19:13:27.383011] [DEBUG] [VALIDATOR ] GNK: Validating primary data. [2025-10-15T19:13:27.809825] [DEBUG] [VALIDATOR ] GNK: All expected trading days are present. [2025-10-15T19:13:27.809965] [DEBUG] [VALIDATOR ] GNK: Primary data validation passed. [2025-10-15T19:13:27.810895] [INFO ] [MAIN ] GNK: Fetched primary data is valid. [2025-10-15T19:13:27.810957] [DEBUG] [LOCAL ] GNK: Saving primary data. [2025-10-15T19:13:27.812152] [DEBUG] [LOCAL ] GNK: Trimmed 57342 records to 40065 (keeping 200 days of data) [2025-10-15T19:13:28.057567] [DEBUG] [LOCAL ] GNK: Primary data saved (40065 records). [2025-10-15T19:13:28.057738] [INFO ] [MAIN ] GNK: Full history saved. [2025-10-15T19:13:28.057845] [INFO ] [MAIN ] Update Progress: 951/2369 symbols completed. GNK took 43.7s. Estimated remaining: 3h 18m 54s. Rate: 7.1 symbols/min [2025-10-15T19:13:28.122215] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2024-12. [2025-10-15T19:13:28.259829] [INFO ] [MAIN ] GOOS: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:13:28.256507] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-15T19:13:28.314099] [DEBUG] [LOCAL ] GOOS: Loaded 44689 existing records from primary storage. [2025-10-15T19:13:28.314400] [INFO ] [MAIN ] GOOS: Loaded 44689 existing records. [2025-10-15T19:13:28.491115] [WARN ] [MAIN ] GOOS: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:13:28.491323] [INFO ] [MAIN ] GOOS: Wiping existing primary data before full refresh. [2025-10-15T19:13:28.491385] [INFO ] [LOCAL ] GOOS: Starting deletion of primary data. [2025-10-15T19:13:28.491885] [DEBUG] [LOCAL ] GOOS: Deleted primary data file. [2025-10-15T19:13:28.491948] [INFO ] [MAIN ] GOOS: Starting full primary refresh. [2025-10-15T19:13:28.854315] [INFO ] [REMOTE ] GOOS: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:13:28.894631] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-15T19:13:28.913953] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2024-12. [2025-10-15T19:13:29.228076] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-15T19:13:29.713997] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-06. [2025-10-15T19:13:30.239456] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-15T19:13:30.513989] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-05. [2025-10-15T19:13:31.014213] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-15T19:13:31.313990] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-07. [2025-10-15T19:13:32.113977] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-01. [2025-10-15T19:13:32.202610] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-15T19:13:32.913987] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-06. [2025-10-15T19:13:32.978937] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-15T19:13:33.071583] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-15T19:13:33.714007] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-01. [2025-10-15T19:13:34.212876] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-15T19:13:34.514066] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-07. [2025-10-15T19:13:35.210738] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-15T19:13:35.313979] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-02. [2025-10-15T19:13:35.832998] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-15T19:13:36.114003] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-02. [2025-10-15T19:13:36.722885] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-15T19:13:36.914011] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-03. [2025-10-15T19:13:37.474358] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-15T19:13:37.713991] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-08. [2025-10-15T19:13:38.514215] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-08. [2025-10-15T19:13:38.514147] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-15T19:13:39.134539] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-15T19:13:39.313981] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-04. [2025-10-15T19:13:40.113988] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-03. [2025-10-15T19:13:40.142491] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-15T19:13:40.913980] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-09. [2025-10-15T19:13:41.151428] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-15T19:13:41.553282] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-15T19:13:41.714049] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-04. [2025-10-15T19:13:42.513982] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-05. [2025-10-15T19:13:42.595770] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-15T19:13:43.176305] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-15T19:13:43.313984] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-05. [2025-10-15T19:13:44.113985] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-09. [2025-10-15T19:13:44.333314] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-15T19:13:44.626175] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-15T19:13:44.914029] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-06. [2025-10-15T19:13:45.714044] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-10. [2025-10-15T19:13:45.857094] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-15T19:13:46.368922] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-15T19:13:46.513968] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-07. [2025-10-15T19:13:47.313996] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-06. [2025-10-15T19:13:47.850965] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-10 (2.14 seconds). [2025-10-15T19:13:47.856257] [INFO ] [REMOTE ] GOF: Full fetch complete (62306 records). [2025-10-15T19:13:47.856358] [DEBUG] [VALIDATOR ] GOF: Validating primary data. [2025-10-15T19:13:48.129966] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-10. [2025-10-15T19:13:48.275431] [DEBUG] [VALIDATOR ] GOF: All expected trading days are present. [2025-10-15T19:13:48.275568] [DEBUG] [VALIDATOR ] GOF: Primary data validation passed. [2025-10-15T19:13:48.276542] [INFO ] [MAIN ] GOF: Fetched primary data is valid. [2025-10-15T19:13:48.276607] [DEBUG] [LOCAL ] GOF: Saving primary data. [2025-10-15T19:13:48.277860] [DEBUG] [LOCAL ] GOF: Trimmed 62306 records to 42604 (keeping 200 days of data) [2025-10-15T19:13:48.535185] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-15T19:13:48.610605] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-15T19:13:48.612798] [DEBUG] [LOCAL ] GOF: Primary data saved (42604 records). [2025-10-15T19:13:48.619009] [INFO ] [MAIN ] GOF: Full history saved. [2025-10-15T19:13:48.619589] [INFO ] [MAIN ] Update Progress: 952/2369 symbols completed. GOF took 36.1s. Estimated remaining: 3h 19m 3s. Rate: 7.1 symbols/min [2025-10-15T19:13:48.818114] [INFO ] [MAIN ] GOTU: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:13:48.854093] [DEBUG] [LOCAL ] GOTU: Loaded 37406 existing records from primary storage. [2025-10-15T19:13:48.854382] [INFO ] [MAIN ] GOTU: Loaded 37406 existing records. [2025-10-15T19:13:48.919087] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-08. [2025-10-15T19:13:49.032789] [WARN ] [MAIN ] GOTU: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:13:49.033063] [INFO ] [MAIN ] GOTU: Wiping existing primary data before full refresh. [2025-10-15T19:13:49.033123] [INFO ] [LOCAL ] GOTU: Starting deletion of primary data. [2025-10-15T19:13:49.033525] [DEBUG] [LOCAL ] GOTU: Deleted primary data file. [2025-10-15T19:13:49.033581] [INFO ] [MAIN ] GOTU: Starting full primary refresh. [2025-10-15T19:13:49.383892] [INFO ] [REMOTE ] GOTU: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:13:49.709247] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-15T19:13:49.715678] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-07. [2025-10-15T19:13:49.717485] [INFO ] [REMOTE ] GNW: Full fetch complete (73865 records). [2025-10-15T19:13:49.717585] [DEBUG] [VALIDATOR ] GNW: Validating primary data. [2025-10-15T19:13:50.119876] [DEBUG] [VALIDATOR ] GNW: All expected trading days are present. [2025-10-15T19:13:50.119976] [DEBUG] [VALIDATOR ] GNW: Primary data validation passed. [2025-10-15T19:13:50.121617] [INFO ] [MAIN ] GNW: Fetched primary data is valid. [2025-10-15T19:13:50.121715] [DEBUG] [LOCAL ] GNW: Saving primary data. [2025-10-15T19:13:50.123292] [DEBUG] [LOCAL ] GNW: Trimmed 73865 records to 51403 (keeping 200 days of data) [2025-10-15T19:13:50.420665] [DEBUG] [LOCAL ] GNW: Primary data saved (51403 records). [2025-10-15T19:13:50.420830] [INFO ] [MAIN ] GNW: Full history saved. [2025-10-15T19:13:50.421707] [INFO ] [MAIN ] Update Progress: 953/2369 symbols completed. GNW took 42.7s. Estimated remaining: 3h 18m 45s. Rate: 7.1 symbols/min [2025-10-15T19:13:50.519535] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2024-12. [2025-10-15T19:13:50.597830] [INFO ] [MAIN ] GPC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:13:50.598575] [DEBUG] [LOCAL ] GPC: No existing data file found in primary storage. [2025-10-15T19:13:50.598768] [WARN ] [MAIN ] GPC: No existing data found, performing full refresh instead. [2025-10-15T19:13:50.598924] [INFO ] [MAIN ] GPC: Wiping existing primary data before full refresh. [2025-10-15T19:13:50.598971] [INFO ] [LOCAL ] GPC: Starting deletion of primary data. [2025-10-15T19:13:50.599014] [DEBUG] [LOCAL ] GPC: No primary data file found to delete. [2025-10-15T19:13:50.599046] [INFO ] [MAIN ] GPC: Starting full primary refresh. [2025-10-15T19:13:50.809120] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-15T19:13:51.000174] [INFO ] [REMOTE ] GPC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:13:51.051453] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-15T19:13:51.313990] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-08. [2025-10-15T19:13:52.113983] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-09. [2025-10-15T19:13:52.224765] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-15T19:13:52.297673] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-15T19:13:52.914048] [INFO ] [REMOTE ] GPC: Fetching primary data for 2024-12. [2025-10-15T19:13:53.659590] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-15T19:13:53.713988] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-10. [2025-10-15T19:13:54.391167] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-15T19:13:54.514000] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-09. [2025-10-15T19:13:55.021462] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-15T19:13:55.027371] [INFO ] [REMOTE ] GOOS: Full fetch complete (64961 records). [2025-10-15T19:13:55.027518] [DEBUG] [VALIDATOR ] GOOS: Validating primary data. [2025-10-15T19:13:55.315739] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-01. [2025-10-15T19:13:55.409405] [DEBUG] [VALIDATOR ] GOOS: All expected trading days are present. [2025-10-15T19:13:55.409479] [DEBUG] [VALIDATOR ] GOOS: Primary data validation passed. [2025-10-15T19:13:55.410414] [INFO ] [MAIN ] GOOS: Fetched primary data is valid. [2025-10-15T19:13:55.410477] [DEBUG] [LOCAL ] GOOS: Saving primary data. [2025-10-15T19:13:55.411749] [DEBUG] [LOCAL ] GOOS: Trimmed 64961 records to 44661 (keeping 200 days of data) [2025-10-15T19:13:55.631108] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-15T19:13:55.687346] [DEBUG] [LOCAL ] GOOS: Primary data saved (44661 records). [2025-10-15T19:13:55.687474] [INFO ] [MAIN ] GOOS: Full history saved. [2025-10-15T19:13:55.687599] [INFO ] [MAIN ] Update Progress: 954/2369 symbols completed. GOOS took 27.6s. Estimated remaining: 3h 18m 32s. Rate: 7.1 symbols/min [2025-10-15T19:13:55.852577] [INFO ] [MAIN ] GPI: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:13:55.868810] [DEBUG] [LOCAL ] GPI: Loaded 14831 existing records from primary storage. [2025-10-15T19:13:55.869032] [INFO ] [MAIN ] GPI: Loaded 14831 existing records. [2025-10-15T19:13:56.040967] [WARN ] [MAIN ] GPI: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:13:56.041164] [INFO ] [MAIN ] GPI: Wiping existing primary data before full refresh. [2025-10-15T19:13:56.041211] [INFO ] [LOCAL ] GPI: Starting deletion of primary data. [2025-10-15T19:13:56.041453] [DEBUG] [LOCAL ] GPI: Deleted primary data file. [2025-10-15T19:13:56.041510] [INFO ] [MAIN ] GPI: Starting full primary refresh. [2025-10-15T19:13:56.119105] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-10. [2025-10-15T19:13:56.393073] [INFO ] [REMOTE ] GPI: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:13:56.785233] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-15T19:13:56.913981] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-02. [2025-10-15T19:13:57.379034] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-15T19:13:57.384152] [INFO ] [REMOTE ] GOLF: Full fetch complete (45310 records). [2025-10-15T19:13:57.384289] [DEBUG] [VALIDATOR ] GOLF: Validating primary data. [2025-10-15T19:13:57.739693] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-01. [2025-10-15T19:13:57.755708] [DEBUG] [VALIDATOR ] GOLF: All expected trading days are present. [2025-10-15T19:13:57.755763] [DEBUG] [VALIDATOR ] GOLF: Primary data validation passed. [2025-10-15T19:13:57.756474] [INFO ] [MAIN ] GOLF: Fetched primary data is valid. [2025-10-15T19:13:57.756599] [DEBUG] [LOCAL ] GOLF: Saving primary data. [2025-10-15T19:13:57.757523] [DEBUG] [LOCAL ] GOLF: Trimmed 45310 records to 30944 (keeping 200 days of data) [2025-10-15T19:13:57.947586] [DEBUG] [LOCAL ] GOLF: Primary data saved (30944 records). [2025-10-15T19:13:57.947773] [INFO ] [MAIN ] GOLF: Full history saved. [2025-10-15T19:13:57.947873] [INFO ] [MAIN ] Update Progress: 955/2369 symbols completed. GOLF took 31.3s. Estimated remaining: 3h 18m 15s. Rate: 7.1 symbols/min [2025-10-15T19:13:58.117312] [INFO ] [MAIN ] GPJA: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:13:58.124394] [DEBUG] [LOCAL ] GPJA: Loaded 4241 existing records from primary storage. [2025-10-15T19:13:58.124605] [INFO ] [MAIN ] GPJA: Loaded 4241 existing records. [2025-10-15T19:13:58.301897] [WARN ] [MAIN ] GPJA: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:13:58.302143] [INFO ] [MAIN ] GPJA: Wiping existing primary data before full refresh. [2025-10-15T19:13:58.302199] [INFO ] [LOCAL ] GPJA: Starting deletion of primary data. [2025-10-15T19:13:58.302350] [DEBUG] [LOCAL ] GPJA: Deleted primary data file. [2025-10-15T19:13:58.302403] [INFO ] [MAIN ] GPJA: Starting full primary refresh. [2025-10-15T19:13:58.519177] [INFO ] [REMOTE ] GPI: Fetching primary data for 2024-12. [2025-10-15T19:13:58.510090] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-15T19:13:58.697215] [INFO ] [REMOTE ] GPJA: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:13:59.287311] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-15T19:13:59.313956] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-02. [2025-10-15T19:13:59.325433] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-10-15T19:14:00.114004] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-01. [2025-10-15T19:14:00.860484] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-15T19:14:00.913963] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-02. [2025-10-15T19:14:00.947332] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-15T19:14:01.714063] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2024-12. [2025-10-15T19:14:01.773476] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-15T19:14:02.317637] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-10-15T19:14:02.513996] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-01. [2025-10-15T19:14:03.211180] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-15T19:14:03.313998] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-02. [2025-10-15T19:14:03.890606] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-15T19:14:04.114060] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-03. [2025-10-15T19:14:04.914050] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-03. [2025-10-15T19:14:05.714024] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-03. [2025-10-15T19:14:06.201930] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-10-15T19:14:06.231412] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-10-15T19:14:06.381096] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-15T19:14:06.513983] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-04. [2025-10-15T19:14:07.314009] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-03. [2025-10-15T19:14:07.879164] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-15T19:14:08.113956] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-04. [2025-10-15T19:14:08.350520] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-15T19:14:08.914046] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-04. [2025-10-15T19:14:09.481190] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-15T19:14:09.714036] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-05. [2025-10-15T19:14:09.770482] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-15T19:14:10.176368] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-10-15T19:14:10.513984] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-04. [2025-10-15T19:14:11.313981] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-06. [2025-10-15T19:14:11.491202] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-15T19:14:11.843850] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-10-15T19:14:12.114031] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-07. [2025-10-15T19:14:12.719536] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-15T19:14:12.913969] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-05. [2025-10-15T19:14:13.714057] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-08. [2025-10-15T19:14:14.332273] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-15T19:14:14.481015] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-15T19:14:14.514040] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-09. [2025-10-15T19:14:15.110515] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-15T19:14:15.314045] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-06. [2025-10-15T19:14:16.114017] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-05. [2025-10-15T19:14:16.664579] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-15T19:14:16.913996] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-07. [2025-10-15T19:14:17.479627] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-15T19:14:17.714056] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-10. [2025-10-15T19:14:18.044170] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-15T19:14:18.331797] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-15T19:14:18.332983] [INFO ] [REMOTE ] GPJA: Full fetch complete (7065 records). [2025-10-15T19:14:18.333079] [DEBUG] [VALIDATOR ] GPJA: Validating primary data. [2025-10-15T19:14:18.519166] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-05. [2025-10-15T19:14:18.779077] [DEBUG] [VALIDATOR ] GPJA: All expected trading days are present. [2025-10-15T19:14:18.779178] [DEBUG] [VALIDATOR ] GPJA: Primary data validation passed. [2025-10-15T19:14:18.779396] [INFO ] [MAIN ] GPJA: Fetched primary data is valid. [2025-10-15T19:14:18.779437] [DEBUG] [LOCAL ] GPJA: Saving primary data. [2025-10-15T19:14:18.779956] [DEBUG] [LOCAL ] GPJA: Trimmed 7065 records to 4202 (keeping 200 days of data) [2025-10-15T19:14:18.808785] [DEBUG] [LOCAL ] GPJA: Primary data saved (4202 records). [2025-10-15T19:14:18.808947] [INFO ] [MAIN ] GPJA: Full history saved. [2025-10-15T19:14:18.809066] [INFO ] [MAIN ] Update Progress: 956/2369 symbols completed. GPJA took 20.9s. Estimated remaining: 3h 18m 24s. Rate: 7.1 symbols/min [2025-10-15T19:14:18.985768] [INFO ] [MAIN ] GPK: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:14:19.042682] [DEBUG] [LOCAL ] GPK: Loaded 52763 existing records from primary storage. [2025-10-15T19:14:19.043040] [INFO ] [MAIN ] GPK: Loaded 52763 existing records. [2025-10-15T19:14:19.231745] [WARN ] [MAIN ] GPK: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:14:19.231973] [INFO ] [MAIN ] GPK: Wiping existing primary data before full refresh. [2025-10-15T19:14:19.232020] [INFO ] [LOCAL ] GPK: Starting deletion of primary data. [2025-10-15T19:14:19.232445] [DEBUG] [LOCAL ] GPK: Deleted primary data file. [2025-10-15T19:14:19.232483] [INFO ] [MAIN ] GPK: Starting full primary refresh. [2025-10-15T19:14:19.319194] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-08. [2025-10-15T19:14:19.557662] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-15T19:14:19.621362] [INFO ] [REMOTE ] GPK: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:14:20.114049] [INFO ] [REMOTE ] GPK: Fetching primary data for 2024-12. [2025-10-15T19:14:20.614819] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-15T19:14:20.913997] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-06. [2025-10-15T19:14:21.305113] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-15T19:14:21.714012] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-09. [2025-10-15T19:14:21.901145] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-15T19:14:22.514013] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-06. [2025-10-15T19:14:23.074276] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-15T19:14:23.314007] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-10. [2025-10-15T19:14:24.018287] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-15T19:14:24.114014] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-01. [2025-10-15T19:14:24.298170] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-15T19:14:24.302707] [INFO ] [REMOTE ] GOTU: Full fetch complete (58736 records). [2025-10-15T19:14:24.302845] [DEBUG] [VALIDATOR ] GOTU: Validating primary data. [2025-10-15T19:14:24.696530] [DEBUG] [VALIDATOR ] GOTU: All expected trading days are present. [2025-10-15T19:14:24.696604] [DEBUG] [VALIDATOR ] GOTU: Primary data validation passed. [2025-10-15T19:14:24.697445] [INFO ] [MAIN ] GOTU: Fetched primary data is valid. [2025-10-15T19:14:24.697507] [DEBUG] [LOCAL ] GOTU: Saving primary data. [2025-10-15T19:14:24.698669] [DEBUG] [LOCAL ] GOTU: Trimmed 58736 records to 37301 (keeping 200 days of data) [2025-10-15T19:14:24.908725] [DEBUG] [LOCAL ] GOTU: Primary data saved (37301 records). [2025-10-15T19:14:24.908865] [INFO ] [MAIN ] GOTU: Full history saved. [2025-10-15T19:14:24.909311] [INFO ] [MAIN ] Update Progress: 957/2369 symbols completed. GOTU took 36.3s. Estimated remaining: 3h 18m 13s. Rate: 7.1 symbols/min [2025-10-15T19:14:24.913954] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-07. [2025-10-15T19:14:25.698586] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-15T19:14:25.713951] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-02. [2025-10-15T19:14:26.514044] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-07. [2025-10-15T19:14:26.564186] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-15T19:14:27.189443] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-15T19:14:27.314027] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-08. [2025-10-15T19:14:27.569237] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-15T19:14:28.113979] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-08. [2025-10-15T19:14:28.600161] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-15T19:14:28.812684] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-15T19:14:28.914053] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-03. [2025-10-15T19:14:29.714037] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-09. [2025-10-15T19:14:30.514028] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-09. [2025-10-15T19:14:30.607184] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-15T19:14:31.314001] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-04. [2025-10-15T19:14:31.326024] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-15T19:14:31.494879] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-15T19:14:32.114033] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-10. [2025-10-15T19:14:32.913970] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-10. [2025-10-15T19:14:33.230074] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-15T19:14:33.232913] [INFO ] [REMOTE ] GPI: Full fetch complete (21568 records). [2025-10-15T19:14:33.233001] [DEBUG] [VALIDATOR ] GPI: Validating primary data. [2025-10-15T19:14:33.387624] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-10-15T19:14:33.638588] [DEBUG] [VALIDATOR ] GPI: All expected trading days are present. [2025-10-15T19:14:33.638688] [DEBUG] [VALIDATOR ] GPI: Primary data validation passed. [2025-10-15T19:14:33.639174] [INFO ] [MAIN ] GPI: Fetched primary data is valid. [2025-10-15T19:14:33.639237] [DEBUG] [LOCAL ] GPI: Saving primary data. [2025-10-15T19:14:33.640673] [DEBUG] [LOCAL ] GPI: Trimmed 21568 records to 14894 (keeping 200 days of data) [2025-10-15T19:14:33.715798] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-05. [2025-10-15T19:14:33.738446] [DEBUG] [LOCAL ] GPI: Primary data saved (14894 records). [2025-10-15T19:14:33.738667] [INFO ] [MAIN ] GPI: Full history saved. [2025-10-15T19:14:33.738774] [INFO ] [MAIN ] Update Progress: 958/2369 symbols completed. GPI took 38.1s. Estimated remaining: 3h 18m 5s. Rate: 7.1 symbols/min [2025-10-15T19:14:34.213152] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-15T19:14:34.219105] [INFO ] [REMOTE ] GPC: Full fetch complete (68723 records). [2025-10-15T19:14:34.219222] [DEBUG] [VALIDATOR ] GPC: Validating primary data. [2025-10-15T19:14:34.612456] [DEBUG] [VALIDATOR ] GPC: All expected trading days are present. [2025-10-15T19:14:34.612559] [DEBUG] [VALIDATOR ] GPC: Primary data validation passed. [2025-10-15T19:14:34.613511] [INFO ] [MAIN ] GPC: Fetched primary data is valid. [2025-10-15T19:14:34.613577] [DEBUG] [LOCAL ] GPC: Saving primary data. [2025-10-15T19:14:34.615216] [DEBUG] [LOCAL ] GPC: Trimmed 68723 records to 46017 (keeping 200 days of data) [2025-10-15T19:14:34.912743] [DEBUG] [LOCAL ] GPC: Primary data saved (46017 records). [2025-10-15T19:14:34.912892] [INFO ] [MAIN ] GPC: Full history saved. [2025-10-15T19:14:34.912967] [INFO ] [MAIN ] Update Progress: 959/2369 symbols completed. GPC took 44.5s. Estimated remaining: 3h 17m 46s. Rate: 7.1 symbols/min [2025-10-15T19:14:35.158242] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-15T19:14:35.169758] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-06. [2025-10-15T19:14:36.646426] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-15T19:14:36.657446] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-07. [2025-10-15T19:14:38.019627] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-15T19:14:38.031188] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-08. [2025-10-15T19:14:40.003007] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-10-15T19:14:40.014592] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-09. [2025-10-15T19:14:41.736247] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-15T19:14:41.748090] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-10. [2025-10-15T19:14:44.526619] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-10 (2.78 seconds). [2025-10-15T19:14:44.532996] [INFO ] [REMOTE ] GPK: Full fetch complete (75914 records). [2025-10-15T19:14:44.533124] [DEBUG] [VALIDATOR ] GPK: Validating primary data. [2025-10-15T19:14:44.927851] [DEBUG] [VALIDATOR ] GPK: All expected trading days are present. [2025-10-15T19:14:44.927928] [DEBUG] [VALIDATOR ] GPK: Primary data validation passed. [2025-10-15T19:14:44.928927] [INFO ] [MAIN ] GPK: Fetched primary data is valid. [2025-10-15T19:14:44.928992] [DEBUG] [LOCAL ] GPK: Saving primary data. [2025-10-15T19:14:44.930467] [DEBUG] [LOCAL ] GPK: Trimmed 75914 records to 52775 (keeping 200 days of data) [2025-10-15T19:14:45.249200] [DEBUG] [LOCAL ] GPK: Primary data saved (52775 records). [2025-10-15T19:14:45.249360] [INFO ] [MAIN ] GPK: Full history saved. [2025-10-15T19:14:45.249452] [INFO ] [MAIN ] Update Progress: 960/2369 symbols completed. GPK took 26.4s. Estimated remaining: 3h 17m 40s. Rate: 7.1 symbols/min [2025-10-15T19:14:45.849722] [INFO ] [MAIN ] GPOR: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:14:45.875805] [INFO ] [MAIN ] GPN: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:14:45.937536] [INFO ] [MAIN ] GPRK: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:14:45.957144] [INFO ] [MAIN ] GPMT: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:14:45.980108] [DEBUG] [LOCAL ] GPOR: Loaded 23269 existing records from primary storage. [2025-10-15T19:14:45.987308] [INFO ] [MAIN ] GPOR: Loaded 23269 existing records. [2025-10-15T19:14:46.153301] [DEBUG] [LOCAL ] GPMT: Loaded 25901 existing records from primary storage. [2025-10-15T19:14:46.195306] [INFO ] [MAIN ] GPMT: Loaded 25901 existing records. [2025-10-15T19:14:46.196312] [DEBUG] [LOCAL ] GPRK: Loaded 39628 existing records from primary storage. [2025-10-15T19:14:46.212190] [INFO ] [MAIN ] GPRK: Loaded 39628 existing records. [2025-10-15T19:14:46.170600] [DEBUG] [LOCAL ] GPN: Loaded 52040 existing records from primary storage. [2025-10-15T19:14:46.267939] [INFO ] [MAIN ] GPN: Loaded 52040 existing records. [2025-10-15T19:14:46.294701] [WARN ] [MAIN ] GPOR: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:14:46.363947] [INFO ] [MAIN ] GPOR: Wiping existing primary data before full refresh. [2025-10-15T19:14:46.387332] [INFO ] [LOCAL ] GPOR: Starting deletion of primary data. [2025-10-15T19:14:46.445880] [DEBUG] [LOCAL ] GPOR: Deleted primary data file. [2025-10-15T19:14:46.451189] [INFO ] [MAIN ] GPOR: Starting full primary refresh. [2025-10-15T19:14:46.831144] [WARN ] [MAIN ] GPMT: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:14:46.822819] [WARN ] [MAIN ] GPRK: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:14:46.869053] [INFO ] [MAIN ] GPMT: Wiping existing primary data before full refresh. [2025-10-15T19:14:46.907506] [WARN ] [MAIN ] GPN: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:14:46.869234] [INFO ] [MAIN ] GPRK: Wiping existing primary data before full refresh. [2025-10-15T19:14:46.907616] [INFO ] [LOCAL ] GPMT: Starting deletion of primary data. [2025-10-15T19:14:46.918592] [INFO ] [MAIN ] GPN: Wiping existing primary data before full refresh. [2025-10-15T19:14:46.918841] [INFO ] [LOCAL ] GPRK: Starting deletion of primary data. [2025-10-15T19:14:46.929750] [DEBUG] [LOCAL ] GPMT: Deleted primary data file. [2025-10-15T19:14:46.940192] [DEBUG] [LOCAL ] GPRK: Deleted primary data file. [2025-10-15T19:14:46.924555] [INFO ] [LOCAL ] GPN: Starting deletion of primary data. [2025-10-15T19:14:46.945436] [INFO ] [MAIN ] GPRK: Starting full primary refresh. [2025-10-15T19:14:46.969159] [INFO ] [MAIN ] GPMT: Starting full primary refresh. [2025-10-15T19:14:47.050772] [DEBUG] [LOCAL ] GPN: Deleted primary data file. [2025-10-15T19:14:47.061349] [INFO ] [MAIN ] GPN: Starting full primary refresh. [2025-10-15T19:14:47.870258] [INFO ] [REMOTE ] GPOR: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:14:47.993317] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2024-12. [2025-10-15T19:14:48.199951] [INFO ] [REMOTE ] GPMT: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:14:48.233830] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2024-12. [2025-10-15T19:14:48.290583] [INFO ] [REMOTE ] GPN: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:14:48.293487] [INFO ] [REMOTE ] GPN: Fetching primary data for 2024-12. [2025-10-15T19:14:48.320318] [INFO ] [REMOTE ] GPRK: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:14:48.320833] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2024-12. [2025-10-15T19:14:49.535405] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-15T19:14:49.541356] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-01. [2025-10-15T19:14:49.566242] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-15T19:14:49.572321] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-01. [2025-10-15T19:14:49.926925] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-15T19:14:49.935007] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-01. [2025-10-15T19:14:49.966004] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-15T19:14:49.976420] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-01. [2025-10-15T19:14:50.476864] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-15T19:14:50.482266] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-02. [2025-10-15T19:14:50.894018] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-15T19:14:50.900059] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-02. [2025-10-15T19:14:51.475045] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-15T19:14:51.488777] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-02. [2025-10-15T19:14:51.493632] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-15T19:14:51.504833] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-02. [2025-10-15T19:14:51.520486] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-15T19:14:51.526022] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-03. [2025-10-15T19:14:51.815210] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-15T19:14:51.820170] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-03. [2025-10-15T19:14:52.618809] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-15T19:14:52.628299] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-04. [2025-10-15T19:14:52.795358] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-15T19:14:52.806903] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-03. [2025-10-15T19:14:52.877871] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-15T19:14:52.893814] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-04. [2025-10-15T19:14:52.909366] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-15T19:14:52.918009] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-03. [2025-10-15T19:14:53.963721] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-15T19:14:53.971310] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-05. [2025-10-15T19:14:54.017792] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-15T19:14:54.023565] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-05. [2025-10-15T19:14:54.131032] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-15T19:14:54.164619] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-15T19:14:54.514033] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-04. [2025-10-15T19:14:54.663417] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-15T19:14:55.266263] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-15T19:14:55.313962] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-06. [2025-10-15T19:14:55.687267] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-15T19:14:56.114037] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-04. [2025-10-15T19:14:56.671358] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-15T19:14:56.913994] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-06. [2025-10-15T19:14:57.724309] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-05. [2025-10-15T19:14:57.747588] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-15T19:14:57.977426] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-15T19:14:58.514001] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-07. [2025-10-15T19:14:59.034283] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-15T19:14:59.314009] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-07. [2025-10-15T19:14:59.603792] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-15T19:15:00.113984] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-06. [2025-10-15T19:15:00.448098] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-15T19:15:00.914014] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-08. [2025-10-15T19:15:01.714021] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-05. [2025-10-15T19:15:01.812618] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-15T19:15:02.016208] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-15T19:15:02.514005] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-09. [2025-10-15T19:15:03.296753] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-15T19:15:03.313956] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-07. [2025-10-15T19:15:03.500013] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-15T19:15:04.114015] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-10. [2025-10-15T19:15:04.576380] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-15T19:15:04.913992] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-08. [2025-10-15T19:15:05.206559] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-15T19:15:05.210209] [INFO ] [REMOTE ] GPMT: Full fetch complete (36768 records). [2025-10-15T19:15:05.210374] [DEBUG] [VALIDATOR ] GPMT: Validating primary data. [2025-10-15T19:15:05.649999] [DEBUG] [VALIDATOR ] GPMT: All expected trading days are present. [2025-10-15T19:15:05.650101] [DEBUG] [VALIDATOR ] GPMT: Primary data validation passed. [2025-10-15T19:15:05.650915] [INFO ] [MAIN ] GPMT: Fetched primary data is valid. [2025-10-15T19:15:05.650980] [DEBUG] [LOCAL ] GPMT: Saving primary data. [2025-10-15T19:15:05.651997] [DEBUG] [LOCAL ] GPMT: Trimmed 36768 records to 25932 (keeping 200 days of data) [2025-10-15T19:15:05.740322] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-08. [2025-10-15T19:15:05.813595] [DEBUG] [LOCAL ] GPMT: Primary data saved (25932 records). [2025-10-15T19:15:05.813862] [INFO ] [MAIN ] GPMT: Full history saved. [2025-10-15T19:15:05.813978] [INFO ] [MAIN ] Update Progress: 961/2369 symbols completed. GPMT took 20.6s. Estimated remaining: 3h 17m 50s. Rate: 7.1 symbols/min [2025-10-15T19:15:05.994433] [INFO ] [MAIN ] GRBK: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:15:06.020544] [DEBUG] [LOCAL ] GRBK: Loaded 27177 existing records from primary storage. [2025-10-15T19:15:06.020825] [INFO ] [MAIN ] GRBK: Loaded 27177 existing records. [2025-10-15T19:15:06.209872] [WARN ] [MAIN ] GRBK: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:15:06.210241] [INFO ] [MAIN ] GRBK: Wiping existing primary data before full refresh. [2025-10-15T19:15:06.210470] [INFO ] [LOCAL ] GRBK: Starting deletion of primary data. [2025-10-15T19:15:06.210990] [DEBUG] [LOCAL ] GRBK: Deleted primary data file. [2025-10-15T19:15:06.211050] [INFO ] [MAIN ] GRBK: Starting full primary refresh. [2025-10-15T19:15:06.349995] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-15T19:15:06.519153] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-09. [2025-10-15T19:15:06.608759] [INFO ] [REMOTE ] GRBK: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:15:06.886239] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-15T19:15:07.313972] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-09. [2025-10-15T19:15:08.082697] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-15T19:15:08.113962] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-10. [2025-10-15T19:15:08.652427] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-15T19:15:08.914035] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2024-12. [2025-10-15T19:15:09.714025] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-06. [2025-10-15T19:15:09.764038] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-15T19:15:09.771771] [INFO ] [REMOTE ] GPRK: Full fetch complete (58081 records). [2025-10-15T19:15:09.771952] [DEBUG] [VALIDATOR ] GPRK: Validating primary data. [2025-10-15T19:15:10.126180] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-15T19:15:10.179071] [DEBUG] [VALIDATOR ] GPRK: All expected trading days are present. [2025-10-15T19:15:10.179163] [DEBUG] [VALIDATOR ] GPRK: Primary data validation passed. [2025-10-15T19:15:10.180266] [INFO ] [MAIN ] GPRK: Fetched primary data is valid. [2025-10-15T19:15:10.180332] [DEBUG] [LOCAL ] GPRK: Saving primary data. [2025-10-15T19:15:10.181623] [DEBUG] [LOCAL ] GPRK: Trimmed 58081 records to 39736 (keeping 200 days of data) [2025-10-15T19:15:10.422405] [DEBUG] [LOCAL ] GPRK: Primary data saved (39736 records). [2025-10-15T19:15:10.422586] [INFO ] [MAIN ] GPRK: Full history saved. [2025-10-15T19:15:10.423563] [INFO ] [MAIN ] Update Progress: 962/2369 symbols completed. GPRK took 25.2s. Estimated remaining: 3h 17m 36s. Rate: 7.1 symbols/min [2025-10-15T19:15:10.519236] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-10. [2025-10-15T19:15:10.608871] [INFO ] [MAIN ] GRC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:15:10.624561] [DEBUG] [LOCAL ] GRC: Loaded 9280 existing records from primary storage. [2025-10-15T19:15:10.624844] [INFO ] [MAIN ] GRC: Loaded 9280 existing records. [2025-10-15T19:15:10.868360] [WARN ] [MAIN ] GRC: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:15:10.868698] [INFO ] [MAIN ] GRC: Wiping existing primary data before full refresh. [2025-10-15T19:15:10.868778] [INFO ] [LOCAL ] GRC: Starting deletion of primary data. [2025-10-15T19:15:10.869068] [DEBUG] [LOCAL ] GRC: Deleted primary data file. [2025-10-15T19:15:10.869148] [INFO ] [MAIN ] GRC: Starting full primary refresh. [2025-10-15T19:15:11.329761] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-01. [2025-10-15T19:15:11.383358] [INFO ] [REMOTE ] GRC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:15:11.472025] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-15T19:15:11.810849] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-15T19:15:11.814960] [INFO ] [REMOTE ] GPOR: Full fetch complete (35074 records). [2025-10-15T19:15:11.815093] [DEBUG] [VALIDATOR ] GPOR: Validating primary data. [2025-10-15T19:15:12.119125] [INFO ] [REMOTE ] GRC: Fetching primary data for 2024-12. [2025-10-15T19:15:12.193954] [DEBUG] [VALIDATOR ] GPOR: All expected trading days are present. [2025-10-15T19:15:12.194131] [DEBUG] [VALIDATOR ] GPOR: Primary data validation passed. [2025-10-15T19:15:12.194807] [INFO ] [MAIN ] GPOR: Fetched primary data is valid. [2025-10-15T19:15:12.194868] [DEBUG] [LOCAL ] GPOR: Saving primary data. [2025-10-15T19:15:12.195897] [DEBUG] [LOCAL ] GPOR: Trimmed 35074 records to 23324 (keeping 200 days of data) [2025-10-15T19:15:12.333939] [DEBUG] [LOCAL ] GPOR: Primary data saved (23324 records). [2025-10-15T19:15:12.334126] [INFO ] [MAIN ] GPOR: Full history saved. [2025-10-15T19:15:12.334279] [INFO ] [MAIN ] Update Progress: 963/2369 symbols completed. GPOR took 27.1s. Estimated remaining: 3h 17m 18s. Rate: 7.1 symbols/min [2025-10-15T19:15:12.501700] [INFO ] [MAIN ] GRDN: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:15:12.518680] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-15T19:15:12.540214] [DEBUG] [LOCAL ] GRDN: Loaded 20872 existing records from primary storage. [2025-10-15T19:15:12.540450] [INFO ] [MAIN ] GRDN: Loaded 20872 existing records. [2025-10-15T19:15:12.722208] [WARN ] [MAIN ] GRDN: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:15:12.722707] [INFO ] [MAIN ] GRDN: Wiping existing primary data before full refresh. [2025-10-15T19:15:12.728238] [INFO ] [LOCAL ] GRDN: Starting deletion of primary data. [2025-10-15T19:15:12.728983] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-10-15T19:15:12.729022] [DEBUG] [LOCAL ] GRDN: Deleted primary data file. [2025-10-15T19:15:12.729867] [INFO ] [MAIN ] GRDN: Starting full primary refresh. [2025-10-15T19:15:12.921159] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-01. [2025-10-15T19:15:13.074866] [INFO ] [REMOTE ] GRDN: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:15:13.714039] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2024-12. [2025-10-15T19:15:13.891152] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-15T19:15:14.514018] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-02. [2025-10-15T19:15:14.736677] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-15T19:15:15.043916] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-15T19:15:15.314009] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-03. [2025-10-15T19:15:16.079302] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-15T19:15:16.113977] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-04. [2025-10-15T19:15:16.914008] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-07. [2025-10-15T19:15:16.964235] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-15T19:15:17.713998] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-05. [2025-10-15T19:15:18.429812] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-15T19:15:18.457003] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-15T19:15:18.514000] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-02. [2025-10-15T19:15:19.314041] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-08. [2025-10-15T19:15:19.803609] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-15T19:15:20.114030] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-06. [2025-10-15T19:15:20.756067] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-15T19:15:20.883498] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-15T19:15:20.913959] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-09. [2025-10-15T19:15:21.714025] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-01. [2025-10-15T19:15:22.513978] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-03. [2025-10-15T19:15:22.569691] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-15T19:15:22.634939] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-15T19:15:23.313992] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-10. [2025-10-15T19:15:23.861157] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-15T19:15:24.113995] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-04. [2025-10-15T19:15:24.784494] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-15T19:15:24.790629] [INFO ] [REMOTE ] GPN: Full fetch complete (75093 records). [2025-10-15T19:15:24.790773] [DEBUG] [VALIDATOR ] GPN: Validating primary data. [2025-10-15T19:15:24.919113] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-02. [2025-10-15T19:15:25.202821] [DEBUG] [VALIDATOR ] GPN: All expected trading days are present. [2025-10-15T19:15:25.202914] [DEBUG] [VALIDATOR ] GPN: Primary data validation passed. [2025-10-15T19:15:25.204025] [INFO ] [MAIN ] GPN: Fetched primary data is valid. [2025-10-15T19:15:25.204149] [DEBUG] [LOCAL ] GPN: Saving primary data. [2025-10-15T19:15:25.205608] [DEBUG] [LOCAL ] GPN: Trimmed 75093 records to 52001 (keeping 200 days of data) [2025-10-15T19:15:25.469453] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-15T19:15:25.555226] [DEBUG] [LOCAL ] GPN: Primary data saved (52001 records). [2025-10-15T19:15:25.555371] [INFO ] [MAIN ] GPN: Full history saved. [2025-10-15T19:15:25.555455] [INFO ] [MAIN ] Update Progress: 964/2369 symbols completed. GPN took 40.3s. Estimated remaining: 3h 17m 16s. Rate: 7.1 symbols/min [2025-10-15T19:15:25.723775] [INFO ] [MAIN ] GRMN: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:15:25.720162] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-07. [2025-10-15T19:15:25.732482] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-15T19:15:25.772213] [DEBUG] [LOCAL ] GRMN: Loaded 40470 existing records from primary storage. [2025-10-15T19:15:25.772503] [INFO ] [MAIN ] GRMN: Loaded 40470 existing records. [2025-10-15T19:15:25.943260] [WARN ] [MAIN ] GRMN: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:15:25.943456] [INFO ] [MAIN ] GRMN: Wiping existing primary data before full refresh. [2025-10-15T19:15:25.943502] [INFO ] [LOCAL ] GRMN: Starting deletion of primary data. [2025-10-15T19:15:25.943717] [DEBUG] [LOCAL ] GRMN: Deleted primary data file. [2025-10-15T19:15:25.943773] [INFO ] [MAIN ] GRMN: Starting full primary refresh. [2025-10-15T19:15:26.288214] [INFO ] [REMOTE ] GRMN: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:15:26.508042] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-15T19:15:26.513954] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-08. [2025-10-15T19:15:27.313989] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-05. [2025-10-15T19:15:27.334843] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-15T19:15:28.114001] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-09. [2025-10-15T19:15:28.295730] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-15T19:15:28.891084] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-15T19:15:28.913975] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-10. [2025-10-15T19:15:29.714006] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-03. [2025-10-15T19:15:29.857456] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-15T19:15:29.859456] [INFO ] [REMOTE ] GRC: Full fetch complete (13334 records). [2025-10-15T19:15:29.859531] [DEBUG] [VALIDATOR ] GRC: Validating primary data. [2025-10-15T19:15:30.222281] [DEBUG] [VALIDATOR ] GRC: All expected trading days are present. [2025-10-15T19:15:30.222359] [DEBUG] [VALIDATOR ] GRC: Primary data validation passed. [2025-10-15T19:15:30.222677] [INFO ] [MAIN ] GRC: Fetched primary data is valid. [2025-10-15T19:15:30.222738] [DEBUG] [LOCAL ] GRC: Saving primary data. [2025-10-15T19:15:30.223215] [DEBUG] [LOCAL ] GRC: Trimmed 13334 records to 9292 (keeping 200 days of data) [2025-10-15T19:15:30.279892] [DEBUG] [LOCAL ] GRC: Primary data saved (9292 records). [2025-10-15T19:15:30.280014] [INFO ] [MAIN ] GRC: Full history saved. [2025-10-15T19:15:30.280093] [INFO ] [MAIN ] Update Progress: 965/2369 symbols completed. GRC took 19.9s. Estimated remaining: 3h 17m 2s. Rate: 7.1 symbols/min [2025-10-15T19:15:30.462007] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-15T19:15:30.463749] [INFO ] [MAIN ] GRND: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:15:30.515157] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-06. [2025-10-15T19:15:30.518456] [DEBUG] [LOCAL ] GRND: Loaded 50090 existing records from primary storage. [2025-10-15T19:15:30.518773] [INFO ] [MAIN ] GRND: Loaded 50090 existing records. [2025-10-15T19:15:30.696145] [WARN ] [MAIN ] GRND: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:15:30.696357] [INFO ] [MAIN ] GRND: Wiping existing primary data before full refresh. [2025-10-15T19:15:30.696408] [INFO ] [LOCAL ] GRND: Starting deletion of primary data. [2025-10-15T19:15:30.696776] [DEBUG] [LOCAL ] GRND: Deleted primary data file. [2025-10-15T19:15:30.696835] [INFO ] [MAIN ] GRND: Starting full primary refresh. [2025-10-15T19:15:31.050528] [INFO ] [REMOTE ] GRND: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:15:31.313994] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2024-12. [2025-10-15T19:15:31.582513] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-15T19:15:32.114069] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-04. [2025-10-15T19:15:32.848820] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-15T19:15:32.913967] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-07. [2025-10-15T19:15:33.037437] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-15T19:15:33.714010] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-01. [2025-10-15T19:15:34.247629] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-15T19:15:34.513968] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-05. [2025-10-15T19:15:35.288435] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-15T19:15:35.313983] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-02. [2025-10-15T19:15:35.342635] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-15T19:15:36.114056] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-06. [2025-10-15T19:15:36.870673] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-15T19:15:36.913960] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-08. [2025-10-15T19:15:37.102100] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-15T19:15:37.714019] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-07. [2025-10-15T19:15:38.102361] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-15T19:15:38.355765] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-10-15T19:15:38.513985] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-08. [2025-10-15T19:15:39.314006] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-03. [2025-10-15T19:15:39.579046] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-15T19:15:40.114035] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-09. [2025-10-15T19:15:40.729931] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-15T19:15:40.914011] [INFO ] [REMOTE ] GRND: Fetching primary data for 2024-12. [2025-10-15T19:15:41.125347] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-15T19:15:41.714067] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-04. [2025-10-15T19:15:42.300147] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-15T19:15:42.514023] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-01. [2025-10-15T19:15:43.038191] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-15T19:15:43.313998] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-09. [2025-10-15T19:15:44.042897] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-15T19:15:44.113984] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-05. [2025-10-15T19:15:44.558755] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-15T19:15:44.914002] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-10. [2025-10-15T19:15:45.713976] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-10. [2025-10-15T19:15:45.895295] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-15T19:15:46.104433] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-15T19:15:46.108248] [INFO ] [REMOTE ] GRBK: Full fetch complete (40518 records). [2025-10-15T19:15:46.108333] [DEBUG] [VALIDATOR ] GRBK: Validating primary data. [2025-10-15T19:15:46.488296] [DEBUG] [VALIDATOR ] GRBK: All expected trading days are present. [2025-10-15T19:15:46.488370] [DEBUG] [VALIDATOR ] GRBK: Primary data validation passed. [2025-10-15T19:15:46.489092] [INFO ] [MAIN ] GRBK: Fetched primary data is valid. [2025-10-15T19:15:46.489158] [DEBUG] [LOCAL ] GRBK: Saving primary data. [2025-10-15T19:15:46.490058] [DEBUG] [LOCAL ] GRBK: Trimmed 40518 records to 27164 (keeping 200 days of data) [2025-10-15T19:15:46.537093] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-02. [2025-10-15T19:15:46.664233] [DEBUG] [LOCAL ] GRBK: Primary data saved (27164 records). [2025-10-15T19:15:46.664371] [INFO ] [MAIN ] GRBK: Full history saved. [2025-10-15T19:15:46.664453] [INFO ] [MAIN ] Update Progress: 966/2369 symbols completed. GRBK took 40.9s. Estimated remaining: 3h 17m 5s. Rate: 7.1 symbols/min [2025-10-15T19:15:46.846430] [INFO ] [MAIN ] GRNT: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:15:46.847321] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-15T19:15:46.851272] [INFO ] [REMOTE ] GRDN: Full fetch complete (26411 records). [2025-10-15T19:15:46.851376] [DEBUG] [VALIDATOR ] GRDN: Validating primary data. [2025-10-15T19:15:47.087685] [DEBUG] [LOCAL ] GRNT: Loaded 33969 existing records from primary storage. [2025-10-15T19:15:47.125456] [INFO ] [MAIN ] GRNT: Loaded 33969 existing records. [2025-10-15T19:15:47.328908] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-06. [2025-10-15T19:15:47.396699] [DEBUG] [VALIDATOR ] GRDN: All expected trading days are present. [2025-10-15T19:15:47.420610] [DEBUG] [VALIDATOR ] GRDN: Primary data validation passed. [2025-10-15T19:15:47.426693] [INFO ] [MAIN ] GRDN: Fetched primary data is valid. [2025-10-15T19:15:47.426776] [DEBUG] [LOCAL ] GRDN: Saving primary data. [2025-10-15T19:15:47.426070] [WARN ] [MAIN ] GRNT: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:15:47.426997] [INFO ] [MAIN ] GRNT: Wiping existing primary data before full refresh. [2025-10-15T19:15:47.427058] [INFO ] [LOCAL ] GRNT: Starting deletion of primary data. [2025-10-15T19:15:47.427417] [DEBUG] [LOCAL ] GRNT: Deleted primary data file. [2025-10-15T19:15:47.427487] [INFO ] [MAIN ] GRNT: Starting full primary refresh. [2025-10-15T19:15:47.460713] [DEBUG] [LOCAL ] GRDN: Trimmed 26411 records to 20984 (keeping 200 days of data) [2025-10-15T19:15:47.845576] [DEBUG] [LOCAL ] GRDN: Primary data saved (20984 records). [2025-10-15T19:15:47.855948] [INFO ] [MAIN ] GRDN: Full history saved. [2025-10-15T19:15:47.868564] [INFO ] [MAIN ] Update Progress: 967/2369 symbols completed. GRDN took 35.5s. Estimated remaining: 3h 16m 47s. Rate: 7.1 symbols/min [2025-10-15T19:15:47.923054] [INFO ] [REMOTE ] GRNT: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:15:48.095706] [INFO ] [MAIN ] GROV: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:15:48.106074] [DEBUG] [LOCAL ] GROV: Loaded 8717 existing records from primary storage. [2025-10-15T19:15:48.106261] [INFO ] [MAIN ] GROV: Loaded 8717 existing records. [2025-10-15T19:15:48.136193] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2024-12. [2025-10-15T19:15:48.291558] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-15T19:15:48.323850] [WARN ] [MAIN ] GROV: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:15:48.324553] [INFO ] [MAIN ] GROV: Wiping existing primary data before full refresh. [2025-10-15T19:15:48.324614] [INFO ] [LOCAL ] GROV: Starting deletion of primary data. [2025-10-15T19:15:48.324790] [DEBUG] [LOCAL ] GROV: Deleted primary data file. [2025-10-15T19:15:48.324842] [INFO ] [MAIN ] GROV: Starting full primary refresh. [2025-10-15T19:15:48.679337] [INFO ] [REMOTE ] GROV: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:15:48.716201] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-15T19:15:48.914001] [INFO ] [REMOTE ] GROV: Fetching primary data for 2024-12. [2025-10-15T19:15:49.510829] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-15T19:15:49.643857] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-10-15T19:15:49.713983] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-03. [2025-10-15T19:15:50.513996] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-01. [2025-10-15T19:15:51.302359] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-15T19:15:51.317972] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-01. [2025-10-15T19:15:51.352393] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-15T19:15:52.113990] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-02. [2025-10-15T19:15:52.390440] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-15T19:15:52.866683] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-15T19:15:52.913946] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-03. [2025-10-15T19:15:53.459025] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-10-15T19:15:53.713997] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-04. [2025-10-15T19:15:54.514047] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-02. [2025-10-15T19:15:55.313967] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-04. [2025-10-15T19:15:55.473003] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-15T19:15:55.521832] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-15T19:15:55.733456] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-10-15T19:15:56.114045] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-07. [2025-10-15T19:15:56.914010] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-05. [2025-10-15T19:15:57.665386] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-15T19:15:57.665751] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-15T19:15:57.714004] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-06. [2025-10-15T19:15:58.408150] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-15T19:15:58.513995] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-03. [2025-10-15T19:15:59.313962] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-07. [2025-10-15T19:15:59.600268] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-15T19:16:00.114019] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-04. [2025-10-15T19:16:00.278714] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-15T19:16:00.913992] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-05. [2025-10-15T19:16:01.502953] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-15T19:16:01.713969] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-05. [2025-10-15T19:16:02.515754] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-08. [2025-10-15T19:16:02.538776] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-15T19:16:02.568582] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-15T19:16:03.308839] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-15T19:16:03.313950] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-09. [2025-10-15T19:16:03.925608] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-15T19:16:04.113987] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-08. [2025-10-15T19:16:04.913989] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-06. [2025-10-15T19:16:05.644435] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-15T19:16:05.713965] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-09. [2025-10-15T19:16:06.514024] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-10. [2025-10-15T19:16:06.585432] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-15T19:16:07.230208] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-15T19:16:07.234745] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-15T19:16:07.234944] [INFO ] [REMOTE ] GROV: Full fetch complete (14020 records). [2025-10-15T19:16:07.243252] [DEBUG] [VALIDATOR ] GROV: Validating primary data. [2025-10-15T19:16:07.319271] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-07. [2025-10-15T19:16:07.635638] [DEBUG] [VALIDATOR ] GROV: All expected trading days are present. [2025-10-15T19:16:07.635747] [DEBUG] [VALIDATOR ] GROV: Primary data validation passed. [2025-10-15T19:16:07.635975] [INFO ] [MAIN ] GROV: Fetched primary data is valid. [2025-10-15T19:16:07.636015] [DEBUG] [LOCAL ] GROV: Saving primary data. [2025-10-15T19:16:07.636444] [DEBUG] [LOCAL ] GROV: Trimmed 14020 records to 8760 (keeping 200 days of data) [2025-10-15T19:16:07.683773] [DEBUG] [LOCAL ] GROV: Primary data saved (8760 records). [2025-10-15T19:16:07.683877] [INFO ] [MAIN ] GROV: Full history saved. [2025-10-15T19:16:07.683954] [INFO ] [MAIN ] Update Progress: 968/2369 symbols completed. GROV took 19.8s. Estimated remaining: 3h 16m 55s. Rate: 7.1 symbols/min [2025-10-15T19:16:07.847529] [INFO ] [MAIN ] GRX: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:16:07.854148] [DEBUG] [LOCAL ] GRX: Loaded 4788 existing records from primary storage. [2025-10-15T19:16:07.854325] [INFO ] [MAIN ] GRX: Loaded 4788 existing records. [2025-10-15T19:16:08.025300] [WARN ] [MAIN ] GRX: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:16:08.025477] [INFO ] [MAIN ] GRX: Wiping existing primary data before full refresh. [2025-10-15T19:16:08.025523] [INFO ] [LOCAL ] GRX: Starting deletion of primary data. [2025-10-15T19:16:08.025694] [DEBUG] [LOCAL ] GRX: Deleted primary data file. [2025-10-15T19:16:08.025761] [INFO ] [MAIN ] GRX: Starting full primary refresh. [2025-10-15T19:16:08.123503] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-06. [2025-10-15T19:16:08.372912] [INFO ] [REMOTE ] GRX: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:16:08.842676] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-15T19:16:08.914029] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-10. [2025-10-15T19:16:09.578437] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-15T19:16:09.714020] [INFO ] [REMOTE ] GRX: Fetching primary data for 2024-12. [2025-10-15T19:16:10.129427] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2024-12 (0.42 seconds). [2025-10-15T19:16:10.371815] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-15T19:16:10.376402] [INFO ] [REMOTE ] GRMN: Full fetch complete (59691 records). [2025-10-15T19:16:10.376590] [DEBUG] [VALIDATOR ] GRMN: Validating primary data. [2025-10-15T19:16:10.519139] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-01. [2025-10-15T19:16:10.762563] [DEBUG] [VALIDATOR ] GRMN: All expected trading days are present. [2025-10-15T19:16:10.762635] [DEBUG] [VALIDATOR ] GRMN: Primary data validation passed. [2025-10-15T19:16:10.763550] [INFO ] [MAIN ] GRMN: Fetched primary data is valid. [2025-10-15T19:16:10.763597] [DEBUG] [LOCAL ] GRMN: Saving primary data. [2025-10-15T19:16:10.764885] [DEBUG] [LOCAL ] GRMN: Trimmed 59691 records to 40425 (keeping 200 days of data) [2025-10-15T19:16:11.015429] [DEBUG] [LOCAL ] GRMN: Primary data saved (40425 records). [2025-10-15T19:16:11.015558] [INFO ] [MAIN ] GRMN: Full history saved. [2025-10-15T19:16:11.015633] [INFO ] [MAIN ] Update Progress: 969/2369 symbols completed. GRMN took 45.5s. Estimated remaining: 3h 16m 39s. Rate: 7.1 symbols/min [2025-10-15T19:16:11.183457] [INFO ] [MAIN ] GS: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:16:11.188588] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-15T19:16:11.237977] [DEBUG] [LOCAL ] GS: Loaded 51784 existing records from primary storage. [2025-10-15T19:16:11.238310] [INFO ] [MAIN ] GS: Loaded 51784 existing records. [2025-10-15T19:16:11.319184] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-07. [2025-10-15T19:16:11.413259] [WARN ] [MAIN ] GS: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:16:11.413453] [INFO ] [MAIN ] GS: Wiping existing primary data before full refresh. [2025-10-15T19:16:11.413498] [INFO ] [LOCAL ] GS: Starting deletion of primary data. [2025-10-15T19:16:11.414531] [DEBUG] [LOCAL ] GS: Deleted primary data file. [2025-10-15T19:16:11.414588] [INFO ] [MAIN ] GS: Starting full primary refresh. [2025-10-15T19:16:11.764525] [INFO ] [REMOTE ] GS: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:16:12.114017] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-08. [2025-10-15T19:16:12.755427] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-15T19:16:12.914013] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-02. [2025-10-15T19:16:13.391287] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-10-15T19:16:13.713963] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-08. [2025-10-15T19:16:13.927274] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-15T19:16:14.514052] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-03. [2025-10-15T19:16:15.060411] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-10-15T19:16:15.101890] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-15T19:16:15.314000] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-09. [2025-10-15T19:16:16.114039] [INFO ] [REMOTE ] GS: Fetching primary data for 2024-12. [2025-10-15T19:16:16.517814] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-15T19:16:16.914005] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-04. [2025-10-15T19:16:17.471818] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-10-15T19:16:17.719319] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-09. [2025-10-15T19:16:17.732444] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-15T19:16:18.513985] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-10. [2025-10-15T19:16:19.319157] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-01. [2025-10-15T19:16:19.331164] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-15T19:16:19.822844] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-15T19:16:19.827114] [INFO ] [REMOTE ] GRNT: Full fetch complete (48269 records). [2025-10-15T19:16:19.827237] [DEBUG] [VALIDATOR ] GRNT: Validating primary data. [2025-10-15T19:16:20.119142] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-10. [2025-10-15T19:16:20.206840] [DEBUG] [VALIDATOR ] GRNT: All expected trading days are present. [2025-10-15T19:16:20.206939] [DEBUG] [VALIDATOR ] GRNT: Primary data validation passed. [2025-10-15T19:16:20.208011] [INFO ] [MAIN ] GRNT: Fetched primary data is valid. [2025-10-15T19:16:20.208077] [DEBUG] [LOCAL ] GRNT: Saving primary data. [2025-10-15T19:16:20.209176] [DEBUG] [LOCAL ] GRNT: Trimmed 48269 records to 33966 (keeping 200 days of data) [2025-10-15T19:16:20.405976] [DEBUG] [LOCAL ] GRNT: Primary data saved (33966 records). [2025-10-15T19:16:20.406122] [INFO ] [MAIN ] GRNT: Full history saved. [2025-10-15T19:16:20.406462] [INFO ] [MAIN ] Update Progress: 970/2369 symbols completed. GRNT took 33.7s. Estimated remaining: 3h 16m 32s. Rate: 7.1 symbols/min [2025-10-15T19:16:20.572361] [INFO ] [MAIN ] GSBD: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:16:20.612919] [DEBUG] [LOCAL ] GSBD: Loaded 39648 existing records from primary storage. [2025-10-15T19:16:20.613241] [INFO ] [MAIN ] GSBD: Loaded 39648 existing records. [2025-10-15T19:16:20.789477] [WARN ] [MAIN ] GSBD: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:16:20.789708] [INFO ] [MAIN ] GSBD: Wiping existing primary data before full refresh. [2025-10-15T19:16:20.789763] [INFO ] [LOCAL ] GSBD: Starting deletion of primary data. [2025-10-15T19:16:20.790163] [DEBUG] [LOCAL ] GSBD: Deleted primary data file. [2025-10-15T19:16:20.790218] [INFO ] [MAIN ] GSBD: Starting full primary refresh. [2025-10-15T19:16:20.919233] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-05. [2025-10-15T19:16:21.155995] [INFO ] [REMOTE ] GSBD: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:16:21.309317] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-10-15T19:16:21.502093] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-15T19:16:21.512129] [INFO ] [REMOTE ] GRND: Full fetch complete (71557 records). [2025-10-15T19:16:21.512326] [DEBUG] [VALIDATOR ] GRND: Validating primary data. [2025-10-15T19:16:21.642437] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-15T19:16:21.719140] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2024-12. [2025-10-15T19:16:22.054430] [DEBUG] [VALIDATOR ] GRND: All expected trading days are present. [2025-10-15T19:16:22.054559] [DEBUG] [VALIDATOR ] GRND: Primary data validation passed. [2025-10-15T19:16:22.056453] [INFO ] [MAIN ] GRND: Fetched primary data is valid. [2025-10-15T19:16:22.056557] [DEBUG] [LOCAL ] GRND: Saving primary data. [2025-10-15T19:16:22.058832] [DEBUG] [LOCAL ] GRND: Trimmed 71557 records to 50119 (keeping 200 days of data) [2025-10-15T19:16:22.447497] [DEBUG] [LOCAL ] GRND: Primary data saved (50119 records). [2025-10-15T19:16:22.447737] [INFO ] [MAIN ] GRND: Full history saved. [2025-10-15T19:16:22.447867] [INFO ] [MAIN ] Update Progress: 971/2369 symbols completed. GRND took 52.2s. Estimated remaining: 3h 16m 14s. Rate: 7.1 symbols/min [2025-10-15T19:16:22.522736] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-02. [2025-10-15T19:16:22.676328] [INFO ] [MAIN ] GSK: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:16:22.736732] [DEBUG] [LOCAL ] GSK: Loaded 53502 existing records from primary storage. [2025-10-15T19:16:22.737087] [INFO ] [MAIN ] GSK: Loaded 53502 existing records. [2025-10-15T19:16:22.911834] [WARN ] [MAIN ] GSK: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:16:22.912047] [INFO ] [MAIN ] GSK: Wiping existing primary data before full refresh. [2025-10-15T19:16:22.912094] [INFO ] [LOCAL ] GSK: Starting deletion of primary data. [2025-10-15T19:16:22.913205] [DEBUG] [LOCAL ] GSK: Deleted primary data file. [2025-10-15T19:16:22.913264] [INFO ] [MAIN ] GSK: Starting full primary refresh. [2025-10-15T19:16:23.259250] [INFO ] [REMOTE ] GSK: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:16:23.314026] [INFO ] [REMOTE ] GSK: Fetching primary data for 2024-12. [2025-10-15T19:16:23.516738] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-15T19:16:24.113984] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-01. [2025-10-15T19:16:24.260578] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-15T19:16:24.914062] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-03. [2025-10-15T19:16:25.102756] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-15T19:16:25.454801] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-15T19:16:25.714043] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-02. [2025-10-15T19:16:26.513993] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-06. [2025-10-15T19:16:27.108429] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-15T19:16:27.122075] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-15T19:16:27.170301] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-03 (2.26 seconds). [2025-10-15T19:16:27.314065] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-03. [2025-10-15T19:16:28.114110] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-04. [2025-10-15T19:16:28.852306] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-15T19:16:28.913970] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-04. [2025-10-15T19:16:29.714003] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-01. [2025-10-15T19:16:30.515937] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-07. [2025-10-15T19:16:30.544386] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-04 (2.43 seconds). [2025-10-15T19:16:30.558109] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-15T19:16:31.015326] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-10-15T19:16:31.242604] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-15T19:16:31.314013] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-08. [2025-10-15T19:16:31.897033] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-15T19:16:32.113984] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-09. [2025-10-15T19:16:32.682567] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-15T19:16:32.913990] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-02. [2025-10-15T19:16:33.714014] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-05. [2025-10-15T19:16:34.513972] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-10. [2025-10-15T19:16:34.800243] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-10-15T19:16:35.212575] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-15T19:16:35.213810] [INFO ] [REMOTE ] GRX: Full fetch complete (6525 records). [2025-10-15T19:16:35.213880] [DEBUG] [VALIDATOR ] GRX: Validating primary data. [2025-10-15T19:16:35.319129] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-03. [2025-10-15T19:16:35.567339] [DEBUG] [VALIDATOR ] GRX: All expected trading days are present. [2025-10-15T19:16:35.567411] [DEBUG] [VALIDATOR ] GRX: Primary data validation passed. [2025-10-15T19:16:35.567580] [INFO ] [MAIN ] GRX: Fetched primary data is valid. [2025-10-15T19:16:35.567618] [DEBUG] [LOCAL ] GRX: Saving primary data. [2025-10-15T19:16:35.568054] [DEBUG] [LOCAL ] GRX: Trimmed 6525 records to 4797 (keeping 200 days of data) [2025-10-15T19:16:35.596368] [DEBUG] [LOCAL ] GRX: Primary data saved (4797 records). [2025-10-15T19:16:35.596487] [INFO ] [MAIN ] GRX: Full history saved. [2025-10-15T19:16:35.596563] [INFO ] [MAIN ] Update Progress: 972/2369 symbols completed. GRX took 27.9s. Estimated remaining: 3h 16m 13s. Rate: 7.1 symbols/min [2025-10-15T19:16:35.762094] [INFO ] [MAIN ] GSL: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:16:35.792738] [DEBUG] [LOCAL ] GSL: Loaded 33267 existing records from primary storage. [2025-10-15T19:16:35.793019] [INFO ] [MAIN ] GSL: Loaded 33267 existing records. [2025-10-15T19:16:35.968863] [WARN ] [MAIN ] GSL: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:16:35.969138] [INFO ] [MAIN ] GSL: Wiping existing primary data before full refresh. [2025-10-15T19:16:35.969275] [INFO ] [LOCAL ] GSL: Starting deletion of primary data. [2025-10-15T19:16:35.969898] [DEBUG] [LOCAL ] GSL: Deleted primary data file. [2025-10-15T19:16:35.969955] [INFO ] [MAIN ] GSL: Starting full primary refresh. [2025-10-15T19:16:36.116552] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-05. [2025-10-15T19:16:36.324376] [INFO ] [REMOTE ] GSL: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:16:36.353632] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-05 (2.64 seconds). [2025-10-15T19:16:36.913972] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-06. [2025-10-15T19:16:37.341990] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-10-15T19:16:37.375283] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-15T19:16:37.714008] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-06. [2025-10-15T19:16:38.514019] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-04. [2025-10-15T19:16:38.651171] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-15T19:16:38.855866] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-15T19:16:39.313994] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-07. [2025-10-15T19:16:40.113985] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-07. [2025-10-15T19:16:40.455570] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-15T19:16:40.792970] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-15T19:16:40.914085] [INFO ] [REMOTE ] GSL: Fetching primary data for 2024-12. [2025-10-15T19:16:41.714100] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-08. [2025-10-15T19:16:41.904009] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-10-15T19:16:42.134520] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-15T19:16:42.514018] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-08. [2025-10-15T19:16:42.768922] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-15T19:16:43.313996] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-01. [2025-10-15T19:16:44.113970] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-05. [2025-10-15T19:16:44.505803] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-10-15T19:16:44.599268] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-15T19:16:44.914023] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-09. [2025-10-15T19:16:45.713969] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-09. [2025-10-15T19:16:45.848885] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-15T19:16:46.513983] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-02. [2025-10-15T19:16:46.904451] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-10-15T19:16:47.302736] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-15T19:16:47.313941] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-10. [2025-10-15T19:16:47.415293] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-15T19:16:48.114029] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-06. [2025-10-15T19:16:48.740733] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-15T19:16:48.746802] [INFO ] [REMOTE ] GSBD: Full fetch complete (58688 records). [2025-10-15T19:16:48.746937] [DEBUG] [VALIDATOR ] GSBD: Validating primary data. [2025-10-15T19:16:48.938312] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-10. [2025-10-15T19:16:49.175772] [DEBUG] [VALIDATOR ] GSBD: All expected trading days are present. [2025-10-15T19:16:49.175853] [DEBUG] [VALIDATOR ] GSBD: Primary data validation passed. [2025-10-15T19:16:49.176979] [INFO ] [MAIN ] GSBD: Fetched primary data is valid. [2025-10-15T19:16:49.177066] [DEBUG] [LOCAL ] GSBD: Saving primary data. [2025-10-15T19:16:49.178347] [DEBUG] [LOCAL ] GSBD: Trimmed 58688 records to 39619 (keeping 200 days of data) [2025-10-15T19:16:49.443905] [DEBUG] [LOCAL ] GSBD: Primary data saved (39619 records). [2025-10-15T19:16:49.444098] [INFO ] [MAIN ] GSBD: Full history saved. [2025-10-15T19:16:49.444406] [INFO ] [MAIN ] Update Progress: 973/2369 symbols completed. GSBD took 29.0s. Estimated remaining: 3h 16m 12s. Rate: 7.1 symbols/min [2025-10-15T19:16:49.643354] [INFO ] [MAIN ] GTES: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:16:49.691583] [DEBUG] [LOCAL ] GTES: Loaded 50384 existing records from primary storage. [2025-10-15T19:16:49.692084] [INFO ] [MAIN ] GTES: Loaded 50384 existing records. [2025-10-15T19:16:49.735931] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-03. [2025-10-15T19:16:49.791942] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-15T19:16:49.899773] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-15T19:16:49.936599] [INFO ] [REMOTE ] GS: Full fetch complete (75806 records). [2025-10-15T19:16:49.952747] [DEBUG] [VALIDATOR ] GS: Validating primary data. [2025-10-15T19:16:49.977357] [WARN ] [MAIN ] GTES: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:16:50.046167] [INFO ] [MAIN ] GTES: Wiping existing primary data before full refresh. [2025-10-15T19:16:50.059089] [INFO ] [LOCAL ] GTES: Starting deletion of primary data. [2025-10-15T19:16:50.077022] [DEBUG] [LOCAL ] GTES: Deleted primary data file. [2025-10-15T19:16:50.085356] [INFO ] [MAIN ] GTES: Starting full primary refresh. [2025-10-15T19:16:50.521786] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-07. [2025-10-15T19:16:50.731267] [DEBUG] [VALIDATOR ] GS: All expected trading days are present. [2025-10-15T19:16:50.770604] [DEBUG] [VALIDATOR ] GS: Primary data validation passed. [2025-10-15T19:16:50.774572] [INFO ] [REMOTE ] GTES: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:16:50.776022] [INFO ] [MAIN ] GS: Fetched primary data is valid. [2025-10-15T19:16:50.776447] [DEBUG] [LOCAL ] GS: Saving primary data. [2025-10-15T19:16:50.778041] [DEBUG] [LOCAL ] GS: Trimmed 75806 records to 51783 (keeping 200 days of data) [2025-10-15T19:16:51.033151] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-15T19:16:51.137822] [DEBUG] [LOCAL ] GS: Primary data saved (51783 records). [2025-10-15T19:16:51.137948] [INFO ] [MAIN ] GS: Full history saved. [2025-10-15T19:16:51.138025] [INFO ] [MAIN ] Update Progress: 974/2369 symbols completed. GS took 40.1s. Estimated remaining: 3h 15m 54s. Rate: 7.1 symbols/min [2025-10-15T19:16:51.304978] [INFO ] [MAIN ] GTLS: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:16:51.313974] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-04. [2025-10-15T19:16:51.347264] [DEBUG] [LOCAL ] GTLS: Loaded 43298 existing records from primary storage. [2025-10-15T19:16:51.347536] [INFO ] [MAIN ] GTLS: Loaded 43298 existing records. [2025-10-15T19:16:51.522842] [WARN ] [MAIN ] GTLS: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:16:51.523030] [INFO ] [MAIN ] GTLS: Wiping existing primary data before full refresh. [2025-10-15T19:16:51.523078] [INFO ] [LOCAL ] GTLS: Starting deletion of primary data. [2025-10-15T19:16:51.523355] [DEBUG] [LOCAL ] GTLS: Deleted primary data file. [2025-10-15T19:16:51.523395] [INFO ] [MAIN ] GTLS: Starting full primary refresh. [2025-10-15T19:16:51.875223] [INFO ] [REMOTE ] GTLS: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:16:52.113964] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2024-12. [2025-10-15T19:16:52.545334] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-15T19:16:52.595343] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-15T19:16:52.913999] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-08. [2025-10-15T19:16:53.330599] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-15T19:16:53.714051] [INFO ] [REMOTE ] GTES: Fetching primary data for 2024-12. [2025-10-15T19:16:54.513980] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-05. [2025-10-15T19:16:54.782455] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-15T19:16:55.282891] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-15T19:16:55.313953] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-09. [2025-10-15T19:16:55.952559] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-15T19:16:56.113980] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-01. [2025-10-15T19:16:56.885295] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-15T19:16:56.913969] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-06. [2025-10-15T19:16:57.622562] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-15T19:16:57.713953] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-02. [2025-10-15T19:16:57.837243] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-15T19:16:58.513984] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-01. [2025-10-15T19:16:59.264224] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-15T19:16:59.313958] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-03. [2025-10-15T19:16:59.938576] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-15T19:17:00.113997] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-10. [2025-10-15T19:17:00.914018] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-02. [2025-10-15T19:17:01.473670] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-03 (2.16 seconds). [2025-10-15T19:17:01.713982] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-04. [2025-10-15T19:17:01.774071] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-15T19:17:01.781220] [INFO ] [REMOTE ] GSK: Full fetch complete (77635 records). [2025-10-15T19:17:01.781428] [DEBUG] [VALIDATOR ] GSK: Validating primary data. [2025-10-15T19:17:02.202635] [DEBUG] [VALIDATOR ] GSK: All expected trading days are present. [2025-10-15T19:17:02.202874] [DEBUG] [VALIDATOR ] GSK: Primary data validation passed. [2025-10-15T19:17:02.204753] [INFO ] [MAIN ] GSK: Fetched primary data is valid. [2025-10-15T19:17:02.204831] [DEBUG] [LOCAL ] GSK: Saving primary data. [2025-10-15T19:17:02.207106] [DEBUG] [LOCAL ] GSK: Trimmed 77635 records to 53505 (keeping 200 days of data) [2025-10-15T19:17:02.485971] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-15T19:17:02.514110] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-03. [2025-10-15T19:17:02.618182] [DEBUG] [LOCAL ] GSK: Primary data saved (53505 records). [2025-10-15T19:17:02.618430] [INFO ] [MAIN ] GSK: Full history saved. [2025-10-15T19:17:02.618592] [INFO ] [MAIN ] Update Progress: 975/2369 symbols completed. GSK took 40.2s. Estimated remaining: 3h 15m 50s. Rate: 7.1 symbols/min [2025-10-15T19:17:02.821021] [INFO ] [MAIN ] GTN: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:17:02.869034] [DEBUG] [LOCAL ] GTN: Loaded 45235 existing records from primary storage. [2025-10-15T19:17:02.869463] [INFO ] [MAIN ] GTN: Loaded 45235 existing records. [2025-10-15T19:17:03.060304] [WARN ] [MAIN ] GTN: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:17:03.060590] [INFO ] [MAIN ] GTN: Wiping existing primary data before full refresh. [2025-10-15T19:17:03.060666] [INFO ] [LOCAL ] GTN: Starting deletion of primary data. [2025-10-15T19:17:03.061906] [DEBUG] [LOCAL ] GTN: Deleted primary data file. [2025-10-15T19:17:03.061964] [INFO ] [MAIN ] GTN: Starting full primary refresh. [2025-10-15T19:17:03.320325] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-07. [2025-10-15T19:17:03.463540] [INFO ] [REMOTE ] GTN: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:17:03.494123] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-15T19:17:04.079055] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-15T19:17:04.113961] [INFO ] [REMOTE ] GTN: Fetching primary data for 2024-12. [2025-10-15T19:17:04.759739] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-15T19:17:04.913981] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-05. [2025-10-15T19:17:05.713982] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-08. [2025-10-15T19:17:05.776928] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-15T19:17:06.513971] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-01. [2025-10-15T19:17:06.593540] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-15T19:17:07.204113] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-15T19:17:07.313973] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-09. [2025-10-15T19:17:07.959900] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-15T19:17:08.113984] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-04. [2025-10-15T19:17:08.719408] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-15T19:17:08.914021] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-02. [2025-10-15T19:17:09.714075] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-06. [2025-10-15T19:17:09.794534] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-15T19:17:10.500338] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-15T19:17:10.513938] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-03. [2025-10-15T19:17:11.314027] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-05. [2025-10-15T19:17:11.394284] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-15T19:17:12.113994] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-10. [2025-10-15T19:17:12.226468] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-15T19:17:12.392469] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-15T19:17:12.914020] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-04. [2025-10-15T19:17:13.436043] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-15T19:17:13.440159] [INFO ] [REMOTE ] GSL: Full fetch complete (48264 records). [2025-10-15T19:17:13.440248] [DEBUG] [VALIDATOR ] GSL: Validating primary data. [2025-10-15T19:17:13.722813] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-07. [2025-10-15T19:17:13.816083] [DEBUG] [VALIDATOR ] GSL: All expected trading days are present. [2025-10-15T19:17:13.816177] [DEBUG] [VALIDATOR ] GSL: Primary data validation passed. [2025-10-15T19:17:13.816956] [INFO ] [MAIN ] GSL: Fetched primary data is valid. [2025-10-15T19:17:13.817017] [DEBUG] [LOCAL ] GSL: Saving primary data. [2025-10-15T19:17:13.818185] [DEBUG] [LOCAL ] GSL: Trimmed 48264 records to 33284 (keeping 200 days of data) [2025-10-15T19:17:14.034624] [DEBUG] [LOCAL ] GSL: Primary data saved (33284 records). [2025-10-15T19:17:14.034799] [INFO ] [MAIN ] GSL: Full history saved. [2025-10-15T19:17:14.034887] [INFO ] [MAIN ] Update Progress: 976/2369 symbols completed. GSL took 38.4s. Estimated remaining: 3h 15m 46s. Rate: 7.1 symbols/min [2025-10-15T19:17:14.241494] [INFO ] [MAIN ] GTY: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:17:14.279873] [DEBUG] [LOCAL ] GTY: Loaded 30186 existing records from primary storage. [2025-10-15T19:17:14.280256] [INFO ] [MAIN ] GTY: Loaded 30186 existing records. [2025-10-15T19:17:14.508745] [WARN ] [MAIN ] GTY: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:17:14.509041] [INFO ] [MAIN ] GTY: Wiping existing primary data before full refresh. [2025-10-15T19:17:14.509320] [INFO ] [LOCAL ] GTY: Starting deletion of primary data. [2025-10-15T19:17:14.509549] [DEBUG] [LOCAL ] GTY: Deleted primary data file. [2025-10-15T19:17:14.509606] [INFO ] [MAIN ] GTY: Starting full primary refresh. [2025-10-15T19:17:14.521920] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-06. [2025-10-15T19:17:14.871185] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-15T19:17:15.059792] [INFO ] [REMOTE ] GTY: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:17:15.319082] [INFO ] [REMOTE ] GTY: Fetching primary data for 2024-12. [2025-10-15T19:17:15.347821] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-15T19:17:16.113978] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-08. [2025-10-15T19:17:16.253327] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-15T19:17:16.470723] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-15T19:17:16.914044] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-07. [2025-10-15T19:17:17.438662] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-15T19:17:17.714008] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-09. [2025-10-15T19:17:18.520524] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-01. [2025-10-15T19:17:18.537267] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-15T19:17:19.155633] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-15T19:17:19.313993] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-08. [2025-10-15T19:17:19.781955] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-15T19:17:20.113999] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-10. [2025-10-15T19:17:20.913962] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-05. [2025-10-15T19:17:21.039301] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-15T19:17:21.470675] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-15T19:17:21.476753] [INFO ] [REMOTE ] GTES: Full fetch complete (73905 records). [2025-10-15T19:17:21.476872] [DEBUG] [VALIDATOR ] GTES: Validating primary data. [2025-10-15T19:17:21.727108] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-02. [2025-10-15T19:17:21.858919] [DEBUG] [VALIDATOR ] GTES: All expected trading days are present. [2025-10-15T19:17:21.858998] [DEBUG] [VALIDATOR ] GTES: Primary data validation passed. [2025-10-15T19:17:21.859984] [INFO ] [MAIN ] GTES: Fetched primary data is valid. [2025-10-15T19:17:21.860047] [DEBUG] [LOCAL ] GTES: Saving primary data. [2025-10-15T19:17:21.861389] [DEBUG] [LOCAL ] GTES: Trimmed 73905 records to 50380 (keeping 200 days of data) [2025-10-15T19:17:22.177825] [DEBUG] [LOCAL ] GTES: Primary data saved (50380 records). [2025-10-15T19:17:22.178032] [INFO ] [MAIN ] GTES: Full history saved. [2025-10-15T19:17:22.178444] [INFO ] [MAIN ] Update Progress: 977/2369 symbols completed. GTES took 32.7s. Estimated remaining: 3h 15m 37s. Rate: 7.1 symbols/min [2025-10-15T19:17:22.359108] [INFO ] [MAIN ] GUG: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:17:22.373975] [DEBUG] [LOCAL ] GUG: Loaded 12212 existing records from primary storage. [2025-10-15T19:17:22.374228] [INFO ] [MAIN ] GUG: Loaded 12212 existing records. [2025-10-15T19:17:22.519691] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-09. [2025-10-15T19:17:22.565623] [WARN ] [MAIN ] GUG: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:17:22.565883] [INFO ] [MAIN ] GUG: Wiping existing primary data before full refresh. [2025-10-15T19:17:22.565933] [INFO ] [LOCAL ] GUG: Starting deletion of primary data. [2025-10-15T19:17:22.566107] [DEBUG] [LOCAL ] GUG: Deleted primary data file. [2025-10-15T19:17:22.566162] [INFO ] [MAIN ] GUG: Starting full primary refresh. [2025-10-15T19:17:22.752067] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-15T19:17:22.995691] [INFO ] [REMOTE ] GUG: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:17:23.010964] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-15T19:17:23.314080] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-06. [2025-10-15T19:17:23.959000] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-15T19:17:24.114045] [INFO ] [REMOTE ] GUG: Fetching primary data for 2024-12. [2025-10-15T19:17:24.919111] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-10. [2025-10-15T19:17:24.934155] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-15T19:17:25.088330] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-10-15T19:17:25.714074] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-07. [2025-10-15T19:17:26.492351] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-15T19:17:26.497527] [INFO ] [REMOTE ] GTLS: Full fetch complete (61577 records). [2025-10-15T19:17:26.497630] [DEBUG] [VALIDATOR ] GTLS: Validating primary data. [2025-10-15T19:17:26.522484] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-03. [2025-10-15T19:17:26.911749] [DEBUG] [VALIDATOR ] GTLS: All expected trading days are present. [2025-10-15T19:17:26.911841] [DEBUG] [VALIDATOR ] GTLS: Primary data validation passed. [2025-10-15T19:17:26.912905] [INFO ] [MAIN ] GTLS: Fetched primary data is valid. [2025-10-15T19:17:26.912970] [DEBUG] [LOCAL ] GTLS: Saving primary data. [2025-10-15T19:17:26.914429] [DEBUG] [LOCAL ] GTLS: Trimmed 61577 records to 43272 (keeping 200 days of data) [2025-10-15T19:17:27.192757] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-15T19:17:27.247840] [DEBUG] [LOCAL ] GTLS: Primary data saved (43272 records). [2025-10-15T19:17:27.247989] [INFO ] [MAIN ] GTLS: Full history saved. [2025-10-15T19:17:27.248084] [INFO ] [MAIN ] Update Progress: 978/2369 symbols completed. GTLS took 36.1s. Estimated remaining: 3h 15m 24s. Rate: 7.1 symbols/min [2025-10-15T19:17:27.319936] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-01. [2025-10-15T19:17:27.447550] [INFO ] [MAIN ] GUT: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:17:27.465210] [DEBUG] [LOCAL ] GUT: Loaded 15591 existing records from primary storage. [2025-10-15T19:17:27.465538] [INFO ] [MAIN ] GUT: Loaded 15591 existing records. [2025-10-15T19:17:27.663985] [WARN ] [MAIN ] GUT: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:17:27.664315] [INFO ] [MAIN ] GUT: Wiping existing primary data before full refresh. [2025-10-15T19:17:27.664366] [INFO ] [LOCAL ] GUT: Starting deletion of primary data. [2025-10-15T19:17:27.665106] [DEBUG] [LOCAL ] GUT: Deleted primary data file. [2025-10-15T19:17:27.665165] [INFO ] [MAIN ] GUT: Starting full primary refresh. [2025-10-15T19:17:28.098322] [INFO ] [REMOTE ] GUT: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:17:28.115160] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-08. [2025-10-15T19:17:28.134125] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-15T19:17:28.134962] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-15T19:17:28.913997] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-04. [2025-10-15T19:17:29.480628] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-15T19:17:29.713996] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-09. [2025-10-15T19:17:30.382587] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-15T19:17:30.513992] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-05. [2025-10-15T19:17:30.895215] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-15T19:17:31.314002] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-02. [2025-10-15T19:17:31.848301] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-15T19:17:32.076072] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-15T19:17:32.113968] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-03. [2025-10-15T19:17:32.752824] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-15T19:17:32.913994] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-06. [2025-10-15T19:17:33.714001] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-04. [2025-10-15T19:17:34.079979] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-15T19:17:34.230196] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-10-15T19:17:34.514055] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-07. [2025-10-15T19:17:35.314049] [INFO ] [REMOTE ] GUT: Fetching primary data for 2024-12. [2025-10-15T19:17:35.960718] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-15T19:17:36.114035] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-05. [2025-10-15T19:17:36.301843] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-10-15T19:17:36.714198] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-15T19:17:36.914051] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-08. [2025-10-15T19:17:37.713977] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-06. [2025-10-15T19:17:37.985472] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-15T19:17:38.514042] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-01. [2025-10-15T19:17:38.592359] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-15T19:17:39.313979] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-10. [2025-10-15T19:17:39.340774] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-15T19:17:40.114013] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-09. [2025-10-15T19:17:40.818736] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-15T19:17:40.824105] [INFO ] [REMOTE ] GTN: Full fetch complete (66210 records). [2025-10-15T19:17:40.824229] [DEBUG] [VALIDATOR ] GTN: Validating primary data. [2025-10-15T19:17:40.920206] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-02. [2025-10-15T19:17:41.218232] [DEBUG] [VALIDATOR ] GTN: All expected trading days are present. [2025-10-15T19:17:41.218314] [DEBUG] [VALIDATOR ] GTN: Primary data validation passed. [2025-10-15T19:17:41.219343] [INFO ] [MAIN ] GTN: Fetched primary data is valid. [2025-10-15T19:17:41.219407] [DEBUG] [LOCAL ] GTN: Saving primary data. [2025-10-15T19:17:41.220695] [DEBUG] [LOCAL ] GTN: Trimmed 66210 records to 45215 (keeping 200 days of data) [2025-10-15T19:17:41.437353] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-15T19:17:41.503127] [DEBUG] [LOCAL ] GTN: Primary data saved (45215 records). [2025-10-15T19:17:41.503256] [INFO ] [MAIN ] GTN: Full history saved. [2025-10-15T19:17:41.503337] [INFO ] [MAIN ] Update Progress: 979/2369 symbols completed. GTN took 38.9s. Estimated remaining: 3h 15m 23s. Rate: 7.1 symbols/min [2025-10-15T19:17:41.672721] [INFO ] [MAIN ] GVA: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:17:41.706060] [DEBUG] [LOCAL ] GVA: Loaded 32725 existing records from primary storage. [2025-10-15T19:17:41.706320] [INFO ] [MAIN ] GVA: Loaded 32725 existing records. [2025-10-15T19:17:41.719117] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-10. [2025-10-15T19:17:41.897185] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-15T19:17:41.901047] [WARN ] [MAIN ] GVA: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:17:41.905337] [INFO ] [MAIN ] GVA: Wiping existing primary data before full refresh. [2025-10-15T19:17:41.905410] [INFO ] [LOCAL ] GVA: Starting deletion of primary data. [2025-10-15T19:17:41.905698] [DEBUG] [LOCAL ] GVA: Deleted primary data file. [2025-10-15T19:17:41.905755] [INFO ] [MAIN ] GVA: Starting full primary refresh. [2025-10-15T19:17:42.257006] [INFO ] [REMOTE ] GVA: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:17:42.513993] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-03. [2025-10-15T19:17:43.105428] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-15T19:17:43.109713] [INFO ] [REMOTE ] GTY: Full fetch complete (43926 records). [2025-10-15T19:17:43.109811] [DEBUG] [VALIDATOR ] GTY: Validating primary data. [2025-10-15T19:17:43.319059] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-07. [2025-10-15T19:17:43.463015] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-15T19:17:43.527468] [DEBUG] [VALIDATOR ] GTY: All expected trading days are present. [2025-10-15T19:17:43.527546] [DEBUG] [VALIDATOR ] GTY: Primary data validation passed. [2025-10-15T19:17:43.528365] [INFO ] [MAIN ] GTY: Fetched primary data is valid. [2025-10-15T19:17:43.528427] [DEBUG] [LOCAL ] GTY: Saving primary data. [2025-10-15T19:17:43.529408] [DEBUG] [LOCAL ] GTY: Trimmed 43926 records to 30274 (keeping 200 days of data) [2025-10-15T19:17:43.710110] [DEBUG] [LOCAL ] GTY: Primary data saved (30274 records). [2025-10-15T19:17:43.710247] [INFO ] [MAIN ] GTY: Full history saved. [2025-10-15T19:17:43.710329] [INFO ] [MAIN ] Update Progress: 980/2369 symbols completed. GTY took 29.7s. Estimated remaining: 3h 15m 6s. Rate: 7.1 symbols/min [2025-10-15T19:17:43.875931] [INFO ] [MAIN ] GWH: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:17:43.894330] [DEBUG] [LOCAL ] GWH: Loaded 18271 existing records from primary storage. [2025-10-15T19:17:43.894566] [INFO ] [MAIN ] GWH: Loaded 18271 existing records. [2025-10-15T19:17:44.074760] [WARN ] [MAIN ] GWH: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:17:44.074962] [INFO ] [MAIN ] GWH: Wiping existing primary data before full refresh. [2025-10-15T19:17:44.075008] [INFO ] [LOCAL ] GWH: Starting deletion of primary data. [2025-10-15T19:17:44.075212] [DEBUG] [LOCAL ] GWH: Deleted primary data file. [2025-10-15T19:17:44.075268] [INFO ] [MAIN ] GWH: Starting full primary refresh. [2025-10-15T19:17:44.117685] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-04. [2025-10-15T19:17:44.378250] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-15T19:17:44.462168] [INFO ] [REMOTE ] GWH: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:17:44.915948] [INFO ] [REMOTE ] GVA: Fetching primary data for 2024-12. [2025-10-15T19:17:44.919534] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-15T19:17:45.713988] [INFO ] [REMOTE ] GWH: Fetching primary data for 2024-12. [2025-10-15T19:17:46.249531] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-15T19:17:46.275814] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2024-12 (0.56 seconds). [2025-10-15T19:17:46.513986] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-08. [2025-10-15T19:17:47.314037] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-01. [2025-10-15T19:17:47.365411] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-15T19:17:48.088028] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-15T19:17:48.113948] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-09. [2025-10-15T19:17:48.915410] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-02. [2025-10-15T19:17:48.918018] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-15T19:17:49.713985] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-01. [2025-10-15T19:17:49.724620] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-15T19:17:50.513986] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-05. [2025-10-15T19:17:51.063386] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-15T19:17:51.111172] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-15T19:17:51.314008] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-06. [2025-10-15T19:17:52.113995] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-02. [2025-10-15T19:17:52.333211] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-15T19:17:52.914030] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-03. [2025-10-15T19:17:53.387524] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-15T19:17:53.629024] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-15T19:17:53.713987] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-03. [2025-10-15T19:17:54.513992] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-10. [2025-10-15T19:17:55.224371] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-15T19:17:55.276750] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-15T19:17:55.278865] [INFO ] [REMOTE ] GUG: Full fetch complete (19185 records). [2025-10-15T19:17:55.278937] [DEBUG] [VALIDATOR ] GUG: Validating primary data. [2025-10-15T19:17:55.319156] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-07. [2025-10-15T19:17:55.717536] [DEBUG] [VALIDATOR ] GUG: All expected trading days are present. [2025-10-15T19:17:55.717615] [DEBUG] [VALIDATOR ] GUG: Primary data validation passed. [2025-10-15T19:17:55.718200] [INFO ] [MAIN ] GUG: Fetched primary data is valid. [2025-10-15T19:17:55.718264] [DEBUG] [LOCAL ] GUG: Saving primary data. [2025-10-15T19:17:55.719081] [DEBUG] [LOCAL ] GUG: Trimmed 19185 records to 12167 (keeping 200 days of data) [2025-10-15T19:17:55.802353] [DEBUG] [LOCAL ] GUG: Primary data saved (12167 records). [2025-10-15T19:17:55.802487] [INFO ] [MAIN ] GUG: Full history saved. [2025-10-15T19:17:55.802568] [INFO ] [MAIN ] Update Progress: 981/2369 symbols completed. GUG took 33.6s. Estimated remaining: 3h 15m 3s. Rate: 7.1 symbols/min [2025-10-15T19:17:55.969371] [INFO ] [MAIN ] GWRE: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:17:56.009083] [DEBUG] [LOCAL ] GWRE: Loaded 39976 existing records from primary storage. [2025-10-15T19:17:56.009410] [INFO ] [MAIN ] GWRE: Loaded 39976 existing records. [2025-10-15T19:17:56.119122] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-04. [2025-10-15T19:17:56.189946] [WARN ] [MAIN ] GWRE: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:17:56.190511] [INFO ] [MAIN ] GWRE: Wiping existing primary data before full refresh. [2025-10-15T19:17:56.190593] [INFO ] [LOCAL ] GWRE: Starting deletion of primary data. [2025-10-15T19:17:56.190880] [DEBUG] [LOCAL ] GWRE: Deleted primary data file. [2025-10-15T19:17:56.190937] [INFO ] [MAIN ] GWRE: Starting full primary refresh. [2025-10-15T19:17:56.508261] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-15T19:17:56.583297] [INFO ] [REMOTE ] GWRE: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:17:56.918754] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-04. [2025-10-15T19:17:56.921896] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-15T19:17:57.714012] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-05. [2025-10-15T19:17:58.449304] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-15T19:17:58.513985] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-05. [2025-10-15T19:17:58.710436] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-15T19:17:59.313996] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-06. [2025-10-15T19:17:59.726046] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-15T19:18:00.114024] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-08. [2025-10-15T19:18:00.380437] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-15T19:18:00.913962] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-07. [2025-10-15T19:18:01.244312] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-15T19:18:01.714004] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-09. [2025-10-15T19:18:02.257283] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-15T19:18:02.513970] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2024-12. [2025-10-15T19:18:02.640631] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-15T19:18:03.314006] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-06. [2025-10-15T19:18:04.113988] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-08. [2025-10-15T19:18:04.258574] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-15T19:18:04.584580] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-15T19:18:04.791931] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-15T19:18:04.913994] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-07. [2025-10-15T19:18:05.713975] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-01. [2025-10-15T19:18:06.222999] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-15T19:18:06.514011] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-08. [2025-10-15T19:18:07.177400] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-15T19:18:07.314066] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-10. [2025-10-15T19:18:07.837407] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-15T19:18:08.032013] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-15T19:18:08.035922] [INFO ] [REMOTE ] GUT: Full fetch complete (22605 records). [2025-10-15T19:18:08.036127] [DEBUG] [VALIDATOR ] GUT: Validating primary data. [2025-10-15T19:18:08.119264] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-02. [2025-10-15T19:18:08.475938] [DEBUG] [VALIDATOR ] GUT: All expected trading days are present. [2025-10-15T19:18:08.476032] [DEBUG] [VALIDATOR ] GUT: Primary data validation passed. [2025-10-15T19:18:08.476504] [INFO ] [MAIN ] GUT: Fetched primary data is valid. [2025-10-15T19:18:08.476545] [DEBUG] [LOCAL ] GUT: Saving primary data. [2025-10-15T19:18:08.477347] [DEBUG] [LOCAL ] GUT: Trimmed 22605 records to 15593 (keeping 200 days of data) [2025-10-15T19:18:08.569694] [DEBUG] [LOCAL ] GUT: Primary data saved (15593 records). [2025-10-15T19:18:08.569850] [INFO ] [MAIN ] GUT: Full history saved. [2025-10-15T19:18:08.569937] [INFO ] [MAIN ] Update Progress: 982/2369 symbols completed. GUT took 41.3s. Estimated remaining: 3h 15m 1s. Rate: 7.1 symbols/min [2025-10-15T19:18:08.750391] [INFO ] [MAIN ] GWW: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:18:08.770608] [DEBUG] [LOCAL ] GWW: Loaded 19603 existing records from primary storage. [2025-10-15T19:18:08.770878] [INFO ] [MAIN ] GWW: Loaded 19603 existing records. [2025-10-15T19:18:08.922693] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-09. [2025-10-15T19:18:08.947415] [WARN ] [MAIN ] GWW: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:18:08.947915] [INFO ] [MAIN ] GWW: Wiping existing primary data before full refresh. [2025-10-15T19:18:08.947969] [INFO ] [LOCAL ] GWW: Starting deletion of primary data. [2025-10-15T19:18:08.948248] [DEBUG] [LOCAL ] GWW: Deleted primary data file. [2025-10-15T19:18:08.948303] [INFO ] [MAIN ] GWW: Starting full primary refresh. [2025-10-15T19:18:09.291010] [INFO ] [REMOTE ] GWW: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:18:09.713992] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-09. [2025-10-15T19:18:09.775290] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-15T19:18:10.072756] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-15T19:18:10.513983] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-10. [2025-10-15T19:18:10.673582] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-15T19:18:11.314046] [INFO ] [REMOTE ] GWW: Fetching primary data for 2024-12. [2025-10-15T19:18:12.098394] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-15T19:18:12.103146] [INFO ] [REMOTE ] GWH: Full fetch complete (23302 records). [2025-10-15T19:18:12.103239] [DEBUG] [VALIDATOR ] GWH: Validating primary data. [2025-10-15T19:18:12.124275] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-10. [2025-10-15T19:18:12.488391] [DEBUG] [VALIDATOR ] GWH: All expected trading days are present. [2025-10-15T19:18:12.488554] [DEBUG] [VALIDATOR ] GWH: Primary data validation passed. [2025-10-15T19:18:12.489190] [INFO ] [MAIN ] GWH: Fetched primary data is valid. [2025-10-15T19:18:12.489296] [DEBUG] [LOCAL ] GWH: Saving primary data. [2025-10-15T19:18:12.502190] [DEBUG] [LOCAL ] GWH: Trimmed 23302 records to 18636 (keeping 200 days of data) [2025-10-15T19:18:12.502075] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-15T19:18:12.617511] [DEBUG] [LOCAL ] GWH: Primary data saved (18636 records). [2025-10-15T19:18:12.617675] [INFO ] [MAIN ] GWH: Full history saved. [2025-10-15T19:18:12.617795] [INFO ] [MAIN ] Update Progress: 983/2369 symbols completed. GWH took 28.9s. Estimated remaining: 3h 14m 46s. Rate: 7.1 symbols/min [2025-10-15T19:18:12.783315] [INFO ] [MAIN ] GXO: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:18:12.828632] [DEBUG] [LOCAL ] GXO: Loaded 46833 existing records from primary storage. [2025-10-15T19:18:12.828964] [INFO ] [MAIN ] GXO: Loaded 46833 existing records. [2025-10-15T19:18:12.919126] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-01. [2025-10-15T19:18:13.007754] [WARN ] [MAIN ] GXO: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:18:13.007968] [INFO ] [MAIN ] GXO: Wiping existing primary data before full refresh. [2025-10-15T19:18:13.008016] [INFO ] [LOCAL ] GXO: Starting deletion of primary data. [2025-10-15T19:18:13.008444] [DEBUG] [LOCAL ] GXO: Deleted primary data file. [2025-10-15T19:18:13.008500] [INFO ] [MAIN ] GXO: Starting full primary refresh. [2025-10-15T19:18:13.359974] [INFO ] [REMOTE ] GXO: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:18:13.570225] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-15T19:18:13.574779] [INFO ] [REMOTE ] GVA: Full fetch complete (48468 records). [2025-10-15T19:18:13.574950] [DEBUG] [VALIDATOR ] GVA: Validating primary data. [2025-10-15T19:18:13.719167] [INFO ] [REMOTE ] GXO: Fetching primary data for 2024-12. [2025-10-15T19:18:13.957741] [DEBUG] [VALIDATOR ] GVA: All expected trading days are present. [2025-10-15T19:18:13.957823] [DEBUG] [VALIDATOR ] GVA: Primary data validation passed. [2025-10-15T19:18:13.958612] [INFO ] [MAIN ] GVA: Fetched primary data is valid. [2025-10-15T19:18:13.958699] [DEBUG] [LOCAL ] GVA: Saving primary data. [2025-10-15T19:18:13.959712] [DEBUG] [LOCAL ] GVA: Trimmed 48468 records to 32702 (keeping 200 days of data) [2025-10-15T19:18:14.190174] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-15T19:18:14.208301] [DEBUG] [LOCAL ] GVA: Primary data saved (32702 records). [2025-10-15T19:18:14.208441] [INFO ] [MAIN ] GVA: Full history saved. [2025-10-15T19:18:14.208522] [INFO ] [MAIN ] Update Progress: 984/2369 symbols completed. GVA took 32.7s. Estimated remaining: 3h 14m 28s. Rate: 7.1 symbols/min [2025-10-15T19:18:14.379509] [INFO ] [MAIN ] GYLD: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:18:14.383253] [DEBUG] [LOCAL ] GYLD: Loaded 1542 existing records from primary storage. [2025-10-15T19:18:14.383386] [INFO ] [MAIN ] GYLD: Loaded 1542 existing records. [2025-10-15T19:18:14.521730] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-02. [2025-10-15T19:18:14.562401] [WARN ] [MAIN ] GYLD: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:18:14.562601] [INFO ] [MAIN ] GYLD: Wiping existing primary data before full refresh. [2025-10-15T19:18:14.562672] [INFO ] [LOCAL ] GYLD: Starting deletion of primary data. [2025-10-15T19:18:14.562819] [DEBUG] [LOCAL ] GYLD: Deleted primary data file. [2025-10-15T19:18:14.562857] [INFO ] [MAIN ] GYLD: Starting full primary refresh. [2025-10-15T19:18:14.903349] [INFO ] [REMOTE ] GYLD: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:18:15.319226] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2024-12. [2025-10-15T19:18:15.325293] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-15T19:18:15.617593] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-15T19:18:15.616216] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2024-12 (0.30 seconds). [2025-10-15T19:18:16.114020] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-03. [2025-10-15T19:18:16.914012] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-03. [2025-10-15T19:18:17.713987] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-01. [2025-10-15T19:18:17.814265] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-15T19:18:18.156897] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-15T19:18:18.513983] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-04. [2025-10-15T19:18:19.314026] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-04. [2025-10-15T19:18:19.365427] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-15T19:18:19.682879] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-15T19:18:20.114014] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-05. [2025-10-15T19:18:20.594744] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-15T19:18:20.914020] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-02. [2025-10-15T19:18:21.578753] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-15T19:18:21.714064] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-05. [2025-10-15T19:18:22.513986] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-06. [2025-10-15T19:18:22.564267] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-15T19:18:22.702701] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-15T19:18:23.313994] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-06. [2025-10-15T19:18:24.127327] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-01. [2025-10-15T19:18:24.129736] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-15T19:18:24.306214] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-15T19:18:24.485214] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-01 (0.36 seconds). [2025-10-15T19:18:24.914003] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-02. [2025-10-15T19:18:25.256195] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-10-15T19:18:25.713992] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-07. [2025-10-15T19:18:26.513995] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-03. [2025-10-15T19:18:26.688271] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-15T19:18:27.313993] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-03. [2025-10-15T19:18:27.606568] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-03 (0.29 seconds). [2025-10-15T19:18:28.067228] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-15T19:18:28.113981] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-04. [2025-10-15T19:18:28.914059] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-07. [2025-10-15T19:18:29.714028] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-04. [2025-10-15T19:18:29.803794] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-15T19:18:30.197766] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-10-15T19:18:30.230402] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-15T19:18:30.514003] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-08. [2025-10-15T19:18:31.313965] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-05. [2025-10-15T19:18:31.666442] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-10-15T19:18:31.690005] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-15T19:18:32.114075] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-09. [2025-10-15T19:18:32.913970] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-06. [2025-10-15T19:18:33.355561] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-10-15T19:18:33.410600] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-15T19:18:33.713979] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-07. [2025-10-15T19:18:34.163428] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-10-15T19:18:34.514038] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-05. [2025-10-15T19:18:35.314062] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-08. [2025-10-15T19:18:36.121461] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-08. [2025-10-15T19:18:36.127109] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-15T19:18:36.573367] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-15T19:18:36.729999] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-15T19:18:36.913998] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-09. [2025-10-15T19:18:37.713999] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-10. [2025-10-15T19:18:38.412985] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-15T19:18:38.513961] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-10. [2025-10-15T19:18:38.844384] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-15T19:18:38.847080] [INFO ] [REMOTE ] GWW: Full fetch complete (29153 records). [2025-10-15T19:18:38.847155] [DEBUG] [VALIDATOR ] GWW: Validating primary data. [2025-10-15T19:18:39.209211] [DEBUG] [VALIDATOR ] GWW: All expected trading days are present. [2025-10-15T19:18:39.209283] [DEBUG] [VALIDATOR ] GWW: Primary data validation passed. [2025-10-15T19:18:39.209826] [INFO ] [MAIN ] GWW: Fetched primary data is valid. [2025-10-15T19:18:39.209886] [DEBUG] [LOCAL ] GWW: Saving primary data. [2025-10-15T19:18:39.210529] [DEBUG] [LOCAL ] GWW: Trimmed 29153 records to 19562 (keeping 200 days of data) [2025-10-15T19:18:39.317231] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-06. [2025-10-15T19:18:39.334261] [DEBUG] [LOCAL ] GWW: Primary data saved (19562 records). [2025-10-15T19:18:39.334366] [INFO ] [MAIN ] GWW: Full history saved. [2025-10-15T19:18:39.334440] [INFO ] [MAIN ] Update Progress: 985/2369 symbols completed. GWW took 30.8s. Estimated remaining: 3h 14m 43s. Rate: 7.1 symbols/min [2025-10-15T19:18:39.499980] [INFO ] [MAIN ] H: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:18:39.543168] [DEBUG] [LOCAL ] H: Loaded 44431 existing records from primary storage. [2025-10-15T19:18:39.543468] [INFO ] [MAIN ] H: Loaded 44431 existing records. [2025-10-15T19:18:39.720198] [WARN ] [MAIN ] H: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:18:39.720488] [INFO ] [MAIN ] H: Wiping existing primary data before full refresh. [2025-10-15T19:18:39.720562] [INFO ] [LOCAL ] H: Starting deletion of primary data. [2025-10-15T19:18:39.721045] [DEBUG] [LOCAL ] H: Deleted primary data file. [2025-10-15T19:18:39.721105] [INFO ] [MAIN ] H: Starting full primary refresh. [2025-10-15T19:18:39.909535] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-15T19:18:39.994112] [INFO ] [REMOTE ] GWRE: Full fetch complete (60450 records). [2025-10-15T19:18:40.017249] [DEBUG] [VALIDATOR ] GWRE: Validating primary data. [2025-10-15T19:18:40.126738] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-09. [2025-10-15T19:18:40.199985] [INFO ] [REMOTE ] H: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:18:40.499115] [DEBUG] [VALIDATOR ] GWRE: All expected trading days are present. [2025-10-15T19:18:40.499194] [DEBUG] [VALIDATOR ] GWRE: Primary data validation passed. [2025-10-15T19:18:40.500053] [INFO ] [MAIN ] GWRE: Fetched primary data is valid. [2025-10-15T19:18:40.500116] [DEBUG] [LOCAL ] GWRE: Saving primary data. [2025-10-15T19:18:40.501299] [DEBUG] [LOCAL ] GWRE: Trimmed 60450 records to 39928 (keeping 200 days of data) [2025-10-15T19:18:40.709014] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-15T19:18:40.745146] [DEBUG] [LOCAL ] GWRE: Primary data saved (39928 records). [2025-10-15T19:18:40.745263] [INFO ] [MAIN ] GWRE: Full history saved. [2025-10-15T19:18:40.745485] [INFO ] [MAIN ] Update Progress: 986/2369 symbols completed. GWRE took 44.9s. Estimated remaining: 3h 14m 25s. Rate: 7.1 symbols/min [2025-10-15T19:18:40.918440] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-10. [2025-10-15T19:18:40.922356] [INFO ] [MAIN ] HAE: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:18:40.961749] [DEBUG] [LOCAL ] HAE: Loaded 39414 existing records from primary storage. [2025-10-15T19:18:40.962068] [INFO ] [MAIN ] HAE: Loaded 39414 existing records. [2025-10-15T19:18:41.176258] [WARN ] [MAIN ] HAE: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:18:41.176510] [INFO ] [MAIN ] HAE: Wiping existing primary data before full refresh. [2025-10-15T19:18:41.176743] [INFO ] [LOCAL ] HAE: Starting deletion of primary data. [2025-10-15T19:18:41.178699] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-15T19:18:41.178745] [DEBUG] [LOCAL ] HAE: Deleted primary data file. [2025-10-15T19:18:41.178871] [INFO ] [MAIN ] HAE: Starting full primary refresh. [2025-10-15T19:18:41.375018] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-15T19:18:41.413273] [INFO ] [REMOTE ] GYLD: Full fetch complete (2109 records). [2025-10-15T19:18:41.439457] [DEBUG] [VALIDATOR ] GYLD: Validating primary data. [2025-10-15T19:18:41.707604] [INFO ] [REMOTE ] HAE: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:18:41.722132] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-07. [2025-10-15T19:18:41.913706] [DEBUG] [VALIDATOR ] GYLD: All expected trading days are present. [2025-10-15T19:18:41.914014] [DEBUG] [VALIDATOR ] GYLD: Primary data validation passed. [2025-10-15T19:18:41.914136] [INFO ] [MAIN ] GYLD: Fetched primary data is valid. [2025-10-15T19:18:41.914176] [DEBUG] [LOCAL ] GYLD: Saving primary data. [2025-10-15T19:18:41.914493] [DEBUG] [LOCAL ] GYLD: Trimmed 2109 records to 1544 (keeping 200 days of data) [2025-10-15T19:18:41.924674] [DEBUG] [LOCAL ] GYLD: Primary data saved (1544 records). [2025-10-15T19:18:41.924737] [INFO ] [MAIN ] GYLD: Full history saved. [2025-10-15T19:18:41.924819] [INFO ] [MAIN ] Update Progress: 987/2369 symbols completed. GYLD took 27.7s. Estimated remaining: 3h 14m 6s. Rate: 7.1 symbols/min [2025-10-15T19:18:42.102295] [INFO ] [MAIN ] HAFN: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:18:42.140545] [DEBUG] [LOCAL ] HAFN: Loaded 43050 existing records from primary storage. [2025-10-15T19:18:42.140890] [INFO ] [MAIN ] HAFN: Loaded 43050 existing records. [2025-10-15T19:18:42.312187] [WARN ] [MAIN ] HAFN: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:18:42.312415] [INFO ] [MAIN ] HAFN: Wiping existing primary data before full refresh. [2025-10-15T19:18:42.312463] [INFO ] [LOCAL ] HAFN: Starting deletion of primary data. [2025-10-15T19:18:42.312802] [DEBUG] [LOCAL ] HAFN: Deleted primary data file. [2025-10-15T19:18:42.312858] [INFO ] [MAIN ] HAFN: Starting full primary refresh. [2025-10-15T19:18:42.519180] [INFO ] [REMOTE ] HAE: Fetching primary data for 2024-12. [2025-10-15T19:18:42.662308] [INFO ] [REMOTE ] HAFN: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:18:43.314029] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2024-12. [2025-10-15T19:18:43.399720] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-15T19:18:43.978437] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-15T19:18:44.113967] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-01. [2025-10-15T19:18:44.913978] [INFO ] [REMOTE ] H: Fetching primary data for 2024-12. [2025-10-15T19:18:45.155251] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-15T19:18:45.221930] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-15T19:18:45.714045] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-02. [2025-10-15T19:18:46.174904] [INFO ] [REMOTE ] H: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-15T19:18:46.514001] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-08. [2025-10-15T19:18:47.273581] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-15T19:18:47.313994] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-03. [2025-10-15T19:18:48.071207] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-15T19:18:48.113978] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-09. [2025-10-15T19:18:48.887605] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-15T19:18:48.913950] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-04. [2025-10-15T19:18:49.307199] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-15T19:18:49.714053] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-10. [2025-10-15T19:18:50.075927] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-15T19:18:50.513995] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-01. [2025-10-15T19:18:51.282369] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-15T19:18:51.288053] [INFO ] [REMOTE ] GXO: Full fetch complete (69649 records). [2025-10-15T19:18:51.288182] [DEBUG] [VALIDATOR ] GXO: Validating primary data. [2025-10-15T19:18:51.319306] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-05. [2025-10-15T19:18:51.684228] [DEBUG] [VALIDATOR ] GXO: All expected trading days are present. [2025-10-15T19:18:51.684304] [DEBUG] [VALIDATOR ] GXO: Primary data validation passed. [2025-10-15T19:18:51.685249] [INFO ] [MAIN ] GXO: Fetched primary data is valid. [2025-10-15T19:18:51.685313] [DEBUG] [LOCAL ] GXO: Saving primary data. [2025-10-15T19:18:51.686602] [DEBUG] [LOCAL ] GXO: Trimmed 69649 records to 46756 (keeping 200 days of data) [2025-10-15T19:18:51.964051] [DEBUG] [LOCAL ] GXO: Primary data saved (46756 records). [2025-10-15T19:18:51.964173] [INFO ] [MAIN ] GXO: Full history saved. [2025-10-15T19:18:51.964974] [INFO ] [MAIN ] Update Progress: 988/2369 symbols completed. GXO took 39.3s. Estimated remaining: 3h 13m 60s. Rate: 7.1 symbols/min [2025-10-15T19:18:52.116489] [INFO ] [REMOTE ] H: Fetching primary data for 2025-01. [2025-10-15T19:18:52.144114] [INFO ] [MAIN ] HAL: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:18:52.178019] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-15T19:18:52.233319] [DEBUG] [LOCAL ] HAL: Loaded 53718 existing records from primary storage. [2025-10-15T19:18:52.233661] [INFO ] [MAIN ] HAL: Loaded 53718 existing records. [2025-10-15T19:18:52.422221] [WARN ] [MAIN ] HAL: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:18:52.422691] [INFO ] [MAIN ] HAL: Wiping existing primary data before full refresh. [2025-10-15T19:18:52.422779] [INFO ] [LOCAL ] HAL: Starting deletion of primary data. [2025-10-15T19:18:52.423148] [DEBUG] [LOCAL ] HAL: Deleted primary data file. [2025-10-15T19:18:52.423262] [INFO ] [MAIN ] HAL: Starting full primary refresh. [2025-10-15T19:18:52.728277] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-15T19:18:52.818386] [INFO ] [REMOTE ] HAL: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:18:52.914005] [INFO ] [REMOTE ] HAL: Fetching primary data for 2024-12. [2025-10-15T19:18:53.496223] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-15T19:18:53.713992] [INFO ] [REMOTE ] H: Fetching primary data for 2025-02. [2025-10-15T19:18:54.514011] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-02. [2025-10-15T19:18:54.616159] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-15T19:18:55.064216] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-15T19:18:55.314006] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-01. [2025-10-15T19:18:56.113984] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-06. [2025-10-15T19:18:56.244158] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-15T19:18:56.913974] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-03. [2025-10-15T19:18:57.194030] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-15T19:18:57.397097] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-15T19:18:57.714035] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-07. [2025-10-15T19:18:58.513989] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-02. [2025-10-15T19:18:58.890844] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-10-15T19:18:59.314062] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-04. [2025-10-15T19:18:59.594839] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-15T19:19:00.114022] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-08. [2025-10-15T19:19:00.914066] [INFO ] [REMOTE ] H: Fetching primary data for 2025-03. [2025-10-15T19:19:01.221852] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-02 (2.71 seconds). [2025-10-15T19:19:01.476220] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-04 (2.16 seconds). [2025-10-15T19:19:01.713991] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-05. [2025-10-15T19:19:02.289063] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-08 (2.18 seconds). [2025-10-15T19:19:02.336020] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-15T19:19:02.513990] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-09. [2025-10-15T19:19:03.313987] [INFO ] [REMOTE ] H: Fetching primary data for 2025-04. [2025-10-15T19:19:03.383251] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-15T19:19:04.113994] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-03. [2025-10-15T19:19:04.152150] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-15T19:19:04.822089] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-15T19:19:04.914008] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-06. [2025-10-15T19:19:05.590148] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-15T19:19:05.714037] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-10. [2025-10-15T19:19:05.959001] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-15T19:19:06.514045] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-07. [2025-10-15T19:19:07.167934] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-15T19:19:07.173527] [INFO ] [REMOTE ] HAE: Full fetch complete (58849 records). [2025-10-15T19:19:07.173716] [DEBUG] [VALIDATOR ] HAE: Validating primary data. [2025-10-15T19:19:07.319063] [INFO ] [REMOTE ] H: Fetching primary data for 2025-05. [2025-10-15T19:19:07.605977] [DEBUG] [VALIDATOR ] HAE: All expected trading days are present. [2025-10-15T19:19:07.606064] [DEBUG] [VALIDATOR ] HAE: Primary data validation passed. [2025-10-15T19:19:07.606942] [INFO ] [MAIN ] HAE: Fetched primary data is valid. [2025-10-15T19:19:07.607009] [DEBUG] [LOCAL ] HAE: Saving primary data. [2025-10-15T19:19:07.608283] [DEBUG] [LOCAL ] HAE: Trimmed 58849 records to 39371 (keeping 200 days of data) [2025-10-15T19:19:07.847442] [DEBUG] [LOCAL ] HAE: Primary data saved (39371 records). [2025-10-15T19:19:07.847588] [INFO ] [MAIN ] HAE: Full history saved. [2025-10-15T19:19:07.847898] [INFO ] [MAIN ] Update Progress: 989/2369 symbols completed. HAE took 27.1s. Estimated remaining: 3h 14m 2s. Rate: 7.1 symbols/min [2025-10-15T19:19:08.020967] [INFO ] [MAIN ] HASI: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:19:08.047694] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-15T19:19:08.094387] [DEBUG] [LOCAL ] HASI: Loaded 47577 existing records from primary storage. [2025-10-15T19:19:08.094734] [INFO ] [MAIN ] HASI: Loaded 47577 existing records. [2025-10-15T19:19:08.124605] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-04. [2025-10-15T19:19:08.268965] [WARN ] [MAIN ] HASI: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:19:08.269193] [INFO ] [MAIN ] HASI: Wiping existing primary data before full refresh. [2025-10-15T19:19:08.269242] [INFO ] [LOCAL ] HASI: Starting deletion of primary data. [2025-10-15T19:19:08.269485] [DEBUG] [LOCAL ] HASI: Deleted primary data file. [2025-10-15T19:19:08.269524] [INFO ] [MAIN ] HASI: Starting full primary refresh. [2025-10-15T19:19:08.630829] [INFO ] [REMOTE ] HASI: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:19:08.735129] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-15T19:19:08.914019] [INFO ] [REMOTE ] H: Fetching primary data for 2025-06. [2025-10-15T19:19:09.714028] [INFO ] [REMOTE ] HASI: Fetching primary data for 2024-12. [2025-10-15T19:19:10.305715] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-04 (2.18 seconds). [2025-10-15T19:19:10.386760] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-15T19:19:10.514044] [INFO ] [REMOTE ] H: Fetching primary data for 2025-07. [2025-10-15T19:19:11.231287] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-15T19:19:11.313997] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-01. [2025-10-15T19:19:11.768184] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-15T19:19:12.114001] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-05. [2025-10-15T19:19:12.817723] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-15T19:19:12.913973] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-02. [2025-10-15T19:19:13.714007] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-08. [2025-10-15T19:19:13.775421] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-15T19:19:14.383409] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-15T19:19:14.513995] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-03. [2025-10-15T19:19:15.314007] [INFO ] [REMOTE ] H: Fetching primary data for 2025-08. [2025-10-15T19:19:15.379926] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-15T19:19:15.688931] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-15T19:19:16.114102] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-04. [2025-10-15T19:19:16.914083] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-09. [2025-10-15T19:19:16.996530] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-15T19:19:17.714043] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-06. [2025-10-15T19:19:17.856456] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-15T19:19:18.286294] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-15T19:19:18.514061] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-10. [2025-10-15T19:19:19.314042] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-05. [2025-10-15T19:19:19.361851] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-15T19:19:19.612372] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-15T19:19:19.617796] [INFO ] [REMOTE ] HAFN: Full fetch complete (65007 records). [2025-10-15T19:19:19.617924] [DEBUG] [VALIDATOR ] HAFN: Validating primary data. [2025-10-15T19:19:20.009278] [DEBUG] [VALIDATOR ] HAFN: All expected trading days are present. [2025-10-15T19:19:20.009394] [DEBUG] [VALIDATOR ] HAFN: Primary data validation passed. [2025-10-15T19:19:20.010354] [INFO ] [MAIN ] HAFN: Fetched primary data is valid. [2025-10-15T19:19:20.010418] [DEBUG] [LOCAL ] HAFN: Saving primary data. [2025-10-15T19:19:20.011867] [DEBUG] [LOCAL ] HAFN: Trimmed 65007 records to 42943 (keeping 200 days of data) [2025-10-15T19:19:20.116274] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-07. [2025-10-15T19:19:20.257942] [DEBUG] [LOCAL ] HAFN: Primary data saved (42943 records). [2025-10-15T19:19:20.258068] [INFO ] [MAIN ] HAFN: Full history saved. [2025-10-15T19:19:20.258151] [INFO ] [MAIN ] Update Progress: 990/2369 symbols completed. HAFN took 38.3s. Estimated remaining: 3h 13m 59s. Rate: 7.1 symbols/min [2025-10-15T19:19:20.421197] [INFO ] [MAIN ] HAYW: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:19:20.466452] [DEBUG] [LOCAL ] HAYW: Loaded 48878 existing records from primary storage. [2025-10-15T19:19:20.466791] [INFO ] [MAIN ] HAYW: Loaded 48878 existing records. [2025-10-15T19:19:20.646923] [WARN ] [MAIN ] HAYW: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:19:20.647216] [INFO ] [MAIN ] HAYW: Wiping existing primary data before full refresh. [2025-10-15T19:19:20.647268] [INFO ] [LOCAL ] HAYW: Starting deletion of primary data. [2025-10-15T19:19:20.647483] [DEBUG] [LOCAL ] HAYW: Deleted primary data file. [2025-10-15T19:19:20.647541] [INFO ] [MAIN ] HAYW: Starting full primary refresh. [2025-10-15T19:19:20.921498] [INFO ] [REMOTE ] H: Fetching primary data for 2025-09. [2025-10-15T19:19:21.014573] [INFO ] [REMOTE ] HAYW: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:19:21.052555] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-15T19:19:21.714017] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-06. [2025-10-15T19:19:22.154802] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-10-15T19:19:22.203086] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-15T19:19:22.513996] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2024-12. [2025-10-15T19:19:22.987764] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-15T19:19:23.314081] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-08. [2025-10-15T19:19:24.089543] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-15T19:19:24.113996] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-01. [2025-10-15T19:19:24.913996] [INFO ] [REMOTE ] H: Fetching primary data for 2025-10. [2025-10-15T19:19:25.185782] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-15T19:19:25.612744] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-15T19:19:25.713964] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-02. [2025-10-15T19:19:26.514031] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-07. [2025-10-15T19:19:26.567623] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-15T19:19:26.572856] [INFO ] [REMOTE ] H: Full fetch complete (62854 records). [2025-10-15T19:19:26.572963] [DEBUG] [VALIDATOR ] H: Validating primary data. [2025-10-15T19:19:26.975710] [DEBUG] [VALIDATOR ] H: All expected trading days are present. [2025-10-15T19:19:26.975842] [DEBUG] [VALIDATOR ] H: Primary data validation passed. [2025-10-15T19:19:26.977226] [INFO ] [MAIN ] H: Fetched primary data is valid. [2025-10-15T19:19:26.986118] [DEBUG] [LOCAL ] H: Saving primary data. [2025-10-15T19:19:27.005902] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-15T19:19:27.006101] [DEBUG] [LOCAL ] H: Trimmed 62854 records to 44421 (keeping 200 days of data) [2025-10-15T19:19:27.297157] [DEBUG] [LOCAL ] H: Primary data saved (44421 records). [2025-10-15T19:19:27.297321] [INFO ] [MAIN ] H: Full history saved. [2025-10-15T19:19:27.297418] [INFO ] [MAIN ] Update Progress: 991/2369 symbols completed. H took 48.0s. Estimated remaining: 3h 13m 49s. Rate: 7.1 symbols/min [2025-10-15T19:19:27.319832] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-03. [2025-10-15T19:19:27.469593] [INFO ] [MAIN ] HBB: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:19:27.480509] [DEBUG] [LOCAL ] HBB: Loaded 6478 existing records from primary storage. [2025-10-15T19:19:27.480761] [INFO ] [MAIN ] HBB: Loaded 6478 existing records. [2025-10-15T19:19:27.680581] [WARN ] [MAIN ] HBB: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:19:27.680859] [INFO ] [MAIN ] HBB: Wiping existing primary data before full refresh. [2025-10-15T19:19:27.680932] [INFO ] [LOCAL ] HBB: Starting deletion of primary data. [2025-10-15T19:19:27.681109] [DEBUG] [LOCAL ] HBB: Deleted primary data file. [2025-10-15T19:19:27.681150] [INFO ] [MAIN ] HBB: Starting full primary refresh. [2025-10-15T19:19:28.048519] [INFO ] [REMOTE ] HBB: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:19:28.077994] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-15T19:19:28.113966] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-08. [2025-10-15T19:19:28.919086] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-09. [2025-10-15T19:19:28.935088] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-15T19:19:29.192108] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-15T19:19:29.714050] [INFO ] [REMOTE ] HBB: Fetching primary data for 2024-12. [2025-10-15T19:19:30.375029] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-10-15T19:19:30.513985] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-01. [2025-10-15T19:19:30.757367] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-15T19:19:31.187052] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-15T19:19:31.314031] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-02. [2025-10-15T19:19:31.909424] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-15T19:19:32.113997] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-10. [2025-10-15T19:19:32.792505] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-15T19:19:32.798932] [INFO ] [REMOTE ] HAL: Full fetch complete (77897 records). [2025-10-15T19:19:32.799047] [DEBUG] [VALIDATOR ] HAL: Validating primary data. [2025-10-15T19:19:32.919132] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-03. [2025-10-15T19:19:33.205829] [DEBUG] [VALIDATOR ] HAL: All expected trading days are present. [2025-10-15T19:19:33.205899] [DEBUG] [VALIDATOR ] HAL: Primary data validation passed. [2025-10-15T19:19:33.206904] [INFO ] [MAIN ] HAL: Fetched primary data is valid. [2025-10-15T19:19:33.206967] [DEBUG] [LOCAL ] HAL: Saving primary data. [2025-10-15T19:19:33.208327] [DEBUG] [LOCAL ] HAL: Trimmed 77897 records to 53718 (keeping 200 days of data) [2025-10-15T19:19:33.540816] [DEBUG] [LOCAL ] HAL: Primary data saved (53718 records). [2025-10-15T19:19:33.541053] [INFO ] [MAIN ] HAL: Full history saved. [2025-10-15T19:19:33.541951] [INFO ] [MAIN ] Update Progress: 992/2369 symbols completed. HAL took 41.6s. Estimated remaining: 3h 13m 37s. Rate: 7.1 symbols/min [2025-10-15T19:19:33.714491] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-09. [2025-10-15T19:19:33.714332] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-15T19:19:33.714120] [INFO ] [MAIN ] HBI: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:19:33.779029] [DEBUG] [LOCAL ] HBI: Loaded 52982 existing records from primary storage. [2025-10-15T19:19:33.779322] [INFO ] [MAIN ] HBI: Loaded 52982 existing records. [2025-10-15T19:19:33.950684] [WARN ] [MAIN ] HBI: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:19:33.950867] [INFO ] [MAIN ] HBI: Wiping existing primary data before full refresh. [2025-10-15T19:19:33.950914] [INFO ] [LOCAL ] HBI: Starting deletion of primary data. [2025-10-15T19:19:33.951186] [DEBUG] [LOCAL ] HBI: Deleted primary data file. [2025-10-15T19:19:33.951224] [INFO ] [MAIN ] HBI: Starting full primary refresh. [2025-10-15T19:19:34.292591] [INFO ] [REMOTE ] HBI: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:19:34.514011] [INFO ] [REMOTE ] HBI: Fetching primary data for 2024-12. [2025-10-15T19:19:35.148240] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-15T19:19:35.313980] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-10. [2025-10-15T19:19:36.098726] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-15T19:19:36.113951] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-04. [2025-10-15T19:19:36.647722] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-15T19:19:36.653454] [INFO ] [REMOTE ] HASI: Full fetch complete (68293 records). [2025-10-15T19:19:36.653559] [DEBUG] [VALIDATOR ] HASI: Validating primary data. [2025-10-15T19:19:36.919125] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-01. [2025-10-15T19:19:37.034718] [DEBUG] [VALIDATOR ] HASI: All expected trading days are present. [2025-10-15T19:19:37.034803] [DEBUG] [VALIDATOR ] HASI: Primary data validation passed. [2025-10-15T19:19:37.035759] [INFO ] [MAIN ] HASI: Fetched primary data is valid. [2025-10-15T19:19:37.035820] [DEBUG] [LOCAL ] HASI: Saving primary data. [2025-10-15T19:19:37.037066] [DEBUG] [LOCAL ] HASI: Trimmed 68293 records to 47673 (keeping 200 days of data) [2025-10-15T19:19:37.319285] [DEBUG] [LOCAL ] HASI: Primary data saved (47673 records). [2025-10-15T19:19:37.319411] [INFO ] [MAIN ] HASI: Full history saved. [2025-10-15T19:19:37.319863] [INFO ] [MAIN ] Update Progress: 993/2369 symbols completed. HASI took 29.5s. Estimated remaining: 3h 13m 22s. Rate: 7.1 symbols/min [2025-10-15T19:19:37.487418] [INFO ] [MAIN ] HBM: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:19:37.538167] [DEBUG] [LOCAL ] HBM: Loaded 52944 existing records from primary storage. [2025-10-15T19:19:37.538480] [INFO ] [MAIN ] HBM: Loaded 52944 existing records. [2025-10-15T19:19:37.714878] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-04. [2025-10-15T19:19:37.721107] [WARN ] [MAIN ] HBM: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:19:37.722433] [INFO ] [MAIN ] HBM: Wiping existing primary data before full refresh. [2025-10-15T19:19:37.722630] [INFO ] [LOCAL ] HBM: Starting deletion of primary data. [2025-10-15T19:19:37.722918] [DEBUG] [LOCAL ] HBM: Deleted primary data file. [2025-10-15T19:19:37.722963] [INFO ] [MAIN ] HBM: Starting full primary refresh. [2025-10-15T19:19:37.827327] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-15T19:19:38.109189] [INFO ] [REMOTE ] HBM: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:19:38.402307] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-15T19:19:38.513978] [INFO ] [REMOTE ] HBM: Fetching primary data for 2024-12. [2025-10-15T19:19:38.707333] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-15T19:19:39.314116] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-02. [2025-10-15T19:19:40.105985] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-15T19:19:40.115624] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-05. [2025-10-15T19:19:40.757332] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-15T19:19:40.847588] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-15T19:19:40.914027] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-01. [2025-10-15T19:19:41.713994] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-03. [2025-10-15T19:19:42.519083] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-06. [2025-10-15T19:19:42.531096] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-15T19:19:42.994011] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-10-15T19:19:43.313996] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-05. [2025-10-15T19:19:43.410735] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-15T19:19:44.113999] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-04. [2025-10-15T19:19:44.655322] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-15T19:19:44.914017] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-07. [2025-10-15T19:19:45.532428] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-15T19:19:45.646099] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-15T19:19:45.713981] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-05. [2025-10-15T19:19:46.514016] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-02. [2025-10-15T19:19:47.313981] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-06. [2025-10-15T19:19:47.418260] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-15T19:19:47.604020] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-15T19:19:48.114047] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-03. [2025-10-15T19:19:48.600550] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-15T19:19:48.914052] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-06. [2025-10-15T19:19:49.713973] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-08. [2025-10-15T19:19:49.872682] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-15T19:19:50.098922] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-15T19:19:50.410765] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-15T19:19:50.514009] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-07. [2025-10-15T19:19:51.313998] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-09. [2025-10-15T19:19:51.888008] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-15T19:19:52.114175] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-10. [2025-10-15T19:19:52.153544] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-15T19:19:52.722841] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-15T19:19:52.724093] [INFO ] [REMOTE ] HBB: Full fetch complete (9384 records). [2025-10-15T19:19:52.724165] [DEBUG] [VALIDATOR ] HBB: Validating primary data. [2025-10-15T19:19:52.919175] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-07. [2025-10-15T19:19:53.087342] [DEBUG] [VALIDATOR ] HBB: All expected trading days are present. [2025-10-15T19:19:53.087421] [DEBUG] [VALIDATOR ] HBB: Primary data validation passed. [2025-10-15T19:19:53.091096] [INFO ] [MAIN ] HBB: Fetched primary data is valid. [2025-10-15T19:19:53.091354] [DEBUG] [LOCAL ] HBB: Saving primary data. [2025-10-15T19:19:53.092303] [DEBUG] [LOCAL ] HBB: Trimmed 9384 records to 6475 (keeping 200 days of data) [2025-10-15T19:19:53.131888] [DEBUG] [LOCAL ] HBB: Primary data saved (6475 records). [2025-10-15T19:19:53.132014] [INFO ] [MAIN ] HBB: Full history saved. [2025-10-15T19:19:53.132099] [INFO ] [MAIN ] Update Progress: 994/2369 symbols completed. HBB took 25.8s. Estimated remaining: 3h 13m 24s. Rate: 7.1 symbols/min [2025-10-15T19:19:53.297838] [INFO ] [MAIN ] HCA: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:19:53.342326] [DEBUG] [LOCAL ] HCA: Loaded 46950 existing records from primary storage. [2025-10-15T19:19:53.342613] [INFO ] [MAIN ] HCA: Loaded 46950 existing records. [2025-10-15T19:19:53.516000] [WARN ] [MAIN ] HCA: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:19:53.516202] [INFO ] [MAIN ] HCA: Wiping existing primary data before full refresh. [2025-10-15T19:19:53.516248] [INFO ] [LOCAL ] HCA: Starting deletion of primary data. [2025-10-15T19:19:53.516620] [DEBUG] [LOCAL ] HCA: Deleted primary data file. [2025-10-15T19:19:53.516702] [INFO ] [MAIN ] HCA: Starting full primary refresh. [2025-10-15T19:19:53.721639] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-08. [2025-10-15T19:19:53.892433] [INFO ] [REMOTE ] HCA: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:19:54.513969] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-04. [2025-10-15T19:19:54.808229] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-15T19:19:55.313980] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-08. [2025-10-15T19:19:55.438678] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-15T19:19:56.113996] [INFO ] [REMOTE ] HCA: Fetching primary data for 2024-12. [2025-10-15T19:19:56.220532] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-15T19:19:56.746639] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-15T19:19:56.913988] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-05. [2025-10-15T19:19:57.714004] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-09. [2025-10-15T19:19:57.807271] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-15T19:19:58.513975] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-01. [2025-10-15T19:19:58.629497] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-15T19:19:59.314051] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-09. [2025-10-15T19:19:59.603847] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-15T19:20:00.113998] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-10. [2025-10-15T19:20:00.157618] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-15T19:20:00.913999] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-02. [2025-10-15T19:20:01.063475] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-15T19:20:01.713987] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-10. [2025-10-15T19:20:01.946592] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-15T19:20:01.953122] [INFO ] [REMOTE ] HBI: Full fetch complete (77020 records). [2025-10-15T19:20:01.953251] [DEBUG] [VALIDATOR ] HBI: Validating primary data. [2025-10-15T19:20:02.353797] [DEBUG] [VALIDATOR ] HBI: All expected trading days are present. [2025-10-15T19:20:02.353912] [DEBUG] [VALIDATOR ] HBI: Primary data validation passed. [2025-10-15T19:20:02.354928] [INFO ] [MAIN ] HBI: Fetched primary data is valid. [2025-10-15T19:20:02.354994] [DEBUG] [LOCAL ] HBI: Saving primary data. [2025-10-15T19:20:02.356489] [DEBUG] [LOCAL ] HBI: Trimmed 77020 records to 52974 (keeping 200 days of data) [2025-10-15T19:20:02.525272] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-06. [2025-10-15T19:20:02.678046] [DEBUG] [LOCAL ] HBI: Primary data saved (52974 records). [2025-10-15T19:20:02.678184] [INFO ] [MAIN ] HBI: Full history saved. [2025-10-15T19:20:02.678968] [INFO ] [MAIN ] Update Progress: 995/2369 symbols completed. HBI took 29.1s. Estimated remaining: 3h 13m 17s. Rate: 7.1 symbols/min [2025-10-15T19:20:02.851604] [INFO ] [MAIN ] HCC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:20:02.898273] [DEBUG] [LOCAL ] HCC: Loaded 45223 existing records from primary storage. [2025-10-15T19:20:02.898859] [INFO ] [MAIN ] HCC: Loaded 45223 existing records. [2025-10-15T19:20:03.106040] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-02 (2.19 seconds). [2025-10-15T19:20:03.153480] [WARN ] [MAIN ] HCC: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:20:03.154448] [INFO ] [MAIN ] HCC: Wiping existing primary data before full refresh. [2025-10-15T19:20:03.154525] [INFO ] [LOCAL ] HCC: Starting deletion of primary data. [2025-10-15T19:20:03.154995] [DEBUG] [LOCAL ] HCC: Deleted primary data file. [2025-10-15T19:20:03.155064] [INFO ] [MAIN ] HCC: Starting full primary refresh. [2025-10-15T19:20:03.318069] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-03. [2025-10-15T19:20:03.523781] [INFO ] [REMOTE ] HCC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:20:03.591987] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-10 (1.88 seconds). [2025-10-15T19:20:03.598137] [INFO ] [REMOTE ] HAYW: Full fetch complete (70891 records). [2025-10-15T19:20:03.598271] [DEBUG] [VALIDATOR ] HAYW: Validating primary data. [2025-10-15T19:20:03.988637] [DEBUG] [VALIDATOR ] HAYW: All expected trading days are present. [2025-10-15T19:20:03.988765] [DEBUG] [VALIDATOR ] HAYW: Primary data validation passed. [2025-10-15T19:20:03.989743] [INFO ] [MAIN ] HAYW: Fetched primary data is valid. [2025-10-15T19:20:03.989808] [DEBUG] [LOCAL ] HAYW: Saving primary data. [2025-10-15T19:20:03.991260] [DEBUG] [LOCAL ] HAYW: Trimmed 70891 records to 48908 (keeping 200 days of data) [2025-10-15T19:20:04.155635] [INFO ] [REMOTE ] HCC: Fetching primary data for 2024-12. [2025-10-15T19:20:04.276354] [DEBUG] [LOCAL ] HAYW: Primary data saved (48908 records). [2025-10-15T19:20:04.276484] [INFO ] [MAIN ] HAYW: Full history saved. [2025-10-15T19:20:04.276562] [INFO ] [MAIN ] Update Progress: 996/2369 symbols completed. HAYW took 44.0s. Estimated remaining: 3h 12m 59s. Rate: 7.1 symbols/min [2025-10-15T19:20:04.449745] [INFO ] [MAIN ] HCI: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:20:04.464790] [DEBUG] [LOCAL ] HCI: Loaded 14096 existing records from primary storage. [2025-10-15T19:20:04.465014] [INFO ] [MAIN ] HCI: Loaded 14096 existing records. [2025-10-15T19:20:04.650460] [WARN ] [MAIN ] HCI: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:20:04.667090] [INFO ] [MAIN ] HCI: Wiping existing primary data before full refresh. [2025-10-15T19:20:04.676890] [INFO ] [LOCAL ] HCI: Starting deletion of primary data. [2025-10-15T19:20:04.677275] [DEBUG] [LOCAL ] HCI: Deleted primary data file. [2025-10-15T19:20:04.678819] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-06 (2.15 seconds). [2025-10-15T19:20:04.677780] [INFO ] [MAIN ] HCI: Starting full primary refresh. [2025-10-15T19:20:04.919245] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-07. [2025-10-15T19:20:05.075396] [INFO ] [REMOTE ] HCI: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:20:05.283693] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-15T19:20:05.393053] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-15T19:20:05.714017] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-04. [2025-10-15T19:20:06.389218] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-15T19:20:06.513995] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-08. [2025-10-15T19:20:07.226402] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-15T19:20:07.313950] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-05. [2025-10-15T19:20:08.114016] [INFO ] [REMOTE ] HCI: Fetching primary data for 2024-12. [2025-10-15T19:20:08.305728] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-15T19:20:08.913971] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-09. [2025-10-15T19:20:08.991113] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-15T19:20:09.010898] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-10-15T19:20:09.714001] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-06. [2025-10-15T19:20:10.514063] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-01. [2025-10-15T19:20:10.760587] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-15T19:20:11.289477] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-15T19:20:11.313996] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-01. [2025-10-15T19:20:11.865335] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-15T19:20:12.038979] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-15T19:20:12.114041] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-02. [2025-10-15T19:20:12.776858] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-15T19:20:12.914041] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-03. [2025-10-15T19:20:13.524143] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-15T19:20:13.714062] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-02. [2025-10-15T19:20:14.514006] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-10. [2025-10-15T19:20:15.294003] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-15T19:20:15.313970] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-03. [2025-10-15T19:20:16.114029] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-04. [2025-10-15T19:20:16.345468] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-15T19:20:16.351811] [INFO ] [REMOTE ] HBM: Full fetch complete (76667 records). [2025-10-15T19:20:16.351928] [DEBUG] [VALIDATOR ] HBM: Validating primary data. [2025-10-15T19:20:16.651051] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-15T19:20:16.790463] [DEBUG] [VALIDATOR ] HBM: All expected trading days are present. [2025-10-15T19:20:16.790561] [DEBUG] [VALIDATOR ] HBM: Primary data validation passed. [2025-10-15T19:20:16.791593] [INFO ] [MAIN ] HBM: Fetched primary data is valid. [2025-10-15T19:20:16.791679] [DEBUG] [LOCAL ] HBM: Saving primary data. [2025-10-15T19:20:16.793233] [DEBUG] [LOCAL ] HBM: Trimmed 76667 records to 52958 (keeping 200 days of data) [2025-10-15T19:20:16.964044] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-04. [2025-10-15T19:20:17.115965] [DEBUG] [LOCAL ] HBM: Primary data saved (52958 records). [2025-10-15T19:20:17.116101] [INFO ] [MAIN ] HBM: Full history saved. [2025-10-15T19:20:17.116333] [INFO ] [MAIN ] Update Progress: 997/2369 symbols completed. HBM took 39.8s. Estimated remaining: 3h 12m 57s. Rate: 7.1 symbols/min [2025-10-15T19:20:17.174616] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-15T19:20:17.714000] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-07. [2025-10-15T19:20:18.442352] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-15T19:20:18.513989] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-05. [2025-10-15T19:20:19.314030] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-05. [2025-10-15T19:20:19.506452] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-15T19:20:19.827474] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-15T19:20:20.114008] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-08. [2025-10-15T19:20:20.209288] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-15T19:20:20.914058] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-06. [2025-10-15T19:20:21.460981] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-15T19:20:21.713973] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-09. [2025-10-15T19:20:22.061112] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-15T19:20:22.514041] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-07. [2025-10-15T19:20:23.314079] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-06. [2025-10-15T19:20:23.376318] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-15T19:20:24.120795] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-10. [2025-10-15T19:20:24.144112] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-15T19:20:24.256716] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-15T19:20:24.913994] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-07. [2025-10-15T19:20:25.713993] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-08. [2025-10-15T19:20:25.767179] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-15T19:20:25.773080] [INFO ] [REMOTE ] HCA: Full fetch complete (68902 records). [2025-10-15T19:20:25.773230] [DEBUG] [VALIDATOR ] HCA: Validating primary data. [2025-10-15T19:20:25.980677] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-15T19:20:26.181270] [DEBUG] [VALIDATOR ] HCA: All expected trading days are present. [2025-10-15T19:20:26.181358] [DEBUG] [VALIDATOR ] HCA: Primary data validation passed. [2025-10-15T19:20:26.182327] [INFO ] [MAIN ] HCA: Fetched primary data is valid. [2025-10-15T19:20:26.182392] [DEBUG] [LOCAL ] HCA: Saving primary data. [2025-10-15T19:20:26.183767] [DEBUG] [LOCAL ] HCA: Trimmed 68902 records to 46992 (keeping 200 days of data) [2025-10-15T19:20:26.468848] [DEBUG] [LOCAL ] HCA: Primary data saved (46992 records). [2025-10-15T19:20:26.468969] [INFO ] [MAIN ] HCA: Full history saved. [2025-10-15T19:20:26.469045] [INFO ] [MAIN ] Update Progress: 998/2369 symbols completed. HCA took 33.3s. Estimated remaining: 3h 12m 50s. Rate: 7.1 symbols/min [2025-10-15T19:20:26.514028] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-08. [2025-10-15T19:20:27.366445] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-15T19:20:27.376115] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-09. [2025-10-15T19:20:27.434769] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-15T19:20:28.113993] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-09. [2025-10-15T19:20:28.895902] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-15T19:20:28.913958] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-10. [2025-10-15T19:20:28.945956] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-15T19:20:29.714027] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-10. [2025-10-15T19:20:30.470948] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-15T19:20:30.477078] [INFO ] [REMOTE ] HCC: Full fetch complete (64865 records). [2025-10-15T19:20:30.477215] [DEBUG] [VALIDATOR ] HCC: Validating primary data. [2025-10-15T19:20:30.720725] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-15T19:20:30.764433] [INFO ] [REMOTE ] HCI: Full fetch complete (19566 records). [2025-10-15T19:20:30.775884] [DEBUG] [VALIDATOR ] HCI: Validating primary data. [2025-10-15T19:20:31.079517] [DEBUG] [VALIDATOR ] HCC: All expected trading days are present. [2025-10-15T19:20:31.144903] [DEBUG] [VALIDATOR ] HCC: Primary data validation passed. [2025-10-15T19:20:31.157620] [INFO ] [MAIN ] HCC: Fetched primary data is valid. [2025-10-15T19:20:31.184273] [DEBUG] [LOCAL ] HCC: Saving primary data. [2025-10-15T19:20:31.244080] [DEBUG] [LOCAL ] HCC: Trimmed 64865 records to 45241 (keeping 200 days of data) [2025-10-15T19:20:31.269098] [DEBUG] [VALIDATOR ] HCI: All expected trading days are present. [2025-10-15T19:20:31.269217] [DEBUG] [VALIDATOR ] HCI: Primary data validation passed. [2025-10-15T19:20:31.269781] [INFO ] [MAIN ] HCI: Fetched primary data is valid. [2025-10-15T19:20:31.269879] [DEBUG] [LOCAL ] HCI: Saving primary data. [2025-10-15T19:20:31.270491] [DEBUG] [LOCAL ] HCI: Trimmed 19566 records to 14115 (keeping 200 days of data) [2025-10-15T19:20:31.468311] [DEBUG] [LOCAL ] HCI: Primary data saved (14115 records). [2025-10-15T19:20:31.472797] [INFO ] [MAIN ] HCI: Full history saved. [2025-10-15T19:20:31.472925] [INFO ] [MAIN ] Update Progress: 999/2369 symbols completed. HCI took 27.2s. Estimated remaining: 3h 12m 36s. Rate: 7.1 symbols/min [2025-10-15T19:20:31.648618] [DEBUG] [LOCAL ] HCC: Primary data saved (45241 records). [2025-10-15T19:20:31.649005] [INFO ] [MAIN ] HCC: Full history saved. [2025-10-15T19:20:31.650072] [INFO ] [MAIN ] Update Progress: 1000/2369 symbols completed. HCC took 29.0s. Estimated remaining: 3h 12m 17s. Rate: 7.1 symbols/min [2025-10-15T19:20:32.363573] [INFO ] [MAIN ] HDB: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:20:32.364372] [INFO ] [MAIN ] HD: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:20:32.359850] [INFO ] [MAIN ] HCXY: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:20:32.389791] [DEBUG] [LOCAL ] HCXY: No existing data file found in primary storage. [2025-10-15T19:20:32.388952] [INFO ] [MAIN ] HE: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:20:32.390045] [WARN ] [MAIN ] HCXY: No existing data found, performing full refresh instead. [2025-10-15T19:20:32.392129] [INFO ] [MAIN ] HCXY: Wiping existing primary data before full refresh. [2025-10-15T19:20:32.392207] [INFO ] [LOCAL ] HCXY: Starting deletion of primary data. [2025-10-15T19:20:32.392263] [DEBUG] [LOCAL ] HCXY: No primary data file found to delete. [2025-10-15T19:20:32.392304] [INFO ] [MAIN ] HCXY: Starting full primary refresh. [2025-10-15T19:20:32.766057] [DEBUG] [LOCAL ] HD: Loaded 53493 existing records from primary storage. [2025-10-15T19:20:32.785987] [INFO ] [MAIN ] HD: Loaded 53493 existing records. [2025-10-15T19:20:32.773206] [DEBUG] [LOCAL ] HE: Loaded 48972 existing records from primary storage. [2025-10-15T19:20:32.867508] [DEBUG] [LOCAL ] HDB: Loaded 51927 existing records from primary storage. [2025-10-15T19:20:32.931896] [INFO ] [MAIN ] HDB: Loaded 51927 existing records. [2025-10-15T19:20:32.931780] [INFO ] [REMOTE ] HCXY: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:20:32.867673] [INFO ] [MAIN ] HE: Loaded 48972 existing records. [2025-10-15T19:20:32.976702] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2024-12. [2025-10-15T19:20:33.266805] [WARN ] [MAIN ] HD: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:20:33.298283] [INFO ] [MAIN ] HD: Wiping existing primary data before full refresh. [2025-10-15T19:20:33.338734] [INFO ] [LOCAL ] HD: Starting deletion of primary data. [2025-10-15T19:20:33.411830] [WARN ] [MAIN ] HE: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:20:33.413367] [DEBUG] [LOCAL ] HD: Deleted primary data file. [2025-10-15T19:20:33.416296] [INFO ] [MAIN ] HE: Wiping existing primary data before full refresh. [2025-10-15T19:20:33.416207] [WARN ] [MAIN ] HDB: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:20:33.416634] [INFO ] [MAIN ] HDB: Wiping existing primary data before full refresh. [2025-10-15T19:20:33.416592] [INFO ] [MAIN ] HD: Starting full primary refresh. [2025-10-15T19:20:33.416543] [INFO ] [LOCAL ] HE: Starting deletion of primary data. [2025-10-15T19:20:33.416894] [INFO ] [LOCAL ] HDB: Starting deletion of primary data. [2025-10-15T19:20:33.427849] [DEBUG] [LOCAL ] HE: Deleted primary data file. [2025-10-15T19:20:33.460493] [DEBUG] [LOCAL ] HDB: Deleted primary data file. [2025-10-15T19:20:33.472409] [INFO ] [MAIN ] HE: Starting full primary refresh. [2025-10-15T19:20:33.481859] [INFO ] [MAIN ] HDB: Starting full primary refresh. [2025-10-15T19:20:33.624902] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-10-15T19:20:33.719412] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-01. [2025-10-15T19:20:34.041533] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-01 (0.32 seconds). [2025-10-15T19:20:34.216950] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-02. [2025-10-15T19:20:34.414551] [INFO ] [REMOTE ] HE: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:20:34.433194] [INFO ] [REMOTE ] HE: Fetching primary data for 2024-12. [2025-10-15T19:20:34.548929] [INFO ] [REMOTE ] HD: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:20:34.553512] [INFO ] [REMOTE ] HDB: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:20:34.550534] [INFO ] [REMOTE ] HD: Fetching primary data for 2024-12. [2025-10-15T19:20:34.553802] [INFO ] [REMOTE ] HDB: Fetching primary data for 2024-12. [2025-10-15T19:20:34.745588] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-15T19:20:35.314062] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-03. [2025-10-15T19:20:35.541310] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-03 (0.23 seconds). [2025-10-15T19:20:36.114067] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-04. [2025-10-15T19:20:36.167740] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-15T19:20:36.237786] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-15T19:20:36.279449] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-15T19:20:36.356902] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-04 (0.24 seconds). [2025-10-15T19:20:36.914001] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-01. [2025-10-15T19:20:37.714022] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-01. [2025-10-15T19:20:38.514002] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-05. [2025-10-15T19:20:38.655054] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-15T19:20:38.729399] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-05 (0.22 seconds). [2025-10-15T19:20:39.313970] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-02. [2025-10-15T19:20:39.492528] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-15T19:20:40.114009] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-02. [2025-10-15T19:20:40.914013] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-01. [2025-10-15T19:20:41.216696] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-10-15T19:20:41.720316] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-06. [2025-10-15T19:20:41.726101] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-15T19:20:42.043560] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-06 (0.32 seconds). [2025-10-15T19:20:42.513971] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-07. [2025-10-15T19:20:42.730092] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-15T19:20:42.844746] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-07 (0.33 seconds). [2025-10-15T19:20:43.313990] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-02. [2025-10-15T19:20:44.113998] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-08. [2025-10-15T19:20:44.414151] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-08 (0.30 seconds). [2025-10-15T19:20:44.913972] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-03. [2025-10-15T19:20:45.096267] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-15T19:20:45.714004] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-09. [2025-10-15T19:20:45.931108] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-09 (0.22 seconds). [2025-10-15T19:20:46.374797] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-15T19:20:46.513954] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-04. [2025-10-15T19:20:47.314034] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-10. [2025-10-15T19:20:47.630304] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-10 (0.32 seconds). [2025-10-15T19:20:47.631119] [INFO ] [REMOTE ] HCXY: Full fetch complete (520 records). [2025-10-15T19:20:47.631199] [DEBUG] [VALIDATOR ] HCXY: Validating primary data. [2025-10-15T19:20:47.823314] [WARN ] [VALIDATOR ] HCXY: Validation failed - insufficient historical data. Have 164 unique days, need 200 days [2025-10-15T19:20:47.823511] [FATAL] [MAIN ] HCXY: Fetched primary data is invalid. Refusing to save it. [2025-10-15T19:20:47.823598] [WARN ] [MAIN ] HCXY: Deleting existing primary and derivative data due to validation failure. [2025-10-15T19:20:47.823712] [INFO ] [LOCAL ] HCXY: Starting deletion of primary data. [2025-10-15T19:20:47.823795] [DEBUG] [LOCAL ] HCXY: No primary data file found to delete. [2025-10-15T19:20:47.823835] [INFO ] [LOCAL ] HCXY: Starting deletion of derivative data. [2025-10-15T19:20:47.823874] [DEBUG] [LOCAL ] HCXY: No derivative data file found to delete. [2025-10-15T19:20:47.823929] [INFO ] [MAIN ] Update Progress: 1001/2369 symbols completed. HCXY took 16.2s. Estimated remaining: 3h 12m 19s. Rate: 7.1 symbols/min [2025-10-15T19:20:48.000117] [INFO ] [MAIN ] HEI: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:20:48.035596] [DEBUG] [LOCAL ] HEI: Loaded 31298 existing records from primary storage. [2025-10-15T19:20:48.035972] [INFO ] [MAIN ] HEI: Loaded 31298 existing records. [2025-10-15T19:20:48.119122] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-03. [2025-10-15T19:20:48.218098] [WARN ] [MAIN ] HEI: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:20:48.218318] [INFO ] [MAIN ] HEI: Wiping existing primary data before full refresh. [2025-10-15T19:20:48.218365] [INFO ] [LOCAL ] HEI: Starting deletion of primary data. [2025-10-15T19:20:48.218619] [DEBUG] [LOCAL ] HEI: Deleted primary data file. [2025-10-15T19:20:48.218739] [INFO ] [MAIN ] HEI: Starting full primary refresh. [2025-10-15T19:20:48.622296] [INFO ] [REMOTE ] HEI: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:20:48.627252] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-10-15T19:20:48.913976] [INFO ] [REMOTE ] HEI: Fetching primary data for 2024-12. [2025-10-15T19:20:49.714061] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-05. [2025-10-15T19:20:50.129135] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-15T19:20:50.200352] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-10-15T19:20:50.513996] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-03. [2025-10-15T19:20:51.313996] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-04. [2025-10-15T19:20:51.378108] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-15T19:20:52.027376] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-15T19:20:52.113975] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-04. [2025-10-15T19:20:52.913960] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-06. [2025-10-15T19:20:53.474238] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-04 (2.16 seconds). [2025-10-15T19:20:53.713980] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-01. [2025-10-15T19:20:53.842508] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-15T19:20:54.315795] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-15T19:20:54.514064] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-05. [2025-10-15T19:20:55.227475] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-15T19:20:55.313987] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-02. [2025-10-15T19:20:56.113987] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-07. [2025-10-15T19:20:56.470313] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-15T19:20:56.577310] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-10-15T19:20:56.914007] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-05. [2025-10-15T19:20:57.713975] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-03. [2025-10-15T19:20:57.805836] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-15T19:20:58.514004] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-08. [2025-10-15T19:20:58.571637] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-15T19:20:58.839488] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-15T19:20:59.314003] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-06. [2025-10-15T19:20:59.893109] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-15T19:21:00.113997] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-04. [2025-10-15T19:21:00.914001] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-09. [2025-10-15T19:21:01.138468] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-15T19:21:01.651436] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-15T19:21:01.713992] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-05. [2025-10-15T19:21:02.227476] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-15T19:21:02.514066] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-07. [2025-10-15T19:21:03.221883] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-15T19:21:03.313954] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-06. [2025-10-15T19:21:04.114016] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-06. [2025-10-15T19:21:04.262099] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-15T19:21:04.656146] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-15T19:21:04.914023] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-07. [2025-10-15T19:21:05.714087] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-08. [2025-10-15T19:21:05.949018] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-15T19:21:06.243992] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-15T19:21:06.513994] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-07. [2025-10-15T19:21:07.030721] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-15T19:21:07.314008] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-09. [2025-10-15T19:21:08.114115] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-08. [2025-10-15T19:21:08.378694] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-15T19:21:08.614692] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-15T19:21:08.914051] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-08. [2025-10-15T19:21:09.076979] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-15T19:21:09.713995] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-10. [2025-10-15T19:21:10.514087] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-10. [2025-10-15T19:21:10.978336] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-10-15T19:21:11.274638] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-15T19:21:11.280448] [INFO ] [REMOTE ] HE: Full fetch complete (72248 records). [2025-10-15T19:21:11.280553] [DEBUG] [VALIDATOR ] HE: Validating primary data. [2025-10-15T19:21:11.319168] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-09. [2025-10-15T19:21:11.690575] [DEBUG] [VALIDATOR ] HE: All expected trading days are present. [2025-10-15T19:21:11.690706] [DEBUG] [VALIDATOR ] HE: Primary data validation passed. [2025-10-15T19:21:11.691834] [INFO ] [MAIN ] HE: Fetched primary data is valid. [2025-10-15T19:21:11.691910] [DEBUG] [LOCAL ] HE: Saving primary data. [2025-10-15T19:21:11.693490] [DEBUG] [LOCAL ] HE: Trimmed 72248 records to 48936 (keeping 200 days of data) [2025-10-15T19:21:11.984866] [DEBUG] [LOCAL ] HE: Primary data saved (48936 records). [2025-10-15T19:21:11.984993] [INFO ] [MAIN ] HE: Full history saved. [2025-10-15T19:21:11.985114] [INFO ] [MAIN ] Update Progress: 1002/2369 symbols completed. HE took 40.3s. Estimated remaining: 3h 12m 32s. Rate: 7.1 symbols/min [2025-10-15T19:21:12.118581] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-09. [2025-10-15T19:21:12.161534] [INFO ] [MAIN ] HEQ: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:21:12.170562] [DEBUG] [LOCAL ] HEQ: Loaded 6781 existing records from primary storage. [2025-10-15T19:21:12.170792] [INFO ] [MAIN ] HEQ: Loaded 6781 existing records. [2025-10-15T19:21:12.348461] [WARN ] [MAIN ] HEQ: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:21:12.348705] [INFO ] [MAIN ] HEQ: Wiping existing primary data before full refresh. [2025-10-15T19:21:12.348846] [INFO ] [LOCAL ] HEQ: Starting deletion of primary data. [2025-10-15T19:21:12.354704] [DEBUG] [LOCAL ] HEQ: Deleted primary data file. [2025-10-15T19:21:12.364237] [INFO ] [MAIN ] HEQ: Starting full primary refresh. [2025-10-15T19:21:12.396470] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-10 (1.88 seconds). [2025-10-15T19:21:12.472062] [INFO ] [REMOTE ] HDB: Full fetch complete (75578 records). [2025-10-15T19:21:12.477868] [DEBUG] [VALIDATOR ] HDB: Validating primary data. [2025-10-15T19:21:12.979456] [INFO ] [REMOTE ] HEQ: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:21:12.999536] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2024-12. [2025-10-15T19:21:13.132637] [DEBUG] [VALIDATOR ] HDB: All expected trading days are present. [2025-10-15T19:21:13.132796] [DEBUG] [VALIDATOR ] HDB: Primary data validation passed. [2025-10-15T19:21:13.133823] [INFO ] [MAIN ] HDB: Fetched primary data is valid. [2025-10-15T19:21:13.133903] [DEBUG] [LOCAL ] HDB: Saving primary data. [2025-10-15T19:21:13.135348] [DEBUG] [LOCAL ] HDB: Trimmed 75578 records to 51932 (keeping 200 days of data) [2025-10-15T19:21:13.381140] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-10-15T19:21:13.483320] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-15T19:21:13.512800] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2024-12 (0.51 seconds). [2025-10-15T19:21:13.532817] [DEBUG] [LOCAL ] HDB: Primary data saved (51932 records). [2025-10-15T19:21:13.532950] [INFO ] [MAIN ] HDB: Full history saved. [2025-10-15T19:21:13.533034] [INFO ] [MAIN ] Update Progress: 1003/2369 symbols completed. HDB took 41.9s. Estimated remaining: 3h 12m 14s. Rate: 7.1 symbols/min [2025-10-15T19:21:13.697681] [INFO ] [MAIN ] HESM: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:21:13.714021] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-01. [2025-10-15T19:21:13.746482] [DEBUG] [LOCAL ] HESM: Loaded 48462 existing records from primary storage. [2025-10-15T19:21:13.746819] [INFO ] [MAIN ] HESM: Loaded 48462 existing records. [2025-10-15T19:21:13.919250] [WARN ] [MAIN ] HESM: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:21:13.919704] [INFO ] [MAIN ] HESM: Wiping existing primary data before full refresh. [2025-10-15T19:21:13.919761] [INFO ] [LOCAL ] HESM: Starting deletion of primary data. [2025-10-15T19:21:13.920060] [DEBUG] [LOCAL ] HESM: Deleted primary data file. [2025-10-15T19:21:13.920098] [INFO ] [MAIN ] HESM: Starting full primary refresh. [2025-10-15T19:21:14.273613] [INFO ] [REMOTE ] HESM: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:21:14.363500] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-15T19:21:14.514015] [INFO ] [REMOTE ] HESM: Fetching primary data for 2024-12. [2025-10-15T19:21:15.314053] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-02. [2025-10-15T19:21:15.922804] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-15T19:21:15.987639] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-15T19:21:16.113977] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-10. [2025-10-15T19:21:16.913984] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-10. [2025-10-15T19:21:16.972826] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-15T19:21:16.979559] [INFO ] [REMOTE ] HD: Full fetch complete (77563 records). [2025-10-15T19:21:16.979787] [DEBUG] [VALIDATOR ] HD: Validating primary data. [2025-10-15T19:21:17.362633] [DEBUG] [VALIDATOR ] HD: All expected trading days are present. [2025-10-15T19:21:17.362777] [DEBUG] [VALIDATOR ] HD: Primary data validation passed. [2025-10-15T19:21:17.363813] [INFO ] [MAIN ] HD: Fetched primary data is valid. [2025-10-15T19:21:17.363875] [DEBUG] [LOCAL ] HD: Saving primary data. [2025-10-15T19:21:17.365262] [DEBUG] [LOCAL ] HD: Trimmed 77563 records to 53492 (keeping 200 days of data) [2025-10-15T19:21:17.696614] [DEBUG] [LOCAL ] HD: Primary data saved (53492 records). [2025-10-15T19:21:17.696768] [INFO ] [MAIN ] HD: Full history saved. [2025-10-15T19:21:17.696851] [INFO ] [MAIN ] Update Progress: 1004/2369 symbols completed. HD took 46.0s. Estimated remaining: 3h 11m 60s. Rate: 7.1 symbols/min [2025-10-15T19:21:17.719128] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-01. [2025-10-15T19:21:17.866445] [INFO ] [MAIN ] HF: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:21:17.866596] [DEBUG] [LOCAL ] HF: No existing data file found in primary storage. [2025-10-15T19:21:17.866632] [WARN ] [MAIN ] HF: No existing data found, performing full refresh instead. [2025-10-15T19:21:17.866757] [INFO ] [MAIN ] HF: Wiping existing primary data before full refresh. [2025-10-15T19:21:17.866798] [INFO ] [LOCAL ] HF: Starting deletion of primary data. [2025-10-15T19:21:17.866838] [DEBUG] [LOCAL ] HF: No primary data file found to delete. [2025-10-15T19:21:17.866868] [INFO ] [MAIN ] HF: Starting full primary refresh. [2025-10-15T19:21:18.052903] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-15T19:21:18.103156] [INFO ] [REMOTE ] HEI: Full fetch complete (47729 records). [2025-10-15T19:21:18.128533] [DEBUG] [VALIDATOR ] HEI: Validating primary data. [2025-10-15T19:21:18.390401] [INFO ] [REMOTE ] HF: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:21:18.520216] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-03. [2025-10-15T19:21:18.643470] [DEBUG] [VALIDATOR ] HEI: All expected trading days are present. [2025-10-15T19:21:18.643542] [DEBUG] [VALIDATOR ] HEI: Primary data validation passed. [2025-10-15T19:21:18.644326] [INFO ] [MAIN ] HEI: Fetched primary data is valid. [2025-10-15T19:21:18.644387] [DEBUG] [LOCAL ] HEI: Saving primary data. [2025-10-15T19:21:18.645287] [DEBUG] [LOCAL ] HEI: Trimmed 47729 records to 31248 (keeping 200 days of data) [2025-10-15T19:21:18.838244] [DEBUG] [LOCAL ] HEI: Primary data saved (31248 records). [2025-10-15T19:21:18.838398] [INFO ] [MAIN ] HEI: Full history saved. [2025-10-15T19:21:18.838484] [INFO ] [MAIN ] Update Progress: 1005/2369 symbols completed. HEI took 31.0s. Estimated remaining: 3h 11m 41s. Rate: 7.1 symbols/min [2025-10-15T19:21:19.006535] [INFO ] [MAIN ] HFND: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:21:19.006690] [DEBUG] [LOCAL ] HFND: No existing data file found in primary storage. [2025-10-15T19:21:19.006741] [WARN ] [MAIN ] HFND: No existing data found, performing full refresh instead. [2025-10-15T19:21:19.006844] [INFO ] [MAIN ] HFND: Wiping existing primary data before full refresh. [2025-10-15T19:21:19.006886] [INFO ] [LOCAL ] HFND: Starting deletion of primary data. [2025-10-15T19:21:19.006926] [DEBUG] [LOCAL ] HFND: No primary data file found to delete. [2025-10-15T19:21:19.006962] [INFO ] [MAIN ] HFND: Starting full primary refresh. [2025-10-15T19:21:19.283154] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-15T19:21:19.320302] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-04. [2025-10-15T19:21:19.430060] [INFO ] [REMOTE ] HFND: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:21:19.432748] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-15T19:21:20.113983] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-02. [2025-10-15T19:21:20.208272] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-15T19:21:20.914048] [INFO ] [REMOTE ] HFND: Fetching primary data for 2024-12. [2025-10-15T19:21:21.341864] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2024-12 (0.43 seconds). [2025-10-15T19:21:21.388931] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-15T19:21:21.714020] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-03. [2025-10-15T19:21:22.514016] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-01. [2025-10-15T19:21:22.857339] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-01 (0.34 seconds). [2025-10-15T19:21:22.913695] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-15T19:21:23.314006] [INFO ] [REMOTE ] HF: Fetching primary data for 2024-12. [2025-10-15T19:21:23.663928] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2024-12 (0.35 seconds). [2025-10-15T19:21:24.114009] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-04. [2025-10-15T19:21:24.914079] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-02. [2025-10-15T19:21:25.616993] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-15T19:21:25.658867] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-15T19:21:25.713974] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-05. [2025-10-15T19:21:26.514060] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-03. [2025-10-15T19:21:26.937935] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-10-15T19:21:27.232353] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-15T19:21:27.313961] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-06. [2025-10-15T19:21:28.113972] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-05. [2025-10-15T19:21:28.506286] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-05 (0.39 seconds). [2025-10-15T19:21:28.913988] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-04. [2025-10-15T19:21:28.969174] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-15T19:21:29.315810] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-04 (0.40 seconds). [2025-10-15T19:21:29.714012] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-01. [2025-10-15T19:21:30.020277] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-01 (0.31 seconds). [2025-10-15T19:21:30.513992] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-02. [2025-10-15T19:21:30.826796] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-02 (0.31 seconds). [2025-10-15T19:21:31.314010] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-06. [2025-10-15T19:21:31.712706] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-10-15T19:21:32.113997] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-07. [2025-10-15T19:21:32.799879] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-15T19:21:32.914014] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-07. [2025-10-15T19:21:33.714017] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-03. [2025-10-15T19:21:33.951525] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-03 (0.24 seconds). [2025-10-15T19:21:34.514010] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-08. [2025-10-15T19:21:34.574046] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-15T19:21:35.091493] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-15T19:21:35.314021] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-09. [2025-10-15T19:21:35.863734] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-15T19:21:36.114053] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-05. [2025-10-15T19:21:36.444076] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-05 (0.33 seconds). [2025-10-15T19:21:36.914012] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-06. [2025-10-15T19:21:37.238880] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-06 (0.32 seconds). [2025-10-15T19:21:37.714007] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-10. [2025-10-15T19:21:38.509337] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-15T19:21:38.511037] [INFO ] [REMOTE ] HEQ: Full fetch complete (9605 records). [2025-10-15T19:21:38.511112] [DEBUG] [VALIDATOR ] HEQ: Validating primary data. [2025-10-15T19:21:38.522484] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-08. [2025-10-15T19:21:38.908382] [DEBUG] [VALIDATOR ] HEQ: All expected trading days are present. [2025-10-15T19:21:38.908462] [DEBUG] [VALIDATOR ] HEQ: Primary data validation passed. [2025-10-15T19:21:38.908701] [INFO ] [MAIN ] HEQ: Fetched primary data is valid. [2025-10-15T19:21:38.908761] [DEBUG] [LOCAL ] HEQ: Saving primary data. [2025-10-15T19:21:38.909176] [DEBUG] [LOCAL ] HEQ: Trimmed 9605 records to 6769 (keeping 200 days of data) [2025-10-15T19:21:38.948815] [DEBUG] [LOCAL ] HEQ: Primary data saved (6769 records). [2025-10-15T19:21:38.948926] [INFO ] [MAIN ] HEQ: Full history saved. [2025-10-15T19:21:38.949017] [INFO ] [MAIN ] Update Progress: 1006/2369 symbols completed. HEQ took 27.0s. Estimated remaining: 3h 11m 49s. Rate: 7.1 symbols/min [2025-10-15T19:21:39.113794] [INFO ] [MAIN ] HFRO: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:21:39.131179] [DEBUG] [LOCAL ] HFRO: Loaded 17027 existing records from primary storage. [2025-10-15T19:21:39.131401] [INFO ] [MAIN ] HFRO: Loaded 17027 existing records. [2025-10-15T19:21:39.305524] [WARN ] [MAIN ] HFRO: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:21:39.305769] [INFO ] [MAIN ] HFRO: Wiping existing primary data before full refresh. [2025-10-15T19:21:39.305818] [INFO ] [LOCAL ] HFRO: Starting deletion of primary data. [2025-10-15T19:21:39.306013] [DEBUG] [LOCAL ] HFRO: Deleted primary data file. [2025-10-15T19:21:39.306071] [INFO ] [MAIN ] HFRO: Starting full primary refresh. [2025-10-15T19:21:39.319222] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-04. [2025-10-15T19:21:39.648055] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-04 (0.33 seconds). [2025-10-15T19:21:39.669601] [INFO ] [REMOTE ] HFRO: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:21:40.000515] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-15T19:21:40.114003] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2024-12. [2025-10-15T19:21:40.914010] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-07. [2025-10-15T19:21:41.249387] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-15T19:21:41.310611] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-07 (0.40 seconds). [2025-10-15T19:21:41.714013] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-01. [2025-10-15T19:21:42.514012] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-05. [2025-10-15T19:21:42.777071] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-05 (0.26 seconds). [2025-10-15T19:21:42.792846] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-15T19:21:43.313996] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-02. [2025-10-15T19:21:44.113979] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-08. [2025-10-15T19:21:44.416767] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-15T19:21:44.531842] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-10-15T19:21:44.914052] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-03. [2025-10-15T19:21:45.713980] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-09. [2025-10-15T19:21:45.961715] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-15T19:21:46.514081] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-04. [2025-10-15T19:21:47.313993] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-09. [2025-10-15T19:21:47.426798] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-15T19:21:47.485696] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-15T19:21:47.574749] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-09 (0.26 seconds). [2025-10-15T19:21:48.113997] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-10. [2025-10-15T19:21:48.914051] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-10. [2025-10-15T19:21:49.303730] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-10 (0.39 seconds). [2025-10-15T19:21:49.304435] [INFO ] [REMOTE ] HFND: Full fetch complete (1763 records). [2025-10-15T19:21:49.304503] [DEBUG] [VALIDATOR ] HFND: Validating primary data. [2025-10-15T19:21:49.485728] [WARN ] [VALIDATOR ] HFND: Validation failed - insufficient historical data. Have 196 unique days, need 200 days [2025-10-15T19:21:49.485920] [FATAL] [MAIN ] HFND: Fetched primary data is invalid. Refusing to save it. [2025-10-15T19:21:49.485990] [WARN ] [MAIN ] HFND: Deleting existing primary and derivative data due to validation failure. [2025-10-15T19:21:49.486063] [INFO ] [LOCAL ] HFND: Starting deletion of primary data. [2025-10-15T19:21:49.486129] [DEBUG] [LOCAL ] HFND: No primary data file found to delete. [2025-10-15T19:21:49.486166] [INFO ] [LOCAL ] HFND: Starting deletion of derivative data. [2025-10-15T19:21:49.486207] [DEBUG] [LOCAL ] HFND: No derivative data file found to delete. [2025-10-15T19:21:49.486265] [INFO ] [MAIN ] Update Progress: 1007/2369 symbols completed. HFND took 30.6s. Estimated remaining: 3h 11m 43s. Rate: 7.1 symbols/min [2025-10-15T19:21:49.657490] [INFO ] [MAIN ] HGER: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:21:49.672383] [DEBUG] [LOCAL ] HGER: Loaded 14809 existing records from primary storage. [2025-10-15T19:21:49.672629] [INFO ] [MAIN ] HGER: Loaded 14809 existing records. [2025-10-15T19:21:49.719348] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-05. [2025-10-15T19:21:49.863866] [WARN ] [MAIN ] HGER: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:21:49.864095] [INFO ] [MAIN ] HGER: Wiping existing primary data before full refresh. [2025-10-15T19:21:49.864143] [INFO ] [LOCAL ] HGER: Starting deletion of primary data. [2025-10-15T19:21:49.864351] [DEBUG] [LOCAL ] HGER: Deleted primary data file. [2025-10-15T19:21:49.864409] [INFO ] [MAIN ] HGER: Starting full primary refresh. [2025-10-15T19:21:50.060222] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-10 (1.95 seconds). [2025-10-15T19:21:50.131522] [INFO ] [REMOTE ] HESM: Full fetch complete (69637 records). [2025-10-15T19:21:50.146628] [DEBUG] [VALIDATOR ] HESM: Validating primary data. [2025-10-15T19:21:50.385350] [INFO ] [REMOTE ] HGER: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:21:50.521141] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-06. [2025-10-15T19:21:50.606157] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-15T19:21:50.732929] [DEBUG] [VALIDATOR ] HESM: All expected trading days are present. [2025-10-15T19:21:50.733050] [DEBUG] [VALIDATOR ] HESM: Primary data validation passed. [2025-10-15T19:21:50.734283] [INFO ] [MAIN ] HESM: Fetched primary data is valid. [2025-10-15T19:21:50.734412] [DEBUG] [LOCAL ] HESM: Saving primary data. [2025-10-15T19:21:50.736589] [DEBUG] [LOCAL ] HESM: Trimmed 69637 records to 48517 (keeping 200 days of data) [2025-10-15T19:21:50.834805] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-06 (0.31 seconds). [2025-10-15T19:21:51.057387] [DEBUG] [LOCAL ] HESM: Primary data saved (48517 records). [2025-10-15T19:21:51.057546] [INFO ] [MAIN ] HESM: Full history saved. [2025-10-15T19:21:51.057660] [INFO ] [MAIN ] Update Progress: 1008/2369 symbols completed. HESM took 37.5s. Estimated remaining: 3h 11m 26s. Rate: 7.1 symbols/min [2025-10-15T19:21:51.244082] [INFO ] [MAIN ] HGLB: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:21:51.255706] [DEBUG] [LOCAL ] HGLB: Loaded 9621 existing records from primary storage. [2025-10-15T19:21:51.255937] [INFO ] [MAIN ] HGLB: Loaded 9621 existing records. [2025-10-15T19:21:51.321571] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-07. [2025-10-15T19:21:51.459082] [WARN ] [MAIN ] HGLB: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:21:51.459298] [INFO ] [MAIN ] HGLB: Wiping existing primary data before full refresh. [2025-10-15T19:21:51.459348] [INFO ] [LOCAL ] HGLB: Starting deletion of primary data. [2025-10-15T19:21:51.459514] [DEBUG] [LOCAL ] HGLB: Deleted primary data file. [2025-10-15T19:21:51.459572] [INFO ] [MAIN ] HGLB: Starting full primary refresh. [2025-10-15T19:21:51.638964] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-07 (0.32 seconds). [2025-10-15T19:21:51.875144] [INFO ] [REMOTE ] HGLB: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:21:52.114011] [INFO ] [REMOTE ] HGER: Fetching primary data for 2024-12. [2025-10-15T19:21:52.784951] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-10-15T19:21:52.913996] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-06. [2025-10-15T19:21:53.669396] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-15T19:21:53.713986] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-08. [2025-10-15T19:21:54.117270] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-10-15T19:21:54.514035] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-09. [2025-10-15T19:21:54.729416] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-09 (0.22 seconds). [2025-10-15T19:21:55.313977] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-01. [2025-10-15T19:21:56.061278] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-15T19:21:56.114008] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-02. [2025-10-15T19:21:56.688141] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-15T19:21:56.914038] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-03. [2025-10-15T19:21:57.388288] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-10-15T19:21:57.714043] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-04. [2025-10-15T19:21:58.498713] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-15T19:21:58.513949] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-05. [2025-10-15T19:21:59.139511] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-15T19:21:59.314003] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-06. [2025-10-15T19:22:00.016873] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-15T19:22:00.114107] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-07. [2025-10-15T19:22:00.913992] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-10. [2025-10-15T19:22:01.082581] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-15T19:22:01.612761] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-15T19:22:01.613462] [INFO ] [REMOTE ] HF: Full fetch complete (435 records). [2025-10-15T19:22:01.613530] [DEBUG] [VALIDATOR ] HF: Validating primary data. [2025-10-15T19:22:01.718821] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-07. [2025-10-15T19:22:01.805261] [WARN ] [VALIDATOR ] HF: Validation failed - insufficient historical data. Have 143 unique days, need 200 days [2025-10-15T19:22:01.805506] [FATAL] [MAIN ] HF: Fetched primary data is invalid. Refusing to save it. [2025-10-15T19:22:01.805591] [WARN ] [MAIN ] HF: Deleting existing primary and derivative data due to validation failure. [2025-10-15T19:22:01.805709] [INFO ] [LOCAL ] HF: Starting deletion of primary data. [2025-10-15T19:22:01.805806] [DEBUG] [LOCAL ] HF: No primary data file found to delete. [2025-10-15T19:22:01.805858] [INFO ] [LOCAL ] HF: Starting deletion of derivative data. [2025-10-15T19:22:01.805917] [DEBUG] [LOCAL ] HF: No derivative data file found to delete. [2025-10-15T19:22:01.805999] [INFO ] [MAIN ] Update Progress: 1009/2369 symbols completed. HF took 44.1s. Estimated remaining: 3h 11m 20s. Rate: 7.1 symbols/min [2025-10-15T19:22:01.982431] [INFO ] [MAIN ] HGTY: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:22:01.999286] [DEBUG] [LOCAL ] HGTY: Loaded 13282 existing records from primary storage. [2025-10-15T19:22:01.999526] [INFO ] [MAIN ] HGTY: Loaded 13282 existing records. [2025-10-15T19:22:02.183210] [WARN ] [MAIN ] HGTY: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:22:02.183427] [INFO ] [MAIN ] HGTY: Wiping existing primary data before full refresh. [2025-10-15T19:22:02.183475] [INFO ] [LOCAL ] HGTY: Starting deletion of primary data. [2025-10-15T19:22:02.183708] [DEBUG] [LOCAL ] HGTY: Deleted primary data file. [2025-10-15T19:22:02.183765] [INFO ] [MAIN ] HGTY: Starting full primary refresh. [2025-10-15T19:22:02.519137] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2024-12. [2025-10-15T19:22:02.575949] [INFO ] [REMOTE ] HGTY: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:22:02.766372] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-15T19:22:03.314027] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-08. [2025-10-15T19:22:03.450619] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-10-15T19:22:04.114006] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-01. [2025-10-15T19:22:04.315444] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-15T19:22:04.818981] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-15T19:22:04.914081] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-08. [2025-10-15T19:22:05.713972] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-09. [2025-10-15T19:22:05.869890] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-15T19:22:06.488376] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-15T19:22:06.513955] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-10. [2025-10-15T19:22:07.314056] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-02. [2025-10-15T19:22:07.490135] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-15T19:22:07.492922] [INFO ] [REMOTE ] HFRO: Full fetch complete (27949 records). [2025-10-15T19:22:07.493004] [DEBUG] [VALIDATOR ] HFRO: Validating primary data. [2025-10-15T19:22:07.865249] [DEBUG] [VALIDATOR ] HFRO: All expected trading days are present. [2025-10-15T19:22:07.865351] [DEBUG] [VALIDATOR ] HFRO: Primary data validation passed. [2025-10-15T19:22:07.865947] [INFO ] [MAIN ] HFRO: Fetched primary data is valid. [2025-10-15T19:22:07.866009] [DEBUG] [LOCAL ] HFRO: Saving primary data. [2025-10-15T19:22:07.866670] [DEBUG] [LOCAL ] HFRO: Trimmed 27949 records to 16923 (keeping 200 days of data) [2025-10-15T19:22:07.961982] [DEBUG] [LOCAL ] HFRO: Primary data saved (16923 records). [2025-10-15T19:22:07.962116] [INFO ] [MAIN ] HFRO: Full history saved. [2025-10-15T19:22:07.962195] [INFO ] [MAIN ] Update Progress: 1010/2369 symbols completed. HFRO took 29.0s. Estimated remaining: 3h 11m 9s. Rate: 7.1 symbols/min [2025-10-15T19:22:08.137139] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-15T19:22:08.136475] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-09. [2025-10-15T19:22:08.139496] [INFO ] [MAIN ] HGV: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:22:08.184895] [DEBUG] [LOCAL ] HGV: Loaded 46382 existing records from primary storage. [2025-10-15T19:22:08.185180] [INFO ] [MAIN ] HGV: Loaded 46382 existing records. [2025-10-15T19:22:08.364362] [WARN ] [MAIN ] HGV: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:22:08.364803] [INFO ] [MAIN ] HGV: Wiping existing primary data before full refresh. [2025-10-15T19:22:08.364863] [INFO ] [LOCAL ] HGV: Starting deletion of primary data. [2025-10-15T19:22:08.365193] [DEBUG] [LOCAL ] HGV: Deleted primary data file. [2025-10-15T19:22:08.365249] [INFO ] [MAIN ] HGV: Starting full primary refresh. [2025-10-15T19:22:08.706770] [INFO ] [REMOTE ] HGV: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:22:08.914012] [INFO ] [REMOTE ] HGV: Fetching primary data for 2024-12. [2025-10-15T19:22:09.044597] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-15T19:22:09.714061] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2024-12. [2025-10-15T19:22:09.849919] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-10-15T19:22:10.196895] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2024-12 (0.48 seconds). [2025-10-15T19:22:10.513965] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-01. [2025-10-15T19:22:11.253181] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-15T19:22:11.313996] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-02. [2025-10-15T19:22:11.863391] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-15T19:22:12.114000] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-01. [2025-10-15T19:22:12.914054] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-10. [2025-10-15T19:22:13.438322] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-15T19:22:13.714113] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-03. [2025-10-15T19:22:13.991418] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-15T19:22:13.994823] [INFO ] [REMOTE ] HGER: Full fetch complete (18185 records). [2025-10-15T19:22:13.994897] [DEBUG] [VALIDATOR ] HGER: Validating primary data. [2025-10-15T19:22:14.381977] [DEBUG] [VALIDATOR ] HGER: All expected trading days are present. [2025-10-15T19:22:14.382059] [DEBUG] [VALIDATOR ] HGER: Primary data validation passed. [2025-10-15T19:22:14.382480] [INFO ] [MAIN ] HGER: Fetched primary data is valid. [2025-10-15T19:22:14.382524] [DEBUG] [LOCAL ] HGER: Saving primary data. [2025-10-15T19:22:14.383088] [DEBUG] [LOCAL ] HGER: Trimmed 18185 records to 14918 (keeping 200 days of data) [2025-10-15T19:22:14.473251] [DEBUG] [LOCAL ] HGER: Primary data saved (14918 records). [2025-10-15T19:22:14.473395] [INFO ] [MAIN ] HGER: Full history saved. [2025-10-15T19:22:14.473476] [INFO ] [MAIN ] Update Progress: 1011/2369 symbols completed. HGER took 25.0s. Estimated remaining: 3h 10m 58s. Rate: 7.1 symbols/min [2025-10-15T19:22:14.517874] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-03. [2025-10-15T19:22:14.595171] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-15T19:22:14.670468] [INFO ] [MAIN ] HHH: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:22:14.702560] [DEBUG] [LOCAL ] HHH: Loaded 33198 existing records from primary storage. [2025-10-15T19:22:14.702900] [INFO ] [MAIN ] HHH: Loaded 33198 existing records. [2025-10-15T19:22:14.878538] [WARN ] [MAIN ] HHH: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:22:14.878776] [INFO ] [MAIN ] HHH: Wiping existing primary data before full refresh. [2025-10-15T19:22:14.878827] [INFO ] [LOCAL ] HHH: Starting deletion of primary data. [2025-10-15T19:22:14.879061] [DEBUG] [LOCAL ] HHH: Deleted primary data file. [2025-10-15T19:22:14.879116] [INFO ] [MAIN ] HHH: Starting full primary refresh. [2025-10-15T19:22:15.229107] [INFO ] [REMOTE ] HHH: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:22:15.313961] [INFO ] [REMOTE ] HHH: Fetching primary data for 2024-12. [2025-10-15T19:22:15.335920] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-15T19:22:16.114010] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-04. [2025-10-15T19:22:16.380779] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-15T19:22:16.913996] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-02. [2025-10-15T19:22:16.958704] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-15T19:22:17.714030] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-04. [2025-10-15T19:22:18.335268] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-15T19:22:18.441605] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-15T19:22:18.513975] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-05. [2025-10-15T19:22:19.249198] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-15T19:22:19.314007] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-06. [2025-10-15T19:22:20.084573] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-15T19:22:20.114022] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-07. [2025-10-15T19:22:20.680486] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-15T19:22:20.914061] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-01. [2025-10-15T19:22:21.714026] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-08. [2025-10-15T19:22:22.183889] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-15T19:22:22.513971] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-02. [2025-10-15T19:22:22.714617] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-15T19:22:23.314006] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-09. [2025-10-15T19:22:23.887637] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-15T19:22:23.953980] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-15T19:22:24.114012] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-10. [2025-10-15T19:22:24.914034] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-03. [2025-10-15T19:22:24.998895] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-15T19:22:25.000935] [INFO ] [REMOTE ] HGTY: Full fetch complete (17443 records). [2025-10-15T19:22:25.001017] [DEBUG] [VALIDATOR ] HGTY: Validating primary data. [2025-10-15T19:22:25.390789] [DEBUG] [VALIDATOR ] HGTY: All expected trading days are present. [2025-10-15T19:22:25.390866] [DEBUG] [VALIDATOR ] HGTY: Primary data validation passed. [2025-10-15T19:22:25.391233] [INFO ] [MAIN ] HGTY: Fetched primary data is valid. [2025-10-15T19:22:25.391272] [DEBUG] [LOCAL ] HGTY: Saving primary data. [2025-10-15T19:22:25.391817] [DEBUG] [LOCAL ] HGTY: Trimmed 17443 records to 13285 (keeping 200 days of data) [2025-10-15T19:22:25.472509] [DEBUG] [LOCAL ] HGTY: Primary data saved (13285 records). [2025-10-15T19:22:25.472717] [INFO ] [MAIN ] HGTY: Full history saved. [2025-10-15T19:22:25.472836] [INFO ] [MAIN ] Update Progress: 1012/2369 symbols completed. HGTY took 23.7s. Estimated remaining: 3h 10m 53s. Rate: 7.1 symbols/min [2025-10-15T19:22:25.640365] [INFO ] [MAIN ] HI: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:22:25.674962] [DEBUG] [LOCAL ] HI: Loaded 35603 existing records from primary storage. [2025-10-15T19:22:25.675234] [INFO ] [MAIN ] HI: Loaded 35603 existing records. [2025-10-15T19:22:25.719203] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-03. [2025-10-15T19:22:25.851804] [WARN ] [MAIN ] HI: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:22:25.852032] [INFO ] [MAIN ] HI: Wiping existing primary data before full refresh. [2025-10-15T19:22:25.852079] [INFO ] [LOCAL ] HI: Starting deletion of primary data. [2025-10-15T19:22:25.852385] [DEBUG] [LOCAL ] HI: Deleted primary data file. [2025-10-15T19:22:25.852440] [INFO ] [MAIN ] HI: Starting full primary refresh. [2025-10-15T19:22:26.239241] [INFO ] [REMOTE ] HI: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:22:26.491748] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-15T19:22:26.513959] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-04. [2025-10-15T19:22:27.109522] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-15T19:22:27.314068] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-05. [2025-10-15T19:22:27.767600] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-15T19:22:27.886963] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-15T19:22:28.114035] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-06. [2025-10-15T19:22:28.817376] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-15T19:22:28.914102] [INFO ] [REMOTE ] HI: Fetching primary data for 2024-12. [2025-10-15T19:22:29.714054] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-04. [2025-10-15T19:22:30.237931] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-15T19:22:30.422499] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-15T19:22:30.514044] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-05. [2025-10-15T19:22:31.314033] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-05. [2025-10-15T19:22:32.086428] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-15T19:22:32.113999] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-06. [2025-10-15T19:22:32.844840] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-15T19:22:32.913992] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-06. [2025-10-15T19:22:33.611823] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-15T19:22:33.713983] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-07. [2025-10-15T19:22:34.000427] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-15T19:22:34.514065] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-01. [2025-10-15T19:22:35.087181] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-15T19:22:35.314023] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-07. [2025-10-15T19:22:35.759504] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-15T19:22:35.772787] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-10-15T19:22:36.113963] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-02. [2025-10-15T19:22:36.913958] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-08. [2025-10-15T19:22:37.320122] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-15T19:22:37.713981] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-03. [2025-10-15T19:22:38.323002] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-15T19:22:38.514121] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-08. [2025-10-15T19:22:39.028850] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-15T19:22:39.278898] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-15T19:22:39.314091] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-09. [2025-10-15T19:22:39.968833] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-15T19:22:40.114018] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-09. [2025-10-15T19:22:40.914009] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-10. [2025-10-15T19:22:41.522421] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-15T19:22:41.556182] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-15T19:22:41.558210] [INFO ] [REMOTE ] HGLB: Full fetch complete (14750 records). [2025-10-15T19:22:41.558285] [DEBUG] [VALIDATOR ] HGLB: Validating primary data. [2025-10-15T19:22:41.721606] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-07. [2025-10-15T19:22:41.988627] [DEBUG] [VALIDATOR ] HGLB: All expected trading days are present. [2025-10-15T19:22:41.988735] [DEBUG] [VALIDATOR ] HGLB: Primary data validation passed. [2025-10-15T19:22:41.989072] [INFO ] [MAIN ] HGLB: Fetched primary data is valid. [2025-10-15T19:22:41.989112] [DEBUG] [LOCAL ] HGLB: Saving primary data. [2025-10-15T19:22:41.989632] [DEBUG] [LOCAL ] HGLB: Trimmed 14750 records to 9584 (keeping 200 days of data) [2025-10-15T19:22:42.051201] [DEBUG] [LOCAL ] HGLB: Primary data saved (9584 records). [2025-10-15T19:22:42.051340] [INFO ] [MAIN ] HGLB: Full history saved. [2025-10-15T19:22:42.051418] [INFO ] [MAIN ] Update Progress: 1013/2369 symbols completed. HGLB took 51.0s. Estimated remaining: 3h 10m 55s. Rate: 7.1 symbols/min [2025-10-15T19:22:42.218754] [INFO ] [MAIN ] HIG: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:22:42.269099] [DEBUG] [LOCAL ] HIG: Loaded 51171 existing records from primary storage. [2025-10-15T19:22:42.269410] [INFO ] [MAIN ] HIG: Loaded 51171 existing records. [2025-10-15T19:22:42.441733] [WARN ] [MAIN ] HIG: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:22:42.441941] [INFO ] [MAIN ] HIG: Wiping existing primary data before full refresh. [2025-10-15T19:22:42.441988] [INFO ] [LOCAL ] HIG: Starting deletion of primary data. [2025-10-15T19:22:42.442229] [DEBUG] [LOCAL ] HIG: Deleted primary data file. [2025-10-15T19:22:42.442268] [INFO ] [MAIN ] HIG: Starting full primary refresh. [2025-10-15T19:22:42.519152] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-10. [2025-10-15T19:22:42.793229] [INFO ] [REMOTE ] HIG: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:22:43.314024] [INFO ] [REMOTE ] HIG: Fetching primary data for 2024-12. [2025-10-15T19:22:43.494078] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-15T19:22:43.915518] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-15T19:22:43.919963] [INFO ] [REMOTE ] HHH: Full fetch complete (45949 records). [2025-10-15T19:22:43.920236] [DEBUG] [VALIDATOR ] HHH: Validating primary data. [2025-10-15T19:22:44.122623] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-08. [2025-10-15T19:22:44.314353] [DEBUG] [VALIDATOR ] HHH: All expected trading days are present. [2025-10-15T19:22:44.314449] [DEBUG] [VALIDATOR ] HHH: Primary data validation passed. [2025-10-15T19:22:44.315419] [INFO ] [MAIN ] HHH: Fetched primary data is valid. [2025-10-15T19:22:44.315487] [DEBUG] [LOCAL ] HHH: Saving primary data. [2025-10-15T19:22:44.316715] [DEBUG] [LOCAL ] HHH: Trimmed 45949 records to 33258 (keeping 200 days of data) [2025-10-15T19:22:44.520224] [DEBUG] [LOCAL ] HHH: Primary data saved (33258 records). [2025-10-15T19:22:44.520371] [INFO ] [MAIN ] HHH: Full history saved. [2025-10-15T19:22:44.520451] [INFO ] [MAIN ] Update Progress: 1014/2369 symbols completed. HHH took 30.0s. Estimated remaining: 3h 10m 39s. Rate: 7.1 symbols/min [2025-10-15T19:22:44.701287] [INFO ] [MAIN ] HII: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:22:44.746329] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-15T19:22:44.767570] [DEBUG] [LOCAL ] HII: Loaded 33836 existing records from primary storage. [2025-10-15T19:22:44.767927] [INFO ] [MAIN ] HII: Loaded 33836 existing records. [2025-10-15T19:22:44.922298] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-04. [2025-10-15T19:22:44.963943] [WARN ] [MAIN ] HII: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:22:44.964106] [INFO ] [MAIN ] HII: Wiping existing primary data before full refresh. [2025-10-15T19:22:44.964345] [INFO ] [LOCAL ] HII: Starting deletion of primary data. [2025-10-15T19:22:44.964545] [DEBUG] [LOCAL ] HII: Deleted primary data file. [2025-10-15T19:22:44.964600] [INFO ] [MAIN ] HII: Starting full primary refresh. [2025-10-15T19:22:45.325030] [INFO ] [REMOTE ] HII: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:22:45.612271] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-15T19:22:45.713982] [INFO ] [REMOTE ] HII: Fetching primary data for 2024-12. [2025-10-15T19:22:46.117453] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-15T19:22:46.514012] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-01. [2025-10-15T19:22:47.033016] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-15T19:22:47.313997] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-05. [2025-10-15T19:22:48.038348] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-15T19:22:48.113992] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-02. [2025-10-15T19:22:48.790476] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-15T19:22:48.914028] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-09. [2025-10-15T19:22:49.544695] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-15T19:22:49.713991] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-03. [2025-10-15T19:22:50.224829] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-15T19:22:50.513982] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-10. [2025-10-15T19:22:51.313987] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-01. [2025-10-15T19:22:51.462780] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-15T19:22:52.113988] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-04. [2025-10-15T19:22:52.914053] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-06. [2025-10-15T19:23:06.926698] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-04 (14.81 seconds). [2025-10-15T19:23:06.938256] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-05. [2025-10-15T19:23:06.988159] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-01 (15.67 seconds). [2025-10-15T19:23:06.995634] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-02. [2025-10-15T19:23:08.514980] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-15T19:23:08.523842] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-03. [2025-10-15T19:23:09.231206] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-06 (16.32 seconds). [2025-10-15T19:23:09.238212] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-07. [2025-10-15T19:23:10.217141] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-15T19:23:10.226595] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-04. [2025-10-15T19:23:10.432769] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-10 (19.92 seconds). [2025-10-15T19:23:10.438338] [INFO ] [REMOTE ] HGV: Full fetch complete (66024 records). [2025-10-15T19:23:10.438474] [DEBUG] [VALIDATOR ] HGV: Validating primary data. [2025-10-15T19:23:10.827865] [DEBUG] [VALIDATOR ] HGV: All expected trading days are present. [2025-10-15T19:23:10.827946] [DEBUG] [VALIDATOR ] HGV: Primary data validation passed. [2025-10-15T19:23:10.828872] [INFO ] [MAIN ] HGV: Fetched primary data is valid. [2025-10-15T19:23:10.828936] [DEBUG] [LOCAL ] HGV: Saving primary data. [2025-10-15T19:23:10.830196] [DEBUG] [LOCAL ] HGV: Trimmed 66024 records to 46390 (keeping 200 days of data) [2025-10-15T19:23:11.102029] [DEBUG] [LOCAL ] HGV: Primary data saved (46390 records). [2025-10-15T19:23:11.102194] [INFO ] [MAIN ] HGV: Full history saved. [2025-10-15T19:23:11.103192] [INFO ] [MAIN ] Update Progress: 1015/2369 symbols completed. HGV took 1m 3s. Estimated remaining: 3h 10m 54s. Rate: 7.1 symbols/min [2025-10-15T19:23:11.269243] [INFO ] [MAIN ] HIMS: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:23:11.323130] [DEBUG] [LOCAL ] HIMS: Loaded 53817 existing records from primary storage. [2025-10-15T19:23:11.323438] [INFO ] [MAIN ] HIMS: Loaded 53817 existing records. [2025-10-15T19:23:11.500221] [WARN ] [MAIN ] HIMS: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:23:11.500448] [INFO ] [MAIN ] HIMS: Wiping existing primary data before full refresh. [2025-10-15T19:23:11.500496] [INFO ] [LOCAL ] HIMS: Starting deletion of primary data. [2025-10-15T19:23:11.500992] [DEBUG] [LOCAL ] HIMS: Deleted primary data file. [2025-10-15T19:23:11.501049] [INFO ] [MAIN ] HIMS: Starting full primary refresh. [2025-10-15T19:23:11.887756] [INFO ] [REMOTE ] HIMS: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:23:11.888629] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2024-12. [2025-10-15T19:23:11.975550] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-15T19:23:11.985324] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-05. [2025-10-15T19:23:12.559502] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-05 (5.62 seconds). [2025-10-15T19:23:12.571880] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-06. [2025-10-15T19:23:13.347515] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-07 (4.11 seconds). [2025-10-15T19:23:13.355388] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-08. [2025-10-15T19:23:13.509136] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-15T19:23:13.516763] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-06. [2025-10-15T19:23:14.308738] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-15T19:23:14.319732] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-07. [2025-10-15T19:23:14.802340] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-15T19:23:14.816014] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-09. [2025-10-15T19:23:14.817569] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2024-12 (2.93 seconds). [2025-10-15T19:23:14.830518] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-01. [2025-10-15T19:23:15.149375] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-15T19:23:15.157086] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-07. [2025-10-15T19:23:16.128956] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-15T19:23:16.143822] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-08. [2025-10-15T19:23:16.167585] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-15T19:23:16.176990] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-10. [2025-10-15T19:23:16.508252] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-15T19:23:16.519737] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-02. [2025-10-15T19:23:16.760506] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-15T19:23:16.767857] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-08. [2025-10-15T19:23:17.677812] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-15T19:23:17.682394] [INFO ] [REMOTE ] HI: Full fetch complete (50472 records). [2025-10-15T19:23:17.682480] [DEBUG] [VALIDATOR ] HI: Validating primary data. [2025-10-15T19:23:18.077321] [DEBUG] [VALIDATOR ] HI: All expected trading days are present. [2025-10-15T19:23:18.087787] [DEBUG] [VALIDATOR ] HI: Primary data validation passed. [2025-10-15T19:23:18.093894] [INFO ] [MAIN ] HI: Fetched primary data is valid. [2025-10-15T19:23:18.107560] [DEBUG] [LOCAL ] HI: Saving primary data. [2025-10-15T19:23:18.127352] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-10-15T19:23:18.138938] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-15T19:23:18.144507] [DEBUG] [LOCAL ] HI: Trimmed 50472 records to 35761 (keeping 200 days of data) [2025-10-15T19:23:18.150698] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-09. [2025-10-15T19:23:18.152976] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-09. [2025-10-15T19:23:18.379591] [DEBUG] [LOCAL ] HI: Primary data saved (35761 records). [2025-10-15T19:23:18.379773] [INFO ] [MAIN ] HI: Full history saved. [2025-10-15T19:23:18.379927] [INFO ] [MAIN ] Update Progress: 1016/2369 symbols completed. HI took 52.9s. Estimated remaining: 3h 10m 44s. Rate: 7.1 symbols/min [2025-10-15T19:23:18.527370] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-02 (2.01 seconds). [2025-10-15T19:23:18.579868] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-03. [2025-10-15T19:23:18.598310] [INFO ] [MAIN ] HIO: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:23:18.622226] [DEBUG] [LOCAL ] HIO: Loaded 24147 existing records from primary storage. [2025-10-15T19:23:18.622484] [INFO ] [MAIN ] HIO: Loaded 24147 existing records. [2025-10-15T19:23:18.799824] [WARN ] [MAIN ] HIO: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:23:18.800029] [INFO ] [MAIN ] HIO: Wiping existing primary data before full refresh. [2025-10-15T19:23:18.800114] [INFO ] [LOCAL ] HIO: Starting deletion of primary data. [2025-10-15T19:23:18.800501] [DEBUG] [LOCAL ] HIO: Deleted primary data file. [2025-10-15T19:23:18.800557] [INFO ] [MAIN ] HIO: Starting full primary refresh. [2025-10-15T19:23:19.145696] [INFO ] [REMOTE ] HIO: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:23:19.146020] [INFO ] [REMOTE ] HIO: Fetching primary data for 2024-12. [2025-10-15T19:23:19.733190] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-15T19:23:19.740471] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-10. [2025-10-15T19:23:19.989705] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-15T19:23:20.000894] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-10. [2025-10-15T19:23:20.297389] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-15T19:23:20.303739] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-01. [2025-10-15T19:23:20.889210] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-15T19:23:20.893498] [INFO ] [REMOTE ] HII: Full fetch complete (52525 records). [2025-10-15T19:23:20.902316] [DEBUG] [VALIDATOR ] HII: Validating primary data. [2025-10-15T19:23:20.941505] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-15T19:23:21.021403] [INFO ] [REMOTE ] HIG: Full fetch complete (73448 records). [2025-10-15T19:23:21.032001] [DEBUG] [VALIDATOR ] HIG: Validating primary data. [2025-10-15T19:23:21.507414] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-03 (2.93 seconds). [2025-10-15T19:23:21.668074] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-04. [2025-10-15T19:23:21.676431] [DEBUG] [VALIDATOR ] HII: All expected trading days are present. [2025-10-15T19:23:21.680180] [DEBUG] [VALIDATOR ] HII: Primary data validation passed. [2025-10-15T19:23:21.697727] [INFO ] [MAIN ] HII: Fetched primary data is valid. [2025-10-15T19:23:21.697876] [DEBUG] [LOCAL ] HII: Saving primary data. [2025-10-15T19:23:21.713583] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-15T19:23:21.751679] [DEBUG] [LOCAL ] HII: Trimmed 52525 records to 33852 (keeping 200 days of data) [2025-10-15T19:23:21.751478] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-02. [2025-10-15T19:23:21.813904] [DEBUG] [VALIDATOR ] HIG: All expected trading days are present. [2025-10-15T19:23:21.814018] [DEBUG] [VALIDATOR ] HIG: Primary data validation passed. [2025-10-15T19:23:21.814993] [INFO ] [MAIN ] HIG: Fetched primary data is valid. [2025-10-15T19:23:21.815100] [DEBUG] [LOCAL ] HIG: Saving primary data. [2025-10-15T19:23:21.907069] [DEBUG] [LOCAL ] HIG: Trimmed 73448 records to 51192 (keeping 200 days of data) [2025-10-15T19:23:22.219457] [DEBUG] [LOCAL ] HII: Primary data saved (33852 records). [2025-10-15T19:23:22.228306] [INFO ] [MAIN ] HII: Full history saved. [2025-10-15T19:23:22.255432] [INFO ] [MAIN ] Update Progress: 1017/2369 symbols completed. HII took 37.7s. Estimated remaining: 3h 10m 30s. Rate: 7.1 symbols/min [2025-10-15T19:23:22.458944] [INFO ] [MAIN ] HIPO: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:23:22.549857] [DEBUG] [LOCAL ] HIPO: Loaded 21934 existing records from primary storage. [2025-10-15T19:23:22.550990] [INFO ] [MAIN ] HIPO: Loaded 21934 existing records. [2025-10-15T19:23:22.732183] [DEBUG] [LOCAL ] HIG: Primary data saved (51192 records). [2025-10-15T19:23:22.748322] [INFO ] [MAIN ] HIG: Full history saved. [2025-10-15T19:23:22.752788] [WARN ] [MAIN ] HIPO: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:23:22.753736] [INFO ] [MAIN ] HIPO: Wiping existing primary data before full refresh. [2025-10-15T19:23:22.753502] [INFO ] [MAIN ] Update Progress: 1018/2369 symbols completed. HIG took 40.7s. Estimated remaining: 3h 10m 11s. Rate: 7.1 symbols/min [2025-10-15T19:23:22.753914] [INFO ] [LOCAL ] HIPO: Starting deletion of primary data. [2025-10-15T19:23:22.759448] [DEBUG] [LOCAL ] HIPO: Deleted primary data file. [2025-10-15T19:23:22.777276] [INFO ] [MAIN ] HIPO: Starting full primary refresh. [2025-10-15T19:23:23.134291] [INFO ] [MAIN ] HIW: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:23:23.178449] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-15T19:23:23.227043] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-03. [2025-10-15T19:23:23.341498] [INFO ] [REMOTE ] HIPO: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:23:23.341842] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2024-12. [2025-10-15T19:23:23.370529] [DEBUG] [LOCAL ] HIW: Loaded 44584 existing records from primary storage. [2025-10-15T19:23:23.370871] [INFO ] [MAIN ] HIW: Loaded 44584 existing records. [2025-10-15T19:23:23.556436] [WARN ] [MAIN ] HIW: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:23:23.556694] [INFO ] [MAIN ] HIW: Wiping existing primary data before full refresh. [2025-10-15T19:23:23.556755] [INFO ] [LOCAL ] HIW: Starting deletion of primary data. [2025-10-15T19:23:23.557159] [DEBUG] [LOCAL ] HIW: Deleted primary data file. [2025-10-15T19:23:23.557214] [INFO ] [MAIN ] HIW: Starting full primary refresh. [2025-10-15T19:23:23.918010] [INFO ] [REMOTE ] HIW: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:23:23.918401] [INFO ] [REMOTE ] HIW: Fetching primary data for 2024-12. [2025-10-15T19:23:24.192861] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-04 (2.52 seconds). [2025-10-15T19:23:24.205681] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-05. [2025-10-15T19:23:24.219943] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-15T19:23:24.224666] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-01. [2025-10-15T19:23:24.595136] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-15T19:23:24.602145] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-04. [2025-10-15T19:23:24.840343] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-15T19:23:24.844783] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-02. [2025-10-15T19:23:25.424896] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-15T19:23:25.434284] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-01. [2025-10-15T19:23:25.453811] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-15T19:23:25.460473] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-05. [2025-10-15T19:23:25.824538] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-15T19:23:25.828803] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-03. [2025-10-15T19:23:26.265875] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-15T19:23:26.271457] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-06. [2025-10-15T19:23:26.320625] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-05 (2.11 seconds). [2025-10-15T19:23:26.332169] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-06. [2025-10-15T19:23:26.539087] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-15T19:23:26.544432] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-04. [2025-10-15T19:23:26.982385] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-15T19:23:26.991427] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-02. [2025-10-15T19:23:27.252320] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-15T19:23:27.258155] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-07. [2025-10-15T19:23:27.487474] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-15T19:23:27.492878] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-05. [2025-10-15T19:23:28.289251] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-15T19:23:28.294558] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-08. [2025-10-15T19:23:28.446596] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-15T19:23:28.488502] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-15T19:23:28.684260] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-06 (2.35 seconds). [2025-10-15T19:23:28.913992] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-06. [2025-10-15T19:23:29.245800] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-15T19:23:29.713966] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-03. [2025-10-15T19:23:30.102999] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-15T19:23:30.514065] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-07. [2025-10-15T19:23:31.314089] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-09. [2025-10-15T19:23:31.409936] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-15T19:23:32.114037] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-04. [2025-10-15T19:23:32.446635] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-15T19:23:32.913999] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-10. [2025-10-15T19:23:33.065810] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-07 (2.55 seconds). [2025-10-15T19:23:33.719441] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-08. [2025-10-15T19:23:33.733993] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-15T19:23:34.244774] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-15T19:23:34.249774] [INFO ] [REMOTE ] HIO: Full fetch complete (37955 records). [2025-10-15T19:23:34.249888] [DEBUG] [VALIDATOR ] HIO: Validating primary data. [2025-10-15T19:23:34.526211] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-07. [2025-10-15T19:23:34.648691] [DEBUG] [VALIDATOR ] HIO: All expected trading days are present. [2025-10-15T19:23:34.648780] [DEBUG] [VALIDATOR ] HIO: Primary data validation passed. [2025-10-15T19:23:34.649526] [INFO ] [MAIN ] HIO: Fetched primary data is valid. [2025-10-15T19:23:34.649585] [DEBUG] [LOCAL ] HIO: Saving primary data. [2025-10-15T19:23:34.650607] [DEBUG] [LOCAL ] HIO: Trimmed 37955 records to 24351 (keeping 200 days of data) [2025-10-15T19:23:34.790725] [DEBUG] [LOCAL ] HIO: Primary data saved (24351 records). [2025-10-15T19:23:34.790866] [INFO ] [MAIN ] HIO: Full history saved. [2025-10-15T19:23:34.790946] [INFO ] [MAIN ] Update Progress: 1019/2369 symbols completed. HIO took 16.4s. Estimated remaining: 3h 10m 7s. Rate: 7.1 symbols/min [2025-10-15T19:23:34.953291] [INFO ] [MAIN ] HIX: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:23:34.973293] [DEBUG] [LOCAL ] HIX: Loaded 20500 existing records from primary storage. [2025-10-15T19:23:34.973527] [INFO ] [MAIN ] HIX: Loaded 20500 existing records. [2025-10-15T19:23:35.145361] [WARN ] [MAIN ] HIX: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:23:35.145563] [INFO ] [MAIN ] HIX: Wiping existing primary data before full refresh. [2025-10-15T19:23:35.145629] [INFO ] [LOCAL ] HIX: Starting deletion of primary data. [2025-10-15T19:23:35.145919] [DEBUG] [LOCAL ] HIX: Deleted primary data file. [2025-10-15T19:23:35.145964] [INFO ] [MAIN ] HIX: Starting full primary refresh. [2025-10-15T19:23:35.324299] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-05. [2025-10-15T19:23:35.495752] [INFO ] [REMOTE ] HIX: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:23:35.641199] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-15T19:23:36.106725] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-08 (2.39 seconds). [2025-10-15T19:23:36.117355] [INFO ] [REMOTE ] HIX: Fetching primary data for 2024-12. [2025-10-15T19:23:36.885900] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-15T19:23:36.913961] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-06. [2025-10-15T19:23:37.227197] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-15T19:23:37.714003] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-08. [2025-10-15T19:23:38.395319] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-15T19:23:38.514033] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-01. [2025-10-15T19:23:38.715169] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-15T19:23:39.314022] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-07. [2025-10-15T19:23:39.363048] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-15T19:23:40.114054] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-09. [2025-10-15T19:23:40.685357] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-15T19:23:40.913986] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-09. [2025-10-15T19:23:41.713994] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-08. [2025-10-15T19:23:41.915088] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-15T19:23:42.514068] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-10. [2025-10-15T19:23:42.759142] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-09 (2.65 seconds). [2025-10-15T19:23:43.282356] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-15T19:23:43.313955] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-09. [2025-10-15T19:23:43.527081] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-15T19:23:43.529495] [INFO ] [REMOTE ] HIPO: Full fetch complete (31266 records). [2025-10-15T19:23:43.529590] [DEBUG] [VALIDATOR ] HIPO: Validating primary data. [2025-10-15T19:23:43.889156] [DEBUG] [VALIDATOR ] HIPO: All expected trading days are present. [2025-10-15T19:23:43.889231] [DEBUG] [VALIDATOR ] HIPO: Primary data validation passed. [2025-10-15T19:23:43.889852] [INFO ] [MAIN ] HIPO: Fetched primary data is valid. [2025-10-15T19:23:43.889913] [DEBUG] [LOCAL ] HIPO: Saving primary data. [2025-10-15T19:23:43.890603] [DEBUG] [LOCAL ] HIPO: Trimmed 31266 records to 21869 (keeping 200 days of data) [2025-10-15T19:23:44.019110] [DEBUG] [LOCAL ] HIPO: Primary data saved (21869 records). [2025-10-15T19:23:44.019248] [INFO ] [MAIN ] HIPO: Full history saved. [2025-10-15T19:23:44.019328] [INFO ] [MAIN ] Update Progress: 1020/2369 symbols completed. HIPO took 21.8s. Estimated remaining: 3h 9m 60s. Rate: 7.1 symbols/min [2025-10-15T19:23:44.116905] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-10. [2025-10-15T19:23:44.186551] [INFO ] [MAIN ] HKD: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:23:44.203926] [DEBUG] [LOCAL ] HKD: Loaded 18591 existing records from primary storage. [2025-10-15T19:23:44.204196] [INFO ] [MAIN ] HKD: Loaded 18591 existing records. [2025-10-15T19:23:44.380762] [WARN ] [MAIN ] HKD: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:23:44.380976] [INFO ] [MAIN ] HKD: Wiping existing primary data before full refresh. [2025-10-15T19:23:44.381021] [INFO ] [LOCAL ] HKD: Starting deletion of primary data. [2025-10-15T19:23:44.381186] [DEBUG] [LOCAL ] HKD: Deleted primary data file. [2025-10-15T19:23:44.381223] [INFO ] [MAIN ] HKD: Starting full primary refresh. [2025-10-15T19:23:44.743495] [INFO ] [REMOTE ] HKD: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:23:44.794416] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-15T19:23:44.913983] [INFO ] [REMOTE ] HKD: Fetching primary data for 2024-12. [2025-10-15T19:23:45.713996] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-10. [2025-10-15T19:23:45.942921] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-15T19:23:46.514007] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-02. [2025-10-15T19:23:46.561764] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-10 (2.44 seconds). [2025-10-15T19:23:46.569174] [INFO ] [REMOTE ] HIMS: Full fetch complete (77996 records). [2025-10-15T19:23:46.569317] [DEBUG] [VALIDATOR ] HIMS: Validating primary data. [2025-10-15T19:23:46.989916] [DEBUG] [VALIDATOR ] HIMS: All expected trading days are present. [2025-10-15T19:23:46.990000] [DEBUG] [VALIDATOR ] HIMS: Primary data validation passed. [2025-10-15T19:23:46.991093] [INFO ] [MAIN ] HIMS: Fetched primary data is valid. [2025-10-15T19:23:46.991166] [DEBUG] [LOCAL ] HIMS: Saving primary data. [2025-10-15T19:23:46.992709] [DEBUG] [LOCAL ] HIMS: Trimmed 77996 records to 53817 (keeping 200 days of data) [2025-10-15T19:23:47.311547] [DEBUG] [LOCAL ] HIMS: Primary data saved (53817 records). [2025-10-15T19:23:47.311808] [INFO ] [MAIN ] HIMS: Full history saved. [2025-10-15T19:23:47.323216] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-01. [2025-10-15T19:23:47.326114] [INFO ] [MAIN ] Update Progress: 1021/2369 symbols completed. HIMS took 36.2s. Estimated remaining: 3h 9m 44s. Rate: 7.1 symbols/min [2025-10-15T19:23:47.350163] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-15T19:23:47.431498] [INFO ] [REMOTE ] HIW: Full fetch complete (64874 records). [2025-10-15T19:23:47.431817] [DEBUG] [VALIDATOR ] HIW: Validating primary data. [2025-10-15T19:23:47.541574] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-15T19:23:47.599953] [INFO ] [MAIN ] HL: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:23:47.940832] [DEBUG] [VALIDATOR ] HIW: All expected trading days are present. [2025-10-15T19:23:47.955554] [DEBUG] [VALIDATOR ] HIW: Primary data validation passed. [2025-10-15T19:23:47.958120] [INFO ] [MAIN ] HIW: Fetched primary data is valid. [2025-10-15T19:23:47.958204] [DEBUG] [LOCAL ] HIW: Saving primary data. [2025-10-15T19:23:47.959279] [DEBUG] [LOCAL ] HL: Loaded 53673 existing records from primary storage. [2025-10-15T19:23:47.960015] [INFO ] [MAIN ] HL: Loaded 53673 existing records. [2025-10-15T19:23:48.032760] [DEBUG] [LOCAL ] HIW: Trimmed 64874 records to 44595 (keeping 200 days of data) [2025-10-15T19:23:48.144686] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-03. [2025-10-15T19:23:48.242405] [WARN ] [MAIN ] HL: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:23:48.243512] [INFO ] [MAIN ] HL: Wiping existing primary data before full refresh. [2025-10-15T19:23:48.243596] [INFO ] [LOCAL ] HL: Starting deletion of primary data. [2025-10-15T19:23:48.245662] [DEBUG] [LOCAL ] HL: Deleted primary data file. [2025-10-15T19:23:48.246776] [INFO ] [MAIN ] HL: Starting full primary refresh. [2025-10-15T19:23:48.780190] [INFO ] [REMOTE ] HL: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:23:48.795460] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-15T19:23:48.829556] [DEBUG] [LOCAL ] HIW: Primary data saved (44595 records). [2025-10-15T19:23:48.829749] [INFO ] [MAIN ] HIW: Full history saved. [2025-10-15T19:23:48.829850] [INFO ] [MAIN ] Update Progress: 1022/2369 symbols completed. HIW took 26.1s. Estimated remaining: 3h 9m 27s. Rate: 7.1 symbols/min [2025-10-15T19:23:48.919159] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-02. [2025-10-15T19:23:49.002464] [INFO ] [MAIN ] HLF: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:23:49.049130] [DEBUG] [LOCAL ] HLF: Loaded 48505 existing records from primary storage. [2025-10-15T19:23:49.049476] [INFO ] [MAIN ] HLF: Loaded 48505 existing records. [2025-10-15T19:23:49.234667] [WARN ] [MAIN ] HLF: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:23:49.243072] [INFO ] [MAIN ] HLF: Wiping existing primary data before full refresh. [2025-10-15T19:23:49.243156] [INFO ] [LOCAL ] HLF: Starting deletion of primary data. [2025-10-15T19:23:49.243685] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-15T19:23:49.248269] [DEBUG] [LOCAL ] HLF: Deleted primary data file. [2025-10-15T19:23:49.248632] [INFO ] [MAIN ] HLF: Starting full primary refresh. [2025-10-15T19:23:49.594040] [INFO ] [REMOTE ] HLF: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:23:49.714000] [INFO ] [REMOTE ] HLF: Fetching primary data for 2024-12. [2025-10-15T19:23:50.203342] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-15T19:23:50.514035] [INFO ] [REMOTE ] HL: Fetching primary data for 2024-12. [2025-10-15T19:23:51.192517] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-15T19:23:51.314025] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-04. [2025-10-15T19:23:51.994709] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-15T19:23:52.113965] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-01. [2025-10-15T19:23:52.241857] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-15T19:23:52.914004] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-05. [2025-10-15T19:23:53.714043] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-01. [2025-10-15T19:23:53.919971] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-15T19:23:54.031368] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-10-15T19:23:54.513998] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-03. [2025-10-15T19:23:55.043584] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-15T19:23:55.191486] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-15T19:23:55.314019] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-02. [2025-10-15T19:23:56.114002] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-04. [2025-10-15T19:23:56.913971] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-06. [2025-10-15T19:23:57.267243] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-10-15T19:23:57.315570] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-15T19:23:57.456721] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-10-15T19:23:57.714042] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-05. [2025-10-15T19:23:58.514049] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-02. [2025-10-15T19:23:58.731344] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-15T19:23:59.314046] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-07. [2025-10-15T19:24:00.070478] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-15T19:24:00.113954] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-03. [2025-10-15T19:24:00.325934] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-15T19:24:00.913998] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-03. [2025-10-15T19:24:01.714026] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-08. [2025-10-15T19:24:01.744673] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-15T19:24:02.493508] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-15T19:24:02.519208] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-04. [2025-10-15T19:24:02.522130] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-15T19:24:03.314034] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-04. [2025-10-15T19:24:04.113986] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-09. [2025-10-15T19:24:04.291713] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-15T19:24:04.907382] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-15T19:24:04.918074] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-05. [2025-10-15T19:24:05.107618] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-15T19:24:05.714039] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-10. [2025-10-15T19:24:06.462716] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-15T19:24:06.514005] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-06. [2025-10-15T19:24:06.784301] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-15T19:24:06.786957] [INFO ] [REMOTE ] HIX: Full fetch complete (30135 records). [2025-10-15T19:24:06.787036] [DEBUG] [VALIDATOR ] HIX: Validating primary data. [2025-10-15T19:24:07.150817] [DEBUG] [VALIDATOR ] HIX: All expected trading days are present. [2025-10-15T19:24:07.150899] [DEBUG] [VALIDATOR ] HIX: Primary data validation passed. [2025-10-15T19:24:07.151488] [INFO ] [MAIN ] HIX: Fetched primary data is valid. [2025-10-15T19:24:07.151528] [DEBUG] [LOCAL ] HIX: Saving primary data. [2025-10-15T19:24:07.152325] [DEBUG] [LOCAL ] HIX: Trimmed 30135 records to 20507 (keeping 200 days of data) [2025-10-15T19:24:07.269283] [DEBUG] [LOCAL ] HIX: Primary data saved (20507 records). [2025-10-15T19:24:07.269406] [INFO ] [MAIN ] HIX: Full history saved. [2025-10-15T19:24:07.269483] [INFO ] [MAIN ] Update Progress: 1023/2369 symbols completed. HIX took 32.5s. Estimated remaining: 3h 9m 32s. Rate: 7.1 symbols/min [2025-10-15T19:24:07.321249] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-05. [2025-10-15T19:24:07.445588] [INFO ] [MAIN ] HLI: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:24:07.476160] [DEBUG] [LOCAL ] HLI: Loaded 30898 existing records from primary storage. [2025-10-15T19:24:07.476409] [INFO ] [MAIN ] HLI: Loaded 30898 existing records. [2025-10-15T19:24:07.654615] [WARN ] [MAIN ] HLI: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:24:07.654961] [INFO ] [MAIN ] HLI: Wiping existing primary data before full refresh. [2025-10-15T19:24:07.655017] [INFO ] [LOCAL ] HLI: Starting deletion of primary data. [2025-10-15T19:24:07.655218] [DEBUG] [LOCAL ] HLI: Deleted primary data file. [2025-10-15T19:24:07.655285] [INFO ] [MAIN ] HLI: Starting full primary refresh. [2025-10-15T19:24:07.846153] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-15T19:24:08.061217] [INFO ] [REMOTE ] HLI: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:24:08.113961] [INFO ] [REMOTE ] HLI: Fetching primary data for 2024-12. [2025-10-15T19:24:08.914032] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-07. [2025-10-15T19:24:09.178103] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-15T19:24:09.215186] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-15T19:24:09.714060] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-06. [2025-10-15T19:24:10.093364] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-15T19:24:10.514013] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-06. [2025-10-15T19:24:11.314022] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-08. [2025-10-15T19:24:11.538659] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-15T19:24:12.028670] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-15T19:24:12.063926] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-15T19:24:12.114016] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-09. [2025-10-15T19:24:12.914010] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-01. [2025-10-15T19:24:13.358411] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-15T19:24:13.714061] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-07. [2025-10-15T19:24:14.361573] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-15T19:24:14.514001] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-07. [2025-10-15T19:24:15.314055] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-10. [2025-10-15T19:24:15.375590] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-15T19:24:16.114005] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-08. [2025-10-15T19:24:16.541050] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-15T19:24:16.544148] [INFO ] [REMOTE ] HKD: Full fetch complete (28348 records). [2025-10-15T19:24:16.544237] [DEBUG] [VALIDATOR ] HKD: Validating primary data. [2025-10-15T19:24:16.906281] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-07 (2.39 seconds). [2025-10-15T19:24:16.931084] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-02. [2025-10-15T19:24:16.953794] [DEBUG] [VALIDATOR ] HKD: All expected trading days are present. [2025-10-15T19:24:16.953873] [DEBUG] [VALIDATOR ] HKD: Primary data validation passed. [2025-10-15T19:24:16.954563] [INFO ] [MAIN ] HKD: Fetched primary data is valid. [2025-10-15T19:24:16.954662] [DEBUG] [LOCAL ] HKD: Saving primary data. [2025-10-15T19:24:16.956152] [DEBUG] [LOCAL ] HKD: Trimmed 28348 records to 18657 (keeping 200 days of data) [2025-10-15T19:24:17.061799] [DEBUG] [LOCAL ] HKD: Primary data saved (18657 records). [2025-10-15T19:24:17.061920] [INFO ] [MAIN ] HKD: Full history saved. [2025-10-15T19:24:17.061997] [INFO ] [MAIN ] Update Progress: 1024/2369 symbols completed. HKD took 33.0s. Estimated remaining: 3h 9m 25s. Rate: 7.1 symbols/min [2025-10-15T19:24:17.255342] [INFO ] [MAIN ] HLIO: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:24:17.284359] [DEBUG] [LOCAL ] HLIO: Loaded 28076 existing records from primary storage. [2025-10-15T19:24:17.284704] [INFO ] [MAIN ] HLIO: Loaded 28076 existing records. [2025-10-15T19:24:17.497397] [WARN ] [MAIN ] HLIO: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:24:17.500082] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-15T19:24:17.500246] [INFO ] [MAIN ] HLIO: Wiping existing primary data before full refresh. [2025-10-15T19:24:17.510081] [INFO ] [LOCAL ] HLIO: Starting deletion of primary data. [2025-10-15T19:24:17.510878] [DEBUG] [LOCAL ] HLIO: Deleted primary data file. [2025-10-15T19:24:17.510947] [INFO ] [MAIN ] HLIO: Starting full primary refresh. [2025-10-15T19:24:17.719168] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-09. [2025-10-15T19:24:17.867970] [INFO ] [REMOTE ] HLIO: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:24:18.192891] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-15T19:24:18.514032] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-08. [2025-10-15T19:24:19.313995] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-03. [2025-10-15T19:24:19.416519] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-15T19:24:20.114019] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-10. [2025-10-15T19:24:20.461286] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-15T19:24:20.582681] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-08 (2.07 seconds). [2025-10-15T19:24:20.914055] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-09. [2025-10-15T19:24:21.506497] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-15T19:24:21.512127] [INFO ] [REMOTE ] HLF: Full fetch complete (70995 records). [2025-10-15T19:24:21.512228] [DEBUG] [VALIDATOR ] HLF: Validating primary data. [2025-10-15T19:24:21.721690] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2024-12. [2025-10-15T19:24:21.900004] [DEBUG] [VALIDATOR ] HLF: All expected trading days are present. [2025-10-15T19:24:21.900097] [DEBUG] [VALIDATOR ] HLF: Primary data validation passed. [2025-10-15T19:24:21.901160] [INFO ] [MAIN ] HLF: Fetched primary data is valid. [2025-10-15T19:24:21.901229] [DEBUG] [LOCAL ] HLF: Saving primary data. [2025-10-15T19:24:21.902541] [DEBUG] [LOCAL ] HLF: Trimmed 70995 records to 48547 (keeping 200 days of data) [2025-10-15T19:24:22.175170] [DEBUG] [LOCAL ] HLF: Primary data saved (48547 records). [2025-10-15T19:24:22.175295] [INFO ] [MAIN ] HLF: Full history saved. [2025-10-15T19:24:22.175376] [INFO ] [MAIN ] Update Progress: 1025/2369 symbols completed. HLF took 33.3s. Estimated remaining: 3h 9m 12s. Rate: 7.1 symbols/min [2025-10-15T19:24:22.346311] [INFO ] [MAIN ] HLLY: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:24:22.377776] [DEBUG] [LOCAL ] HLLY: Loaded 33534 existing records from primary storage. [2025-10-15T19:24:22.378054] [INFO ] [MAIN ] HLLY: Loaded 33534 existing records. [2025-10-15T19:24:22.519150] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-04. [2025-10-15T19:24:22.556114] [WARN ] [MAIN ] HLLY: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:24:22.557331] [INFO ] [MAIN ] HLLY: Wiping existing primary data before full refresh. [2025-10-15T19:24:22.557383] [INFO ] [LOCAL ] HLLY: Starting deletion of primary data. [2025-10-15T19:24:22.557668] [DEBUG] [LOCAL ] HLLY: Deleted primary data file. [2025-10-15T19:24:22.557756] [INFO ] [MAIN ] HLLY: Starting full primary refresh. [2025-10-15T19:24:22.860429] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-15T19:24:22.947568] [INFO ] [REMOTE ] HLLY: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:24:23.313999] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-01. [2025-10-15T19:24:23.393639] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-09 (2.48 seconds). [2025-10-15T19:24:23.938500] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-15T19:24:24.114020] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2024-12. [2025-10-15T19:24:24.210979] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-15T19:24:24.914091] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-10. [2025-10-15T19:24:25.139454] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-15T19:24:25.714000] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-01. [2025-10-15T19:24:26.513996] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-02. [2025-10-15T19:24:26.811067] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-15T19:24:26.920332] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-10 (2.01 seconds). [2025-10-15T19:24:26.926782] [INFO ] [REMOTE ] HL: Full fetch complete (77822 records). [2025-10-15T19:24:26.926897] [DEBUG] [VALIDATOR ] HL: Validating primary data. [2025-10-15T19:24:27.315791] [DEBUG] [VALIDATOR ] HL: All expected trading days are present. [2025-10-15T19:24:27.315491] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-05. [2025-10-15T19:24:27.316734] [DEBUG] [VALIDATOR ] HL: Primary data validation passed. [2025-10-15T19:24:27.317852] [INFO ] [MAIN ] HL: Fetched primary data is valid. [2025-10-15T19:24:27.318056] [DEBUG] [LOCAL ] HL: Saving primary data. [2025-10-15T19:24:27.319713] [DEBUG] [LOCAL ] HL: Trimmed 77822 records to 53675 (keeping 200 days of data) [2025-10-15T19:24:27.534090] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-15T19:24:27.651903] [DEBUG] [LOCAL ] HL: Primary data saved (53675 records). [2025-10-15T19:24:27.652030] [INFO ] [MAIN ] HL: Full history saved. [2025-10-15T19:24:27.652107] [INFO ] [MAIN ] Update Progress: 1026/2369 symbols completed. HL took 40.3s. Estimated remaining: 3h 8m 60s. Rate: 7.1 symbols/min [2025-10-15T19:24:27.824057] [INFO ] [MAIN ] HLN: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:24:27.874004] [DEBUG] [LOCAL ] HLN: Loaded 53117 existing records from primary storage. [2025-10-15T19:24:27.874296] [INFO ] [MAIN ] HLN: Loaded 53117 existing records. [2025-10-15T19:24:28.067270] [WARN ] [MAIN ] HLN: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:24:28.067502] [INFO ] [MAIN ] HLN: Wiping existing primary data before full refresh. [2025-10-15T19:24:28.067559] [INFO ] [LOCAL ] HLN: Starting deletion of primary data. [2025-10-15T19:24:28.068082] [DEBUG] [LOCAL ] HLN: Deleted primary data file. [2025-10-15T19:24:28.068140] [INFO ] [MAIN ] HLN: Starting full primary refresh. [2025-10-15T19:24:28.119170] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-02. [2025-10-15T19:24:28.443773] [INFO ] [REMOTE ] HLN: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:24:28.654624] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-15T19:24:28.913989] [INFO ] [REMOTE ] HLN: Fetching primary data for 2024-12. [2025-10-15T19:24:29.056069] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-15T19:24:29.714007] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-03. [2025-10-15T19:24:30.468818] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-15T19:24:30.513948] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-01. [2025-10-15T19:24:30.781041] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-15T19:24:31.314015] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-04. [2025-10-15T19:24:31.992246] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-15T19:24:32.113960] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-02. [2025-10-15T19:24:32.590420] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-15T19:24:32.914048] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-06. [2025-10-15T19:24:33.721229] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-03. [2025-10-15T19:24:33.739746] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-15T19:24:34.124693] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-15T19:24:34.514047] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-05. [2025-10-15T19:24:35.140901] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-15T19:24:35.313994] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-04. [2025-10-15T19:24:35.776333] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-15T19:24:36.114096] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-06. [2025-10-15T19:24:36.606946] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-15T19:24:36.914001] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-05. [2025-10-15T19:24:37.354996] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-15T19:24:37.713973] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-07. [2025-10-15T19:24:37.864640] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-15T19:24:38.514044] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-03. [2025-10-15T19:24:39.214861] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-15T19:24:39.314116] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-08. [2025-10-15T19:24:40.030117] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-15T19:24:40.113974] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-04. [2025-10-15T19:24:40.506298] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-15T19:24:40.914031] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-07. [2025-10-15T19:24:41.714049] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-06. [2025-10-15T19:24:41.930749] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-15T19:24:42.514014] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-05. [2025-10-15T19:24:42.883708] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-15T19:24:43.032913] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-15T19:24:43.314006] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-07. [2025-10-15T19:24:44.113978] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-09. [2025-10-15T19:24:44.398769] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-15T19:24:44.675562] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-05 (2.16 seconds). [2025-10-15T19:24:44.913987] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-06. [2025-10-15T19:24:45.244489] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-15T19:24:45.713986] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-10. [2025-10-15T19:24:46.486391] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-15T19:24:46.513980] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-07. [2025-10-15T19:24:46.804511] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-15T19:24:46.807910] [INFO ] [REMOTE ] HLIO: Full fetch complete (36808 records). [2025-10-15T19:24:46.808003] [DEBUG] [VALIDATOR ] HLIO: Validating primary data. [2025-10-15T19:24:47.198425] [DEBUG] [VALIDATOR ] HLIO: All expected trading days are present. [2025-10-15T19:24:47.198503] [DEBUG] [VALIDATOR ] HLIO: Primary data validation passed. [2025-10-15T19:24:47.199329] [INFO ] [MAIN ] HLIO: Fetched primary data is valid. [2025-10-15T19:24:47.199392] [DEBUG] [LOCAL ] HLIO: Saving primary data. [2025-10-15T19:24:47.200217] [DEBUG] [LOCAL ] HLIO: Trimmed 36808 records to 28238 (keeping 200 days of data) [2025-10-15T19:24:47.317676] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-08. [2025-10-15T19:24:47.373204] [DEBUG] [LOCAL ] HLIO: Primary data saved (28238 records). [2025-10-15T19:24:47.373316] [INFO ] [MAIN ] HLIO: Full history saved. [2025-10-15T19:24:47.373394] [INFO ] [MAIN ] Update Progress: 1027/2369 symbols completed. HLIO took 30.3s. Estimated remaining: 3h 9m 6s. Rate: 7.1 symbols/min [2025-10-15T19:24:47.540304] [INFO ] [MAIN ] HLT: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:24:47.593188] [DEBUG] [LOCAL ] HLT: Loaded 50550 existing records from primary storage. [2025-10-15T19:24:47.593533] [INFO ] [MAIN ] HLT: Loaded 50550 existing records. [2025-10-15T19:24:47.782759] [WARN ] [MAIN ] HLT: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:24:47.782940] [INFO ] [MAIN ] HLT: Wiping existing primary data before full refresh. [2025-10-15T19:24:47.782986] [INFO ] [LOCAL ] HLT: Starting deletion of primary data. [2025-10-15T19:24:47.783484] [DEBUG] [LOCAL ] HLT: Deleted primary data file. [2025-10-15T19:24:47.783524] [INFO ] [MAIN ] HLT: Starting full primary refresh. [2025-10-15T19:24:48.118929] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-08. [2025-10-15T19:24:48.140193] [INFO ] [REMOTE ] HLT: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:24:48.254774] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-15T19:24:48.836560] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-15T19:24:48.913962] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-09. [2025-10-15T19:24:49.383716] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-15T19:24:49.713996] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-08. [2025-10-15T19:24:49.793429] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-15T19:24:50.514057] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-09. [2025-10-15T19:24:51.313984] [INFO ] [REMOTE ] HLT: Fetching primary data for 2024-12. [2025-10-15T19:24:51.418402] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-15T19:24:51.490045] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-15T19:24:52.114066] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-10. [2025-10-15T19:24:52.799951] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-15T19:24:52.914002] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-01. [2025-10-15T19:24:53.449475] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-15T19:24:53.454003] [INFO ] [REMOTE ] HLI: Full fetch complete (45212 records). [2025-10-15T19:24:53.454122] [DEBUG] [VALIDATOR ] HLI: Validating primary data. [2025-10-15T19:24:53.719696] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-09. [2025-10-15T19:24:53.884365] [DEBUG] [VALIDATOR ] HLI: All expected trading days are present. [2025-10-15T19:24:53.884470] [DEBUG] [VALIDATOR ] HLI: Primary data validation passed. [2025-10-15T19:24:53.885885] [INFO ] [MAIN ] HLI: Fetched primary data is valid. [2025-10-15T19:24:53.885951] [DEBUG] [LOCAL ] HLI: Saving primary data. [2025-10-15T19:24:53.887296] [DEBUG] [LOCAL ] HLI: Trimmed 45212 records to 30847 (keeping 200 days of data) [2025-10-15T19:24:54.104738] [DEBUG] [LOCAL ] HLI: Primary data saved (30847 records). [2025-10-15T19:24:54.105059] [INFO ] [MAIN ] HLI: Full history saved. [2025-10-15T19:24:54.105181] [INFO ] [MAIN ] Update Progress: 1028/2369 symbols completed. HLI took 46.8s. Estimated remaining: 3h 8m 55s. Rate: 7.1 symbols/min [2025-10-15T19:24:54.286729] [INFO ] [MAIN ] HLX: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:24:54.335193] [DEBUG] [LOCAL ] HLX: Loaded 47440 existing records from primary storage. [2025-10-15T19:24:54.335610] [INFO ] [MAIN ] HLX: Loaded 47440 existing records. [2025-10-15T19:24:54.519634] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-10. [2025-10-15T19:24:54.525806] [WARN ] [MAIN ] HLX: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:24:54.527543] [INFO ] [MAIN ] HLX: Wiping existing primary data before full refresh. [2025-10-15T19:24:54.527689] [INFO ] [LOCAL ] HLX: Starting deletion of primary data. [2025-10-15T19:24:54.528070] [DEBUG] [LOCAL ] HLX: Deleted primary data file. [2025-10-15T19:24:54.528135] [INFO ] [MAIN ] HLX: Starting full primary refresh. [2025-10-15T19:24:54.864776] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-10-15T19:24:54.929355] [INFO ] [REMOTE ] HLX: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:24:55.314041] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-02. [2025-10-15T19:24:55.433110] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-15T19:24:55.659015] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-15T19:24:55.664628] [INFO ] [REMOTE ] HLLY: Full fetch complete (46136 records). [2025-10-15T19:24:55.664851] [DEBUG] [VALIDATOR ] HLLY: Validating primary data. [2025-10-15T19:24:56.058176] [DEBUG] [VALIDATOR ] HLLY: All expected trading days are present. [2025-10-15T19:24:56.058294] [DEBUG] [VALIDATOR ] HLLY: Primary data validation passed. [2025-10-15T19:24:56.059100] [INFO ] [MAIN ] HLLY: Fetched primary data is valid. [2025-10-15T19:24:56.059166] [DEBUG] [LOCAL ] HLLY: Saving primary data. [2025-10-15T19:24:56.060261] [DEBUG] [LOCAL ] HLLY: Trimmed 46136 records to 33508 (keeping 200 days of data) [2025-10-15T19:24:56.140256] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-10. [2025-10-15T19:24:56.249519] [DEBUG] [LOCAL ] HLLY: Primary data saved (33508 records). [2025-10-15T19:24:56.249677] [INFO ] [MAIN ] HLLY: Full history saved. [2025-10-15T19:24:56.249776] [INFO ] [MAIN ] Update Progress: 1029/2369 symbols completed. HLLY took 34.1s. Estimated remaining: 3h 8m 39s. Rate: 7.1 symbols/min [2025-10-15T19:24:56.422906] [INFO ] [MAIN ] HMC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:24:56.463954] [DEBUG] [LOCAL ] HMC: Loaded 46526 existing records from primary storage. [2025-10-15T19:24:56.464280] [INFO ] [MAIN ] HMC: Loaded 46526 existing records. [2025-10-15T19:24:56.644823] [WARN ] [MAIN ] HMC: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:24:56.645068] [INFO ] [MAIN ] HMC: Wiping existing primary data before full refresh. [2025-10-15T19:24:56.645116] [INFO ] [LOCAL ] HMC: Starting deletion of primary data. [2025-10-15T19:24:56.645869] [DEBUG] [LOCAL ] HMC: Deleted primary data file. [2025-10-15T19:24:56.645928] [INFO ] [MAIN ] HMC: Starting full primary refresh. [2025-10-15T19:24:56.921136] [INFO ] [REMOTE ] HLX: Fetching primary data for 2024-12. [2025-10-15T19:24:57.015301] [INFO ] [REMOTE ] HMC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:24:57.043984] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-15T19:24:57.707511] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-15T19:24:57.713976] [INFO ] [REMOTE ] HLN: Full fetch complete (77004 records). [2025-10-15T19:24:57.714035] [INFO ] [REMOTE ] HMC: Fetching primary data for 2024-12. [2025-10-15T19:24:57.714318] [DEBUG] [VALIDATOR ] HLN: Validating primary data. [2025-10-15T19:24:58.117951] [DEBUG] [VALIDATOR ] HLN: All expected trading days are present. [2025-10-15T19:24:58.118295] [DEBUG] [VALIDATOR ] HLN: Primary data validation passed. [2025-10-15T19:24:58.119335] [INFO ] [MAIN ] HLN: Fetched primary data is valid. [2025-10-15T19:24:58.119398] [DEBUG] [LOCAL ] HLN: Saving primary data. [2025-10-15T19:24:58.120957] [DEBUG] [LOCAL ] HLN: Trimmed 77004 records to 53123 (keeping 200 days of data) [2025-10-15T19:24:58.442529] [DEBUG] [LOCAL ] HLN: Primary data saved (53123 records). [2025-10-15T19:24:58.442698] [INFO ] [MAIN ] HLN: Full history saved. [2025-10-15T19:24:58.443860] [INFO ] [MAIN ] Update Progress: 1030/2369 symbols completed. HLN took 30.8s. Estimated remaining: 3h 8m 22s. Rate: 7.1 symbols/min [2025-10-15T19:24:58.518206] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-03. [2025-10-15T19:24:58.632624] [INFO ] [MAIN ] HMN: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:24:58.671482] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-15T19:24:58.688330] [DEBUG] [LOCAL ] HMN: Loaded 23474 existing records from primary storage. [2025-10-15T19:24:58.688554] [INFO ] [MAIN ] HMN: Loaded 23474 existing records. [2025-10-15T19:24:58.865009] [WARN ] [MAIN ] HMN: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:24:58.865226] [INFO ] [MAIN ] HMN: Wiping existing primary data before full refresh. [2025-10-15T19:24:58.865274] [INFO ] [LOCAL ] HMN: Starting deletion of primary data. [2025-10-15T19:24:58.865912] [DEBUG] [LOCAL ] HMN: Deleted primary data file. [2025-10-15T19:24:58.865971] [INFO ] [MAIN ] HMN: Starting full primary refresh. [2025-10-15T19:24:59.218613] [INFO ] [REMOTE ] HMN: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:24:59.313960] [INFO ] [REMOTE ] HMN: Fetching primary data for 2024-12. [2025-10-15T19:24:59.810212] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2024-12 (2.10 seconds). [2025-10-15T19:25:00.113992] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-01. [2025-10-15T19:25:00.410267] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-15T19:25:00.455785] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-15T19:25:00.914059] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-01. [2025-10-15T19:25:01.715966] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-01. [2025-10-15T19:25:01.718828] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-15T19:25:01.811704] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-15T19:25:02.514014] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-04. [2025-10-15T19:25:03.268448] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-15T19:25:03.313955] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-02. [2025-10-15T19:25:04.114000] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-02. [2025-10-15T19:25:04.266720] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-15T19:25:04.913984] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-02. [2025-10-15T19:25:05.096303] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-15T19:25:05.497329] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-15T19:25:05.713986] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-05. [2025-10-15T19:25:05.931316] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-15T19:25:06.514062] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-03. [2025-10-15T19:25:07.314011] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-03. [2025-10-15T19:25:07.454277] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-15T19:25:07.547966] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-15T19:25:08.114038] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-06. [2025-10-15T19:25:08.771585] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-15T19:25:08.913989] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-04. [2025-10-15T19:25:09.713977] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-04. [2025-10-15T19:25:09.808821] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-15T19:25:10.124855] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-15T19:25:10.514056] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-05. [2025-10-15T19:25:11.313977] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-07. [2025-10-15T19:25:11.666171] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-15T19:25:11.770092] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-15T19:25:12.114016] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-06. [2025-10-15T19:25:12.790120] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-15T19:25:12.913968] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-03. [2025-10-15T19:25:13.183339] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-15T19:25:13.713990] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-05. [2025-10-15T19:25:14.514009] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-08. [2025-10-15T19:25:14.862636] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-15T19:25:15.241458] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-15T19:25:15.314002] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-04. [2025-10-15T19:25:16.113990] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-07. [2025-10-15T19:25:16.243603] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-15T19:25:16.913987] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-09. [2025-10-15T19:25:17.226393] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-15T19:25:17.306109] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-15T19:25:17.714052] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-08. [2025-10-15T19:25:18.375517] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-15T19:25:18.513980] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-10. [2025-10-15T19:25:18.717976] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-15T19:25:18.927929] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-10 (0.41 seconds). [2025-10-15T19:25:18.934045] [INFO ] [REMOTE ] HLT: Full fetch complete (73614 records). [2025-10-15T19:25:18.934194] [DEBUG] [VALIDATOR ] HLT: Validating primary data. [2025-10-15T19:25:19.326052] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-06. [2025-10-15T19:25:19.329756] [DEBUG] [VALIDATOR ] HLT: All expected trading days are present. [2025-10-15T19:25:19.330678] [DEBUG] [VALIDATOR ] HLT: Primary data validation passed. [2025-10-15T19:25:19.331842] [INFO ] [MAIN ] HLT: Fetched primary data is valid. [2025-10-15T19:25:19.332028] [DEBUG] [LOCAL ] HLT: Saving primary data. [2025-10-15T19:25:19.333522] [DEBUG] [LOCAL ] HLT: Trimmed 73614 records to 50527 (keeping 200 days of data) [2025-10-15T19:25:19.646899] [DEBUG] [LOCAL ] HLT: Primary data saved (50527 records). [2025-10-15T19:25:19.647032] [INFO ] [MAIN ] HLT: Full history saved. [2025-10-15T19:25:19.647478] [INFO ] [MAIN ] Update Progress: 1031/2369 symbols completed. HLT took 32.3s. Estimated remaining: 3h 8m 30s. Rate: 7.1 symbols/min [2025-10-15T19:25:19.837086] [INFO ] [MAIN ] HMY: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:25:19.890530] [DEBUG] [LOCAL ] HMY: Loaded 53167 existing records from primary storage. [2025-10-15T19:25:19.890979] [INFO ] [MAIN ] HMY: Loaded 53167 existing records. [2025-10-15T19:25:20.102162] [WARN ] [MAIN ] HMY: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:25:20.102376] [INFO ] [MAIN ] HMY: Wiping existing primary data before full refresh. [2025-10-15T19:25:20.102422] [INFO ] [LOCAL ] HMY: Starting deletion of primary data. [2025-10-15T19:25:20.103359] [DEBUG] [LOCAL ] HMY: Deleted primary data file. [2025-10-15T19:25:20.103419] [INFO ] [MAIN ] HMY: Starting full primary refresh. [2025-10-15T19:25:20.119239] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-05. [2025-10-15T19:25:20.466662] [INFO ] [REMOTE ] HMY: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:25:20.913965] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-09. [2025-10-15T19:25:21.109298] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-15T19:25:21.714032] [INFO ] [REMOTE ] HMY: Fetching primary data for 2024-12. [2025-10-15T19:25:21.761120] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-15T19:25:21.918575] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-15T19:25:22.514006] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-07. [2025-10-15T19:25:23.314002] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-06. [2025-10-15T19:25:23.315309] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-15T19:25:23.852453] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-15T19:25:24.114012] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-08. [2025-10-15T19:25:24.919083] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-01. [2025-10-15T19:25:24.932031] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-15T19:25:25.713973] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-07. [2025-10-15T19:25:25.846099] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-15T19:25:26.514040] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-10. [2025-10-15T19:25:26.848360] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-10-15T19:25:27.313973] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-02. [2025-10-15T19:25:27.437090] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-15T19:25:27.436838] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-15T19:25:27.449879] [INFO ] [REMOTE ] HMN: Full fetch complete (31581 records). [2025-10-15T19:25:27.450087] [DEBUG] [VALIDATOR ] HMN: Validating primary data. [2025-10-15T19:25:27.818170] [DEBUG] [VALIDATOR ] HMN: All expected trading days are present. [2025-10-15T19:25:27.818255] [DEBUG] [VALIDATOR ] HMN: Primary data validation passed. [2025-10-15T19:25:27.818922] [INFO ] [MAIN ] HMN: Fetched primary data is valid. [2025-10-15T19:25:27.818982] [DEBUG] [LOCAL ] HMN: Saving primary data. [2025-10-15T19:25:27.819808] [DEBUG] [LOCAL ] HMN: Trimmed 31581 records to 23512 (keeping 200 days of data) [2025-10-15T19:25:27.961702] [DEBUG] [LOCAL ] HMN: Primary data saved (23512 records). [2025-10-15T19:25:27.961836] [INFO ] [MAIN ] HMN: Full history saved. [2025-10-15T19:25:27.961916] [INFO ] [MAIN ] Update Progress: 1032/2369 symbols completed. HMN took 29.5s. Estimated remaining: 3h 8m 22s. Rate: 7.1 symbols/min [2025-10-15T19:25:28.125398] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-09. [2025-10-15T19:25:28.128086] [INFO ] [MAIN ] HNGE: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:25:28.129186] [DEBUG] [LOCAL ] HNGE: No existing data file found in primary storage. [2025-10-15T19:25:28.129233] [WARN ] [MAIN ] HNGE: No existing data found, performing full refresh instead. [2025-10-15T19:25:28.129342] [INFO ] [MAIN ] HNGE: Wiping existing primary data before full refresh. [2025-10-15T19:25:28.129382] [INFO ] [LOCAL ] HNGE: Starting deletion of primary data. [2025-10-15T19:25:28.129423] [DEBUG] [LOCAL ] HNGE: No primary data file found to delete. [2025-10-15T19:25:28.129455] [INFO ] [MAIN ] HNGE: Starting full primary refresh. [2025-10-15T19:25:28.498714] [INFO ] [REMOTE ] HNGE: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:25:28.913969] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-08. [2025-10-15T19:25:29.225156] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-10-15T19:25:29.713983] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-03. [2025-10-15T19:25:29.924928] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-15T19:25:30.513968] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2024-12. [2025-10-15T19:25:30.576584] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-15T19:25:30.713905] [DEBUG] [REMOTE ] HNGE: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-15T19:25:30.714206] [WARN ] [REMOTE ] HNGE: No data returned for month 2024-12 [2025-10-15T19:25:30.714293] [FATAL] [REMOTE ] HNGE: API call failed - aborting fetch to avoid wasting further API calls [2025-10-15T19:25:30.714359] [FATAL] [MAIN ] HNGE: Failed to fetch primary data. [2025-10-15T19:25:30.714423] [WARN ] [MAIN ] HNGE: Deleting existing primary and derivative data due to fetch failure. [2025-10-15T19:25:30.714494] [INFO ] [LOCAL ] HNGE: Starting deletion of primary data. [2025-10-15T19:25:30.714558] [DEBUG] [LOCAL ] HNGE: No primary data file found to delete. [2025-10-15T19:25:30.714593] [INFO ] [LOCAL ] HNGE: Starting deletion of derivative data. [2025-10-15T19:25:30.714631] [DEBUG] [LOCAL ] HNGE: No derivative data file found to delete. [2025-10-15T19:25:30.714725] [INFO ] [MAIN ] Update Progress: 1033/2369 symbols completed. HNGE took 2.8s. Estimated remaining: 3h 8m 6s. Rate: 7.1 symbols/min [2025-10-15T19:25:30.880876] [INFO ] [MAIN ] HNI: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:25:30.909335] [DEBUG] [LOCAL ] HNI: Loaded 29528 existing records from primary storage. [2025-10-15T19:25:30.909596] [INFO ] [MAIN ] HNI: Loaded 29528 existing records. [2025-10-15T19:25:31.093385] [WARN ] [MAIN ] HNI: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:25:31.093711] [INFO ] [MAIN ] HNI: Wiping existing primary data before full refresh. [2025-10-15T19:25:31.093774] [INFO ] [LOCAL ] HNI: Starting deletion of primary data. [2025-10-15T19:25:31.094314] [DEBUG] [LOCAL ] HNI: Deleted primary data file. [2025-10-15T19:25:31.094374] [INFO ] [MAIN ] HNI: Starting full primary refresh. [2025-10-15T19:25:31.320943] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-09. [2025-10-15T19:25:31.643306] [INFO ] [REMOTE ] HNI: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:25:31.821125] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-03 (2.11 seconds). [2025-10-15T19:25:32.114016] [INFO ] [REMOTE ] HNI: Fetching primary data for 2024-12. [2025-10-15T19:25:32.712726] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-15T19:25:32.914059] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-10. [2025-10-15T19:25:33.393086] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-15T19:25:33.714014] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-04. [2025-10-15T19:25:34.514176] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-01. [2025-10-15T19:25:34.536932] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-15T19:25:34.542722] [INFO ] [REMOTE ] HLX: Full fetch complete (69011 records). [2025-10-15T19:25:34.542877] [DEBUG] [VALIDATOR ] HLX: Validating primary data. [2025-10-15T19:25:34.958070] [DEBUG] [VALIDATOR ] HLX: All expected trading days are present. [2025-10-15T19:25:34.958161] [DEBUG] [VALIDATOR ] HLX: Primary data validation passed. [2025-10-15T19:25:34.959155] [INFO ] [MAIN ] HLX: Fetched primary data is valid. [2025-10-15T19:25:34.959219] [DEBUG] [LOCAL ] HLX: Saving primary data. [2025-10-15T19:25:34.960518] [DEBUG] [LOCAL ] HLX: Trimmed 69011 records to 47471 (keeping 200 days of data) [2025-10-15T19:25:35.219581] [DEBUG] [LOCAL ] HLX: Primary data saved (47471 records). [2025-10-15T19:25:35.219737] [INFO ] [MAIN ] HLX: Full history saved. [2025-10-15T19:25:35.219839] [INFO ] [MAIN ] Update Progress: 1034/2369 symbols completed. HLX took 41.1s. Estimated remaining: 3h 7m 52s. Rate: 7.1 symbols/min [2025-10-15T19:25:35.317580] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-10. [2025-10-15T19:25:35.392973] [INFO ] [MAIN ] HOG: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:25:35.441889] [DEBUG] [LOCAL ] HOG: Loaded 50858 existing records from primary storage. [2025-10-15T19:25:35.442227] [INFO ] [MAIN ] HOG: Loaded 50858 existing records. [2025-10-15T19:25:35.621674] [WARN ] [MAIN ] HOG: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:25:35.622032] [INFO ] [MAIN ] HOG: Wiping existing primary data before full refresh. [2025-10-15T19:25:35.622299] [INFO ] [LOCAL ] HOG: Starting deletion of primary data. [2025-10-15T19:25:35.628251] [DEBUG] [LOCAL ] HOG: Deleted primary data file. [2025-10-15T19:25:35.636011] [INFO ] [MAIN ] HOG: Starting full primary refresh. [2025-10-15T19:25:35.668740] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-15T19:25:35.997959] [INFO ] [REMOTE ] HOG: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:25:36.034604] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-04 (2.32 seconds). [2025-10-15T19:25:36.113957] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-05. [2025-10-15T19:25:36.914030] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-02. [2025-10-15T19:25:37.072080] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-15T19:25:37.079939] [INFO ] [REMOTE ] HMC: Full fetch complete (68980 records). [2025-10-15T19:25:37.080119] [DEBUG] [VALIDATOR ] HMC: Validating primary data. [2025-10-15T19:25:37.459367] [DEBUG] [VALIDATOR ] HMC: All expected trading days are present. [2025-10-15T19:25:37.459455] [DEBUG] [VALIDATOR ] HMC: Primary data validation passed. [2025-10-15T19:25:37.460401] [INFO ] [MAIN ] HMC: Fetched primary data is valid. [2025-10-15T19:25:37.460483] [DEBUG] [LOCAL ] HMC: Saving primary data. [2025-10-15T19:25:37.461854] [DEBUG] [LOCAL ] HMC: Trimmed 68980 records to 46489 (keeping 200 days of data) [2025-10-15T19:25:37.716716] [INFO ] [REMOTE ] HOG: Fetching primary data for 2024-12. [2025-10-15T19:25:37.738838] [DEBUG] [LOCAL ] HMC: Primary data saved (46489 records). [2025-10-15T19:25:37.738962] [INFO ] [MAIN ] HMC: Full history saved. [2025-10-15T19:25:37.739054] [INFO ] [MAIN ] Update Progress: 1035/2369 symbols completed. HMC took 41.5s. Estimated remaining: 3h 7m 36s. Rate: 7.1 symbols/min [2025-10-15T19:25:37.914458] [INFO ] [MAIN ] HOMB: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:25:37.957023] [DEBUG] [LOCAL ] HOMB: Loaded 43570 existing records from primary storage. [2025-10-15T19:25:37.957410] [INFO ] [MAIN ] HOMB: Loaded 43570 existing records. [2025-10-15T19:25:38.148630] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-15T19:25:38.152552] [WARN ] [MAIN ] HOMB: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:25:38.159365] [INFO ] [MAIN ] HOMB: Wiping existing primary data before full refresh. [2025-10-15T19:25:38.159950] [INFO ] [LOCAL ] HOMB: Starting deletion of primary data. [2025-10-15T19:25:38.160755] [DEBUG] [LOCAL ] HOMB: Deleted primary data file. [2025-10-15T19:25:38.160817] [INFO ] [MAIN ] HOMB: Starting full primary refresh. [2025-10-15T19:25:38.349137] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-05 (2.24 seconds). [2025-10-15T19:25:38.522339] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-06. [2025-10-15T19:25:38.567149] [INFO ] [REMOTE ] HOMB: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:25:39.324194] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-03. [2025-10-15T19:25:39.355181] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-15T19:25:40.114027] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-01. [2025-10-15T19:25:40.560618] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-06 (2.04 seconds). [2025-10-15T19:25:40.599140] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-15T19:25:40.913998] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-04. [2025-10-15T19:25:41.713977] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-07. [2025-10-15T19:25:41.867046] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-15T19:25:41.900009] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-15T19:25:42.514001] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-02. [2025-10-15T19:25:43.314052] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-05. [2025-10-15T19:25:43.559134] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-15T19:25:43.777475] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-15T19:25:44.114028] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-03. [2025-10-15T19:25:44.175356] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-15T19:25:44.914005] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2024-12. [2025-10-15T19:25:45.714038] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-06. [2025-10-15T19:25:46.151580] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-10-15T19:25:46.350299] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-15T19:25:46.513962] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-04. [2025-10-15T19:25:46.882677] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-15T19:25:47.313998] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-07. [2025-10-15T19:25:48.113962] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-08. [2025-10-15T19:25:48.328212] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-15T19:25:48.354540] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-15T19:25:48.913988] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-05. [2025-10-15T19:25:49.713966] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-01. [2025-10-15T19:25:49.886478] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-15T19:25:50.513999] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-08. [2025-10-15T19:25:50.725954] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-15T19:25:51.208502] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-15T19:25:51.313951] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-02. [2025-10-15T19:25:51.497195] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-15T19:25:52.113995] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-09. [2025-10-15T19:25:52.824454] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-15T19:25:52.913968] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-03. [2025-10-15T19:25:53.616261] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-15T19:25:53.714051] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-06. [2025-10-15T19:25:54.507073] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-15T19:25:54.516151] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-10. [2025-10-15T19:25:55.314025] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-04. [2025-10-15T19:25:55.482227] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-15T19:25:55.812746] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-15T19:25:55.816855] [INFO ] [REMOTE ] HNI: Full fetch complete (42025 records). [2025-10-15T19:25:55.816963] [DEBUG] [VALIDATOR ] HNI: Validating primary data. [2025-10-15T19:25:56.119144] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-09. [2025-10-15T19:25:56.194876] [DEBUG] [VALIDATOR ] HNI: All expected trading days are present. [2025-10-15T19:25:56.194967] [DEBUG] [VALIDATOR ] HNI: Primary data validation passed. [2025-10-15T19:25:56.195796] [INFO ] [MAIN ] HNI: Fetched primary data is valid. [2025-10-15T19:25:56.195871] [DEBUG] [LOCAL ] HNI: Saving primary data. [2025-10-15T19:25:56.197218] [DEBUG] [LOCAL ] HNI: Trimmed 42025 records to 29627 (keeping 200 days of data) [2025-10-15T19:25:56.380041] [DEBUG] [LOCAL ] HNI: Primary data saved (29627 records). [2025-10-15T19:25:56.380169] [INFO ] [MAIN ] HNI: Full history saved. [2025-10-15T19:25:56.380248] [INFO ] [MAIN ] Update Progress: 1036/2369 symbols completed. HNI took 25.7s. Estimated remaining: 3h 7m 41s. Rate: 7.1 symbols/min [2025-10-15T19:25:56.548484] [INFO ] [MAIN ] HOUS: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:25:56.589462] [DEBUG] [LOCAL ] HOUS: Loaded 45217 existing records from primary storage. [2025-10-15T19:25:56.589809] [INFO ] [MAIN ] HOUS: Loaded 45217 existing records. [2025-10-15T19:25:56.767788] [WARN ] [MAIN ] HOUS: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:25:56.768037] [INFO ] [MAIN ] HOUS: Wiping existing primary data before full refresh. [2025-10-15T19:25:56.768085] [INFO ] [LOCAL ] HOUS: Starting deletion of primary data. [2025-10-15T19:25:56.768800] [DEBUG] [LOCAL ] HOUS: Deleted primary data file. [2025-10-15T19:25:56.768858] [INFO ] [MAIN ] HOUS: Starting full primary refresh. [2025-10-15T19:25:56.914295] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-07. [2025-10-15T19:25:57.152255] [INFO ] [REMOTE ] HOUS: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:25:57.182390] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-15T19:25:57.714027] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2024-12. [2025-10-15T19:25:58.128595] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-10-15T19:25:58.513982] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-10. [2025-10-15T19:25:58.689527] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-15T19:25:58.722327] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-10-15T19:25:59.314049] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-08. [2025-10-15T19:26:00.113969] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-01. [2025-10-15T19:26:00.507111] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-10 (1.99 seconds). [2025-10-15T19:26:00.514538] [INFO ] [REMOTE ] HMY: Full fetch complete (77012 records). [2025-10-15T19:26:00.514698] [DEBUG] [VALIDATOR ] HMY: Validating primary data. [2025-10-15T19:26:00.929572] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-05. [2025-10-15T19:26:00.953194] [DEBUG] [VALIDATOR ] HMY: All expected trading days are present. [2025-10-15T19:26:00.954248] [DEBUG] [VALIDATOR ] HMY: Primary data validation passed. [2025-10-15T19:26:00.955411] [INFO ] [MAIN ] HMY: Fetched primary data is valid. [2025-10-15T19:26:00.955673] [DEBUG] [LOCAL ] HMY: Saving primary data. [2025-10-15T19:26:00.957186] [DEBUG] [LOCAL ] HMY: Trimmed 77012 records to 53166 (keeping 200 days of data) [2025-10-15T19:26:01.077768] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-15T19:26:01.335718] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-15T19:26:01.366658] [DEBUG] [LOCAL ] HMY: Primary data saved (53166 records). [2025-10-15T19:26:01.366775] [INFO ] [MAIN ] HMY: Full history saved. [2025-10-15T19:26:01.367079] [INFO ] [MAIN ] Update Progress: 1037/2369 symbols completed. HMY took 41.7s. Estimated remaining: 3h 7m 28s. Rate: 7.1 symbols/min [2025-10-15T19:26:01.713992] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-09. [2025-10-15T19:26:02.514033] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-02. [2025-10-15T19:26:02.594848] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-15T19:26:03.264225] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-15T19:26:03.313965] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-10. [2025-10-15T19:26:03.553725] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-15T19:26:04.114054] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-03. [2025-10-15T19:26:04.914033] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-06. [2025-10-15T19:26:04.980974] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-15T19:26:04.986948] [INFO ] [REMOTE ] HOG: Full fetch complete (74305 records). [2025-10-15T19:26:04.987065] [DEBUG] [VALIDATOR ] HOG: Validating primary data. [2025-10-15T19:26:05.378047] [DEBUG] [VALIDATOR ] HOG: All expected trading days are present. [2025-10-15T19:26:05.378143] [DEBUG] [VALIDATOR ] HOG: Primary data validation passed. [2025-10-15T19:26:05.379194] [INFO ] [MAIN ] HOG: Fetched primary data is valid. [2025-10-15T19:26:05.379299] [DEBUG] [LOCAL ] HOG: Saving primary data. [2025-10-15T19:26:05.380824] [DEBUG] [LOCAL ] HOG: Trimmed 74305 records to 50849 (keeping 200 days of data) [2025-10-15T19:26:05.495014] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-15T19:26:05.719035] [DEBUG] [LOCAL ] HOG: Primary data saved (50849 records). [2025-10-15T19:26:05.716943] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-04. [2025-10-15T19:26:05.720098] [INFO ] [MAIN ] HOG: Full history saved. [2025-10-15T19:26:05.720539] [INFO ] [MAIN ] Update Progress: 1038/2369 symbols completed. HOG took 30.5s. Estimated remaining: 3h 7m 14s. Rate: 7.1 symbols/min [2025-10-15T19:26:06.212683] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-15T19:26:06.514044] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-07. [2025-10-15T19:26:07.008458] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-15T19:26:07.314052] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-05. [2025-10-15T19:26:08.141559] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-15T19:26:08.151962] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-08. [2025-10-15T19:26:08.725113] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-15T19:26:08.914013] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-06. [2025-10-15T19:26:09.644965] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-15T19:26:09.713965] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-09. [2025-10-15T19:26:10.372954] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-15T19:26:10.513966] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-07. [2025-10-15T19:26:10.843344] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-15T19:26:11.314017] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-10. [2025-10-15T19:26:11.623108] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-15T19:26:12.114005] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-08. [2025-10-15T19:26:12.913237] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-15T19:26:12.918684] [INFO ] [REMOTE ] HOMB: Full fetch complete (64137 records). [2025-10-15T19:26:12.918798] [DEBUG] [VALIDATOR ] HOMB: Validating primary data. [2025-10-15T19:26:13.298844] [DEBUG] [VALIDATOR ] HOMB: All expected trading days are present. [2025-10-15T19:26:13.298946] [DEBUG] [VALIDATOR ] HOMB: Primary data validation passed. [2025-10-15T19:26:13.299890] [INFO ] [MAIN ] HOMB: Fetched primary data is valid. [2025-10-15T19:26:13.299971] [DEBUG] [LOCAL ] HOMB: Saving primary data. [2025-10-15T19:26:13.301471] [DEBUG] [LOCAL ] HOMB: Trimmed 64137 records to 43633 (keeping 200 days of data) [2025-10-15T19:26:13.420983] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-15T19:26:13.442964] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-09. [2025-10-15T19:26:13.603929] [DEBUG] [LOCAL ] HOMB: Primary data saved (43633 records). [2025-10-15T19:26:13.604053] [INFO ] [MAIN ] HOMB: Full history saved. [2025-10-15T19:26:13.604130] [INFO ] [MAIN ] Update Progress: 1039/2369 symbols completed. HOMB took 35.9s. Estimated remaining: 3h 7m 5s. Rate: 7.1 symbols/min [2025-10-15T19:26:14.758563] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-15T19:26:14.769472] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-10. [2025-10-15T19:26:16.554774] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-15T19:26:16.561264] [INFO ] [REMOTE ] HOUS: Full fetch complete (64363 records). [2025-10-15T19:26:16.561428] [DEBUG] [VALIDATOR ] HOUS: Validating primary data. [2025-10-15T19:26:16.960389] [DEBUG] [VALIDATOR ] HOUS: All expected trading days are present. [2025-10-15T19:26:16.960466] [DEBUG] [VALIDATOR ] HOUS: Primary data validation passed. [2025-10-15T19:26:16.961376] [INFO ] [MAIN ] HOUS: Fetched primary data is valid. [2025-10-15T19:26:16.961480] [DEBUG] [LOCAL ] HOUS: Saving primary data. [2025-10-15T19:26:16.962786] [DEBUG] [LOCAL ] HOUS: Trimmed 64363 records to 45340 (keeping 200 days of data) [2025-10-15T19:26:17.214377] [DEBUG] [LOCAL ] HOUS: Primary data saved (45340 records). [2025-10-15T19:26:17.214502] [INFO ] [MAIN ] HOUS: Full history saved. [2025-10-15T19:26:17.215401] [INFO ] [MAIN ] Update Progress: 1040/2369 symbols completed. HOUS took 20.8s. Estimated remaining: 3h 6m 50s. Rate: 7.1 symbols/min [2025-10-15T19:26:17.903301] [INFO ] [MAIN ] HOV: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:26:17.834290] [INFO ] [MAIN ] HPF: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:26:17.902186] [INFO ] [MAIN ] HP: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:26:17.948997] [INFO ] [MAIN ] HPE: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:26:17.960726] [DEBUG] [LOCAL ] HPF: Loaded 7523 existing records from primary storage. [2025-10-15T19:26:17.961296] [INFO ] [MAIN ] HPF: Loaded 7523 existing records. [2025-10-15T19:26:18.024358] [DEBUG] [LOCAL ] HOV: Loaded 14015 existing records from primary storage. [2025-10-15T19:26:18.044481] [INFO ] [MAIN ] HOV: Loaded 14015 existing records. [2025-10-15T19:26:18.323157] [DEBUG] [LOCAL ] HP: Loaded 51534 existing records from primary storage. [2025-10-15T19:26:18.306331] [WARN ] [MAIN ] HPF: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:26:18.342724] [INFO ] [MAIN ] HP: Loaded 51534 existing records. [2025-10-15T19:26:18.403087] [INFO ] [MAIN ] HPF: Wiping existing primary data before full refresh. [2025-10-15T19:26:18.397730] [WARN ] [MAIN ] HOV: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:26:18.420465] [INFO ] [LOCAL ] HPF: Starting deletion of primary data. [2025-10-15T19:26:18.420810] [DEBUG] [LOCAL ] HPF: Deleted primary data file. [2025-10-15T19:26:18.420870] [INFO ] [MAIN ] HPF: Starting full primary refresh. [2025-10-15T19:26:18.436695] [INFO ] [MAIN ] HOV: Wiping existing primary data before full refresh. [2025-10-15T19:26:18.444346] [DEBUG] [LOCAL ] HPE: Loaded 53697 existing records from primary storage. [2025-10-15T19:26:18.436905] [INFO ] [LOCAL ] HOV: Starting deletion of primary data. [2025-10-15T19:26:18.489153] [INFO ] [MAIN ] HPE: Loaded 53697 existing records. [2025-10-15T19:26:18.525208] [DEBUG] [LOCAL ] HOV: Deleted primary data file. [2025-10-15T19:26:18.589101] [INFO ] [MAIN ] HOV: Starting full primary refresh. [2025-10-15T19:26:18.891599] [WARN ] [MAIN ] HP: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:26:19.076853] [WARN ] [MAIN ] HPE: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:26:18.980620] [INFO ] [MAIN ] HP: Wiping existing primary data before full refresh. [2025-10-15T19:26:19.117167] [INFO ] [LOCAL ] HP: Starting deletion of primary data. [2025-10-15T19:26:19.117357] [INFO ] [MAIN ] HPE: Wiping existing primary data before full refresh. [2025-10-15T19:26:19.148437] [DEBUG] [LOCAL ] HP: Deleted primary data file. [2025-10-15T19:26:19.173393] [INFO ] [MAIN ] HP: Starting full primary refresh. [2025-10-15T19:26:19.189252] [INFO ] [LOCAL ] HPE: Starting deletion of primary data. [2025-10-15T19:26:19.331928] [DEBUG] [LOCAL ] HPE: Deleted primary data file. [2025-10-15T19:26:19.372142] [INFO ] [MAIN ] HPE: Starting full primary refresh. [2025-10-15T19:26:19.550583] [INFO ] [REMOTE ] HPF: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:26:19.591131] [INFO ] [REMOTE ] HPF: Fetching primary data for 2024-12. [2025-10-15T19:26:20.087489] [INFO ] [REMOTE ] HOV: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:26:20.191479] [INFO ] [REMOTE ] HOV: Fetching primary data for 2024-12. [2025-10-15T19:26:20.191210] [INFO ] [REMOTE ] HP: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:26:20.229929] [INFO ] [REMOTE ] HP: Fetching primary data for 2024-12. [2025-10-15T19:26:20.331610] [INFO ] [REMOTE ] HPE: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:26:20.331983] [INFO ] [REMOTE ] HPE: Fetching primary data for 2024-12. [2025-10-15T19:26:20.604864] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-10-15T19:26:20.607890] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-01. [2025-10-15T19:26:21.125407] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-10-15T19:26:21.128968] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-01. [2025-10-15T19:26:21.375052] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-15T19:26:21.378420] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-02. [2025-10-15T19:26:21.782195] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-15T19:26:21.801898] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-15T19:26:21.800495] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-01. [2025-10-15T19:26:21.805857] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-02. [2025-10-15T19:26:21.812162] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-15T19:26:21.814377] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-03. [2025-10-15T19:26:22.267532] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-10-15T19:26:22.419202] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-15T19:26:22.514028] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-01. [2025-10-15T19:26:22.637257] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-15T19:26:23.218753] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-15T19:26:23.314046] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-02. [2025-10-15T19:26:24.114044] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-03. [2025-10-15T19:26:24.606666] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-01 (2.09 seconds). [2025-10-15T19:26:24.920469] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-02. [2025-10-15T19:26:24.926165] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-15T19:26:24.946150] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-15T19:26:25.713997] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-03. [2025-10-15T19:26:26.514049] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-04. [2025-10-15T19:26:26.723208] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-15T19:26:27.137912] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-10-15T19:26:27.313962] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-05. [2025-10-15T19:26:27.401202] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-15T19:26:28.004928] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-15T19:26:28.113989] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-04. [2025-10-15T19:26:28.913989] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-04. [2025-10-15T19:26:29.022150] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-15T19:26:29.714009] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-03. [2025-10-15T19:26:30.513964] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-05. [2025-10-15T19:26:30.585411] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-15T19:26:31.313975] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-06. [2025-10-15T19:26:31.388534] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-15T19:26:31.866482] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-03 (2.15 seconds). [2025-10-15T19:26:32.055828] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-15T19:26:32.114038] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-05. [2025-10-15T19:26:32.914068] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-04. [2025-10-15T19:26:33.714046] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-07. [2025-10-15T19:26:33.962036] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-15T19:26:34.329402] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-15T19:26:34.513978] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-06. [2025-10-15T19:26:35.012444] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-10-15T19:26:35.314014] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-08. [2025-10-15T19:26:36.025488] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-15T19:26:36.113973] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-09. [2025-10-15T19:26:36.235711] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-15T19:26:36.833270] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-15T19:26:36.913962] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-06. [2025-10-15T19:26:37.713969] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-07. [2025-10-15T19:26:37.897046] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-15T19:26:38.514068] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-10. [2025-10-15T19:26:39.217085] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-15T19:26:39.218469] [INFO ] [REMOTE ] HPF: Full fetch complete (10675 records). [2025-10-15T19:26:39.218538] [DEBUG] [VALIDATOR ] HPF: Validating primary data. [2025-10-15T19:26:39.315258] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-07. [2025-10-15T19:26:39.576945] [DEBUG] [VALIDATOR ] HPF: All expected trading days are present. [2025-10-15T19:26:39.577244] [DEBUG] [VALIDATOR ] HPF: Primary data validation passed. [2025-10-15T19:26:39.577729] [INFO ] [MAIN ] HPF: Fetched primary data is valid. [2025-10-15T19:26:39.577817] [DEBUG] [LOCAL ] HPF: Saving primary data. [2025-10-15T19:26:39.578819] [DEBUG] [LOCAL ] HPF: Trimmed 10675 records to 7499 (keeping 200 days of data) [2025-10-15T19:26:39.642291] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-15T19:26:39.668193] [DEBUG] [LOCAL ] HPF: Primary data saved (7499 records). [2025-10-15T19:26:39.668334] [INFO ] [MAIN ] HPF: Full history saved. [2025-10-15T19:26:39.668419] [INFO ] [MAIN ] Update Progress: 1041/2369 symbols completed. HPF took 22.4s. Estimated remaining: 3h 6m 60s. Rate: 7.1 symbols/min [2025-10-15T19:26:39.833674] [INFO ] [MAIN ] HPI: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:26:39.845191] [DEBUG] [LOCAL ] HPI: Loaded 10657 existing records from primary storage. [2025-10-15T19:26:39.845390] [INFO ] [MAIN ] HPI: Loaded 10657 existing records. [2025-10-15T19:26:40.019296] [WARN ] [MAIN ] HPI: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:26:40.019551] [INFO ] [MAIN ] HPI: Wiping existing primary data before full refresh. [2025-10-15T19:26:40.019599] [INFO ] [LOCAL ] HPI: Starting deletion of primary data. [2025-10-15T19:26:40.019948] [DEBUG] [LOCAL ] HPI: Deleted primary data file. [2025-10-15T19:26:40.020014] [INFO ] [MAIN ] HPI: Starting full primary refresh. [2025-10-15T19:26:40.117485] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-08. [2025-10-15T19:26:40.368820] [INFO ] [REMOTE ] HPI: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:26:40.381261] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-15T19:26:40.914047] [INFO ] [REMOTE ] HPI: Fetching primary data for 2024-12. [2025-10-15T19:26:41.554639] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-10-15T19:26:41.713977] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-01. [2025-10-15T19:26:41.893627] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-15T19:26:42.271302] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-15T19:26:42.514010] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-08. [2025-10-15T19:26:43.314005] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-05. [2025-10-15T19:26:43.605066] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-15T19:26:44.113990] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-09. [2025-10-15T19:26:44.913968] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-09. [2025-10-15T19:26:44.971090] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-15T19:26:45.357456] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-10-15T19:26:45.713981] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-02. [2025-10-15T19:26:46.260822] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-15T19:26:46.290485] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-15T19:26:46.513995] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-10. [2025-10-15T19:26:47.313968] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-10. [2025-10-15T19:26:48.013317] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-15T19:26:48.019329] [INFO ] [REMOTE ] HP: Full fetch complete (74067 records). [2025-10-15T19:26:48.019430] [DEBUG] [VALIDATOR ] HP: Validating primary data. [2025-10-15T19:26:48.117746] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-03. [2025-10-15T19:26:48.295078] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-15T19:26:48.329895] [INFO ] [REMOTE ] HOV: Full fetch complete (19093 records). [2025-10-15T19:26:48.330105] [DEBUG] [VALIDATOR ] HOV: Validating primary data. [2025-10-15T19:26:48.539139] [DEBUG] [VALIDATOR ] HP: All expected trading days are present. [2025-10-15T19:26:48.544388] [DEBUG] [VALIDATOR ] HP: Primary data validation passed. [2025-10-15T19:26:48.550944] [INFO ] [MAIN ] HP: Fetched primary data is valid. [2025-10-15T19:26:48.561345] [DEBUG] [LOCAL ] HP: Saving primary data. [2025-10-15T19:26:48.701558] [DEBUG] [LOCAL ] HP: Trimmed 74067 records to 51543 (keeping 200 days of data) [2025-10-15T19:26:48.943835] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-06. [2025-10-15T19:26:48.944751] [DEBUG] [VALIDATOR ] HOV: All expected trading days are present. [2025-10-15T19:26:48.954112] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-15T19:26:48.960097] [DEBUG] [VALIDATOR ] HOV: Primary data validation passed. [2025-10-15T19:26:48.960627] [INFO ] [MAIN ] HOV: Fetched primary data is valid. [2025-10-15T19:26:49.013412] [DEBUG] [LOCAL ] HOV: Saving primary data. [2025-10-15T19:26:49.054217] [DEBUG] [LOCAL ] HOV: Trimmed 19093 records to 14032 (keeping 200 days of data) [2025-10-15T19:26:49.223212] [DEBUG] [LOCAL ] HOV: Primary data saved (14032 records). [2025-10-15T19:26:49.224373] [INFO ] [MAIN ] HOV: Full history saved. [2025-10-15T19:26:49.227077] [INFO ] [MAIN ] Update Progress: 1042/2369 symbols completed. HOV took 32.0s. Estimated remaining: 3h 6m 53s. Rate: 7.1 symbols/min [2025-10-15T19:26:49.353764] [DEBUG] [LOCAL ] HP: Primary data saved (51543 records). [2025-10-15T19:26:49.364142] [INFO ] [MAIN ] HP: Full history saved. [2025-10-15T19:26:49.390350] [INFO ] [MAIN ] Update Progress: 1043/2369 symbols completed. HP took 32.2s. Estimated remaining: 3h 6m 34s. Rate: 7.1 symbols/min [2025-10-15T19:26:49.424818] [INFO ] [MAIN ] HPP: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:26:49.586781] [INFO ] [MAIN ] HPQ: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:26:49.621505] [DEBUG] [LOCAL ] HPP: Loaded 51172 existing records from primary storage. [2025-10-15T19:26:49.621934] [INFO ] [MAIN ] HPP: Loaded 51172 existing records. [2025-10-15T19:26:49.717930] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-04. [2025-10-15T19:26:49.819753] [WARN ] [MAIN ] HPP: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:26:49.836019] [INFO ] [MAIN ] HPP: Wiping existing primary data before full refresh. [2025-10-15T19:26:49.837135] [DEBUG] [LOCAL ] HPQ: Loaded 53668 existing records from primary storage. [2025-10-15T19:26:49.836187] [INFO ] [LOCAL ] HPP: Starting deletion of primary data. [2025-10-15T19:26:49.837485] [INFO ] [MAIN ] HPQ: Loaded 53668 existing records. [2025-10-15T19:26:49.868468] [DEBUG] [LOCAL ] HPP: Deleted primary data file. [2025-10-15T19:26:49.879851] [INFO ] [MAIN ] HPP: Starting full primary refresh. [2025-10-15T19:26:50.184189] [WARN ] [MAIN ] HPQ: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:26:50.208950] [INFO ] [MAIN ] HPQ: Wiping existing primary data before full refresh. [2025-10-15T19:26:50.246094] [INFO ] [LOCAL ] HPQ: Starting deletion of primary data. [2025-10-15T19:26:50.293060] [DEBUG] [LOCAL ] HPQ: Deleted primary data file. [2025-10-15T19:26:50.305390] [INFO ] [MAIN ] HPQ: Starting full primary refresh. [2025-10-15T19:26:50.564289] [INFO ] [REMOTE ] HPP: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:26:50.598554] [INFO ] [REMOTE ] HPP: Fetching primary data for 2024-12. [2025-10-15T19:26:50.715373] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-15T19:26:50.775254] [INFO ] [REMOTE ] HPQ: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:26:50.822814] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-15T19:26:51.314007] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-05. [2025-10-15T19:26:51.954762] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-15T19:26:52.113988] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-07. [2025-10-15T19:26:52.536678] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-10-15T19:26:52.913994] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-06. [2025-10-15T19:26:53.689030] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-15T19:26:53.713952] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-07. [2025-10-15T19:26:54.000469] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-15T19:26:54.507729] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-15T19:26:54.513950] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-08. [2025-10-15T19:26:55.314023] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-08. [2025-10-15T19:26:55.346892] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-15T19:26:56.114004] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2024-12. [2025-10-15T19:26:56.913999] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-09. [2025-10-15T19:26:57.033730] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-15T19:26:57.713968] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-09. [2025-10-15T19:26:57.928926] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-15T19:26:57.953840] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-15T19:26:58.514115] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-01. [2025-10-15T19:26:59.314005] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-10. [2025-10-15T19:26:59.713768] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-10-15T19:26:59.898720] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-15T19:26:59.900575] [INFO ] [REMOTE ] HPI: Full fetch complete (13931 records). [2025-10-15T19:26:59.900679] [DEBUG] [VALIDATOR ] HPI: Validating primary data. [2025-10-15T19:27:00.123493] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-10. [2025-10-15T19:27:00.289617] [DEBUG] [VALIDATOR ] HPI: All expected trading days are present. [2025-10-15T19:27:00.289742] [DEBUG] [VALIDATOR ] HPI: Primary data validation passed. [2025-10-15T19:27:00.290070] [INFO ] [MAIN ] HPI: Fetched primary data is valid. [2025-10-15T19:27:00.290111] [DEBUG] [LOCAL ] HPI: Saving primary data. [2025-10-15T19:27:00.290587] [DEBUG] [LOCAL ] HPI: Trimmed 13931 records to 10655 (keeping 200 days of data) [2025-10-15T19:27:00.380107] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-15T19:27:00.402870] [DEBUG] [LOCAL ] HPI: Primary data saved (10655 records). [2025-10-15T19:27:00.403347] [INFO ] [MAIN ] HPI: Full history saved. [2025-10-15T19:27:00.403442] [INFO ] [MAIN ] Update Progress: 1044/2369 symbols completed. HPI took 20.7s. Estimated remaining: 3h 6m 29s. Rate: 7.1 symbols/min [2025-10-15T19:27:00.573088] [INFO ] [MAIN ] HPS: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:27:00.584456] [DEBUG] [LOCAL ] HPS: Loaded 10340 existing records from primary storage. [2025-10-15T19:27:00.584736] [INFO ] [MAIN ] HPS: Loaded 10340 existing records. [2025-10-15T19:27:00.760083] [WARN ] [MAIN ] HPS: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:27:00.760282] [INFO ] [MAIN ] HPS: Wiping existing primary data before full refresh. [2025-10-15T19:27:00.760329] [INFO ] [LOCAL ] HPS: Starting deletion of primary data. [2025-10-15T19:27:00.760630] [DEBUG] [LOCAL ] HPS: Deleted primary data file. [2025-10-15T19:27:00.760723] [INFO ] [MAIN ] HPS: Starting full primary refresh. [2025-10-15T19:27:00.914606] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-01. [2025-10-15T19:27:01.110103] [INFO ] [REMOTE ] HPS: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:27:01.714040] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-02. [2025-10-15T19:27:02.142918] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-10 (2.02 seconds). [2025-10-15T19:27:02.149288] [INFO ] [REMOTE ] HPE: Full fetch complete (77875 records). [2025-10-15T19:27:02.149423] [DEBUG] [VALIDATOR ] HPE: Validating primary data. [2025-10-15T19:27:02.549636] [DEBUG] [VALIDATOR ] HPE: All expected trading days are present. [2025-10-15T19:27:02.549234] [INFO ] [REMOTE ] HPS: Fetching primary data for 2024-12. [2025-10-15T19:27:02.549867] [DEBUG] [VALIDATOR ] HPE: Primary data validation passed. [2025-10-15T19:27:02.550956] [INFO ] [MAIN ] HPE: Fetched primary data is valid. [2025-10-15T19:27:02.551149] [DEBUG] [LOCAL ] HPE: Saving primary data. [2025-10-15T19:27:02.582505] [DEBUG] [LOCAL ] HPE: Trimmed 77875 records to 53697 (keeping 200 days of data) [2025-10-15T19:27:02.584246] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-15T19:27:02.925552] [DEBUG] [LOCAL ] HPE: Primary data saved (53697 records). [2025-10-15T19:27:02.925716] [INFO ] [MAIN ] HPE: Full history saved. [2025-10-15T19:27:02.925807] [INFO ] [MAIN ] Update Progress: 1045/2369 symbols completed. HPE took 45.7s. Estimated remaining: 3h 6m 13s. Rate: 7.1 symbols/min [2025-10-15T19:27:03.090724] [INFO ] [MAIN ] HQH: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:27:03.115831] [DEBUG] [LOCAL ] HQH: Loaded 25740 existing records from primary storage. [2025-10-15T19:27:03.116103] [INFO ] [MAIN ] HQH: Loaded 25740 existing records. [2025-10-15T19:27:03.293131] [WARN ] [MAIN ] HQH: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:27:03.293431] [INFO ] [MAIN ] HQH: Wiping existing primary data before full refresh. [2025-10-15T19:27:03.293511] [INFO ] [LOCAL ] HQH: Starting deletion of primary data. [2025-10-15T19:27:03.294179] [DEBUG] [LOCAL ] HQH: Deleted primary data file. [2025-10-15T19:27:03.294236] [INFO ] [MAIN ] HQH: Starting full primary refresh. [2025-10-15T19:27:03.326278] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-02. [2025-10-15T19:27:03.597037] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-15T19:27:03.704296] [INFO ] [REMOTE ] HQH: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:27:03.706736] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-10-15T19:27:04.114002] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-03. [2025-10-15T19:27:04.733103] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-15T19:27:04.914050] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-01. [2025-10-15T19:27:05.713987] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-03. [2025-10-15T19:27:05.760107] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-15T19:27:05.947828] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-15T19:27:06.514014] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-02. [2025-10-15T19:27:07.171119] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-15T19:27:07.246738] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-15T19:27:07.313981] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-04. [2025-10-15T19:27:08.114054] [INFO ] [REMOTE ] HQH: Fetching primary data for 2024-12. [2025-10-15T19:27:08.738553] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-15T19:27:08.914013] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-05. [2025-10-15T19:27:09.466877] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-15T19:27:09.714001] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-03. [2025-10-15T19:27:10.453781] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-15T19:27:10.493495] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-15T19:27:10.513965] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-04. [2025-10-15T19:27:11.117556] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-10-15T19:27:11.314110] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-05. [2025-10-15T19:27:12.030032] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-15T19:27:12.113957] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-06. [2025-10-15T19:27:12.915877] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-04. [2025-10-15T19:27:12.920828] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-15T19:27:13.713986] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-07. [2025-10-15T19:27:14.514027] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-06. [2025-10-15T19:27:14.582584] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-15T19:27:14.940042] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-10-15T19:27:15.314045] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-08. [2025-10-15T19:27:15.756042] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-10-15T19:27:15.954021] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-15T19:27:16.114040] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-05. [2025-10-15T19:27:16.914043] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-07. [2025-10-15T19:27:17.713969] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-01. [2025-10-15T19:27:18.181836] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-10-15T19:27:18.514027] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-09. [2025-10-15T19:27:18.586636] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-15T19:27:18.733545] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-15T19:27:19.267949] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-15T19:27:19.313969] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-10. [2025-10-15T19:27:20.094915] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-15T19:27:20.096590] [INFO ] [REMOTE ] HPS: Full fetch complete (15181 records). [2025-10-15T19:27:20.096682] [DEBUG] [VALIDATOR ] HPS: Validating primary data. [2025-10-15T19:27:20.119125] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-06. [2025-10-15T19:27:20.463015] [DEBUG] [VALIDATOR ] HPS: All expected trading days are present. [2025-10-15T19:27:20.463090] [DEBUG] [VALIDATOR ] HPS: Primary data validation passed. [2025-10-15T19:27:20.463420] [INFO ] [MAIN ] HPS: Fetched primary data is valid. [2025-10-15T19:27:20.463460] [DEBUG] [LOCAL ] HPS: Saving primary data. [2025-10-15T19:27:20.463966] [DEBUG] [LOCAL ] HPS: Trimmed 15181 records to 10310 (keeping 200 days of data) [2025-10-15T19:27:20.525338] [DEBUG] [LOCAL ] HPS: Primary data saved (10310 records). [2025-10-15T19:27:20.525469] [INFO ] [MAIN ] HPS: Full history saved. [2025-10-15T19:27:20.525549] [INFO ] [MAIN ] Update Progress: 1046/2369 symbols completed. HPS took 20.1s. Estimated remaining: 3h 6m 16s. Rate: 7.1 symbols/min [2025-10-15T19:27:20.702630] [INFO ] [MAIN ] HQL: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:27:20.720572] [DEBUG] [LOCAL ] HQL: Loaded 16824 existing records from primary storage. [2025-10-15T19:27:20.720850] [INFO ] [MAIN ] HQL: Loaded 16824 existing records. [2025-10-15T19:27:20.902303] [WARN ] [MAIN ] HQL: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:27:20.902699] [INFO ] [MAIN ] HQL: Wiping existing primary data before full refresh. [2025-10-15T19:27:20.902759] [INFO ] [LOCAL ] HQL: Starting deletion of primary data. [2025-10-15T19:27:20.903780] [DEBUG] [LOCAL ] HQL: Deleted primary data file. [2025-10-15T19:27:20.903866] [INFO ] [MAIN ] HQL: Starting full primary refresh. [2025-10-15T19:27:20.923779] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-02. [2025-10-15T19:27:21.254231] [INFO ] [REMOTE ] HQL: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:27:21.714023] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-08. [2025-10-15T19:27:21.970888] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-15T19:27:22.108325] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-10-15T19:27:22.514069] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-03. [2025-10-15T19:27:23.314041] [INFO ] [REMOTE ] HQL: Fetching primary data for 2024-12. [2025-10-15T19:27:23.368690] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-15T19:27:23.620359] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-15T19:27:24.113997] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-04. [2025-10-15T19:27:24.368795] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-15T19:27:24.913975] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-01. [2025-10-15T19:27:25.069674] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-15T19:27:25.714083] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-07. [2025-10-15T19:27:25.897436] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-15T19:27:26.514016] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-09. [2025-10-15T19:27:27.314065] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-05. [2025-10-15T19:27:27.733236] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-15T19:27:27.927520] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-15T19:27:28.113980] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-10. [2025-10-15T19:27:28.501561] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-15T19:27:28.914056] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-08. [2025-10-15T19:27:29.714069] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-06. [2025-10-15T19:27:29.830677] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-15T19:27:29.836874] [INFO ] [REMOTE ] HPP: Full fetch complete (73421 records). [2025-10-15T19:27:29.837060] [DEBUG] [VALIDATOR ] HPP: Validating primary data. [2025-10-15T19:27:30.231595] [DEBUG] [VALIDATOR ] HPP: All expected trading days are present. [2025-10-15T19:27:30.231727] [DEBUG] [VALIDATOR ] HPP: Primary data validation passed. [2025-10-15T19:27:30.232740] [INFO ] [MAIN ] HPP: Fetched primary data is valid. [2025-10-15T19:27:30.232830] [DEBUG] [LOCAL ] HPP: Saving primary data. [2025-10-15T19:27:30.234428] [DEBUG] [LOCAL ] HPP: Trimmed 73421 records to 51192 (keeping 200 days of data) [2025-10-15T19:27:30.519575] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-02. [2025-10-15T19:27:30.541269] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-15T19:27:30.540695] [DEBUG] [LOCAL ] HPP: Primary data saved (51192 records). [2025-10-15T19:27:30.541809] [INFO ] [MAIN ] HPP: Full history saved. [2025-10-15T19:27:30.547509] [INFO ] [MAIN ] Update Progress: 1047/2369 symbols completed. HPP took 41.3s. Estimated remaining: 3h 6m 9s. Rate: 7.1 symbols/min [2025-10-15T19:27:30.724930] [INFO ] [MAIN ] HR: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:27:30.784206] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-15T19:27:30.813626] [DEBUG] [LOCAL ] HR: Loaded 52103 existing records from primary storage. [2025-10-15T19:27:30.813973] [INFO ] [MAIN ] HR: Loaded 52103 existing records. [2025-10-15T19:27:30.985918] [WARN ] [MAIN ] HR: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:27:30.986138] [INFO ] [MAIN ] HR: Wiping existing primary data before full refresh. [2025-10-15T19:27:30.986186] [INFO ] [LOCAL ] HR: Starting deletion of primary data. [2025-10-15T19:27:30.987139] [DEBUG] [LOCAL ] HR: Deleted primary data file. [2025-10-15T19:27:30.987195] [INFO ] [MAIN ] HR: Starting full primary refresh. [2025-10-15T19:27:31.335027] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-09. [2025-10-15T19:27:31.342509] [INFO ] [REMOTE ] HR: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:27:31.497021] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-15T19:27:32.114008] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-03. [2025-10-15T19:27:32.914004] [INFO ] [REMOTE ] HR: Fetching primary data for 2024-12. [2025-10-15T19:27:33.111127] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-15T19:27:33.152475] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-15T19:27:33.714022] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-10. [2025-10-15T19:27:34.452988] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-15T19:27:34.513955] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-01. [2025-10-15T19:27:34.598790] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-15T19:27:34.605216] [INFO ] [REMOTE ] HPQ: Full fetch complete (77841 records). [2025-10-15T19:27:34.605422] [DEBUG] [VALIDATOR ] HPQ: Validating primary data. [2025-10-15T19:27:34.987882] [DEBUG] [VALIDATOR ] HPQ: All expected trading days are present. [2025-10-15T19:27:34.987961] [DEBUG] [VALIDATOR ] HPQ: Primary data validation passed. [2025-10-15T19:27:34.988991] [INFO ] [MAIN ] HPQ: Fetched primary data is valid. [2025-10-15T19:27:34.989053] [DEBUG] [LOCAL ] HPQ: Saving primary data. [2025-10-15T19:27:34.990471] [DEBUG] [LOCAL ] HPQ: Trimmed 77841 records to 53669 (keeping 200 days of data) [2025-10-15T19:27:35.317580] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-07. [2025-10-15T19:27:35.324706] [DEBUG] [LOCAL ] HPQ: Primary data saved (53669 records). [2025-10-15T19:27:35.325893] [INFO ] [MAIN ] HPQ: Full history saved. [2025-10-15T19:27:35.326035] [INFO ] [MAIN ] Update Progress: 1048/2369 symbols completed. HPQ took 45.9s. Estimated remaining: 3h 5m 56s. Rate: 7.1 symbols/min [2025-10-15T19:27:35.525929] [INFO ] [MAIN ] HRB: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:27:35.572363] [DEBUG] [LOCAL ] HRB: Loaded 48355 existing records from primary storage. [2025-10-15T19:27:35.572681] [INFO ] [MAIN ] HRB: Loaded 48355 existing records. [2025-10-15T19:27:35.756183] [WARN ] [MAIN ] HRB: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:27:35.756392] [INFO ] [MAIN ] HRB: Wiping existing primary data before full refresh. [2025-10-15T19:27:35.756441] [INFO ] [LOCAL ] HRB: Starting deletion of primary data. [2025-10-15T19:27:35.757264] [DEBUG] [LOCAL ] HRB: Deleted primary data file. [2025-10-15T19:27:35.757322] [INFO ] [MAIN ] HRB: Starting full primary refresh. [2025-10-15T19:27:36.134903] [INFO ] [REMOTE ] HRB: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:27:36.122084] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-04. [2025-10-15T19:27:36.166422] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-15T19:27:36.663112] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-15T19:27:36.801862] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-10-15T19:27:36.913976] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-02. [2025-10-15T19:27:37.713990] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-08. [2025-10-15T19:27:38.428295] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-15T19:27:38.513959] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-03. [2025-10-15T19:27:38.659125] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-15T19:27:39.314026] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-09. [2025-10-15T19:27:40.114004] [INFO ] [REMOTE ] HRB: Fetching primary data for 2024-12. [2025-10-15T19:27:40.280239] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-15T19:27:40.366878] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-15T19:27:40.914098] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-04. [2025-10-15T19:27:41.714959] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-05. [2025-10-15T19:27:41.720695] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-15T19:27:42.513996] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-10. [2025-10-15T19:27:42.673367] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-15T19:27:42.780694] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-15T19:27:43.314014] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-05. [2025-10-15T19:27:43.774757] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-15T19:27:43.779138] [INFO ] [REMOTE ] HQH: Full fetch complete (37286 records). [2025-10-15T19:27:43.779284] [DEBUG] [VALIDATOR ] HQH: Validating primary data. [2025-10-15T19:27:44.119208] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-01. [2025-10-15T19:27:44.186154] [DEBUG] [VALIDATOR ] HQH: All expected trading days are present. [2025-10-15T19:27:44.186258] [DEBUG] [VALIDATOR ] HQH: Primary data validation passed. [2025-10-15T19:27:44.187456] [INFO ] [MAIN ] HQH: Fetched primary data is valid. [2025-10-15T19:27:44.187523] [DEBUG] [LOCAL ] HQH: Saving primary data. [2025-10-15T19:27:44.188618] [DEBUG] [LOCAL ] HQH: Trimmed 37286 records to 25800 (keeping 200 days of data) [2025-10-15T19:27:44.370700] [DEBUG] [LOCAL ] HQH: Primary data saved (25800 records). [2025-10-15T19:27:44.370917] [INFO ] [MAIN ] HQH: Full history saved. [2025-10-15T19:27:44.371117] [INFO ] [MAIN ] Update Progress: 1049/2369 symbols completed. HQH took 41.4s. Estimated remaining: 3h 5m 49s. Rate: 7.1 symbols/min [2025-10-15T19:27:44.563162] [INFO ] [MAIN ] HRI: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:27:44.605790] [DEBUG] [LOCAL ] HRI: Loaded 32458 existing records from primary storage. [2025-10-15T19:27:44.606189] [INFO ] [MAIN ] HRI: Loaded 32458 existing records. [2025-10-15T19:27:44.789935] [WARN ] [MAIN ] HRI: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:27:44.790309] [INFO ] [MAIN ] HRI: Wiping existing primary data before full refresh. [2025-10-15T19:27:44.790420] [INFO ] [LOCAL ] HRI: Starting deletion of primary data. [2025-10-15T19:27:44.791062] [DEBUG] [LOCAL ] HRI: Deleted primary data file. [2025-10-15T19:27:44.791123] [INFO ] [MAIN ] HRI: Starting full primary refresh. [2025-10-15T19:27:44.922691] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-06. [2025-10-15T19:27:45.066277] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-15T19:27:45.189601] [INFO ] [REMOTE ] HRI: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:27:45.711703] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-15T19:27:45.720523] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-06. [2025-10-15T19:27:46.013093] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-15T19:27:46.514004] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-02. [2025-10-15T19:27:47.250520] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-15T19:27:47.313969] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-07. [2025-10-15T19:27:48.035966] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-15T19:27:48.113964] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-03. [2025-10-15T19:27:48.586148] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-15T19:27:48.914054] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-08. [2025-10-15T19:27:49.714031] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-07. [2025-10-15T19:27:49.900119] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-15T19:27:50.167071] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-15T19:27:50.514013] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-09. [2025-10-15T19:27:50.712774] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-15T19:27:51.314016] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-04. [2025-10-15T19:27:52.022865] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-15T19:27:52.114030] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-08. [2025-10-15T19:27:52.913993] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-10. [2025-10-15T19:27:52.971879] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-15T19:27:53.136858] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-15T19:27:53.714006] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-05. [2025-10-15T19:27:54.514015] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-09. [2025-10-15T19:27:54.631823] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-15T19:27:54.639119] [INFO ] [REMOTE ] HR: Full fetch complete (75040 records). [2025-10-15T19:27:54.639394] [DEBUG] [VALIDATOR ] HR: Validating primary data. [2025-10-15T19:27:55.028946] [DEBUG] [VALIDATOR ] HR: All expected trading days are present. [2025-10-15T19:27:55.029092] [DEBUG] [VALIDATOR ] HR: Primary data validation passed. [2025-10-15T19:27:55.030299] [INFO ] [MAIN ] HR: Fetched primary data is valid. [2025-10-15T19:27:55.030464] [DEBUG] [LOCAL ] HR: Saving primary data. [2025-10-15T19:27:55.032088] [DEBUG] [LOCAL ] HR: Trimmed 75040 records to 52106 (keeping 200 days of data) [2025-10-15T19:27:55.276476] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-15T19:27:55.315170] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-06. [2025-10-15T19:27:55.395506] [DEBUG] [LOCAL ] HR: Primary data saved (52106 records). [2025-10-15T19:27:55.395695] [INFO ] [MAIN ] HR: Full history saved. [2025-10-15T19:27:55.396130] [INFO ] [MAIN ] Update Progress: 1050/2369 symbols completed. HR took 24.8s. Estimated remaining: 3h 5m 44s. Rate: 7.1 symbols/min [2025-10-15T19:27:55.576320] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-15T19:27:55.578562] [INFO ] [MAIN ] HRL: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:27:55.630475] [DEBUG] [LOCAL ] HRL: Loaded 53119 existing records from primary storage. [2025-10-15T19:27:55.630841] [INFO ] [MAIN ] HRL: Loaded 53119 existing records. [2025-10-15T19:27:55.806035] [WARN ] [MAIN ] HRL: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:27:55.806334] [INFO ] [MAIN ] HRL: Wiping existing primary data before full refresh. [2025-10-15T19:27:55.806393] [INFO ] [LOCAL ] HRL: Starting deletion of primary data. [2025-10-15T19:27:55.807383] [DEBUG] [LOCAL ] HRL: Deleted primary data file. [2025-10-15T19:27:55.807441] [INFO ] [MAIN ] HRL: Starting full primary refresh. [2025-10-15T19:27:56.120720] [INFO ] [REMOTE ] HRI: Fetching primary data for 2024-12. [2025-10-15T19:27:56.161936] [INFO ] [REMOTE ] HRL: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:27:56.846991] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-15T19:27:56.913980] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-07. [2025-10-15T19:27:57.000762] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-15T19:27:57.714049] [INFO ] [REMOTE ] HRL: Fetching primary data for 2024-12. [2025-10-15T19:27:58.523064] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-01. [2025-10-15T19:27:58.531049] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-15T19:27:59.314046] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-10. [2025-10-15T19:27:59.449215] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-15T19:27:59.477903] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-15T19:28:00.114006] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-01. [2025-10-15T19:28:00.380930] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-15T19:28:00.384030] [INFO ] [REMOTE ] HQL: Full fetch complete (25236 records). [2025-10-15T19:28:00.384102] [DEBUG] [VALIDATOR ] HQL: Validating primary data. [2025-10-15T19:28:00.745044] [DEBUG] [VALIDATOR ] HQL: All expected trading days are present. [2025-10-15T19:28:00.745129] [DEBUG] [VALIDATOR ] HQL: Primary data validation passed. [2025-10-15T19:28:00.745680] [INFO ] [MAIN ] HQL: Fetched primary data is valid. [2025-10-15T19:28:00.745741] [DEBUG] [LOCAL ] HQL: Saving primary data. [2025-10-15T19:28:00.746326] [DEBUG] [LOCAL ] HQL: Trimmed 25236 records to 16872 (keeping 200 days of data) [2025-10-15T19:28:00.846671] [DEBUG] [LOCAL ] HQL: Primary data saved (16872 records). [2025-10-15T19:28:00.846805] [INFO ] [MAIN ] HQL: Full history saved. [2025-10-15T19:28:00.846884] [INFO ] [MAIN ] Update Progress: 1051/2369 symbols completed. HQL took 40.3s. Estimated remaining: 3h 5m 31s. Rate: 7.1 symbols/min [2025-10-15T19:28:00.920339] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-02. [2025-10-15T19:28:01.015034] [INFO ] [MAIN ] HRTG: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:28:01.046987] [DEBUG] [LOCAL ] HRTG: Loaded 34286 existing records from primary storage. [2025-10-15T19:28:01.047240] [INFO ] [MAIN ] HRTG: Loaded 34286 existing records. [2025-10-15T19:28:01.223852] [WARN ] [MAIN ] HRTG: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:28:01.224061] [INFO ] [MAIN ] HRTG: Wiping existing primary data before full refresh. [2025-10-15T19:28:01.224132] [INFO ] [LOCAL ] HRTG: Starting deletion of primary data. [2025-10-15T19:28:01.224758] [DEBUG] [LOCAL ] HRTG: Deleted primary data file. [2025-10-15T19:28:01.224816] [INFO ] [MAIN ] HRTG: Starting full primary refresh. [2025-10-15T19:28:01.577469] [INFO ] [REMOTE ] HRTG: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:28:01.714013] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2024-12. [2025-10-15T19:28:01.902437] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-15T19:28:02.393845] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-15T19:28:02.514049] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-03. [2025-10-15T19:28:02.602744] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-10-15T19:28:03.314059] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-08. [2025-10-15T19:28:04.113961] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-02. [2025-10-15T19:28:04.144457] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-15T19:28:04.914053] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-01. [2025-10-15T19:28:05.248396] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-10-15T19:28:05.536808] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-15T19:28:05.714008] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-09. [2025-10-15T19:28:05.915057] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-15T19:28:06.513997] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-03. [2025-10-15T19:28:07.192498] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-15T19:28:07.313982] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-04. [2025-10-15T19:28:08.113988] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-10. [2025-10-15T19:28:08.384790] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-15T19:28:08.820975] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-15T19:28:08.914057] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-05. [2025-10-15T19:28:09.492368] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-15T19:28:09.498180] [INFO ] [REMOTE ] HRB: Full fetch complete (70074 records). [2025-10-15T19:28:09.498311] [DEBUG] [VALIDATOR ] HRB: Validating primary data. [2025-10-15T19:28:09.719134] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-02. [2025-10-15T19:28:09.905464] [DEBUG] [VALIDATOR ] HRB: All expected trading days are present. [2025-10-15T19:28:09.905549] [DEBUG] [VALIDATOR ] HRB: Primary data validation passed. [2025-10-15T19:28:09.906553] [INFO ] [MAIN ] HRB: Fetched primary data is valid. [2025-10-15T19:28:09.906625] [DEBUG] [LOCAL ] HRB: Saving primary data. [2025-10-15T19:28:09.909149] [DEBUG] [LOCAL ] HRB: Trimmed 70074 records to 48404 (keeping 200 days of data) [2025-10-15T19:28:10.223604] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-15T19:28:10.235761] [DEBUG] [LOCAL ] HRB: Primary data saved (48404 records). [2025-10-15T19:28:10.235865] [INFO ] [MAIN ] HRB: Full history saved. [2025-10-15T19:28:10.235936] [INFO ] [MAIN ] Update Progress: 1052/2369 symbols completed. HRB took 34.9s. Estimated remaining: 3h 5m 24s. Rate: 7.1 symbols/min [2025-10-15T19:28:10.401376] [INFO ] [MAIN ] HSBC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:28:10.448930] [DEBUG] [LOCAL ] HSBC: Loaded 50997 existing records from primary storage. [2025-10-15T19:28:10.449229] [INFO ] [MAIN ] HSBC: Loaded 50997 existing records. [2025-10-15T19:28:10.517319] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-06. [2025-10-15T19:28:10.626757] [WARN ] [MAIN ] HSBC: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:28:10.626942] [INFO ] [MAIN ] HSBC: Wiping existing primary data before full refresh. [2025-10-15T19:28:10.626988] [INFO ] [LOCAL ] HSBC: Starting deletion of primary data. [2025-10-15T19:28:10.627686] [DEBUG] [LOCAL ] HSBC: Deleted primary data file. [2025-10-15T19:28:10.627761] [INFO ] [MAIN ] HSBC: Starting full primary refresh. [2025-10-15T19:28:10.811975] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-15T19:28:10.999077] [INFO ] [REMOTE ] HSBC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:28:11.313990] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2024-12. [2025-10-15T19:28:11.830053] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-15T19:28:12.114002] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-07. [2025-10-15T19:28:12.918991] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-03. [2025-10-15T19:28:12.924456] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-15T19:28:13.226131] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-15T19:28:13.714078] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-04. [2025-10-15T19:28:14.013901] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-15T19:28:14.514012] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-01. [2025-10-15T19:28:15.314044] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-04. [2025-10-15T19:28:15.536717] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-15T19:28:16.113957] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-05. [2025-10-15T19:28:16.237716] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-15T19:28:16.590698] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-15T19:28:16.913992] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-08. [2025-10-15T19:28:17.459936] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-15T19:28:17.713988] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-05. [2025-10-15T19:28:18.121107] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-15T19:28:18.514056] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-06. [2025-10-15T19:28:18.902556] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-15T19:28:19.313984] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-06. [2025-10-15T19:28:20.041927] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-15T19:28:20.114039] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-07. [2025-10-15T19:28:20.717586] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-15T19:28:20.914017] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-02. [2025-10-15T19:28:21.713981] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-09. [2025-10-15T19:28:22.014550] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-15T19:28:22.370385] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-15T19:28:22.511207] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-15T19:28:22.517518] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-08. [2025-10-15T19:28:23.313999] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-03. [2025-10-15T19:28:24.114052] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-10. [2025-10-15T19:28:24.470308] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-10-15T19:28:24.915739] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-15T19:28:24.914310] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-07. [2025-10-15T19:28:25.170412] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-15T19:28:25.174732] [INFO ] [REMOTE ] HRI: Full fetch complete (46463 records). [2025-10-15T19:28:25.174843] [DEBUG] [VALIDATOR ] HRI: Validating primary data. [2025-10-15T19:28:25.562306] [DEBUG] [VALIDATOR ] HRI: All expected trading days are present. [2025-10-15T19:28:25.562455] [DEBUG] [VALIDATOR ] HRI: Primary data validation passed. [2025-10-15T19:28:25.563994] [INFO ] [MAIN ] HRI: Fetched primary data is valid. [2025-10-15T19:28:25.564065] [DEBUG] [LOCAL ] HRI: Saving primary data. [2025-10-15T19:28:25.565530] [DEBUG] [LOCAL ] HRI: Trimmed 46463 records to 32443 (keeping 200 days of data) [2025-10-15T19:28:25.738030] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-09. [2025-10-15T19:28:25.792349] [DEBUG] [LOCAL ] HRI: Primary data saved (32443 records). [2025-10-15T19:28:25.792494] [INFO ] [MAIN ] HRI: Full history saved. [2025-10-15T19:28:25.792578] [INFO ] [MAIN ] Update Progress: 1053/2369 symbols completed. HRI took 41.4s. Estimated remaining: 3h 5m 24s. Rate: 7.1 symbols/min [2025-10-15T19:28:25.968320] [INFO ] [MAIN ] HSHP: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:28:25.983169] [DEBUG] [LOCAL ] HSHP: Loaded 14927 existing records from primary storage. [2025-10-15T19:28:25.983430] [INFO ] [MAIN ] HSHP: Loaded 14927 existing records. [2025-10-15T19:28:26.163364] [WARN ] [MAIN ] HSHP: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:28:26.163777] [INFO ] [MAIN ] HSHP: Wiping existing primary data before full refresh. [2025-10-15T19:28:26.163848] [INFO ] [LOCAL ] HSHP: Starting deletion of primary data. [2025-10-15T19:28:26.164039] [DEBUG] [LOCAL ] HSHP: Deleted primary data file. [2025-10-15T19:28:26.164248] [INFO ] [MAIN ] HSHP: Starting full primary refresh. [2025-10-15T19:28:26.269224] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-15T19:28:26.526758] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-08. [2025-10-15T19:28:26.567890] [INFO ] [REMOTE ] HSHP: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:28:27.314022] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-04. [2025-10-15T19:28:27.744523] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-10-15T19:28:27.807425] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-15T19:28:28.114001] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2024-12. [2025-10-15T19:28:28.914056] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-09. [2025-10-15T19:28:29.166681] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-15T19:28:29.449210] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-04 (2.14 seconds). [2025-10-15T19:28:29.713994] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-10. [2025-10-15T19:28:29.902487] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-15T19:28:30.514056] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-05. [2025-10-15T19:28:31.313986] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-10. [2025-10-15T19:28:31.345214] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-15T19:28:31.351673] [INFO ] [REMOTE ] HRL: Full fetch complete (76948 records). [2025-10-15T19:28:31.351795] [DEBUG] [VALIDATOR ] HRL: Validating primary data. [2025-10-15T19:28:31.750383] [DEBUG] [VALIDATOR ] HRL: All expected trading days are present. [2025-10-15T19:28:31.750492] [DEBUG] [VALIDATOR ] HRL: Primary data validation passed. [2025-10-15T19:28:31.751600] [INFO ] [MAIN ] HRL: Fetched primary data is valid. [2025-10-15T19:28:31.751700] [DEBUG] [LOCAL ] HRL: Saving primary data. [2025-10-15T19:28:31.753267] [DEBUG] [LOCAL ] HRL: Trimmed 76948 records to 53128 (keeping 200 days of data) [2025-10-15T19:28:32.079629] [DEBUG] [LOCAL ] HRL: Primary data saved (53128 records). [2025-10-15T19:28:32.079912] [INFO ] [MAIN ] HRL: Full history saved. [2025-10-15T19:28:32.080336] [INFO ] [MAIN ] Update Progress: 1054/2369 symbols completed. HRL took 36.7s. Estimated remaining: 3h 5m 13s. Rate: 7.1 symbols/min [2025-10-15T19:28:32.122853] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-01. [2025-10-15T19:28:32.252330] [INFO ] [MAIN ] HSY: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:28:32.310254] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-15T19:28:32.344987] [DEBUG] [LOCAL ] HSY: Loaded 50417 existing records from primary storage. [2025-10-15T19:28:32.345451] [INFO ] [MAIN ] HSY: Loaded 50417 existing records. [2025-10-15T19:28:32.522143] [WARN ] [MAIN ] HSY: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:28:32.522471] [INFO ] [MAIN ] HSY: Wiping existing primary data before full refresh. [2025-10-15T19:28:32.522543] [INFO ] [LOCAL ] HSY: Starting deletion of primary data. [2025-10-15T19:28:32.523177] [DEBUG] [LOCAL ] HSY: Deleted primary data file. [2025-10-15T19:28:32.523234] [INFO ] [MAIN ] HSY: Starting full primary refresh. [2025-10-15T19:28:32.800967] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-15T19:28:32.821864] [INFO ] [REMOTE ] HRTG: Full fetch complete (43985 records). [2025-10-15T19:28:32.837426] [DEBUG] [VALIDATOR ] HRTG: Validating primary data. [2025-10-15T19:28:32.914349] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-06. [2025-10-15T19:28:32.950870] [INFO ] [REMOTE ] HSY: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:28:33.197966] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-15T19:28:33.328878] [DEBUG] [VALIDATOR ] HRTG: All expected trading days are present. [2025-10-15T19:28:33.329005] [DEBUG] [VALIDATOR ] HRTG: Primary data validation passed. [2025-10-15T19:28:33.330308] [INFO ] [MAIN ] HRTG: Fetched primary data is valid. [2025-10-15T19:28:33.330377] [DEBUG] [LOCAL ] HRTG: Saving primary data. [2025-10-15T19:28:33.331948] [DEBUG] [LOCAL ] HRTG: Trimmed 43985 records to 34367 (keeping 200 days of data) [2025-10-15T19:28:33.548100] [DEBUG] [LOCAL ] HRTG: Primary data saved (34367 records). [2025-10-15T19:28:33.548321] [INFO ] [MAIN ] HRTG: Full history saved. [2025-10-15T19:28:33.548432] [INFO ] [MAIN ] Update Progress: 1055/2369 symbols completed. HRTG took 32.7s. Estimated remaining: 3h 4m 56s. Rate: 7.1 symbols/min [2025-10-15T19:28:33.721587] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-02. [2025-10-15T19:28:33.726568] [INFO ] [MAIN ] HTB: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:28:33.726893] [DEBUG] [LOCAL ] HTB: No existing data file found in primary storage. [2025-10-15T19:28:33.726945] [WARN ] [MAIN ] HTB: No existing data found, performing full refresh instead. [2025-10-15T19:28:33.727065] [INFO ] [MAIN ] HTB: Wiping existing primary data before full refresh. [2025-10-15T19:28:33.727106] [INFO ] [LOCAL ] HTB: Starting deletion of primary data. [2025-10-15T19:28:33.727147] [DEBUG] [LOCAL ] HTB: No primary data file found to delete. [2025-10-15T19:28:33.727180] [INFO ] [MAIN ] HTB: Starting full primary refresh. [2025-10-15T19:28:34.096987] [INFO ] [REMOTE ] HTB: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:28:34.514070] [INFO ] [REMOTE ] HSY: Fetching primary data for 2024-12. [2025-10-15T19:28:34.621173] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-15T19:28:34.671151] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-15T19:28:35.314031] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-07. [2025-10-15T19:28:36.113998] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-03. [2025-10-15T19:28:36.501335] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-10-15T19:28:36.746332] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-15T19:28:36.914005] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-08. [2025-10-15T19:28:37.209848] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-15T19:28:37.714035] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-01. [2025-10-15T19:28:38.416165] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-15T19:28:38.514022] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-09. [2025-10-15T19:28:39.314002] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-04. [2025-10-15T19:28:39.539263] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-15T19:28:39.829414] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-15T19:28:40.038404] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-15T19:28:40.113990] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-05. [2025-10-15T19:28:40.599613] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-15T19:28:40.913995] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-06. [2025-10-15T19:28:41.713978] [INFO ] [REMOTE ] HTB: Fetching primary data for 2024-12. [2025-10-15T19:28:41.940468] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-15T19:28:42.167040] [DEBUG] [REMOTE ] HTB: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-15T19:28:42.167355] [WARN ] [REMOTE ] HTB: No data returned for month 2024-12 [2025-10-15T19:28:42.167443] [FATAL] [REMOTE ] HTB: API call failed - aborting fetch to avoid wasting further API calls [2025-10-15T19:28:42.167503] [FATAL] [MAIN ] HTB: Failed to fetch primary data. [2025-10-15T19:28:42.167580] [WARN ] [MAIN ] HTB: Deleting existing primary and derivative data due to fetch failure. [2025-10-15T19:28:42.167690] [INFO ] [LOCAL ] HTB: Starting deletion of primary data. [2025-10-15T19:28:42.167813] [DEBUG] [LOCAL ] HTB: No primary data file found to delete. [2025-10-15T19:28:42.167865] [INFO ] [LOCAL ] HTB: Starting deletion of derivative data. [2025-10-15T19:28:42.167922] [DEBUG] [LOCAL ] HTB: No derivative data file found to delete. [2025-10-15T19:28:42.167985] [INFO ] [MAIN ] Update Progress: 1056/2369 symbols completed. HTB took 8.6s. Estimated remaining: 3h 4m 48s. Rate: 7.1 symbols/min [2025-10-15T19:28:42.331446] [INFO ] [MAIN ] HTD: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:28:42.346225] [DEBUG] [LOCAL ] HTD: Loaded 14145 existing records from primary storage. [2025-10-15T19:28:42.346431] [INFO ] [MAIN ] HTD: Loaded 14145 existing records. [2025-10-15T19:28:42.520629] [WARN ] [MAIN ] HTD: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:28:42.520759] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-07. [2025-10-15T19:28:42.521773] [INFO ] [MAIN ] HTD: Wiping existing primary data before full refresh. [2025-10-15T19:28:42.521837] [INFO ] [LOCAL ] HTD: Starting deletion of primary data. [2025-10-15T19:28:42.522068] [DEBUG] [LOCAL ] HTD: Deleted primary data file. [2025-10-15T19:28:42.522126] [INFO ] [MAIN ] HTD: Starting full primary refresh. [2025-10-15T19:28:42.866715] [INFO ] [REMOTE ] HTD: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:28:43.314008] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-10. [2025-10-15T19:28:43.448292] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-15T19:28:44.113999] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-02. [2025-10-15T19:28:44.914042] [INFO ] [REMOTE ] HTD: Fetching primary data for 2024-12. [2025-10-15T19:28:45.038696] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-15T19:28:45.045239] [INFO ] [REMOTE ] HSBC: Full fetch complete (74085 records). [2025-10-15T19:28:45.045380] [DEBUG] [VALIDATOR ] HSBC: Validating primary data. [2025-10-15T19:28:45.500519] [DEBUG] [VALIDATOR ] HSBC: All expected trading days are present. [2025-10-15T19:28:45.500609] [DEBUG] [VALIDATOR ] HSBC: Primary data validation passed. [2025-10-15T19:28:45.501635] [INFO ] [MAIN ] HSBC: Fetched primary data is valid. [2025-10-15T19:28:45.501731] [DEBUG] [LOCAL ] HSBC: Saving primary data. [2025-10-15T19:28:45.503244] [DEBUG] [LOCAL ] HSBC: Trimmed 74085 records to 51004 (keeping 200 days of data) [2025-10-15T19:28:45.715621] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-08. [2025-10-15T19:28:45.827383] [DEBUG] [LOCAL ] HSBC: Primary data saved (51004 records). [2025-10-15T19:28:45.827766] [INFO ] [MAIN ] HSBC: Full history saved. [2025-10-15T19:28:45.833137] [INFO ] [MAIN ] Update Progress: 1057/2369 symbols completed. HSBC took 35.6s. Estimated remaining: 3h 4m 34s. Rate: 7.1 symbols/min [2025-10-15T19:28:45.877224] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-10-15T19:28:45.985944] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-10-15T19:28:46.056452] [INFO ] [MAIN ] HTFC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:28:46.056623] [DEBUG] [LOCAL ] HTFC: No existing data file found in primary storage. [2025-10-15T19:28:46.056692] [WARN ] [MAIN ] HTFC: No existing data found, performing full refresh instead. [2025-10-15T19:28:46.056805] [INFO ] [MAIN ] HTFC: Wiping existing primary data before full refresh. [2025-10-15T19:28:46.056847] [INFO ] [LOCAL ] HTFC: Starting deletion of primary data. [2025-10-15T19:28:46.056887] [DEBUG] [LOCAL ] HTFC: No primary data file found to delete. [2025-10-15T19:28:46.056969] [INFO ] [MAIN ] HTFC: Starting full primary refresh. [2025-10-15T19:28:46.404527] [INFO ] [REMOTE ] HTFC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:28:46.514012] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-01. [2025-10-15T19:28:46.609712] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-15T19:28:47.313980] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-09. [2025-10-15T19:28:47.358577] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-15T19:28:48.113982] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-03. [2025-10-15T19:28:48.160673] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-15T19:28:48.913994] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-02. [2025-10-15T19:28:49.663282] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-15T19:28:49.713963] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-03. [2025-10-15T19:28:49.813891] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-15T19:28:50.514018] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-10. [2025-10-15T19:28:50.577832] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-15T19:28:51.313988] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-04. [2025-10-15T19:28:51.479278] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-15T19:28:51.481292] [INFO ] [REMOTE ] HSHP: Full fetch complete (23322 records). [2025-10-15T19:28:51.481365] [DEBUG] [VALIDATOR ] HSHP: Validating primary data. [2025-10-15T19:28:51.848584] [DEBUG] [VALIDATOR ] HSHP: All expected trading days are present. [2025-10-15T19:28:51.848711] [DEBUG] [VALIDATOR ] HSHP: Primary data validation passed. [2025-10-15T19:28:51.849309] [INFO ] [MAIN ] HSHP: Fetched primary data is valid. [2025-10-15T19:28:51.849350] [DEBUG] [LOCAL ] HSHP: Saving primary data. [2025-10-15T19:28:51.849979] [DEBUG] [LOCAL ] HSHP: Trimmed 23322 records to 14871 (keeping 200 days of data) [2025-10-15T19:28:51.935009] [DEBUG] [LOCAL ] HSHP: Primary data saved (14871 records). [2025-10-15T19:28:51.935143] [INFO ] [MAIN ] HSHP: Full history saved. [2025-10-15T19:28:51.935225] [INFO ] [MAIN ] Update Progress: 1058/2369 symbols completed. HSHP took 26.1s. Estimated remaining: 3h 4m 22s. Rate: 7.1 symbols/min [2025-10-15T19:28:52.096406] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-15T19:28:52.116974] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2024-12. [2025-10-15T19:28:52.120259] [INFO ] [MAIN ] HTGC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:28:52.166158] [DEBUG] [LOCAL ] HTGC: Loaded 47691 existing records from primary storage. [2025-10-15T19:28:52.166454] [INFO ] [MAIN ] HTGC: Loaded 47691 existing records. [2025-10-15T19:28:52.341661] [WARN ] [MAIN ] HTGC: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:28:52.341887] [INFO ] [MAIN ] HTGC: Wiping existing primary data before full refresh. [2025-10-15T19:28:52.341934] [INFO ] [LOCAL ] HTGC: Starting deletion of primary data. [2025-10-15T19:28:52.342246] [DEBUG] [LOCAL ] HTGC: Deleted primary data file. [2025-10-15T19:28:52.342284] [INFO ] [MAIN ] HTGC: Starting full primary refresh. [2025-10-15T19:28:52.454514] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2024-12 (0.34 seconds). [2025-10-15T19:28:52.705502] [INFO ] [REMOTE ] HTGC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:28:52.914025] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-05. [2025-10-15T19:28:53.668302] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-15T19:28:53.714067] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-06. [2025-10-15T19:28:54.513985] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-04. [2025-10-15T19:28:54.588886] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-15T19:28:55.314019] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2024-12. [2025-10-15T19:28:56.114092] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-01. [2025-10-15T19:28:56.253124] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-15T19:28:56.425636] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-15T19:28:56.600832] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-10-15T19:28:56.914092] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-01. [2025-10-15T19:28:57.714033] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-07. [2025-10-15T19:28:58.385679] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-15T19:28:58.408949] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-15T19:28:58.513984] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-08. [2025-10-15T19:28:59.280777] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-15T19:28:59.313960] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-09. [2025-10-15T19:29:00.064117] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-15T19:29:00.113964] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-10. [2025-10-15T19:29:00.914007] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-02. [2025-10-15T19:29:01.033857] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-15T19:29:01.036720] [INFO ] [REMOTE ] HTD: Full fetch complete (19480 records). [2025-10-15T19:29:01.036806] [DEBUG] [VALIDATOR ] HTD: Validating primary data. [2025-10-15T19:29:01.414810] [DEBUG] [VALIDATOR ] HTD: All expected trading days are present. [2025-10-15T19:29:01.414926] [DEBUG] [VALIDATOR ] HTD: Primary data validation passed. [2025-10-15T19:29:01.415594] [INFO ] [MAIN ] HTD: Fetched primary data is valid. [2025-10-15T19:29:01.415659] [DEBUG] [LOCAL ] HTD: Saving primary data. [2025-10-15T19:29:01.416453] [DEBUG] [LOCAL ] HTD: Trimmed 19480 records to 14172 (keeping 200 days of data) [2025-10-15T19:29:01.510799] [DEBUG] [LOCAL ] HTD: Primary data saved (14172 records). [2025-10-15T19:29:01.510964] [INFO ] [MAIN ] HTD: Full history saved. [2025-10-15T19:29:01.511063] [INFO ] [MAIN ] Update Progress: 1059/2369 symbols completed. HTD took 19.3s. Estimated remaining: 3h 4m 15s. Rate: 7.1 symbols/min [2025-10-15T19:29:01.680989] [INFO ] [MAIN ] HTH: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:29:01.716373] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-05. [2025-10-15T19:29:01.718399] [DEBUG] [LOCAL ] HTH: Loaded 32540 existing records from primary storage. [2025-10-15T19:29:01.718669] [INFO ] [MAIN ] HTH: Loaded 32540 existing records. [2025-10-15T19:29:01.908447] [WARN ] [MAIN ] HTH: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:29:01.908788] [INFO ] [MAIN ] HTH: Wiping existing primary data before full refresh. [2025-10-15T19:29:01.908846] [INFO ] [LOCAL ] HTH: Starting deletion of primary data. [2025-10-15T19:29:01.909172] [DEBUG] [LOCAL ] HTH: Deleted primary data file. [2025-10-15T19:29:01.909257] [INFO ] [MAIN ] HTH: Starting full primary refresh. [2025-10-15T19:29:02.294315] [INFO ] [REMOTE ] HTH: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:29:02.494444] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-15T19:29:02.513960] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-03. [2025-10-15T19:29:03.314083] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-02. [2025-10-15T19:29:03.578387] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-15T19:29:03.628778] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-02 (0.31 seconds). [2025-10-15T19:29:04.101162] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-15T19:29:04.113946] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-04. [2025-10-15T19:29:04.914064] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-03. [2025-10-15T19:29:05.214288] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-03 (0.30 seconds). [2025-10-15T19:29:05.714004] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-04. [2025-10-15T19:29:05.847346] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-15T19:29:06.072257] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-04 (0.36 seconds). [2025-10-15T19:29:06.514091] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-05. [2025-10-15T19:29:06.836225] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-05 (0.32 seconds). [2025-10-15T19:29:07.314073] [INFO ] [REMOTE ] HTH: Fetching primary data for 2024-12. [2025-10-15T19:29:08.113966] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-05. [2025-10-15T19:29:08.227572] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-10-15T19:29:08.914020] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-06. [2025-10-15T19:29:09.714004] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-06. [2025-10-15T19:29:10.025585] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-06 (0.31 seconds). [2025-10-15T19:29:10.514033] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-07. [2025-10-15T19:29:10.743094] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-15T19:29:10.903433] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-07 (0.39 seconds). [2025-10-15T19:29:11.314024] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-08. [2025-10-15T19:29:11.640758] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-08 (0.33 seconds). [2025-10-15T19:29:12.114069] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-09. [2025-10-15T19:29:12.403319] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-09 (0.29 seconds). [2025-10-15T19:29:12.914064] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-07. [2025-10-15T19:29:13.720823] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-01. [2025-10-15T19:29:13.740576] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-05 (5.63 seconds). [2025-10-15T19:29:14.514024] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-06. [2025-10-15T19:29:14.737633] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-15T19:29:14.902230] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-15T19:29:15.314006] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-08. [2025-10-15T19:29:15.815157] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-15T19:29:16.114067] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-10. [2025-10-15T19:29:16.449469] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-10 (0.34 seconds). [2025-10-15T19:29:16.450448] [INFO ] [REMOTE ] HTFC: Full fetch complete (842 records). [2025-10-15T19:29:16.450538] [DEBUG] [VALIDATOR ] HTFC: Validating primary data. [2025-10-15T19:29:16.693832] [WARN ] [VALIDATOR ] HTFC: Validation failed - insufficient historical data. Have 182 unique days, need 200 days [2025-10-15T19:29:16.694062] [FATAL] [MAIN ] HTFC: Fetched primary data is invalid. Refusing to save it. [2025-10-15T19:29:16.694135] [WARN ] [MAIN ] HTFC: Deleting existing primary and derivative data due to validation failure. [2025-10-15T19:29:16.694212] [INFO ] [LOCAL ] HTFC: Starting deletion of primary data. [2025-10-15T19:29:16.694279] [DEBUG] [LOCAL ] HTFC: No primary data file found to delete. [2025-10-15T19:29:16.694318] [INFO ] [LOCAL ] HTFC: Starting deletion of derivative data. [2025-10-15T19:29:16.694360] [DEBUG] [LOCAL ] HTFC: No derivative data file found to delete. [2025-10-15T19:29:16.694422] [INFO ] [MAIN ] Update Progress: 1060/2369 symbols completed. HTFC took 30.9s. Estimated remaining: 3h 4m 15s. Rate: 7.1 symbols/min [2025-10-15T19:29:16.870396] [INFO ] [MAIN ] HUBB: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:29:16.905038] [DEBUG] [LOCAL ] HUBB: Loaded 36488 existing records from primary storage. [2025-10-15T19:29:16.905304] [INFO ] [MAIN ] HUBB: Loaded 36488 existing records. [2025-10-15T19:29:16.925683] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-07. [2025-10-15T19:29:17.088930] [WARN ] [MAIN ] HUBB: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:29:17.089187] [INFO ] [MAIN ] HUBB: Wiping existing primary data before full refresh. [2025-10-15T19:29:17.089239] [INFO ] [LOCAL ] HUBB: Starting deletion of primary data. [2025-10-15T19:29:17.089573] [DEBUG] [LOCAL ] HUBB: Deleted primary data file. [2025-10-15T19:29:17.089630] [INFO ] [MAIN ] HUBB: Starting full primary refresh. [2025-10-15T19:29:17.263183] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-10-15T19:29:17.484068] [INFO ] [REMOTE ] HUBB: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:29:17.713965] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2024-12. [2025-10-15T19:29:18.513971] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-02. [2025-10-15T19:29:18.625600] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-15T19:29:18.700322] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-10-15T19:29:19.313993] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-09. [2025-10-15T19:29:19.884331] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-15T19:29:20.114025] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-03. [2025-10-15T19:29:20.913976] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-01. [2025-10-15T19:29:21.118971] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-15T19:29:21.170970] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-15T19:29:21.713996] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-08. [2025-10-15T19:29:22.428083] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-15T19:29:22.513973] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-10. [2025-10-15T19:29:23.259320] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-15T19:29:23.314032] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-04. [2025-10-15T19:29:24.114032] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-02. [2025-10-15T19:29:24.343533] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-15T19:29:24.349982] [INFO ] [REMOTE ] HSY: Full fetch complete (73645 records). [2025-10-15T19:29:24.350191] [DEBUG] [VALIDATOR ] HSY: Validating primary data. [2025-10-15T19:29:24.759739] [DEBUG] [VALIDATOR ] HSY: All expected trading days are present. [2025-10-15T19:29:24.759837] [DEBUG] [VALIDATOR ] HSY: Primary data validation passed. [2025-10-15T19:29:24.778034] [INFO ] [MAIN ] HSY: Fetched primary data is valid. [2025-10-15T19:29:24.778180] [DEBUG] [LOCAL ] HSY: Saving primary data. [2025-10-15T19:29:24.780010] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-15T19:29:24.787773] [DEBUG] [LOCAL ] HSY: Trimmed 73645 records to 50437 (keeping 200 days of data) [2025-10-15T19:29:24.965767] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-05. [2025-10-15T19:29:25.106129] [DEBUG] [LOCAL ] HSY: Primary data saved (50437 records). [2025-10-15T19:29:25.106272] [INFO ] [MAIN ] HSY: Full history saved. [2025-10-15T19:29:25.106730] [INFO ] [MAIN ] Update Progress: 1061/2369 symbols completed. HSY took 53.0s. Estimated remaining: 3h 4m 7s. Rate: 7.1 symbols/min [2025-10-15T19:29:25.286176] [INFO ] [MAIN ] HUBS: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:29:25.326032] [DEBUG] [LOCAL ] HUBS: Loaded 40047 existing records from primary storage. [2025-10-15T19:29:25.326312] [INFO ] [MAIN ] HUBS: Loaded 40047 existing records. [2025-10-15T19:29:25.507417] [WARN ] [MAIN ] HUBS: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:29:25.507983] [INFO ] [MAIN ] HUBS: Wiping existing primary data before full refresh. [2025-10-15T19:29:25.508164] [INFO ] [LOCAL ] HUBS: Starting deletion of primary data. [2025-10-15T19:29:25.509033] [DEBUG] [LOCAL ] HUBS: Deleted primary data file. [2025-10-15T19:29:25.509094] [INFO ] [MAIN ] HUBS: Starting full primary refresh. [2025-10-15T19:29:25.724579] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-09. [2025-10-15T19:29:25.847830] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-15T19:29:25.918718] [INFO ] [REMOTE ] HUBS: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:29:26.251994] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-15T19:29:26.513999] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2024-12. [2025-10-15T19:29:27.108759] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-15T19:29:27.314006] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-10. [2025-10-15T19:29:27.519462] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-10-15T19:29:28.114049] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-06. [2025-10-15T19:29:28.914029] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-03. [2025-10-15T19:29:29.045577] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-15T19:29:29.051627] [INFO ] [REMOTE ] HTGC: Full fetch complete (68824 records). [2025-10-15T19:29:29.051763] [DEBUG] [VALIDATOR ] HTGC: Validating primary data. [2025-10-15T19:29:29.490723] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-15T19:29:29.494596] [DEBUG] [VALIDATOR ] HTGC: All expected trading days are present. [2025-10-15T19:29:29.494829] [DEBUG] [VALIDATOR ] HTGC: Primary data validation passed. [2025-10-15T19:29:29.502811] [INFO ] [MAIN ] HTGC: Fetched primary data is valid. [2025-10-15T19:29:29.503296] [DEBUG] [LOCAL ] HTGC: Saving primary data. [2025-10-15T19:29:29.504567] [DEBUG] [LOCAL ] HTGC: Trimmed 68824 records to 47734 (keeping 200 days of data) [2025-10-15T19:29:29.714232] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-01. [2025-10-15T19:29:29.802502] [DEBUG] [LOCAL ] HTGC: Primary data saved (47734 records). [2025-10-15T19:29:29.802697] [INFO ] [MAIN ] HTGC: Full history saved. [2025-10-15T19:29:29.802804] [INFO ] [MAIN ] Update Progress: 1062/2369 symbols completed. HTGC took 37.9s. Estimated remaining: 3h 3m 54s. Rate: 7.1 symbols/min [2025-10-15T19:29:29.970618] [INFO ] [MAIN ] HUM: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:29:30.015019] [DEBUG] [LOCAL ] HUM: Loaded 49228 existing records from primary storage. [2025-10-15T19:29:30.015335] [INFO ] [MAIN ] HUM: Loaded 49228 existing records. [2025-10-15T19:29:30.191495] [WARN ] [MAIN ] HUM: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:29:30.191748] [INFO ] [MAIN ] HUM: Wiping existing primary data before full refresh. [2025-10-15T19:29:30.191803] [INFO ] [LOCAL ] HUM: Starting deletion of primary data. [2025-10-15T19:29:30.192085] [DEBUG] [LOCAL ] HUM: Deleted primary data file. [2025-10-15T19:29:30.192124] [INFO ] [MAIN ] HUM: Starting full primary refresh. [2025-10-15T19:29:30.524066] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-07. [2025-10-15T19:29:30.567424] [INFO ] [REMOTE ] HUM: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:29:30.598136] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-15T19:29:30.716786] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-15T19:29:31.314006] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-04. [2025-10-15T19:29:31.912425] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-15T19:29:32.113991] [INFO ] [REMOTE ] HUM: Fetching primary data for 2024-12. [2025-10-15T19:29:32.567104] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-15T19:29:32.914000] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-08. [2025-10-15T19:29:33.714044] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-05. [2025-10-15T19:29:33.780229] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-15T19:29:34.329394] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-15T19:29:34.513998] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-09. [2025-10-15T19:29:34.745661] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-15T19:29:35.314001] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-01. [2025-10-15T19:29:35.378260] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-15T19:29:36.114001] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-10. [2025-10-15T19:29:36.914014] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-06. [2025-10-15T19:29:37.062411] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-15T19:29:37.372911] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-15T19:29:37.376582] [INFO ] [REMOTE ] HTH: Full fetch complete (46769 records). [2025-10-15T19:29:37.376716] [DEBUG] [VALIDATOR ] HTH: Validating primary data. [2025-10-15T19:29:37.719881] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-02. [2025-10-15T19:29:37.773376] [DEBUG] [VALIDATOR ] HTH: All expected trading days are present. [2025-10-15T19:29:37.773459] [DEBUG] [VALIDATOR ] HTH: Primary data validation passed. [2025-10-15T19:29:37.774298] [INFO ] [MAIN ] HTH: Fetched primary data is valid. [2025-10-15T19:29:37.774378] [DEBUG] [LOCAL ] HTH: Saving primary data. [2025-10-15T19:29:37.775488] [DEBUG] [LOCAL ] HTH: Trimmed 46769 records to 32576 (keeping 200 days of data) [2025-10-15T19:29:37.970505] [DEBUG] [LOCAL ] HTH: Primary data saved (32576 records). [2025-10-15T19:29:37.970671] [INFO ] [MAIN ] HTH: Full history saved. [2025-10-15T19:29:37.970775] [INFO ] [MAIN ] Update Progress: 1063/2369 symbols completed. HTH took 36.5s. Estimated remaining: 3h 3m 45s. Rate: 7.1 symbols/min [2025-10-15T19:29:38.138054] [INFO ] [MAIN ] HUN: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:29:38.187731] [DEBUG] [LOCAL ] HUN: Loaded 53215 existing records from primary storage. [2025-10-15T19:29:38.188062] [INFO ] [MAIN ] HUN: Loaded 53215 existing records. [2025-10-15T19:29:38.369284] [WARN ] [MAIN ] HUN: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:29:38.369612] [INFO ] [MAIN ] HUN: Wiping existing primary data before full refresh. [2025-10-15T19:29:38.369778] [INFO ] [LOCAL ] HUN: Starting deletion of primary data. [2025-10-15T19:29:38.370314] [DEBUG] [LOCAL ] HUN: Deleted primary data file. [2025-10-15T19:29:38.370410] [INFO ] [MAIN ] HUN: Starting full primary refresh. [2025-10-15T19:29:38.517885] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-02. [2025-10-15T19:29:38.552903] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-15T19:29:38.803889] [INFO ] [REMOTE ] HUN: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:29:38.943457] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-15T19:29:39.314032] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-03. [2025-10-15T19:29:40.037085] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-15T19:29:40.113991] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-07. [2025-10-15T19:29:40.914024] [INFO ] [REMOTE ] HUN: Fetching primary data for 2024-12. [2025-10-15T19:29:41.018075] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-15T19:29:41.669394] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-15T19:29:41.714028] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-08. [2025-10-15T19:29:42.364257] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-15T19:29:42.513996] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-01. [2025-10-15T19:29:43.147008] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-15T19:29:43.314002] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-09. [2025-10-15T19:29:43.816317] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-15T19:29:44.113992] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-04. [2025-10-15T19:29:44.737945] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-15T19:29:44.913988] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-10. [2025-10-15T19:29:45.680814] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-15T19:29:45.713957] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-05. [2025-10-15T19:29:46.247227] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-15T19:29:46.251743] [INFO ] [REMOTE ] HUBB: Full fetch complete (54233 records). [2025-10-15T19:29:46.251892] [DEBUG] [VALIDATOR ] HUBB: Validating primary data. [2025-10-15T19:29:46.519124] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-03. [2025-10-15T19:29:46.626030] [DEBUG] [VALIDATOR ] HUBB: All expected trading days are present. [2025-10-15T19:29:46.626101] [DEBUG] [VALIDATOR ] HUBB: Primary data validation passed. [2025-10-15T19:29:46.626936] [INFO ] [MAIN ] HUBB: Fetched primary data is valid. [2025-10-15T19:29:46.626997] [DEBUG] [LOCAL ] HUBB: Saving primary data. [2025-10-15T19:29:46.628056] [DEBUG] [LOCAL ] HUBB: Trimmed 54233 records to 36510 (keeping 200 days of data) [2025-10-15T19:29:46.862233] [DEBUG] [LOCAL ] HUBB: Primary data saved (36510 records). [2025-10-15T19:29:46.862381] [INFO ] [MAIN ] HUBB: Full history saved. [2025-10-15T19:29:46.862505] [INFO ] [MAIN ] Update Progress: 1064/2369 symbols completed. HUBB took 30.2s. Estimated remaining: 3h 3m 37s. Rate: 7.1 symbols/min [2025-10-15T19:29:47.036708] [INFO ] [MAIN ] HUYA: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:29:47.079741] [DEBUG] [LOCAL ] HUYA: Loaded 43846 existing records from primary storage. [2025-10-15T19:29:47.080174] [INFO ] [MAIN ] HUYA: Loaded 43846 existing records. [2025-10-15T19:29:47.259626] [WARN ] [MAIN ] HUYA: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:29:47.259942] [INFO ] [MAIN ] HUYA: Wiping existing primary data before full refresh. [2025-10-15T19:29:47.260042] [INFO ] [LOCAL ] HUYA: Starting deletion of primary data. [2025-10-15T19:29:47.260427] [DEBUG] [LOCAL ] HUYA: Deleted primary data file. [2025-10-15T19:29:47.260516] [INFO ] [MAIN ] HUYA: Starting full primary refresh. [2025-10-15T19:29:47.354954] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-02. [2025-10-15T19:29:47.391125] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-15T19:29:47.643085] [INFO ] [REMOTE ] HUYA: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:29:47.908679] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-15T19:29:48.113995] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-06. [2025-10-15T19:29:48.774145] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-15T19:29:48.913993] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-03. [2025-10-15T19:29:49.490985] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-15T19:29:49.713999] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2024-12. [2025-10-15T19:29:50.514052] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-07. [2025-10-15T19:29:50.638592] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-15T19:29:51.272781] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-15T19:29:51.313956] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-01. [2025-10-15T19:29:51.695457] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-15T19:29:52.114016] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-04. [2025-10-15T19:29:52.878256] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-15T19:29:52.913960] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-02. [2025-10-15T19:29:53.713985] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-04. [2025-10-15T19:29:53.781815] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-15T19:29:54.468498] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-15T19:29:54.514076] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-05. [2025-10-15T19:29:55.314085] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-03. [2025-10-15T19:29:55.444806] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-15T19:29:56.113982] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-08. [2025-10-15T19:29:56.271418] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-15T19:29:56.914030] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-06. [2025-10-15T19:29:57.103725] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-15T19:29:57.714025] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-04. [2025-10-15T19:29:57.791348] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-15T19:29:58.498799] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-15T19:29:58.513960] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-07. [2025-10-15T19:29:58.826151] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-15T19:29:59.314036] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-09. [2025-10-15T19:30:00.114011] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-05. [2025-10-15T19:30:00.339446] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-15T19:30:00.827750] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-15T19:30:00.913972] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-05. [2025-10-15T19:30:01.714063] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-10. [2025-10-15T19:30:01.873596] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-15T19:30:02.400914] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-15T19:30:02.514058] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-06. [2025-10-15T19:30:03.314008] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-06. [2025-10-15T19:30:03.397633] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-15T19:30:03.403818] [INFO ] [REMOTE ] HUBS: Full fetch complete (56577 records). [2025-10-15T19:30:03.403976] [DEBUG] [VALIDATOR ] HUBS: Validating primary data. [2025-10-15T19:30:03.794527] [DEBUG] [VALIDATOR ] HUBS: All expected trading days are present. [2025-10-15T19:30:03.794612] [DEBUG] [VALIDATOR ] HUBS: Primary data validation passed. [2025-10-15T19:30:03.795509] [INFO ] [MAIN ] HUBS: Fetched primary data is valid. [2025-10-15T19:30:03.795567] [DEBUG] [LOCAL ] HUBS: Saving primary data. [2025-10-15T19:30:03.796667] [DEBUG] [LOCAL ] HUBS: Trimmed 56577 records to 40051 (keeping 200 days of data) [2025-10-15T19:30:04.045501] [DEBUG] [LOCAL ] HUBS: Primary data saved (40051 records). [2025-10-15T19:30:04.045684] [INFO ] [MAIN ] HUBS: Full history saved. [2025-10-15T19:30:04.046088] [INFO ] [MAIN ] Update Progress: 1065/2369 symbols completed. HUBS took 38.9s. Estimated remaining: 3h 3m 39s. Rate: 7.1 symbols/min [2025-10-15T19:30:04.114541] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-08. [2025-10-15T19:30:04.249399] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-15T19:30:04.251769] [INFO ] [MAIN ] HVT: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:30:04.276442] [DEBUG] [LOCAL ] HVT: Loaded 15153 existing records from primary storage. [2025-10-15T19:30:04.276732] [INFO ] [MAIN ] HVT: Loaded 15153 existing records. [2025-10-15T19:30:04.449403] [WARN ] [MAIN ] HVT: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:30:04.449623] [INFO ] [MAIN ] HVT: Wiping existing primary data before full refresh. [2025-10-15T19:30:04.449702] [INFO ] [LOCAL ] HVT: Starting deletion of primary data. [2025-10-15T19:30:04.449879] [DEBUG] [LOCAL ] HVT: Deleted primary data file. [2025-10-15T19:30:04.449917] [INFO ] [MAIN ] HVT: Starting full primary refresh. [2025-10-15T19:30:04.830050] [INFO ] [REMOTE ] HVT: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:30:04.913971] [INFO ] [REMOTE ] HVT: Fetching primary data for 2024-12. [2025-10-15T19:30:05.123853] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-15T19:30:05.713975] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-07. [2025-10-15T19:30:05.862030] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-15T19:30:05.932973] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-15T19:30:06.514031] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-09. [2025-10-15T19:30:07.313981] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-01. [2025-10-15T19:30:07.646615] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-15T19:30:07.988812] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-15T19:30:08.023616] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-15T19:30:08.114000] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-07. [2025-10-15T19:30:08.914095] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-10. [2025-10-15T19:30:09.714040] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-02. [2025-10-15T19:30:10.011481] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-15T19:30:10.323384] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-15T19:30:10.514006] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-03. [2025-10-15T19:30:10.888337] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-10 (1.97 seconds). [2025-10-15T19:30:10.895472] [INFO ] [REMOTE ] HUN: Full fetch complete (76968 records). [2025-10-15T19:30:10.895678] [DEBUG] [VALIDATOR ] HUN: Validating primary data. [2025-10-15T19:30:11.324770] [DEBUG] [VALIDATOR ] HUN: All expected trading days are present. [2025-10-15T19:30:11.320850] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-08. [2025-10-15T19:30:11.326010] [DEBUG] [VALIDATOR ] HUN: Primary data validation passed. [2025-10-15T19:30:11.327113] [INFO ] [MAIN ] HUN: Fetched primary data is valid. [2025-10-15T19:30:11.327280] [DEBUG] [LOCAL ] HUN: Saving primary data. [2025-10-15T19:30:11.333022] [DEBUG] [LOCAL ] HUN: Trimmed 76968 records to 53214 (keeping 200 days of data) [2025-10-15T19:30:11.666757] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-15T19:30:11.693629] [DEBUG] [LOCAL ] HUN: Primary data saved (53214 records). [2025-10-15T19:30:11.693806] [INFO ] [MAIN ] HUN: Full history saved. [2025-10-15T19:30:11.694676] [INFO ] [MAIN ] Update Progress: 1066/2369 symbols completed. HUN took 33.7s. Estimated remaining: 3h 3m 30s. Rate: 7.1 symbols/min [2025-10-15T19:30:11.883291] [INFO ] [MAIN ] HWM: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:30:11.941574] [DEBUG] [LOCAL ] HWM: Loaded 52852 existing records from primary storage. [2025-10-15T19:30:11.941907] [INFO ] [MAIN ] HWM: Loaded 52852 existing records. [2025-10-15T19:30:12.121064] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-04. [2025-10-15T19:30:12.142535] [WARN ] [MAIN ] HWM: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:30:12.143741] [INFO ] [MAIN ] HWM: Wiping existing primary data before full refresh. [2025-10-15T19:30:12.143808] [INFO ] [LOCAL ] HWM: Starting deletion of primary data. [2025-10-15T19:30:12.144126] [DEBUG] [LOCAL ] HWM: Deleted primary data file. [2025-10-15T19:30:12.144168] [INFO ] [MAIN ] HWM: Starting full primary refresh. [2025-10-15T19:30:12.484855] [INFO ] [REMOTE ] HWM: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:30:12.870720] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-15T19:30:12.913990] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-09. [2025-10-15T19:30:12.988143] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-15T19:30:13.714006] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-05. [2025-10-15T19:30:14.431783] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-15T19:30:14.514037] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-08. [2025-10-15T19:30:14.577338] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-15T19:30:15.314019] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-06. [2025-10-15T19:30:16.113969] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-10. [2025-10-15T19:30:16.321627] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-15T19:30:16.351763] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-15T19:30:16.914032] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-07. [2025-10-15T19:30:17.316685] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-15T19:30:17.322337] [INFO ] [REMOTE ] HUYA: Full fetch complete (64117 records). [2025-10-15T19:30:17.322442] [DEBUG] [VALIDATOR ] HUYA: Validating primary data. [2025-10-15T19:30:17.711526] [DEBUG] [VALIDATOR ] HUYA: All expected trading days are present. [2025-10-15T19:30:17.711705] [DEBUG] [VALIDATOR ] HUYA: Primary data validation passed. [2025-10-15T19:30:17.712745] [INFO ] [MAIN ] HUYA: Fetched primary data is valid. [2025-10-15T19:30:17.712808] [DEBUG] [LOCAL ] HUYA: Saving primary data. [2025-10-15T19:30:17.714063] [DEBUG] [LOCAL ] HUYA: Trimmed 64117 records to 43809 (keeping 200 days of data) [2025-10-15T19:30:17.713975] [INFO ] [REMOTE ] HWM: Fetching primary data for 2024-12. [2025-10-15T19:30:17.926275] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-15T19:30:17.983849] [DEBUG] [LOCAL ] HUYA: Primary data saved (43809 records). [2025-10-15T19:30:17.983994] [INFO ] [MAIN ] HUYA: Full history saved. [2025-10-15T19:30:17.984087] [INFO ] [MAIN ] Update Progress: 1067/2369 symbols completed. HUYA took 31.1s. Estimated remaining: 3h 3m 19s. Rate: 7.1 symbols/min [2025-10-15T19:30:18.151090] [INFO ] [MAIN ] HXL: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:30:18.192013] [DEBUG] [LOCAL ] HXL: Loaded 45870 existing records from primary storage. [2025-10-15T19:30:18.192310] [INFO ] [MAIN ] HXL: Loaded 45870 existing records. [2025-10-15T19:30:18.369626] [WARN ] [MAIN ] HXL: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:30:18.369882] [INFO ] [MAIN ] HXL: Wiping existing primary data before full refresh. [2025-10-15T19:30:18.369936] [INFO ] [LOCAL ] HXL: Starting deletion of primary data. [2025-10-15T19:30:18.370360] [DEBUG] [LOCAL ] HXL: Deleted primary data file. [2025-10-15T19:30:18.370416] [INFO ] [MAIN ] HXL: Starting full primary refresh. [2025-10-15T19:30:18.519157] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-09. [2025-10-15T19:30:18.728881] [INFO ] [REMOTE ] HXL: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:30:19.313999] [INFO ] [REMOTE ] HXL: Fetching primary data for 2024-12. [2025-10-15T19:30:20.113996] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-08. [2025-10-15T19:30:20.264379] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2024-12 (2.55 seconds). [2025-10-15T19:30:20.478265] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-10-15T19:30:20.655905] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-10-15T19:30:20.856689] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-15T19:30:20.913952] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-10. [2025-10-15T19:30:21.714015] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-01. [2025-10-15T19:30:22.513996] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-01. [2025-10-15T19:30:22.845979] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-10 (1.93 seconds). [2025-10-15T19:30:22.851992] [INFO ] [REMOTE ] HUM: Full fetch complete (71071 records). [2025-10-15T19:30:22.852097] [DEBUG] [VALIDATOR ] HUM: Validating primary data. [2025-10-15T19:30:23.235310] [DEBUG] [VALIDATOR ] HUM: All expected trading days are present. [2025-10-15T19:30:23.235408] [DEBUG] [VALIDATOR ] HUM: Primary data validation passed. [2025-10-15T19:30:23.236380] [INFO ] [MAIN ] HUM: Fetched primary data is valid. [2025-10-15T19:30:23.236443] [DEBUG] [LOCAL ] HUM: Saving primary data. [2025-10-15T19:30:23.237861] [DEBUG] [LOCAL ] HUM: Trimmed 71071 records to 49309 (keeping 200 days of data) [2025-10-15T19:30:23.325478] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-09. [2025-10-15T19:30:23.550999] [DEBUG] [LOCAL ] HUM: Primary data saved (49309 records). [2025-10-15T19:30:23.551206] [INFO ] [MAIN ] HUM: Full history saved. [2025-10-15T19:30:23.551297] [INFO ] [MAIN ] Update Progress: 1068/2369 symbols completed. HUM took 53.7s. Estimated remaining: 3h 3m 7s. Rate: 7.1 symbols/min [2025-10-15T19:30:23.726964] [INFO ] [MAIN ] HY: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:30:23.760348] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-01 (2.05 seconds). [2025-10-15T19:30:23.775406] [DEBUG] [LOCAL ] HY: Loaded 10030 existing records from primary storage. [2025-10-15T19:30:23.775619] [INFO ] [MAIN ] HY: Loaded 10030 existing records. [2025-10-15T19:30:23.954600] [WARN ] [MAIN ] HY: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:30:23.954852] [INFO ] [MAIN ] HY: Wiping existing primary data before full refresh. [2025-10-15T19:30:23.954912] [INFO ] [LOCAL ] HY: Starting deletion of primary data. [2025-10-15T19:30:23.955099] [DEBUG] [LOCAL ] HY: Deleted primary data file. [2025-10-15T19:30:23.955153] [INFO ] [MAIN ] HY: Starting full primary refresh. [2025-10-15T19:30:24.117827] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-15T19:30:24.116792] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-02. [2025-10-15T19:30:24.178280] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-15T19:30:24.373458] [INFO ] [REMOTE ] HY: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:30:24.914039] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-02. [2025-10-15T19:30:25.714034] [INFO ] [REMOTE ] HY: Fetching primary data for 2024-12. [2025-10-15T19:30:26.007190] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-10-15T19:30:26.212977] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2024-12 (0.50 seconds). [2025-10-15T19:30:26.386387] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-15T19:30:26.514053] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-10. [2025-10-15T19:30:27.313987] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-03. [2025-10-15T19:30:27.374686] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-15T19:30:27.377687] [INFO ] [REMOTE ] HVT: Full fetch complete (23196 records). [2025-10-15T19:30:27.377810] [DEBUG] [VALIDATOR ] HVT: Validating primary data. [2025-10-15T19:30:27.784354] [DEBUG] [VALIDATOR ] HVT: All expected trading days are present. [2025-10-15T19:30:27.784459] [DEBUG] [VALIDATOR ] HVT: Primary data validation passed. [2025-10-15T19:30:27.785055] [INFO ] [MAIN ] HVT: Fetched primary data is valid. [2025-10-15T19:30:27.785119] [DEBUG] [LOCAL ] HVT: Saving primary data. [2025-10-15T19:30:27.785831] [DEBUG] [LOCAL ] HVT: Trimmed 23196 records to 15120 (keeping 200 days of data) [2025-10-15T19:30:27.886527] [DEBUG] [LOCAL ] HVT: Primary data saved (15120 records). [2025-10-15T19:30:27.886693] [INFO ] [MAIN ] HVT: Full history saved. [2025-10-15T19:30:27.886792] [INFO ] [MAIN ] Update Progress: 1069/2369 symbols completed. HVT took 23.8s. Estimated remaining: 3h 2m 53s. Rate: 7.1 symbols/min [2025-10-15T19:30:28.079472] [INFO ] [MAIN ] HYAC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:30:28.079636] [DEBUG] [LOCAL ] HYAC: No existing data file found in primary storage. [2025-10-15T19:30:28.079711] [WARN ] [MAIN ] HYAC: No existing data found, performing full refresh instead. [2025-10-15T19:30:28.079823] [INFO ] [MAIN ] HYAC: Wiping existing primary data before full refresh. [2025-10-15T19:30:28.079864] [INFO ] [LOCAL ] HYAC: Starting deletion of primary data. [2025-10-15T19:30:28.079909] [DEBUG] [LOCAL ] HYAC: No primary data file found to delete. [2025-10-15T19:30:28.079951] [INFO ] [MAIN ] HYAC: Starting full primary refresh. [2025-10-15T19:30:28.120828] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-03. [2025-10-15T19:30:28.430610] [INFO ] [REMOTE ] HYAC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:30:28.913975] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2024-12. [2025-10-15T19:30:29.225465] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2024-12 (0.31 seconds). [2025-10-15T19:30:29.330669] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-10-15T19:30:29.714053] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-01. [2025-10-15T19:30:29.836320] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-15T19:30:30.025669] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-01 (0.31 seconds). [2025-10-15T19:30:30.514076] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-01. [2025-10-15T19:30:31.314005] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-02. [2025-10-15T19:30:31.461745] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-15T19:30:31.654928] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-10-15T19:30:32.113966] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-04. [2025-10-15T19:30:32.913998] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-03. [2025-10-15T19:30:33.165927] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-03 (0.25 seconds). [2025-10-15T19:30:33.713984] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-04. [2025-10-15T19:30:33.987795] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-15T19:30:34.024534] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-04 (0.31 seconds). [2025-10-15T19:30:34.513992] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-02. [2025-10-15T19:30:35.281405] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-15T19:30:35.313960] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-05. [2025-10-15T19:30:35.629537] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-05 (0.32 seconds). [2025-10-15T19:30:36.114006] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-06. [2025-10-15T19:30:36.415731] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-06 (0.30 seconds). [2025-10-15T19:30:36.913999] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-05. [2025-10-15T19:30:37.713991] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-07. [2025-10-15T19:30:38.122749] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-07 (0.41 seconds). [2025-10-15T19:30:38.466613] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-15T19:30:38.513952] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-06. [2025-10-15T19:30:39.314020] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-08. [2025-10-15T19:30:39.537876] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-08 (0.22 seconds). [2025-10-15T19:30:40.109268] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-15T19:30:40.118178] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-09. [2025-10-15T19:30:40.342767] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-09 (0.22 seconds). [2025-10-15T19:30:40.913990] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-03. [2025-10-15T19:30:41.713959] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-07. [2025-10-15T19:30:41.735598] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-15T19:30:42.513992] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-10. [2025-10-15T19:30:42.947947] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-10 (0.43 seconds). [2025-10-15T19:30:42.948779] [INFO ] [REMOTE ] HYAC: Full fetch complete (916 records). [2025-10-15T19:30:42.948846] [DEBUG] [VALIDATOR ] HYAC: Validating primary data. [2025-10-15T19:30:43.128049] [WARN ] [VALIDATOR ] HYAC: Validation failed - insufficient historical data. Have 166 unique days, need 200 days [2025-10-15T19:30:43.128430] [FATAL] [MAIN ] HYAC: Fetched primary data is invalid. Refusing to save it. [2025-10-15T19:30:43.128506] [WARN ] [MAIN ] HYAC: Deleting existing primary and derivative data due to validation failure. [2025-10-15T19:30:43.128630] [INFO ] [LOCAL ] HYAC: Starting deletion of primary data. [2025-10-15T19:30:43.128735] [DEBUG] [LOCAL ] HYAC: No primary data file found to delete. [2025-10-15T19:30:43.128778] [INFO ] [LOCAL ] HYAC: Starting deletion of derivative data. [2025-10-15T19:30:43.128818] [DEBUG] [LOCAL ] HYAC: No derivative data file found to delete. [2025-10-15T19:30:43.128873] [INFO ] [MAIN ] Update Progress: 1070/2369 symbols completed. HYAC took 15.2s. Estimated remaining: 3h 2m 53s. Rate: 7.1 symbols/min [2025-10-15T19:30:43.303019] [INFO ] [MAIN ] HYBX: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:30:43.303365] [DEBUG] [LOCAL ] HYBX: No existing data file found in primary storage. [2025-10-15T19:30:43.303460] [WARN ] [MAIN ] HYBX: No existing data found, performing full refresh instead. [2025-10-15T19:30:43.303599] [INFO ] [MAIN ] HYBX: Wiping existing primary data before full refresh. [2025-10-15T19:30:43.303691] [INFO ] [LOCAL ] HYBX: Starting deletion of primary data. [2025-10-15T19:30:43.303864] [DEBUG] [LOCAL ] HYBX: No primary data file found to delete. [2025-10-15T19:30:43.303982] [INFO ] [MAIN ] HYBX: Starting full primary refresh. [2025-10-15T19:30:43.319134] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-04. [2025-10-15T19:30:43.566015] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-15T19:30:43.718913] [INFO ] [REMOTE ] HYBX: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:30:44.113991] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2024-12. [2025-10-15T19:30:44.469399] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2024-12 (0.36 seconds). [2025-10-15T19:30:44.914000] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-04. [2025-10-15T19:30:45.455161] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-04 (2.14 seconds). [2025-10-15T19:30:45.475546] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-10-15T19:30:45.713982] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-05. [2025-10-15T19:30:46.468211] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-15T19:30:46.513961] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-06. [2025-10-15T19:30:47.283036] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-15T19:30:47.313953] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-07. [2025-10-15T19:30:47.849478] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-10-15T19:30:48.113984] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-01. [2025-10-15T19:30:48.436374] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-01 (0.32 seconds). [2025-10-15T19:30:48.914000] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-08. [2025-10-15T19:30:49.687531] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-15T19:30:49.713951] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-09. [2025-10-15T19:30:50.293443] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-15T19:30:50.513965] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-10. [2025-10-15T19:30:51.237085] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-15T19:30:51.238746] [INFO ] [REMOTE ] HY: Full fetch complete (15050 records). [2025-10-15T19:30:51.238817] [DEBUG] [VALIDATOR ] HY: Validating primary data. [2025-10-15T19:30:51.319127] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-08. [2025-10-15T19:30:51.604912] [DEBUG] [VALIDATOR ] HY: All expected trading days are present. [2025-10-15T19:30:51.604991] [DEBUG] [VALIDATOR ] HY: Primary data validation passed. [2025-10-15T19:30:51.605308] [INFO ] [MAIN ] HY: Fetched primary data is valid. [2025-10-15T19:30:51.605348] [DEBUG] [LOCAL ] HY: Saving primary data. [2025-10-15T19:30:51.605850] [DEBUG] [LOCAL ] HY: Trimmed 15050 records to 10057 (keeping 200 days of data) [2025-10-15T19:30:51.666622] [DEBUG] [LOCAL ] HY: Primary data saved (10057 records). [2025-10-15T19:30:51.666778] [INFO ] [MAIN ] HY: Full history saved. [2025-10-15T19:30:51.666859] [INFO ] [MAIN ] Update Progress: 1071/2369 symbols completed. HY took 28.1s. Estimated remaining: 3h 2m 45s. Rate: 7.1 symbols/min [2025-10-15T19:30:51.833259] [INFO ] [MAIN ] HYI: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:30:51.843710] [DEBUG] [LOCAL ] HYI: Loaded 9904 existing records from primary storage. [2025-10-15T19:30:51.843927] [INFO ] [MAIN ] HYI: Loaded 9904 existing records. [2025-10-15T19:30:52.016438] [WARN ] [MAIN ] HYI: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:30:52.016682] [INFO ] [MAIN ] HYI: Wiping existing primary data before full refresh. [2025-10-15T19:30:52.016761] [INFO ] [LOCAL ] HYI: Starting deletion of primary data. [2025-10-15T19:30:52.016950] [DEBUG] [LOCAL ] HYI: Deleted primary data file. [2025-10-15T19:30:52.017005] [INFO ] [MAIN ] HYI: Starting full primary refresh. [2025-10-15T19:30:52.115836] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-05. [2025-10-15T19:30:52.371543] [INFO ] [REMOTE ] HYI: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:30:52.867308] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-15T19:30:52.913953] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-09. [2025-10-15T19:30:53.717801] [INFO ] [REMOTE ] HYI: Fetching primary data for 2024-12. [2025-10-15T19:30:53.723958] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-15T19:30:54.178636] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-15T19:30:54.492735] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-10-15T19:30:54.513958] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-06. [2025-10-15T19:30:55.313990] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-10. [2025-10-15T19:30:56.113973] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-01. [2025-10-15T19:30:56.275863] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-15T19:30:56.835070] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-15T19:30:56.902328] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-15T19:30:56.907557] [INFO ] [REMOTE ] HXL: Full fetch complete (66381 records). [2025-10-15T19:30:56.907678] [DEBUG] [VALIDATOR ] HXL: Validating primary data. [2025-10-15T19:30:56.919139] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-02. [2025-10-15T19:30:57.301956] [DEBUG] [VALIDATOR ] HXL: All expected trading days are present. [2025-10-15T19:30:57.302031] [DEBUG] [VALIDATOR ] HXL: Primary data validation passed. [2025-10-15T19:30:57.302951] [INFO ] [MAIN ] HXL: Fetched primary data is valid. [2025-10-15T19:30:57.303021] [DEBUG] [LOCAL ] HXL: Saving primary data. [2025-10-15T19:30:57.304219] [DEBUG] [LOCAL ] HXL: Trimmed 66381 records to 45841 (keeping 200 days of data) [2025-10-15T19:30:57.572933] [DEBUG] [LOCAL ] HXL: Primary data saved (45841 records). [2025-10-15T19:30:57.573050] [INFO ] [MAIN ] HXL: Full history saved. [2025-10-15T19:30:57.573129] [INFO ] [MAIN ] Update Progress: 1072/2369 symbols completed. HXL took 39.6s. Estimated remaining: 3h 2m 33s. Rate: 7.1 symbols/min [2025-10-15T19:30:57.728356] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-07. [2025-10-15T19:30:57.754332] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-15T19:30:57.753169] [INFO ] [MAIN ] HYT: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:30:57.788939] [DEBUG] [LOCAL ] HYT: Loaded 33676 existing records from primary storage. [2025-10-15T19:30:57.789204] [INFO ] [MAIN ] HYT: Loaded 33676 existing records. [2025-10-15T19:30:57.964630] [WARN ] [MAIN ] HYT: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:30:57.964874] [INFO ] [MAIN ] HYT: Wiping existing primary data before full refresh. [2025-10-15T19:30:57.964923] [INFO ] [LOCAL ] HYT: Starting deletion of primary data. [2025-10-15T19:30:57.965233] [DEBUG] [LOCAL ] HYT: Deleted primary data file. [2025-10-15T19:30:57.965273] [INFO ] [MAIN ] HYT: Starting full primary refresh. [2025-10-15T19:30:58.310751] [INFO ] [REMOTE ] HYT: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:30:58.514027] [INFO ] [REMOTE ] HYT: Fetching primary data for 2024-12. [2025-10-15T19:30:59.314010] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-03. [2025-10-15T19:30:59.724456] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-15T19:30:59.793526] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-10-15T19:31:00.068102] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-15T19:31:00.113950] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-04. [2025-10-15T19:31:00.769585] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-15T19:31:00.914044] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-05. [2025-10-15T19:31:01.716438] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-08. [2025-10-15T19:31:01.720145] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-15T19:31:02.514004] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-02. [2025-10-15T19:31:02.739699] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-02 (0.23 seconds). [2025-10-15T19:31:03.313980] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-06. [2025-10-15T19:31:03.637011] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-15T19:31:04.051768] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-15T19:31:04.114038] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-09. [2025-10-15T19:31:04.914019] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-03. [2025-10-15T19:31:05.132769] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-03 (0.22 seconds). [2025-10-15T19:31:05.714033] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-07. [2025-10-15T19:31:05.980084] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-15T19:31:06.359989] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-15T19:31:06.513989] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-04. [2025-10-15T19:31:06.862262] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-04 (0.35 seconds). [2025-10-15T19:31:07.314034] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-08. [2025-10-15T19:31:08.070707] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-15T19:31:08.113967] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-09. [2025-10-15T19:31:08.914006] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-05. [2025-10-15T19:31:09.236143] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-05 (0.32 seconds). [2025-10-15T19:31:09.257384] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-15T19:31:09.714013] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-01. [2025-10-15T19:31:10.514008] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-10. [2025-10-15T19:31:11.158172] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-15T19:31:11.314061] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-10. [2025-10-15T19:31:12.113974] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-06. [2025-10-15T19:31:12.153931] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-15T19:31:12.159925] [INFO ] [REMOTE ] HWM: Full fetch complete (76687 records). [2025-10-15T19:31:12.160031] [DEBUG] [VALIDATOR ] HWM: Validating primary data. [2025-10-15T19:31:12.369549] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-15T19:31:12.435009] [INFO ] [REMOTE ] HYI: Full fetch complete (13987 records). [2025-10-15T19:31:12.446628] [DEBUG] [VALIDATOR ] HYI: Validating primary data. [2025-10-15T19:31:12.475627] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-10-15T19:31:12.744933] [DEBUG] [VALIDATOR ] HWM: All expected trading days are present. [2025-10-15T19:31:12.745702] [DEBUG] [VALIDATOR ] HWM: Primary data validation passed. [2025-10-15T19:31:12.770981] [INFO ] [MAIN ] HWM: Fetched primary data is valid. [2025-10-15T19:31:12.810998] [DEBUG] [LOCAL ] HWM: Saving primary data. [2025-10-15T19:31:12.875805] [DEBUG] [LOCAL ] HWM: Trimmed 76687 records to 52813 (keeping 200 days of data) [2025-10-15T19:31:12.919912] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-07. [2025-10-15T19:31:13.051869] [DEBUG] [VALIDATOR ] HYI: All expected trading days are present. [2025-10-15T19:31:13.052829] [DEBUG] [VALIDATOR ] HYI: Primary data validation passed. [2025-10-15T19:31:13.061313] [INFO ] [MAIN ] HYI: Fetched primary data is valid. [2025-10-15T19:31:13.061393] [DEBUG] [LOCAL ] HYI: Saving primary data. [2025-10-15T19:31:13.067787] [DEBUG] [LOCAL ] HYI: Trimmed 13987 records to 9824 (keeping 200 days of data) [2025-10-15T19:31:13.240372] [DEBUG] [LOCAL ] HYI: Primary data saved (9824 records). [2025-10-15T19:31:13.257403] [INFO ] [MAIN ] HYI: Full history saved. [2025-10-15T19:31:13.269358] [INFO ] [MAIN ] Update Progress: 1073/2369 symbols completed. HYI took 21.6s. Estimated remaining: 3h 2m 33s. Rate: 7.1 symbols/min [2025-10-15T19:31:13.336498] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-10-15T19:31:13.521833] [INFO ] [MAIN ] HYTR: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:31:13.532311] [DEBUG] [LOCAL ] HYTR: Loaded 3124 existing records from primary storage. [2025-10-15T19:31:13.533695] [INFO ] [MAIN ] HYTR: Loaded 3124 existing records. [2025-10-15T19:31:13.710534] [DEBUG] [LOCAL ] HWM: Primary data saved (52813 records). [2025-10-15T19:31:13.726233] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-08. [2025-10-15T19:31:13.726375] [INFO ] [MAIN ] HWM: Full history saved. [2025-10-15T19:31:13.733852] [WARN ] [MAIN ] HYTR: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:31:13.734164] [INFO ] [MAIN ] HYTR: Wiping existing primary data before full refresh. [2025-10-15T19:31:13.734243] [INFO ] [LOCAL ] HYTR: Starting deletion of primary data. [2025-10-15T19:31:13.730613] [INFO ] [MAIN ] Update Progress: 1074/2369 symbols completed. HWM took 1m 2s. Estimated remaining: 3h 2m 15s. Rate: 7.1 symbols/min [2025-10-15T19:31:13.740050] [DEBUG] [LOCAL ] HYTR: Deleted primary data file. [2025-10-15T19:31:13.811210] [INFO ] [MAIN ] HYTR: Starting full primary refresh. [2025-10-15T19:31:14.039876] [INFO ] [MAIN ] HZO: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:31:14.066873] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-08 (0.34 seconds). [2025-10-15T19:31:14.297563] [DEBUG] [LOCAL ] HZO: Loaded 29123 existing records from primary storage. [2025-10-15T19:31:14.301333] [INFO ] [MAIN ] HZO: Loaded 29123 existing records. [2025-10-15T19:31:14.400787] [INFO ] [REMOTE ] HYTR: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:31:14.505089] [WARN ] [MAIN ] HZO: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:31:14.505296] [INFO ] [MAIN ] HZO: Wiping existing primary data before full refresh. [2025-10-15T19:31:14.505347] [INFO ] [LOCAL ] HZO: Starting deletion of primary data. [2025-10-15T19:31:14.505583] [DEBUG] [LOCAL ] HZO: Deleted primary data file. [2025-10-15T19:31:14.505694] [INFO ] [MAIN ] HZO: Starting full primary refresh. [2025-10-15T19:31:14.519098] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-09. [2025-10-15T19:31:14.869745] [INFO ] [REMOTE ] HZO: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:31:14.922804] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-09 (0.40 seconds). [2025-10-15T19:31:15.313996] [INFO ] [REMOTE ] HZO: Fetching primary data for 2024-12. [2025-10-15T19:31:16.114057] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-02. [2025-10-15T19:31:16.405117] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-15T19:31:16.914020] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2024-12. [2025-10-15T19:31:17.000135] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-15T19:31:17.337571] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2024-12 (0.42 seconds). [2025-10-15T19:31:17.714000] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-01. [2025-10-15T19:31:18.212407] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-10-15T19:31:18.514037] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-03. [2025-10-15T19:31:19.314003] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-01. [2025-10-15T19:31:19.917272] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-15T19:31:20.113987] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-02. [2025-10-15T19:31:20.440597] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-15T19:31:20.483890] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-02 (0.37 seconds). [2025-10-15T19:31:20.914028] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-04. [2025-10-15T19:31:21.714000] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-03. [2025-10-15T19:31:22.274711] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-10-15T19:31:22.422506] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-15T19:31:22.513970] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-04. [2025-10-15T19:31:23.084614] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-15T19:31:23.313991] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-02. [2025-10-15T19:31:24.114011] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-05. [2025-10-15T19:31:24.432941] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-15T19:31:24.914023] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-05. [2025-10-15T19:31:25.501438] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-15T19:31:25.713985] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-06. [2025-10-15T19:31:25.987083] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-15T19:31:26.513980] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-10. [2025-10-15T19:31:26.916708] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-10 (0.40 seconds). [2025-10-15T19:31:26.917378] [INFO ] [REMOTE ] HYBX: Full fetch complete (706 records). [2025-10-15T19:31:26.917447] [DEBUG] [VALIDATOR ] HYBX: Validating primary data. [2025-10-15T19:31:27.146210] [WARN ] [VALIDATOR ] HYBX: Validation failed - insufficient historical data. Have 178 unique days, need 200 days [2025-10-15T19:31:27.152342] [FATAL] [MAIN ] HYBX: Fetched primary data is invalid. Refusing to save it. [2025-10-15T19:31:27.163224] [WARN ] [MAIN ] HYBX: Deleting existing primary and derivative data due to validation failure. [2025-10-15T19:31:27.163871] [INFO ] [LOCAL ] HYBX: Starting deletion of primary data. [2025-10-15T19:31:27.164532] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-15T19:31:27.170777] [DEBUG] [LOCAL ] HYBX: No primary data file found to delete. [2025-10-15T19:31:27.171289] [INFO ] [LOCAL ] HYBX: Starting deletion of derivative data. [2025-10-15T19:31:27.171678] [DEBUG] [LOCAL ] HYBX: No derivative data file found to delete. [2025-10-15T19:31:27.171758] [INFO ] [MAIN ] Update Progress: 1075/2369 symbols completed. HYBX took 44.0s. Estimated remaining: 3h 2m 13s. Rate: 7.1 symbols/min [2025-10-15T19:31:27.319972] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-07. [2025-10-15T19:31:27.340898] [INFO ] [MAIN ] IAE: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:31:27.352308] [DEBUG] [LOCAL ] IAE: Loaded 6255 existing records from primary storage. [2025-10-15T19:31:27.352504] [INFO ] [MAIN ] IAE: Loaded 6255 existing records. [2025-10-15T19:31:27.526052] [WARN ] [MAIN ] IAE: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:31:27.526290] [INFO ] [MAIN ] IAE: Wiping existing primary data before full refresh. [2025-10-15T19:31:27.526343] [INFO ] [LOCAL ] IAE: Starting deletion of primary data. [2025-10-15T19:31:27.526503] [DEBUG] [LOCAL ] IAE: Deleted primary data file. [2025-10-15T19:31:27.526559] [INFO ] [MAIN ] IAE: Starting full primary refresh. [2025-10-15T19:31:27.886266] [INFO ] [REMOTE ] IAE: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:31:28.113964] [INFO ] [REMOTE ] IAE: Fetching primary data for 2024-12. [2025-10-15T19:31:28.767448] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-15T19:31:28.795979] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-10-15T19:31:28.914048] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-01. [2025-10-15T19:31:29.449738] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-10-15T19:31:29.713991] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-03. [2025-10-15T19:31:30.514007] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-06. [2025-10-15T19:31:31.038521] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-10-15T19:31:31.060766] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-15T19:31:31.313997] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-07. [2025-10-15T19:31:31.786456] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-10-15T19:31:32.113991] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-08. [2025-10-15T19:31:32.567764] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-15T19:31:32.913982] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-08. [2025-10-15T19:31:33.713991] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-09. [2025-10-15T19:31:34.319186] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-15T19:31:34.367889] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-15T19:31:34.513984] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-09. [2025-10-15T19:31:35.314049] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-10. [2025-10-15T19:31:35.677069] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-15T19:31:35.959857] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-15T19:31:35.960914] [INFO ] [REMOTE ] HYTR: Full fetch complete (4649 records). [2025-10-15T19:31:35.960982] [DEBUG] [VALIDATOR ] HYTR: Validating primary data. [2025-10-15T19:31:36.119197] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-02. [2025-10-15T19:31:36.355324] [DEBUG] [VALIDATOR ] HYTR: All expected trading days are present. [2025-10-15T19:31:36.355408] [DEBUG] [VALIDATOR ] HYTR: Primary data validation passed. [2025-10-15T19:31:36.355570] [INFO ] [MAIN ] HYTR: Fetched primary data is valid. [2025-10-15T19:31:36.355610] [DEBUG] [LOCAL ] HYTR: Saving primary data. [2025-10-15T19:31:36.356030] [DEBUG] [LOCAL ] HYTR: Trimmed 4649 records to 3132 (keeping 200 days of data) [2025-10-15T19:31:36.374945] [DEBUG] [LOCAL ] HYTR: Primary data saved (3132 records). [2025-10-15T19:31:36.375020] [INFO ] [MAIN ] HYTR: Full history saved. [2025-10-15T19:31:36.375098] [INFO ] [MAIN ] Update Progress: 1076/2369 symbols completed. HYTR took 23.1s. Estimated remaining: 3h 2m 5s. Rate: 7.1 symbols/min [2025-10-15T19:31:36.544352] [INFO ] [MAIN ] IAG: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:31:36.597953] [DEBUG] [LOCAL ] IAG: Loaded 53488 existing records from primary storage. [2025-10-15T19:31:36.598269] [INFO ] [MAIN ] IAG: Loaded 53488 existing records. [2025-10-15T19:31:36.778099] [WARN ] [MAIN ] IAG: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:31:36.778302] [INFO ] [MAIN ] IAG: Wiping existing primary data before full refresh. [2025-10-15T19:31:36.778349] [INFO ] [LOCAL ] IAG: Starting deletion of primary data. [2025-10-15T19:31:36.778548] [DEBUG] [LOCAL ] IAG: Deleted primary data file. [2025-10-15T19:31:36.778588] [INFO ] [MAIN ] IAG: Starting full primary refresh. [2025-10-15T19:31:36.863771] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-15T19:31:36.919123] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-10. [2025-10-15T19:31:37.164990] [INFO ] [REMOTE ] IAG: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:31:37.714001] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-03. [2025-10-15T19:31:38.384821] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-15T19:31:38.431300] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-15T19:31:38.435805] [INFO ] [REMOTE ] HYT: Full fetch complete (47888 records). [2025-10-15T19:31:38.435932] [DEBUG] [VALIDATOR ] HYT: Validating primary data. [2025-10-15T19:31:38.519060] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-04. [2025-10-15T19:31:38.819522] [DEBUG] [VALIDATOR ] HYT: All expected trading days are present. [2025-10-15T19:31:38.819611] [DEBUG] [VALIDATOR ] HYT: Primary data validation passed. [2025-10-15T19:31:38.820603] [INFO ] [MAIN ] HYT: Fetched primary data is valid. [2025-10-15T19:31:38.820699] [DEBUG] [LOCAL ] HYT: Saving primary data. [2025-10-15T19:31:38.821895] [DEBUG] [LOCAL ] HYT: Trimmed 47888 records to 33599 (keeping 200 days of data) [2025-10-15T19:31:39.028014] [DEBUG] [LOCAL ] HYT: Primary data saved (33599 records). [2025-10-15T19:31:39.028163] [INFO ] [MAIN ] HYT: Full history saved. [2025-10-15T19:31:39.028250] [INFO ] [MAIN ] Update Progress: 1077/2369 symbols completed. HYT took 41.5s. Estimated remaining: 3h 1m 50s. Rate: 7.1 symbols/min [2025-10-15T19:31:39.314049] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-04. [2025-10-15T19:31:39.924759] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-15T19:31:39.977284] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-15T19:31:40.113988] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-05. [2025-10-15T19:31:40.913968] [INFO ] [REMOTE ] IAG: Fetching primary data for 2024-12. [2025-10-15T19:31:41.316363] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-15T19:31:41.713981] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-06. [2025-10-15T19:31:42.438830] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-15T19:31:42.513960] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-05. [2025-10-15T19:31:42.946280] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-15T19:31:42.957629] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-10-15T19:31:43.314005] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-01. [2025-10-15T19:31:44.113997] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-06. [2025-10-15T19:31:44.713317] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-15T19:31:44.740969] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-15T19:31:44.914000] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-07. [2025-10-15T19:31:45.603994] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-15T19:31:45.713979] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-08. [2025-10-15T19:31:46.402888] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-15T19:31:46.514000] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-07. [2025-10-15T19:31:47.314016] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-09. [2025-10-15T19:31:47.800549] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-15T19:31:48.053575] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-15T19:31:48.113970] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-10. [2025-10-15T19:31:48.914059] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-02. [2025-10-15T19:31:48.969221] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-15T19:31:48.970990] [INFO ] [REMOTE ] IAE: Full fetch complete (9022 records). [2025-10-15T19:31:48.971062] [DEBUG] [VALIDATOR ] IAE: Validating primary data. [2025-10-15T19:31:49.371449] [DEBUG] [VALIDATOR ] IAE: All expected trading days are present. [2025-10-15T19:31:49.371540] [DEBUG] [VALIDATOR ] IAE: Primary data validation passed. [2025-10-15T19:31:49.371796] [INFO ] [MAIN ] IAE: Fetched primary data is valid. [2025-10-15T19:31:49.371856] [DEBUG] [LOCAL ] IAE: Saving primary data. [2025-10-15T19:31:49.372515] [DEBUG] [LOCAL ] IAE: Trimmed 9022 records to 6256 (keeping 200 days of data) [2025-10-15T19:31:49.408243] [DEBUG] [LOCAL ] IAE: Primary data saved (6256 records). [2025-10-15T19:31:49.408354] [INFO ] [MAIN ] IAE: Full history saved. [2025-10-15T19:31:49.408459] [INFO ] [MAIN ] Update Progress: 1078/2369 symbols completed. IAE took 22.2s. Estimated remaining: 3h 1m 44s. Rate: 7.1 symbols/min [2025-10-15T19:31:49.714058] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-08. [2025-10-15T19:31:50.638201] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-15T19:31:50.648974] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-03. [2025-10-15T19:31:50.889398] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-15T19:31:51.314061] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-09. [2025-10-15T19:31:52.210186] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-15T19:31:52.221637] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-04. [2025-10-15T19:31:52.238547] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-15T19:31:52.914048] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-10. [2025-10-15T19:31:54.176850] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-15T19:31:54.188091] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-05. [2025-10-15T19:31:54.369282] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-15T19:31:54.372941] [INFO ] [REMOTE ] HZO: Full fetch complete (41325 records). [2025-10-15T19:31:54.373046] [DEBUG] [VALIDATOR ] HZO: Validating primary data. [2025-10-15T19:31:54.762820] [DEBUG] [VALIDATOR ] HZO: All expected trading days are present. [2025-10-15T19:31:54.762897] [DEBUG] [VALIDATOR ] HZO: Primary data validation passed. [2025-10-15T19:31:54.763729] [INFO ] [MAIN ] HZO: Fetched primary data is valid. [2025-10-15T19:31:54.763791] [DEBUG] [LOCAL ] HZO: Saving primary data. [2025-10-15T19:31:54.764727] [DEBUG] [LOCAL ] HZO: Trimmed 41325 records to 29081 (keeping 200 days of data) [2025-10-15T19:31:54.939902] [DEBUG] [LOCAL ] HZO: Primary data saved (29081 records). [2025-10-15T19:31:54.940058] [INFO ] [MAIN ] HZO: Full history saved. [2025-10-15T19:31:54.940156] [INFO ] [MAIN ] Update Progress: 1079/2369 symbols completed. HZO took 41.2s. Estimated remaining: 3h 1m 32s. Rate: 7.1 symbols/min [2025-10-15T19:31:55.883540] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-15T19:31:55.895082] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-06. [2025-10-15T19:31:57.873731] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-10-15T19:31:57.884388] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-07. [2025-10-15T19:31:59.448245] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-15T19:31:59.459929] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-08. [2025-10-15T19:32:01.447024] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-10-15T19:32:01.464344] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-09. [2025-10-15T19:32:03.351599] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-15T19:32:03.363114] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-10. [2025-10-15T19:32:05.139904] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-15T19:32:05.146240] [INFO ] [REMOTE ] IAG: Full fetch complete (77476 records). [2025-10-15T19:32:05.146389] [DEBUG] [VALIDATOR ] IAG: Validating primary data. [2025-10-15T19:32:05.528968] [DEBUG] [VALIDATOR ] IAG: All expected trading days are present. [2025-10-15T19:32:05.529053] [DEBUG] [VALIDATOR ] IAG: Primary data validation passed. [2025-10-15T19:32:05.530089] [INFO ] [MAIN ] IAG: Fetched primary data is valid. [2025-10-15T19:32:05.530153] [DEBUG] [LOCAL ] IAG: Saving primary data. [2025-10-15T19:32:05.531792] [DEBUG] [LOCAL ] IAG: Trimmed 77476 records to 53488 (keeping 200 days of data) [2025-10-15T19:32:05.836662] [DEBUG] [LOCAL ] IAG: Primary data saved (53488 records). [2025-10-15T19:32:05.836855] [INFO ] [MAIN ] IAG: Full history saved. [2025-10-15T19:32:05.837013] [INFO ] [MAIN ] Update Progress: 1080/2369 symbols completed. IAG took 29.5s. Estimated remaining: 3h 1m 26s. Rate: 7.1 symbols/min [2025-10-15T19:32:06.407426] [INFO ] [MAIN ] IBM: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:32:06.409766] [INFO ] [MAIN ] IBTA: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:32:06.537833] [INFO ] [MAIN ] IBN: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:32:06.563883] [INFO ] [MAIN ] IBP: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:32:06.600137] [DEBUG] [LOCAL ] IBTA: Loaded 36746 existing records from primary storage. [2025-10-15T19:32:06.600522] [INFO ] [MAIN ] IBTA: Loaded 36746 existing records. [2025-10-15T19:32:06.713492] [DEBUG] [LOCAL ] IBM: Loaded 53632 existing records from primary storage. [2025-10-15T19:32:06.726384] [INFO ] [MAIN ] IBM: Loaded 53632 existing records. [2025-10-15T19:32:06.848068] [WARN ] [MAIN ] IBTA: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:32:06.858492] [DEBUG] [LOCAL ] IBP: Loaded 28892 existing records from primary storage. [2025-10-15T19:32:06.896960] [INFO ] [MAIN ] IBTA: Wiping existing primary data before full refresh. [2025-10-15T19:32:06.891728] [INFO ] [MAIN ] IBP: Loaded 28892 existing records. [2025-10-15T19:32:06.907449] [INFO ] [LOCAL ] IBTA: Starting deletion of primary data. [2025-10-15T19:32:06.956715] [DEBUG] [LOCAL ] IBTA: Deleted primary data file. [2025-10-15T19:32:07.007393] [INFO ] [MAIN ] IBTA: Starting full primary refresh. [2025-10-15T19:32:07.024041] [DEBUG] [LOCAL ] IBN: Loaded 52809 existing records from primary storage. [2025-10-15T19:32:07.060585] [INFO ] [MAIN ] IBN: Loaded 52809 existing records. [2025-10-15T19:32:07.273695] [WARN ] [MAIN ] IBM: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:32:07.312180] [INFO ] [MAIN ] IBM: Wiping existing primary data before full refresh. [2025-10-15T19:32:07.328772] [INFO ] [LOCAL ] IBM: Starting deletion of primary data. [2025-10-15T19:32:07.345109] [DEBUG] [LOCAL ] IBM: Deleted primary data file. [2025-10-15T19:32:07.365873] [INFO ] [MAIN ] IBM: Starting full primary refresh. [2025-10-15T19:32:07.538862] [WARN ] [MAIN ] IBN: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:32:07.582821] [WARN ] [MAIN ] IBP: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:32:07.579749] [INFO ] [MAIN ] IBN: Wiping existing primary data before full refresh. [2025-10-15T19:32:07.597594] [INFO ] [MAIN ] IBP: Wiping existing primary data before full refresh. [2025-10-15T19:32:07.603682] [INFO ] [LOCAL ] IBN: Starting deletion of primary data. [2025-10-15T19:32:07.602899] [INFO ] [LOCAL ] IBP: Starting deletion of primary data. [2025-10-15T19:32:07.645880] [DEBUG] [LOCAL ] IBN: Deleted primary data file. [2025-10-15T19:32:07.659683] [DEBUG] [LOCAL ] IBP: Deleted primary data file. [2025-10-15T19:32:07.707280] [INFO ] [MAIN ] IBN: Starting full primary refresh. [2025-10-15T19:32:07.702069] [INFO ] [MAIN ] IBP: Starting full primary refresh. [2025-10-15T19:32:08.175200] [INFO ] [REMOTE ] IBTA: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:32:08.211385] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2024-12. [2025-10-15T19:32:08.562842] [INFO ] [REMOTE ] IBM: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:32:08.589322] [INFO ] [REMOTE ] IBM: Fetching primary data for 2024-12. [2025-10-15T19:32:08.794511] [INFO ] [REMOTE ] IBN: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:32:08.814610] [INFO ] [REMOTE ] IBN: Fetching primary data for 2024-12. [2025-10-15T19:32:08.851997] [INFO ] [REMOTE ] IBP: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:32:08.852351] [INFO ] [REMOTE ] IBP: Fetching primary data for 2024-12. [2025-10-15T19:32:09.371770] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-15T19:32:09.379796] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-01. [2025-10-15T19:32:09.867563] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-15T19:32:09.877451] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-01. [2025-10-15T19:32:10.145222] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-15T19:32:10.157167] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-01. [2025-10-15T19:32:10.258053] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-15T19:32:10.264305] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-02. [2025-10-15T19:32:10.428474] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-15T19:32:10.440505] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-01. [2025-10-15T19:32:11.024759] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-15T19:32:11.030576] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-02. [2025-10-15T19:32:11.458185] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-15T19:32:11.463624] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-03. [2025-10-15T19:32:11.635993] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-15T19:32:11.651450] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-02. [2025-10-15T19:32:12.265594] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-15T19:32:12.271410] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-03. [2025-10-15T19:32:12.438420] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-10-15T19:32:12.450845] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-02. [2025-10-15T19:32:12.962570] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-15T19:32:12.973246] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-03. [2025-10-15T19:32:13.018808] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-15T19:32:13.029703] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-04. [2025-10-15T19:32:13.252752] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-15T19:32:13.259363] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-04. [2025-10-15T19:32:14.260975] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-15T19:32:14.270986] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-05. [2025-10-15T19:32:14.541584] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-02 (2.09 seconds). [2025-10-15T19:32:14.551730] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-03. [2025-10-15T19:32:14.613032] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-15T19:32:14.619734] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-05. [2025-10-15T19:32:14.934574] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-15T19:32:14.945430] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-04. [2025-10-15T19:32:15.452792] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-15T19:32:15.460155] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-06. [2025-10-15T19:32:15.843334] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-15T19:32:16.114149] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-06. [2025-10-15T19:32:16.462467] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-15T19:32:16.659705] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-15T19:32:16.849954] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-03 (2.30 seconds). [2025-10-15T19:32:16.914094] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-05. [2025-10-15T19:32:17.309697] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-15T19:32:17.714025] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-07. [2025-10-15T19:32:18.513992] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-04. [2025-10-15T19:32:18.720888] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-15T19:32:19.085399] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-15T19:32:19.314020] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-06. [2025-10-15T19:32:20.114036] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-08. [2025-10-15T19:32:20.562552] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-10-15T19:32:20.916528] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-07. [2025-10-15T19:32:20.922187] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-15T19:32:21.301785] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-15T19:32:21.714003] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-05. [2025-10-15T19:32:22.167177] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-15T19:32:22.514007] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-07. [2025-10-15T19:32:23.313993] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-08. [2025-10-15T19:32:23.907833] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-05 (2.19 seconds). [2025-10-15T19:32:24.113991] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-06. [2025-10-15T19:32:24.393839] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-15T19:32:24.906093] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-15T19:32:24.914668] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-09. [2025-10-15T19:32:25.713960] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-08. [2025-10-15T19:32:26.194610] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-15T19:32:26.233325] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-06 (2.12 seconds). [2025-10-15T19:32:26.514002] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-10. [2025-10-15T19:32:27.192282] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-15T19:32:27.313968] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-09. [2025-10-15T19:32:27.626962] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-15T19:32:27.630558] [INFO ] [REMOTE ] IBP: Full fetch complete (41135 records). [2025-10-15T19:32:27.630636] [DEBUG] [VALIDATOR ] IBP: Validating primary data. [2025-10-15T19:32:28.002919] [DEBUG] [VALIDATOR ] IBP: All expected trading days are present. [2025-10-15T19:32:28.003049] [DEBUG] [VALIDATOR ] IBP: Primary data validation passed. [2025-10-15T19:32:28.003868] [INFO ] [MAIN ] IBP: Fetched primary data is valid. [2025-10-15T19:32:28.003932] [DEBUG] [LOCAL ] IBP: Saving primary data. [2025-10-15T19:32:28.005055] [DEBUG] [LOCAL ] IBP: Trimmed 41135 records to 28891 (keeping 200 days of data) [2025-10-15T19:32:28.114039] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-07. [2025-10-15T19:32:28.189582] [DEBUG] [LOCAL ] IBP: Primary data saved (28891 records). [2025-10-15T19:32:28.189734] [INFO ] [MAIN ] IBP: Full history saved. [2025-10-15T19:32:28.189819] [INFO ] [MAIN ] Update Progress: 1081/2369 symbols completed. IBP took 22.3s. Estimated remaining: 3h 1m 35s. Rate: 7.1 symbols/min [2025-10-15T19:32:28.353007] [INFO ] [MAIN ] ICE: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:32:28.408225] [DEBUG] [LOCAL ] ICE: Loaded 53017 existing records from primary storage. [2025-10-15T19:32:28.408517] [INFO ] [MAIN ] ICE: Loaded 53017 existing records. [2025-10-15T19:32:28.582808] [WARN ] [MAIN ] ICE: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:32:28.583790] [INFO ] [MAIN ] ICE: Wiping existing primary data before full refresh. [2025-10-15T19:32:28.583924] [INFO ] [LOCAL ] ICE: Starting deletion of primary data. [2025-10-15T19:32:28.584382] [DEBUG] [LOCAL ] ICE: Deleted primary data file. [2025-10-15T19:32:28.584457] [INFO ] [MAIN ] ICE: Starting full primary refresh. [2025-10-15T19:32:28.916279] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-09. [2025-10-15T19:32:28.947499] [INFO ] [REMOTE ] ICE: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:32:28.977731] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-15T19:32:29.713989] [INFO ] [REMOTE ] ICE: Fetching primary data for 2024-12. [2025-10-15T19:32:30.370695] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-15T19:32:30.514830] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-10. [2025-10-15T19:32:30.517563] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-07 (2.40 seconds). [2025-10-15T19:32:31.313967] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-10. [2025-10-15T19:32:31.381039] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-15T19:32:32.113964] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-01. [2025-10-15T19:32:32.281288] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-15T19:32:32.287780] [INFO ] [REMOTE ] IBN: Full fetch complete (76531 records). [2025-10-15T19:32:32.287904] [DEBUG] [VALIDATOR ] IBN: Validating primary data. [2025-10-15T19:32:32.710241] [DEBUG] [VALIDATOR ] IBN: All expected trading days are present. [2025-10-15T19:32:32.710339] [DEBUG] [VALIDATOR ] IBN: Primary data validation passed. [2025-10-15T19:32:32.711447] [INFO ] [MAIN ] IBN: Fetched primary data is valid. [2025-10-15T19:32:32.711511] [DEBUG] [LOCAL ] IBN: Saving primary data. [2025-10-15T19:32:32.712911] [DEBUG] [LOCAL ] IBN: Trimmed 76531 records to 52819 (keeping 200 days of data) [2025-10-15T19:32:32.930031] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-08. [2025-10-15T19:32:32.945379] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-15T19:32:32.951566] [INFO ] [REMOTE ] IBTA: Full fetch complete (51132 records). [2025-10-15T19:32:32.952912] [DEBUG] [VALIDATOR ] IBTA: Validating primary data. [2025-10-15T19:32:33.376412] [DEBUG] [VALIDATOR ] IBTA: All expected trading days are present. [2025-10-15T19:32:33.376852] [DEBUG] [VALIDATOR ] IBTA: Primary data validation passed. [2025-10-15T19:32:33.378605] [INFO ] [MAIN ] IBTA: Fetched primary data is valid. [2025-10-15T19:32:33.379252] [DEBUG] [LOCAL ] IBTA: Saving primary data. [2025-10-15T19:32:33.385100] [DEBUG] [LOCAL ] IBTA: Trimmed 51132 records to 36655 (keeping 200 days of data) [2025-10-15T19:32:33.581918] [DEBUG] [LOCAL ] IBN: Primary data saved (52819 records). [2025-10-15T19:32:33.584497] [INFO ] [MAIN ] IBN: Full history saved. [2025-10-15T19:32:33.585316] [INFO ] [MAIN ] Update Progress: 1082/2369 symbols completed. IBN took 27.7s. Estimated remaining: 3h 1m 22s. Rate: 7.1 symbols/min [2025-10-15T19:32:33.840444] [INFO ] [MAIN ] ICL: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:32:33.896838] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-15T19:32:33.909871] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-02. [2025-10-15T19:32:33.930024] [DEBUG] [LOCAL ] ICL: Loaded 38549 existing records from primary storage. [2025-10-15T19:32:33.933117] [INFO ] [MAIN ] ICL: Loaded 38549 existing records. [2025-10-15T19:32:33.932951] [DEBUG] [LOCAL ] IBTA: Primary data saved (36655 records). [2025-10-15T19:32:33.977100] [INFO ] [MAIN ] IBTA: Full history saved. [2025-10-15T19:32:33.998212] [INFO ] [MAIN ] Update Progress: 1083/2369 symbols completed. IBTA took 28.2s. Estimated remaining: 3h 1m 4s. Rate: 7.1 symbols/min [2025-10-15T19:32:34.272263] [WARN ] [MAIN ] ICL: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:32:34.290209] [INFO ] [MAIN ] IDA: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:32:34.290282] [INFO ] [MAIN ] ICL: Wiping existing primary data before full refresh. [2025-10-15T19:32:34.290683] [INFO ] [LOCAL ] ICL: Starting deletion of primary data. [2025-10-15T19:32:34.290865] [DEBUG] [LOCAL ] ICL: Deleted primary data file. [2025-10-15T19:32:34.290905] [INFO ] [MAIN ] ICL: Starting full primary refresh. [2025-10-15T19:32:34.602308] [DEBUG] [LOCAL ] IDA: Loaded 32789 existing records from primary storage. [2025-10-15T19:32:34.613321] [INFO ] [MAIN ] IDA: Loaded 32789 existing records. [2025-10-15T19:32:34.785880] [INFO ] [REMOTE ] ICL: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:32:34.786233] [INFO ] [REMOTE ] ICL: Fetching primary data for 2024-12. [2025-10-15T19:32:34.867477] [WARN ] [MAIN ] IDA: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:32:34.867743] [INFO ] [MAIN ] IDA: Wiping existing primary data before full refresh. [2025-10-15T19:32:34.867828] [INFO ] [LOCAL ] IDA: Starting deletion of primary data. [2025-10-15T19:32:34.868071] [DEBUG] [LOCAL ] IDA: Deleted primary data file. [2025-10-15T19:32:34.868127] [INFO ] [MAIN ] IDA: Starting full primary refresh. [2025-10-15T19:32:35.221932] [INFO ] [REMOTE ] IDA: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:32:35.314080] [INFO ] [REMOTE ] IDA: Fetching primary data for 2024-12. [2025-10-15T19:32:35.717206] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-15T19:32:35.764508] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-08 (2.83 seconds). [2025-10-15T19:32:35.919149] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-15T19:32:36.113969] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-09. [2025-10-15T19:32:36.469244] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-15T19:32:36.914056] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-01. [2025-10-15T19:32:37.713994] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-03. [2025-10-15T19:32:38.245818] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-15T19:32:38.513981] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-01. [2025-10-15T19:32:38.569489] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-09 (2.46 seconds). [2025-10-15T19:32:39.314071] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-10. [2025-10-15T19:32:39.659675] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-15T19:32:39.901629] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-15T19:32:40.115094] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-02. [2025-10-15T19:32:40.117435] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-15T19:32:40.125104] [INFO ] [REMOTE ] IBM: Full fetch complete (77739 records). [2025-10-15T19:32:40.125286] [DEBUG] [VALIDATOR ] IBM: Validating primary data. [2025-10-15T19:32:40.510957] [DEBUG] [VALIDATOR ] IBM: All expected trading days are present. [2025-10-15T19:32:40.511034] [DEBUG] [VALIDATOR ] IBM: Primary data validation passed. [2025-10-15T19:32:40.512053] [INFO ] [MAIN ] IBM: Fetched primary data is valid. [2025-10-15T19:32:40.512117] [DEBUG] [LOCAL ] IBM: Saving primary data. [2025-10-15T19:32:40.513540] [DEBUG] [LOCAL ] IBM: Trimmed 77739 records to 53633 (keeping 200 days of data) [2025-10-15T19:32:40.849913] [DEBUG] [LOCAL ] IBM: Primary data saved (53633 records). [2025-10-15T19:32:40.850072] [INFO ] [MAIN ] IBM: Full history saved. [2025-10-15T19:32:40.850166] [INFO ] [MAIN ] Update Progress: 1084/2369 symbols completed. IBM took 35.0s. Estimated remaining: 3h 0m 54s. Rate: 7.1 symbols/min [2025-10-15T19:32:40.923915] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-02. [2025-10-15T19:32:41.021568] [INFO ] [MAIN ] IDE: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:32:41.033965] [DEBUG] [LOCAL ] IDE: Loaded 9113 existing records from primary storage. [2025-10-15T19:32:41.034312] [INFO ] [MAIN ] IDE: Loaded 9113 existing records. [2025-10-15T19:32:41.230352] [WARN ] [MAIN ] IDE: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:32:41.230681] [INFO ] [MAIN ] IDE: Wiping existing primary data before full refresh. [2025-10-15T19:32:41.230794] [INFO ] [LOCAL ] IDE: Starting deletion of primary data. [2025-10-15T19:32:41.230977] [DEBUG] [LOCAL ] IDE: Deleted primary data file. [2025-10-15T19:32:41.231034] [INFO ] [MAIN ] IDE: Starting full primary refresh. [2025-10-15T19:32:41.498218] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-15T19:32:41.625876] [INFO ] [REMOTE ] IDE: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:32:41.714018] [INFO ] [REMOTE ] IDE: Fetching primary data for 2024-12. [2025-10-15T19:32:42.331215] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-15T19:32:42.346198] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-10-15T19:32:42.513980] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-01. [2025-10-15T19:32:43.313991] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-03. [2025-10-15T19:32:43.330372] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-15T19:32:44.113982] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-03. [2025-10-15T19:32:44.333108] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-15T19:32:44.914053] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-04. [2025-10-15T19:32:45.683722] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-15T19:32:45.713950] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-04. [2025-10-15T19:32:46.291871] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-15T19:32:46.513989] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-05. [2025-10-15T19:32:47.322684] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-02. [2025-10-15T19:32:47.328132] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-15T19:32:47.930582] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-15T19:32:47.928995] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-15T19:32:48.113985] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-05. [2025-10-15T19:32:48.914060] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-04. [2025-10-15T19:32:49.674528] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-15T19:32:49.713949] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-06. [2025-10-15T19:32:50.514023] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-06. [2025-10-15T19:32:50.733542] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-15T19:32:51.246045] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-15T19:32:51.313954] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-07. [2025-10-15T19:32:51.927304] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-15T19:32:52.113980] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-05. [2025-10-15T19:32:52.458867] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-15T19:32:52.914013] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-08. [2025-10-15T19:32:53.714039] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-03. [2025-10-15T19:32:54.158629] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-10-15T19:32:54.303267] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-15T19:32:54.406219] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-15T19:32:54.514053] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-09. [2025-10-15T19:32:55.314075] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-04. [2025-10-15T19:32:55.729153] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-15T19:32:56.032419] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-15T19:32:56.114008] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-07. [2025-10-15T19:32:56.913988] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-10. [2025-10-15T19:32:57.609054] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-15T19:32:57.713953] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-08. [2025-10-15T19:32:58.149964] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-15T19:32:58.154579] [INFO ] [REMOTE ] ICL: Full fetch complete (56159 records). [2025-10-15T19:32:58.154685] [DEBUG] [VALIDATOR ] ICL: Validating primary data. [2025-10-15T19:32:58.517803] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-05. [2025-10-15T19:32:58.532091] [DEBUG] [VALIDATOR ] ICL: All expected trading days are present. [2025-10-15T19:32:58.532157] [DEBUG] [VALIDATOR ] ICL: Primary data validation passed. [2025-10-15T19:32:58.533015] [INFO ] [MAIN ] ICL: Fetched primary data is valid. [2025-10-15T19:32:58.533086] [DEBUG] [LOCAL ] ICL: Saving primary data. [2025-10-15T19:32:58.535177] [DEBUG] [LOCAL ] ICL: Trimmed 56159 records to 38552 (keeping 200 days of data) [2025-10-15T19:32:58.752123] [DEBUG] [LOCAL ] ICL: Primary data saved (38552 records). [2025-10-15T19:32:58.752347] [INFO ] [MAIN ] ICL: Full history saved. [2025-10-15T19:32:58.752708] [INFO ] [MAIN ] Update Progress: 1085/2369 symbols completed. ICL took 25.2s. Estimated remaining: 3h 0m 57s. Rate: 7.1 symbols/min [2025-10-15T19:32:58.921608] [INFO ] [MAIN ] IDT: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:32:58.944076] [DEBUG] [LOCAL ] IDT: Loaded 18405 existing records from primary storage. [2025-10-15T19:32:58.944345] [INFO ] [MAIN ] IDT: Loaded 18405 existing records. [2025-10-15T19:32:59.103321] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-15T19:32:59.153370] [WARN ] [MAIN ] IDT: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:32:59.153847] [INFO ] [MAIN ] IDT: Wiping existing primary data before full refresh. [2025-10-15T19:32:59.153898] [INFO ] [LOCAL ] IDT: Starting deletion of primary data. [2025-10-15T19:32:59.154063] [DEBUG] [LOCAL ] IDT: Deleted primary data file. [2025-10-15T19:32:59.154119] [INFO ] [MAIN ] IDT: Starting full primary refresh. [2025-10-15T19:32:59.325476] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-09. [2025-10-15T19:32:59.455412] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-15T19:32:59.525564] [INFO ] [REMOTE ] IDT: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:33:00.113978] [INFO ] [REMOTE ] IDT: Fetching primary data for 2024-12. [2025-10-15T19:33:00.573373] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-15T19:33:00.914007] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-06. [2025-10-15T19:33:01.496545] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-15T19:33:01.714084] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-10. [2025-10-15T19:33:02.514047] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-01. [2025-10-15T19:33:03.151589] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-15T19:33:03.155832] [INFO ] [REMOTE ] IDA: Full fetch complete (45276 records). [2025-10-15T19:33:03.155933] [DEBUG] [VALIDATOR ] IDA: Validating primary data. [2025-10-15T19:33:03.319771] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-06. [2025-10-15T19:33:03.463770] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-15T19:33:03.586943] [DEBUG] [VALIDATOR ] IDA: All expected trading days are present. [2025-10-15T19:33:03.587043] [DEBUG] [VALIDATOR ] IDA: Primary data validation passed. [2025-10-15T19:33:03.587926] [INFO ] [MAIN ] IDA: Fetched primary data is valid. [2025-10-15T19:33:03.588009] [DEBUG] [LOCAL ] IDA: Saving primary data. [2025-10-15T19:33:03.589420] [DEBUG] [LOCAL ] IDA: Trimmed 45276 records to 32824 (keeping 200 days of data) [2025-10-15T19:33:03.710281] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-06 (2.80 seconds). [2025-10-15T19:33:03.848369] [DEBUG] [LOCAL ] IDA: Primary data saved (32824 records). [2025-10-15T19:33:03.848536] [INFO ] [MAIN ] IDA: Full history saved. [2025-10-15T19:33:03.848631] [INFO ] [MAIN ] Update Progress: 1086/2369 symbols completed. IDA took 29.8s. Estimated remaining: 3h 0m 44s. Rate: 7.1 symbols/min [2025-10-15T19:33:03.976444] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-15T19:33:04.055528] [INFO ] [MAIN ] IEX: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:33:04.094672] [DEBUG] [LOCAL ] IEX: Loaded 38366 existing records from primary storage. [2025-10-15T19:33:04.094980] [INFO ] [MAIN ] IEX: Loaded 38366 existing records. [2025-10-15T19:33:04.119183] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-07. [2025-10-15T19:33:04.286970] [WARN ] [MAIN ] IEX: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:33:04.287303] [INFO ] [MAIN ] IEX: Wiping existing primary data before full refresh. [2025-10-15T19:33:04.287361] [INFO ] [LOCAL ] IEX: Starting deletion of primary data. [2025-10-15T19:33:04.287861] [DEBUG] [LOCAL ] IEX: Deleted primary data file. [2025-10-15T19:33:04.287918] [INFO ] [MAIN ] IEX: Starting full primary refresh. [2025-10-15T19:33:04.627219] [INFO ] [REMOTE ] IEX: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:33:04.914008] [INFO ] [REMOTE ] IEX: Fetching primary data for 2024-12. [2025-10-15T19:33:05.714005] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-07. [2025-10-15T19:33:05.943701] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-15T19:33:06.160159] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-10-15T19:33:06.312124] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-15T19:33:06.514049] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-08. [2025-10-15T19:33:07.314017] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-08. [2025-10-15T19:33:08.077238] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-15T19:33:08.113966] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-02. [2025-10-15T19:33:08.346367] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-15T19:33:08.913975] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-09. [2025-10-15T19:33:08.921363] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-15T19:33:09.684410] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-15T19:33:09.713975] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-10. [2025-10-15T19:33:10.345492] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-15T19:33:10.347422] [INFO ] [REMOTE ] IDE: Full fetch complete (12720 records). [2025-10-15T19:33:10.347502] [DEBUG] [VALIDATOR ] IDE: Validating primary data. [2025-10-15T19:33:10.524582] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-03. [2025-10-15T19:33:10.701769] [DEBUG] [VALIDATOR ] IDE: All expected trading days are present. [2025-10-15T19:33:10.701843] [DEBUG] [VALIDATOR ] IDE: Primary data validation passed. [2025-10-15T19:33:10.702134] [INFO ] [MAIN ] IDE: Fetched primary data is valid. [2025-10-15T19:33:10.702171] [DEBUG] [LOCAL ] IDE: Saving primary data. [2025-10-15T19:33:10.702600] [DEBUG] [LOCAL ] IDE: Trimmed 12720 records to 9108 (keeping 200 days of data) [2025-10-15T19:33:10.757108] [DEBUG] [LOCAL ] IDE: Primary data saved (9108 records). [2025-10-15T19:33:10.757237] [INFO ] [MAIN ] IDE: Full history saved. [2025-10-15T19:33:10.757316] [INFO ] [MAIN ] Update Progress: 1087/2369 symbols completed. IDE took 29.9s. Estimated remaining: 3h 0m 34s. Rate: 7.1 symbols/min [2025-10-15T19:33:10.921591] [INFO ] [MAIN ] IFF: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:33:10.970847] [DEBUG] [LOCAL ] IFF: Loaded 51103 existing records from primary storage. [2025-10-15T19:33:10.971170] [INFO ] [MAIN ] IFF: Loaded 51103 existing records. [2025-10-15T19:33:11.145943] [WARN ] [MAIN ] IFF: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:33:11.146151] [INFO ] [MAIN ] IFF: Wiping existing primary data before full refresh. [2025-10-15T19:33:11.146197] [INFO ] [LOCAL ] IFF: Starting deletion of primary data. [2025-10-15T19:33:11.146733] [DEBUG] [LOCAL ] IFF: Deleted primary data file. [2025-10-15T19:33:11.146790] [INFO ] [MAIN ] IFF: Starting full primary refresh. [2025-10-15T19:33:11.319180] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-09. [2025-10-15T19:33:11.500976] [INFO ] [REMOTE ] IFF: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:33:11.742840] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-15T19:33:12.114033] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-01. [2025-10-15T19:33:12.914067] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-04. [2025-10-15T19:33:13.212144] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-15T19:33:13.483259] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-15T19:33:13.578757] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-15T19:33:13.714028] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-02. [2025-10-15T19:33:14.514003] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-10. [2025-10-15T19:33:15.093860] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-15T19:33:15.314002] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-03. [2025-10-15T19:33:16.113998] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-05. [2025-10-15T19:33:16.613482] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-10 (2.10 seconds). [2025-10-15T19:33:16.622910] [INFO ] [REMOTE ] ICE: Full fetch complete (76958 records). [2025-10-15T19:33:16.623088] [DEBUG] [VALIDATOR ] ICE: Validating primary data. [2025-10-15T19:33:16.927340] [INFO ] [REMOTE ] IFF: Fetching primary data for 2024-12. [2025-10-15T19:33:17.035863] [DEBUG] [VALIDATOR ] ICE: All expected trading days are present. [2025-10-15T19:33:17.036089] [DEBUG] [VALIDATOR ] ICE: Primary data validation passed. [2025-10-15T19:33:17.037315] [INFO ] [MAIN ] ICE: Fetched primary data is valid. [2025-10-15T19:33:17.037545] [DEBUG] [LOCAL ] ICE: Saving primary data. [2025-10-15T19:33:17.053755] [DEBUG] [LOCAL ] ICE: Trimmed 76958 records to 53018 (keeping 200 days of data) [2025-10-15T19:33:17.061198] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-15T19:33:17.176793] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-15T19:33:17.416353] [DEBUG] [LOCAL ] ICE: Primary data saved (53018 records). [2025-10-15T19:33:17.416499] [INFO ] [MAIN ] ICE: Full history saved. [2025-10-15T19:33:17.417571] [INFO ] [MAIN ] Update Progress: 1088/2369 symbols completed. ICE took 49.2s. Estimated remaining: 3h 0m 24s. Rate: 7.1 symbols/min [2025-10-15T19:33:17.586432] [INFO ] [MAIN ] IFN: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:33:17.607931] [DEBUG] [LOCAL ] IFN: Loaded 18475 existing records from primary storage. [2025-10-15T19:33:17.608191] [INFO ] [MAIN ] IFN: Loaded 18475 existing records. [2025-10-15T19:33:17.719079] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-06. [2025-10-15T19:33:17.796518] [WARN ] [MAIN ] IFN: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:33:17.796747] [INFO ] [MAIN ] IFN: Wiping existing primary data before full refresh. [2025-10-15T19:33:17.796799] [INFO ] [LOCAL ] IFN: Starting deletion of primary data. [2025-10-15T19:33:17.797009] [DEBUG] [LOCAL ] IFN: Deleted primary data file. [2025-10-15T19:33:17.797048] [INFO ] [MAIN ] IFN: Starting full primary refresh. [2025-10-15T19:33:18.149502] [INFO ] [REMOTE ] IFN: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:33:18.514044] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-04. [2025-10-15T19:33:18.661926] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-15T19:33:18.976788] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-15T19:33:19.313998] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-07. [2025-10-15T19:33:19.817504] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-15T19:33:20.114057] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-01. [2025-10-15T19:33:20.322105] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-15T19:33:20.914012] [INFO ] [REMOTE ] IFN: Fetching primary data for 2024-12. [2025-10-15T19:33:21.725397] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-05. [2025-10-15T19:33:21.734749] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-15T19:33:22.072569] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-15T19:33:22.514007] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-01. [2025-10-15T19:33:22.845349] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-15T19:33:23.313999] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-06. [2025-10-15T19:33:23.685201] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-15T19:33:24.114014] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-02. [2025-10-15T19:33:24.719921] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-15T19:33:24.913991] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-08. [2025-10-15T19:33:25.713998] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-07. [2025-10-15T19:33:25.788593] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-15T19:33:25.858547] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-15T19:33:26.514024] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-02. [2025-10-15T19:33:26.919678] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-15T19:33:27.313977] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-09. [2025-10-15T19:33:27.605783] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-15T19:33:28.092055] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-15T19:33:28.113967] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-10. [2025-10-15T19:33:28.913998] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-03. [2025-10-15T19:33:29.262129] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-15T19:33:29.265464] [INFO ] [REMOTE ] IDT: Full fetch complete (23728 records). [2025-10-15T19:33:29.265554] [DEBUG] [VALIDATOR ] IDT: Validating primary data. [2025-10-15T19:33:29.621666] [DEBUG] [VALIDATOR ] IDT: All expected trading days are present. [2025-10-15T19:33:29.621759] [DEBUG] [VALIDATOR ] IDT: Primary data validation passed. [2025-10-15T19:33:29.622251] [INFO ] [MAIN ] IDT: Fetched primary data is valid. [2025-10-15T19:33:29.622290] [DEBUG] [LOCAL ] IDT: Saving primary data. [2025-10-15T19:33:29.623038] [DEBUG] [LOCAL ] IDT: Trimmed 23728 records to 18488 (keeping 200 days of data) [2025-10-15T19:33:29.714937] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-08. [2025-10-15T19:33:29.738365] [DEBUG] [LOCAL ] IDT: Primary data saved (18488 records). [2025-10-15T19:33:29.738517] [INFO ] [MAIN ] IDT: Full history saved. [2025-10-15T19:33:29.738611] [INFO ] [MAIN ] Update Progress: 1089/2369 symbols completed. IDT took 31.0s. Estimated remaining: 3h 0m 20s. Rate: 7.1 symbols/min [2025-10-15T19:33:29.909661] [INFO ] [MAIN ] IFS: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:33:29.931296] [DEBUG] [LOCAL ] IFS: Loaded 22683 existing records from primary storage. [2025-10-15T19:33:29.931553] [INFO ] [MAIN ] IFS: Loaded 22683 existing records. [2025-10-15T19:33:30.104226] [WARN ] [MAIN ] IFS: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:33:30.104448] [INFO ] [MAIN ] IFS: Wiping existing primary data before full refresh. [2025-10-15T19:33:30.104502] [INFO ] [LOCAL ] IFS: Starting deletion of primary data. [2025-10-15T19:33:30.104916] [DEBUG] [LOCAL ] IFS: Deleted primary data file. [2025-10-15T19:33:30.104976] [INFO ] [MAIN ] IFS: Starting full primary refresh. [2025-10-15T19:33:30.479530] [INFO ] [REMOTE ] IFS: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:33:30.519846] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-03. [2025-10-15T19:33:30.532489] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-15T19:33:31.216337] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-15T19:33:31.263596] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-15T19:33:31.313957] [INFO ] [REMOTE ] IFS: Fetching primary data for 2024-12. [2025-10-15T19:33:32.113972] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-04. [2025-10-15T19:33:32.265307] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-10-15T19:33:32.914012] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-09. [2025-10-15T19:33:32.997912] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-15T19:33:33.714065] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-05. [2025-10-15T19:33:34.473123] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-15T19:33:34.519107] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-10. [2025-10-15T19:33:34.529063] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-15T19:33:35.314010] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-04. [2025-10-15T19:33:36.113969] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-06. [2025-10-15T19:33:36.175815] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-15T19:33:36.180194] [INFO ] [REMOTE ] IEX: Full fetch complete (53582 records). [2025-10-15T19:33:36.180293] [DEBUG] [VALIDATOR ] IEX: Validating primary data. [2025-10-15T19:33:36.563425] [DEBUG] [VALIDATOR ] IEX: All expected trading days are present. [2025-10-15T19:33:36.563498] [DEBUG] [VALIDATOR ] IEX: Primary data validation passed. [2025-10-15T19:33:36.564361] [INFO ] [MAIN ] IEX: Fetched primary data is valid. [2025-10-15T19:33:36.564421] [DEBUG] [LOCAL ] IEX: Saving primary data. [2025-10-15T19:33:36.565416] [DEBUG] [LOCAL ] IEX: Trimmed 53582 records to 38458 (keeping 200 days of data) [2025-10-15T19:33:36.808638] [DEBUG] [LOCAL ] IEX: Primary data saved (38458 records). [2025-10-15T19:33:36.808811] [INFO ] [MAIN ] IEX: Full history saved. [2025-10-15T19:33:36.808898] [INFO ] [MAIN ] Update Progress: 1090/2369 symbols completed. IEX took 33.0s. Estimated remaining: 3h 0m 10s. Rate: 7.1 symbols/min [2025-10-15T19:33:36.920172] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-01. [2025-10-15T19:33:36.983716] [INFO ] [MAIN ] IGA: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:33:36.995217] [DEBUG] [LOCAL ] IGA: Loaded 10185 existing records from primary storage. [2025-10-15T19:33:36.995488] [INFO ] [MAIN ] IGA: Loaded 10185 existing records. [2025-10-15T19:33:37.070709] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-15T19:33:37.228374] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-15T19:33:37.234678] [WARN ] [MAIN ] IGA: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:33:37.245718] [INFO ] [MAIN ] IGA: Wiping existing primary data before full refresh. [2025-10-15T19:33:37.246115] [INFO ] [LOCAL ] IGA: Starting deletion of primary data. [2025-10-15T19:33:37.246325] [DEBUG] [LOCAL ] IGA: Deleted primary data file. [2025-10-15T19:33:37.246383] [INFO ] [MAIN ] IGA: Starting full primary refresh. [2025-10-15T19:33:37.628068] [INFO ] [REMOTE ] IGA: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:33:37.638535] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-15T19:33:37.713968] [INFO ] [REMOTE ] IGA: Fetching primary data for 2024-12. [2025-10-15T19:33:38.343954] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-10-15T19:33:38.513989] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-01. [2025-10-15T19:33:39.286052] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-15T19:33:39.313959] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-02. [2025-10-15T19:33:40.021897] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-15T19:33:40.113998] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-05. [2025-10-15T19:33:40.914013] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-07. [2025-10-15T19:33:41.714002] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-02. [2025-10-15T19:33:41.869870] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-15T19:33:41.951545] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-15T19:33:42.513964] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-06. [2025-10-15T19:33:42.792057] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-15T19:33:43.314055] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-08. [2025-10-15T19:33:44.113960] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-03. [2025-10-15T19:33:44.156114] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-15T19:33:44.361783] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-15T19:33:44.913969] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-09. [2025-10-15T19:33:45.194638] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-15T19:33:45.713982] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-03. [2025-10-15T19:33:46.113891] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-15T19:33:46.514085] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-10. [2025-10-15T19:33:47.003990] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-15T19:33:47.247427] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-15T19:33:47.250112] [INFO ] [REMOTE ] IFN: Full fetch complete (28625 records). [2025-10-15T19:33:47.250210] [DEBUG] [VALIDATOR ] IFN: Validating primary data. [2025-10-15T19:33:47.319173] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-07. [2025-10-15T19:33:47.620720] [DEBUG] [VALIDATOR ] IFN: All expected trading days are present. [2025-10-15T19:33:47.620833] [DEBUG] [VALIDATOR ] IFN: Primary data validation passed. [2025-10-15T19:33:47.621440] [INFO ] [MAIN ] IFN: Fetched primary data is valid. [2025-10-15T19:33:47.621484] [DEBUG] [LOCAL ] IFN: Saving primary data. [2025-10-15T19:33:47.622245] [DEBUG] [LOCAL ] IFN: Trimmed 28625 records to 18517 (keeping 200 days of data) [2025-10-15T19:33:47.736243] [DEBUG] [LOCAL ] IFN: Primary data saved (18517 records). [2025-10-15T19:33:47.736375] [INFO ] [MAIN ] IFN: Full history saved. [2025-10-15T19:33:47.736453] [INFO ] [MAIN ] Update Progress: 1091/2369 symbols completed. IFN took 30.3s. Estimated remaining: 3h 0m 4s. Rate: 7.1 symbols/min [2025-10-15T19:33:47.899449] [INFO ] [MAIN ] IGD: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:33:47.918513] [DEBUG] [LOCAL ] IGD: Loaded 19411 existing records from primary storage. [2025-10-15T19:33:47.918772] [INFO ] [MAIN ] IGD: Loaded 19411 existing records. [2025-10-15T19:33:48.089792] [WARN ] [MAIN ] IGD: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:33:48.090024] [INFO ] [MAIN ] IGD: Wiping existing primary data before full refresh. [2025-10-15T19:33:48.090072] [INFO ] [LOCAL ] IGD: Starting deletion of primary data. [2025-10-15T19:33:48.090313] [DEBUG] [LOCAL ] IGD: Deleted primary data file. [2025-10-15T19:33:48.090392] [INFO ] [MAIN ] IGD: Starting full primary refresh. [2025-10-15T19:33:48.120928] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-04. [2025-10-15T19:33:48.440781] [INFO ] [REMOTE ] IGD: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:33:48.914058] [INFO ] [REMOTE ] IGD: Fetching primary data for 2024-12. [2025-10-15T19:33:49.112555] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-15T19:33:49.446792] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-07 (2.13 seconds). [2025-10-15T19:33:49.714038] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-04. [2025-10-15T19:33:50.166534] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-15T19:33:50.513967] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-08. [2025-10-15T19:33:50.849040] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-15T19:33:51.313990] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-05. [2025-10-15T19:33:52.027622] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-15T19:33:52.123223] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-01. [2025-10-15T19:33:52.143376] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-15T19:33:52.913997] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-09. [2025-10-15T19:33:53.420436] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-15T19:33:53.714064] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-06. [2025-10-15T19:33:54.205999] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-10-15T19:33:54.405246] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-15T19:33:54.514034] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-02. [2025-10-15T19:33:55.313984] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-10. [2025-10-15T19:33:55.404792] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-15T19:33:56.113992] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-03. [2025-10-15T19:33:56.914029] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-07. [2025-10-15T19:33:57.022453] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-15T19:33:57.028590] [INFO ] [REMOTE ] IFF: Full fetch complete (73512 records). [2025-10-15T19:33:57.028731] [DEBUG] [VALIDATOR ] IFF: Validating primary data. [2025-10-15T19:33:57.185998] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-15T19:33:57.447304] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-10-15T19:33:57.447513] [DEBUG] [VALIDATOR ] IFF: All expected trading days are present. [2025-10-15T19:33:57.451069] [DEBUG] [VALIDATOR ] IFF: Primary data validation passed. [2025-10-15T19:33:57.452103] [INFO ] [MAIN ] IFF: Fetched primary data is valid. [2025-10-15T19:33:57.452166] [DEBUG] [LOCAL ] IFF: Saving primary data. [2025-10-15T19:33:57.453410] [DEBUG] [LOCAL ] IFF: Trimmed 73512 records to 51147 (keeping 200 days of data) [2025-10-15T19:33:57.731001] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-04. [2025-10-15T19:33:57.772052] [DEBUG] [LOCAL ] IFF: Primary data saved (51147 records). [2025-10-15T19:33:57.772163] [INFO ] [MAIN ] IFF: Full history saved. [2025-10-15T19:33:57.772237] [INFO ] [MAIN ] Update Progress: 1092/2369 symbols completed. IFF took 47.0s. Estimated remaining: 2h 59m 57s. Rate: 7.1 symbols/min [2025-10-15T19:33:57.943619] [INFO ] [MAIN ] IGI: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:33:57.950159] [DEBUG] [LOCAL ] IGI: Loaded 3934 existing records from primary storage. [2025-10-15T19:33:57.950382] [INFO ] [MAIN ] IGI: Loaded 3934 existing records. [2025-10-15T19:33:58.124283] [WARN ] [MAIN ] IGI: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:33:58.124493] [INFO ] [MAIN ] IGI: Wiping existing primary data before full refresh. [2025-10-15T19:33:58.124543] [INFO ] [LOCAL ] IGI: Starting deletion of primary data. [2025-10-15T19:33:58.124979] [DEBUG] [LOCAL ] IGI: Deleted primary data file. [2025-10-15T19:33:58.125039] [INFO ] [MAIN ] IGI: Starting full primary refresh. [2025-10-15T19:33:58.478673] [INFO ] [REMOTE ] IGI: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:33:58.513974] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-05. [2025-10-15T19:33:58.908275] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-15T19:33:59.319091] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-08. [2025-10-15T19:33:59.327431] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-15T19:34:00.114029] [INFO ] [REMOTE ] IGI: Fetching primary data for 2024-12. [2025-10-15T19:34:00.125591] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-15T19:34:00.914024] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-09. [2025-10-15T19:34:01.199634] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-15T19:34:01.714022] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-06. [2025-10-15T19:34:01.911485] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-15T19:34:02.514039] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-10. [2025-10-15T19:34:02.938389] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-15T19:34:03.314036] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-01. [2025-10-15T19:34:03.325932] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-15T19:34:03.328028] [INFO ] [REMOTE ] IGA: Full fetch complete (14139 records). [2025-10-15T19:34:03.328108] [DEBUG] [VALIDATOR ] IGA: Validating primary data. [2025-10-15T19:34:03.690921] [DEBUG] [VALIDATOR ] IGA: All expected trading days are present. [2025-10-15T19:34:03.690990] [DEBUG] [VALIDATOR ] IGA: Primary data validation passed. [2025-10-15T19:34:03.691303] [INFO ] [MAIN ] IGA: Fetched primary data is valid. [2025-10-15T19:34:03.691341] [DEBUG] [LOCAL ] IGA: Saving primary data. [2025-10-15T19:34:03.691853] [DEBUG] [LOCAL ] IGA: Trimmed 14139 records to 10170 (keeping 200 days of data) [2025-10-15T19:34:03.750730] [DEBUG] [LOCAL ] IGA: Primary data saved (10170 records). [2025-10-15T19:34:03.750850] [INFO ] [MAIN ] IGA: Full history saved. [2025-10-15T19:34:03.750926] [INFO ] [MAIN ] Update Progress: 1093/2369 symbols completed. IGA took 26.9s. Estimated remaining: 2h 59m 46s. Rate: 7.1 symbols/min [2025-10-15T19:34:03.826867] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-10-15T19:34:03.919736] [INFO ] [MAIN ] IGR: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:34:03.949347] [DEBUG] [LOCAL ] IGR: Loaded 30377 existing records from primary storage. [2025-10-15T19:34:03.949595] [INFO ] [MAIN ] IGR: Loaded 30377 existing records. [2025-10-15T19:34:04.119135] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-02. [2025-10-15T19:34:04.124486] [WARN ] [MAIN ] IGR: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:34:04.125549] [INFO ] [MAIN ] IGR: Wiping existing primary data before full refresh. [2025-10-15T19:34:04.125602] [INFO ] [LOCAL ] IGR: Starting deletion of primary data. [2025-10-15T19:34:04.125920] [DEBUG] [LOCAL ] IGR: Deleted primary data file. [2025-10-15T19:34:04.125976] [INFO ] [MAIN ] IGR: Starting full primary refresh. [2025-10-15T19:34:04.480984] [INFO ] [REMOTE ] IGR: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:34:04.683488] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-15T19:34:04.913990] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-03. [2025-10-15T19:34:05.381355] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-10-15T19:34:05.714029] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-07. [2025-10-15T19:34:06.513981] [INFO ] [REMOTE ] IGR: Fetching primary data for 2024-12. [2025-10-15T19:34:06.828138] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-15T19:34:07.314009] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-05. [2025-10-15T19:34:08.093191] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-15T19:34:08.113963] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-01. [2025-10-15T19:34:08.389017] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-15T19:34:08.914040] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-06. [2025-10-15T19:34:09.236053] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-15T19:34:09.713958] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-02. [2025-10-15T19:34:09.953769] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-15T19:34:10.514075] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-04. [2025-10-15T19:34:10.910716] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-15T19:34:11.070184] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-10-15T19:34:11.313994] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-05. [2025-10-15T19:34:11.721211] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-10-15T19:34:12.114034] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-06. [2025-10-15T19:34:12.691786] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-15T19:34:12.914028] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-07. [2025-10-15T19:34:13.523116] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-15T19:34:13.713998] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-07. [2025-10-15T19:34:14.514037] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-03. [2025-10-15T19:34:14.787335] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-15T19:34:15.314001] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-08. [2025-10-15T19:34:15.427032] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-15T19:34:16.113969] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-08. [2025-10-15T19:34:16.273182] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-15T19:34:16.913967] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-08. [2025-10-15T19:34:17.139423] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-15T19:34:17.490924] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-15T19:34:17.714054] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-09. [2025-10-15T19:34:18.205799] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-10-15T19:34:18.514014] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-04. [2025-10-15T19:34:19.314009] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-09. [2025-10-15T19:34:19.571499] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-15T19:34:20.113972] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-05. [2025-10-15T19:34:20.253348] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-15T19:34:20.914035] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-10. [2025-10-15T19:34:21.402693] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-15T19:34:21.597900] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-15T19:34:21.599355] [INFO ] [REMOTE ] IGI: Full fetch complete (5490 records). [2025-10-15T19:34:21.599446] [DEBUG] [VALIDATOR ] IGI: Validating primary data. [2025-10-15T19:34:21.719135] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-10. [2025-10-15T19:34:21.964047] [DEBUG] [VALIDATOR ] IGI: All expected trading days are present. [2025-10-15T19:34:21.964126] [DEBUG] [VALIDATOR ] IGI: Primary data validation passed. [2025-10-15T19:34:21.964284] [INFO ] [MAIN ] IGI: Fetched primary data is valid. [2025-10-15T19:34:21.964324] [DEBUG] [LOCAL ] IGI: Saving primary data. [2025-10-15T19:34:21.964705] [DEBUG] [LOCAL ] IGI: Trimmed 5490 records to 3999 (keeping 200 days of data) [2025-10-15T19:34:21.990782] [DEBUG] [LOCAL ] IGI: Primary data saved (3999 records). [2025-10-15T19:34:21.990847] [INFO ] [MAIN ] IGI: Full history saved. [2025-10-15T19:34:21.990956] [INFO ] [MAIN ] Update Progress: 1094/2369 symbols completed. IGI took 24.2s. Estimated remaining: 2h 59m 49s. Rate: 7.1 symbols/min [2025-10-15T19:34:22.154175] [INFO ] [MAIN ] IH: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:34:22.160366] [DEBUG] [LOCAL ] IH: Loaded 2794 existing records from primary storage. [2025-10-15T19:34:22.160543] [INFO ] [MAIN ] IH: Loaded 2794 existing records. [2025-10-15T19:34:22.330954] [WARN ] [MAIN ] IH: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:34:22.331161] [INFO ] [MAIN ] IH: Wiping existing primary data before full refresh. [2025-10-15T19:34:22.331209] [INFO ] [LOCAL ] IH: Starting deletion of primary data. [2025-10-15T19:34:22.331383] [DEBUG] [LOCAL ] IH: Deleted primary data file. [2025-10-15T19:34:22.331438] [INFO ] [MAIN ] IH: Starting full primary refresh. [2025-10-15T19:34:22.522080] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-09. [2025-10-15T19:34:22.685890] [INFO ] [REMOTE ] IH: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:34:22.883480] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-15T19:34:22.886730] [INFO ] [REMOTE ] IGD: Full fetch complete (30115 records). [2025-10-15T19:34:22.886851] [DEBUG] [VALIDATOR ] IGD: Validating primary data. [2025-10-15T19:34:23.263877] [DEBUG] [VALIDATOR ] IGD: All expected trading days are present. [2025-10-15T19:34:23.263949] [DEBUG] [VALIDATOR ] IGD: Primary data validation passed. [2025-10-15T19:34:23.264516] [INFO ] [MAIN ] IGD: Fetched primary data is valid. [2025-10-15T19:34:23.264554] [DEBUG] [LOCAL ] IGD: Saving primary data. [2025-10-15T19:34:23.265231] [DEBUG] [LOCAL ] IGD: Trimmed 30115 records to 19405 (keeping 200 days of data) [2025-10-15T19:34:23.320678] [INFO ] [REMOTE ] IH: Fetching primary data for 2024-12. [2025-10-15T19:34:23.379967] [DEBUG] [LOCAL ] IGD: Primary data saved (19405 records). [2025-10-15T19:34:23.380073] [INFO ] [MAIN ] IGD: Full history saved. [2025-10-15T19:34:23.380146] [INFO ] [MAIN ] Update Progress: 1095/2369 symbols completed. IGD took 35.6s. Estimated remaining: 2h 59m 32s. Rate: 7.1 symbols/min [2025-10-15T19:34:23.557185] [INFO ] [MAIN ] IHD: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:34:23.573045] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-15T19:34:23.581832] [DEBUG] [LOCAL ] IHD: Loaded 7305 existing records from primary storage. [2025-10-15T19:34:23.582003] [INFO ] [MAIN ] IHD: Loaded 7305 existing records. [2025-10-15T19:34:23.766304] [WARN ] [MAIN ] IHD: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:34:23.766907] [INFO ] [MAIN ] IHD: Wiping existing primary data before full refresh. [2025-10-15T19:34:23.766976] [INFO ] [LOCAL ] IHD: Starting deletion of primary data. [2025-10-15T19:34:23.767149] [DEBUG] [LOCAL ] IHD: Deleted primary data file. [2025-10-15T19:34:23.767189] [INFO ] [MAIN ] IHD: Starting full primary refresh. [2025-10-15T19:34:24.015396] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-10-15T19:34:24.131775] [INFO ] [REMOTE ] IHD: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:34:24.126391] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-06. [2025-10-15T19:34:24.914011] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-01. [2025-10-15T19:34:25.239070] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-15T19:34:25.438442] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-10-15T19:34:25.714002] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-02. [2025-10-15T19:34:26.307167] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-15T19:34:26.514002] [INFO ] [REMOTE ] IHD: Fetching primary data for 2024-12. [2025-10-15T19:34:27.314045] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-07. [2025-10-15T19:34:27.476478] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-10-15T19:34:28.114052] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-03. [2025-10-15T19:34:28.796564] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-15T19:34:28.855129] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-15T19:34:28.913990] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-04. [2025-10-15T19:34:29.377439] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-10-15T19:34:29.713984] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-05. [2025-10-15T19:34:30.136219] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-10-15T19:34:30.514010] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-10. [2025-10-15T19:34:31.314055] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-08. [2025-10-15T19:34:31.558346] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-15T19:34:31.561133] [INFO ] [REMOTE ] IFS: Full fetch complete (32033 records). [2025-10-15T19:34:31.561217] [DEBUG] [VALIDATOR ] IFS: Validating primary data. [2025-10-15T19:34:31.947187] [DEBUG] [VALIDATOR ] IFS: All expected trading days are present. [2025-10-15T19:34:31.947285] [DEBUG] [VALIDATOR ] IFS: Primary data validation passed. [2025-10-15T19:34:31.948087] [INFO ] [MAIN ] IFS: Fetched primary data is valid. [2025-10-15T19:34:31.948153] [DEBUG] [LOCAL ] IFS: Saving primary data. [2025-10-15T19:34:31.949096] [DEBUG] [LOCAL ] IFS: Trimmed 32033 records to 22636 (keeping 200 days of data) [2025-10-15T19:34:32.085805] [DEBUG] [LOCAL ] IFS: Primary data saved (22636 records). [2025-10-15T19:34:32.085952] [INFO ] [MAIN ] IFS: Full history saved. [2025-10-15T19:34:32.086061] [INFO ] [MAIN ] Update Progress: 1096/2369 symbols completed. IFS took 1m 2s. Estimated remaining: 2h 59m 24s. Rate: 7.1 symbols/min [2025-10-15T19:34:32.117738] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-06. [2025-10-15T19:34:32.256200] [INFO ] [MAIN ] IHG: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:34:32.280117] [DEBUG] [LOCAL ] IHG: Loaded 24262 existing records from primary storage. [2025-10-15T19:34:32.280348] [INFO ] [MAIN ] IHG: Loaded 24262 existing records. [2025-10-15T19:34:32.455399] [WARN ] [MAIN ] IHG: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:34:32.455692] [INFO ] [MAIN ] IHG: Wiping existing primary data before full refresh. [2025-10-15T19:34:32.455750] [INFO ] [LOCAL ] IHG: Starting deletion of primary data. [2025-10-15T19:34:32.455932] [DEBUG] [LOCAL ] IHG: Deleted primary data file. [2025-10-15T19:34:32.455986] [INFO ] [MAIN ] IHG: Starting full primary refresh. [2025-10-15T19:34:32.638125] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-10-15T19:34:32.834053] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-15T19:34:32.882762] [INFO ] [REMOTE ] IHG: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:34:32.913989] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-09. [2025-10-15T19:34:33.713953] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-07. [2025-10-15T19:34:34.150360] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-15T19:34:34.193042] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-15T19:34:34.514060] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-10. [2025-10-15T19:34:35.314086] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-08. [2025-10-15T19:34:35.736255] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-15T19:34:35.739461] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-10-15T19:34:35.744630] [INFO ] [REMOTE ] IGR: Full fetch complete (45018 records). [2025-10-15T19:34:35.744752] [DEBUG] [VALIDATOR ] IGR: Validating primary data. [2025-10-15T19:34:36.116668] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-09. [2025-10-15T19:34:36.132130] [DEBUG] [VALIDATOR ] IGR: All expected trading days are present. [2025-10-15T19:34:36.132205] [DEBUG] [VALIDATOR ] IGR: Primary data validation passed. [2025-10-15T19:34:36.132987] [INFO ] [MAIN ] IGR: Fetched primary data is valid. [2025-10-15T19:34:36.133130] [DEBUG] [LOCAL ] IGR: Saving primary data. [2025-10-15T19:34:36.134227] [DEBUG] [LOCAL ] IGR: Trimmed 45018 records to 30438 (keeping 200 days of data) [2025-10-15T19:34:36.311185] [DEBUG] [LOCAL ] IGR: Primary data saved (30438 records). [2025-10-15T19:34:36.311331] [INFO ] [MAIN ] IGR: Full history saved. [2025-10-15T19:34:36.311412] [INFO ] [MAIN ] Update Progress: 1097/2369 symbols completed. IGR took 32.6s. Estimated remaining: 2h 59m 11s. Rate: 7.1 symbols/min [2025-10-15T19:34:36.483782] [INFO ] [MAIN ] IHS: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:34:36.518017] [DEBUG] [LOCAL ] IHS: Loaded 37773 existing records from primary storage. [2025-10-15T19:34:36.518320] [INFO ] [MAIN ] IHS: Loaded 37773 existing records. [2025-10-15T19:34:36.683720] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-15T19:34:36.704007] [WARN ] [MAIN ] IHS: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:34:36.705627] [INFO ] [MAIN ] IHS: Wiping existing primary data before full refresh. [2025-10-15T19:34:36.705717] [INFO ] [LOCAL ] IHS: Starting deletion of primary data. [2025-10-15T19:34:36.706144] [DEBUG] [LOCAL ] IHS: Deleted primary data file. [2025-10-15T19:34:36.706199] [INFO ] [MAIN ] IHS: Starting full primary refresh. [2025-10-15T19:34:36.919121] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-01. [2025-10-15T19:34:37.084255] [INFO ] [REMOTE ] IHS: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:34:37.713999] [INFO ] [REMOTE ] IHS: Fetching primary data for 2024-12. [2025-10-15T19:34:37.826784] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-15T19:34:38.514057] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-02. [2025-10-15T19:34:39.117468] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-15T19:34:39.257500] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-15T19:34:39.313982] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-01. [2025-10-15T19:34:40.114002] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-03. [2025-10-15T19:34:40.550411] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-15T19:34:40.809430] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-15T19:34:40.913951] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-02. [2025-10-15T19:34:41.714073] [INFO ] [REMOTE ] IHG: Fetching primary data for 2024-12. [2025-10-15T19:34:42.013949] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-15T19:34:42.514049] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-03. [2025-10-15T19:34:42.938724] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-15T19:34:43.314049] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-01. [2025-10-15T19:34:43.605586] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-15T19:34:44.114035] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-10. [2025-10-15T19:34:44.141629] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-15T19:34:44.565380] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-15T19:34:44.566274] [INFO ] [REMOTE ] IH: Full fetch complete (5019 records). [2025-10-15T19:34:44.566342] [DEBUG] [VALIDATOR ] IH: Validating primary data. [2025-10-15T19:34:44.917244] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-04. [2025-10-15T19:34:44.922266] [DEBUG] [VALIDATOR ] IH: All expected trading days are present. [2025-10-15T19:34:44.923228] [DEBUG] [VALIDATOR ] IH: Primary data validation passed. [2025-10-15T19:34:44.923441] [INFO ] [MAIN ] IH: Fetched primary data is valid. [2025-10-15T19:34:44.923483] [DEBUG] [LOCAL ] IH: Saving primary data. [2025-10-15T19:34:44.923930] [DEBUG] [LOCAL ] IH: Trimmed 5019 records to 2799 (keeping 200 days of data) [2025-10-15T19:34:44.939870] [DEBUG] [LOCAL ] IH: Primary data saved (2799 records). [2025-10-15T19:34:44.940205] [INFO ] [MAIN ] IH: Full history saved. [2025-10-15T19:34:44.940399] [INFO ] [MAIN ] Update Progress: 1098/2369 symbols completed. IH took 22.9s. Estimated remaining: 2h 59m 3s. Rate: 7.1 symbols/min [2025-10-15T19:34:45.138270] [INFO ] [MAIN ] IIF: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:34:45.147559] [DEBUG] [LOCAL ] IIF: Loaded 5596 existing records from primary storage. [2025-10-15T19:34:45.147858] [INFO ] [MAIN ] IIF: Loaded 5596 existing records. [2025-10-15T19:34:45.326466] [WARN ] [MAIN ] IIF: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:34:45.326719] [INFO ] [MAIN ] IIF: Wiping existing primary data before full refresh. [2025-10-15T19:34:45.326774] [INFO ] [LOCAL ] IIF: Starting deletion of primary data. [2025-10-15T19:34:45.326930] [DEBUG] [LOCAL ] IIF: Deleted primary data file. [2025-10-15T19:34:45.326968] [INFO ] [MAIN ] IIF: Starting full primary refresh. [2025-10-15T19:34:45.700377] [INFO ] [REMOTE ] IIF: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:34:45.713950] [INFO ] [REMOTE ] IIF: Fetching primary data for 2024-12. [2025-10-15T19:34:46.160781] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-15T19:34:46.514061] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-02. [2025-10-15T19:34:46.734318] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-15T19:34:47.314029] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-01. [2025-10-15T19:34:47.589002] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-15T19:34:48.113961] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-04. [2025-10-15T19:34:48.162144] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-15T19:34:48.756435] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-10-15T19:34:48.913975] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-03. [2025-10-15T19:34:49.714045] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-05. [2025-10-15T19:34:50.141524] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-15T19:34:50.201327] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-15T19:34:50.514052] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-06. [2025-10-15T19:34:51.111184] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-15T19:34:51.314018] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-05. [2025-10-15T19:34:52.114028] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-04. [2025-10-15T19:34:52.835859] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-15T19:34:52.914009] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-06. [2025-10-15T19:34:53.152790] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-15T19:34:53.714005] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-07. [2025-10-15T19:34:54.321884] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-15T19:34:54.384374] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-15T19:34:54.514030] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-02. [2025-10-15T19:34:55.220794] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-15T19:34:55.314006] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-03. [2025-10-15T19:34:55.890261] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-15T19:34:56.114022] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-04. [2025-10-15T19:34:56.887545] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-15T19:34:56.913954] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-05. [2025-10-15T19:34:57.557721] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-15T19:34:57.714001] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-05. [2025-10-15T19:34:58.514009] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-07. [2025-10-15T19:34:58.852037] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-15T19:34:59.314071] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-06. [2025-10-15T19:34:59.935272] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-15T19:35:00.114015] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-08. [2025-10-15T19:35:00.403930] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-15T19:35:00.846139] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-15T19:35:00.913953] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-06. [2025-10-15T19:35:01.568266] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-15T19:35:01.714005] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-09. [2025-10-15T19:35:02.514002] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-07. [2025-10-15T19:35:02.630369] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-15T19:35:03.314043] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-10. [2025-10-15T19:35:03.920277] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-15T19:35:04.113984] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-08. [2025-10-15T19:35:04.146459] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-15T19:35:04.148262] [INFO ] [REMOTE ] IHD: Full fetch complete (11868 records). [2025-10-15T19:35:04.148332] [DEBUG] [VALIDATOR ] IHD: Validating primary data. [2025-10-15T19:35:04.498412] [DEBUG] [VALIDATOR ] IHD: All expected trading days are present. [2025-10-15T19:35:04.498494] [DEBUG] [VALIDATOR ] IHD: Primary data validation passed. [2025-10-15T19:35:04.498788] [INFO ] [MAIN ] IHD: Fetched primary data is valid. [2025-10-15T19:35:04.498850] [DEBUG] [LOCAL ] IHD: Saving primary data. [2025-10-15T19:35:04.499275] [DEBUG] [LOCAL ] IHD: Trimmed 11868 records to 7329 (keeping 200 days of data) [2025-10-15T19:35:04.547376] [DEBUG] [LOCAL ] IHD: Primary data saved (7329 records). [2025-10-15T19:35:04.547516] [INFO ] [MAIN ] IHD: Full history saved. [2025-10-15T19:35:04.547599] [INFO ] [MAIN ] Update Progress: 1099/2369 symbols completed. IHD took 41.2s. Estimated remaining: 2h 59m 7s. Rate: 7.1 symbols/min [2025-10-15T19:35:04.717073] [INFO ] [MAIN ] IIIN: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:35:04.734052] [DEBUG] [LOCAL ] IIIN: Loaded 15969 existing records from primary storage. [2025-10-15T19:35:04.734424] [INFO ] [MAIN ] IIIN: Loaded 15969 existing records. [2025-10-15T19:35:04.913149] [WARN ] [MAIN ] IIIN: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:35:04.913344] [INFO ] [MAIN ] IIIN: Wiping existing primary data before full refresh. [2025-10-15T19:35:04.913405] [INFO ] [LOCAL ] IIIN: Starting deletion of primary data. [2025-10-15T19:35:04.913585] [DEBUG] [LOCAL ] IIIN: Deleted primary data file. [2025-10-15T19:35:04.913624] [INFO ] [MAIN ] IIIN: Starting full primary refresh. [2025-10-15T19:35:04.924637] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-08. [2025-10-15T19:35:05.270832] [INFO ] [REMOTE ] IIIN: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:35:05.301058] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-15T19:35:05.714024] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-07. [2025-10-15T19:35:06.500087] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-15T19:35:06.513952] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-08. [2025-10-15T19:35:06.543573] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-15T19:35:07.115882] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-15T19:35:07.314058] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-09. [2025-10-15T19:35:07.893165] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-15T19:35:08.114001] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-10. [2025-10-15T19:35:08.604376] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-15T19:35:08.605294] [INFO ] [REMOTE ] IIF: Full fetch complete (9021 records). [2025-10-15T19:35:08.605362] [DEBUG] [VALIDATOR ] IIF: Validating primary data. [2025-10-15T19:35:08.924143] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-09. [2025-10-15T19:35:08.955935] [DEBUG] [VALIDATOR ] IIF: All expected trading days are present. [2025-10-15T19:35:08.956063] [DEBUG] [VALIDATOR ] IIF: Primary data validation passed. [2025-10-15T19:35:08.956301] [INFO ] [MAIN ] IIF: Fetched primary data is valid. [2025-10-15T19:35:08.956342] [DEBUG] [LOCAL ] IIF: Saving primary data. [2025-10-15T19:35:08.956954] [DEBUG] [LOCAL ] IIF: Trimmed 9021 records to 5591 (keeping 200 days of data) [2025-10-15T19:35:09.001937] [DEBUG] [LOCAL ] IIF: Primary data saved (5591 records). [2025-10-15T19:35:09.002098] [INFO ] [MAIN ] IIF: Full history saved. [2025-10-15T19:35:09.002197] [INFO ] [MAIN ] Update Progress: 1100/2369 symbols completed. IIF took 24.1s. Estimated remaining: 2h 58m 54s. Rate: 7.1 symbols/min [2025-10-15T19:35:09.168611] [INFO ] [MAIN ] IIM: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:35:09.184888] [DEBUG] [LOCAL ] IIM: Loaded 15708 existing records from primary storage. [2025-10-15T19:35:09.185112] [INFO ] [MAIN ] IIM: Loaded 15708 existing records. [2025-10-15T19:35:09.355833] [WARN ] [MAIN ] IIM: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:35:09.356017] [INFO ] [MAIN ] IIM: Wiping existing primary data before full refresh. [2025-10-15T19:35:09.356063] [INFO ] [LOCAL ] IIM: Starting deletion of primary data. [2025-10-15T19:35:09.356311] [DEBUG] [LOCAL ] IIM: Deleted primary data file. [2025-10-15T19:35:09.356367] [INFO ] [MAIN ] IIM: Starting full primary refresh. [2025-10-15T19:35:09.699009] [INFO ] [REMOTE ] IIM: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:35:09.713951] [INFO ] [REMOTE ] IIM: Fetching primary data for 2024-12. [2025-10-15T19:35:10.219834] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-15T19:35:10.514050] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-09. [2025-10-15T19:35:10.777615] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-10-15T19:35:11.313982] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-01. [2025-10-15T19:35:11.569739] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-15T19:35:12.114012] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-10. [2025-10-15T19:35:12.392816] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-15T19:35:12.913955] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2024-12. [2025-10-15T19:35:12.994014] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-15T19:35:12.996993] [INFO ] [REMOTE ] IHG: Full fetch complete (34003 records). [2025-10-15T19:35:12.997072] [DEBUG] [VALIDATOR ] IHG: Validating primary data. [2025-10-15T19:35:13.370709] [DEBUG] [VALIDATOR ] IHG: All expected trading days are present. [2025-10-15T19:35:13.370793] [DEBUG] [VALIDATOR ] IHG: Primary data validation passed. [2025-10-15T19:35:13.371459] [INFO ] [MAIN ] IHG: Fetched primary data is valid. [2025-10-15T19:35:13.371505] [DEBUG] [LOCAL ] IHG: Saving primary data. [2025-10-15T19:35:13.372316] [DEBUG] [LOCAL ] IHG: Trimmed 34003 records to 24302 (keeping 200 days of data) [2025-10-15T19:35:13.520631] [DEBUG] [LOCAL ] IHG: Primary data saved (24302 records). [2025-10-15T19:35:13.520779] [INFO ] [MAIN ] IHG: Full history saved. [2025-10-15T19:35:13.520858] [INFO ] [MAIN ] Update Progress: 1101/2369 symbols completed. IHG took 41.4s. Estimated remaining: 2h 58m 41s. Rate: 7.1 symbols/min [2025-10-15T19:35:13.686441] [INFO ] [MAIN ] IIPR: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:35:13.717131] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-02. [2025-10-15T19:35:13.718507] [DEBUG] [LOCAL ] IIPR: Loaded 29452 existing records from primary storage. [2025-10-15T19:35:13.718751] [INFO ] [MAIN ] IIPR: Loaded 29452 existing records. [2025-10-15T19:35:13.900020] [WARN ] [MAIN ] IIPR: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:35:13.900229] [INFO ] [MAIN ] IIPR: Wiping existing primary data before full refresh. [2025-10-15T19:35:13.900283] [INFO ] [LOCAL ] IIPR: Starting deletion of primary data. [2025-10-15T19:35:13.900617] [DEBUG] [LOCAL ] IIPR: Deleted primary data file. [2025-10-15T19:35:13.900699] [INFO ] [MAIN ] IIPR: Starting full primary refresh. [2025-10-15T19:35:14.284358] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-15T19:35:14.283864] [INFO ] [REMOTE ] IIPR: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:35:14.513965] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-10. [2025-10-15T19:35:14.852922] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-15T19:35:15.314045] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-03. [2025-10-15T19:35:15.429699] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-15T19:35:15.433341] [INFO ] [REMOTE ] IHS: Full fetch complete (51487 records). [2025-10-15T19:35:15.433445] [DEBUG] [VALIDATOR ] IHS: Validating primary data. [2025-10-15T19:35:15.822038] [DEBUG] [VALIDATOR ] IHS: All expected trading days are present. [2025-10-15T19:35:15.822128] [DEBUG] [VALIDATOR ] IHS: Primary data validation passed. [2025-10-15T19:35:15.823053] [INFO ] [MAIN ] IHS: Fetched primary data is valid. [2025-10-15T19:35:15.823118] [DEBUG] [LOCAL ] IHS: Saving primary data. [2025-10-15T19:35:15.824326] [DEBUG] [LOCAL ] IHS: Trimmed 51487 records to 37622 (keeping 200 days of data) [2025-10-15T19:35:16.038231] [DEBUG] [LOCAL ] IHS: Primary data saved (37622 records). [2025-10-15T19:35:16.038376] [INFO ] [MAIN ] IHS: Full history saved. [2025-10-15T19:35:16.038452] [INFO ] [MAIN ] Update Progress: 1102/2369 symbols completed. IHS took 39.7s. Estimated remaining: 2h 58m 26s. Rate: 7.1 symbols/min [2025-10-15T19:35:16.116686] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-01. [2025-10-15T19:35:16.219559] [INFO ] [MAIN ] IMAX: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:35:16.265095] [DEBUG] [LOCAL ] IMAX: Loaded 43182 existing records from primary storage. [2025-10-15T19:35:16.265423] [INFO ] [MAIN ] IMAX: Loaded 43182 existing records. [2025-10-15T19:35:16.397842] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-15T19:35:16.476761] [WARN ] [MAIN ] IMAX: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:35:16.477179] [INFO ] [MAIN ] IMAX: Wiping existing primary data before full refresh. [2025-10-15T19:35:16.477237] [INFO ] [LOCAL ] IMAX: Starting deletion of primary data. [2025-10-15T19:35:16.477736] [DEBUG] [LOCAL ] IMAX: Deleted primary data file. [2025-10-15T19:35:16.477793] [INFO ] [MAIN ] IMAX: Starting full primary refresh. [2025-10-15T19:35:16.826417] [INFO ] [REMOTE ] IMAX: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:35:16.914014] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-04. [2025-10-15T19:35:17.248939] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-15T19:35:17.714014] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2024-12. [2025-10-15T19:35:17.859423] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-15T19:35:18.514009] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2024-12. [2025-10-15T19:35:18.623006] [DEBUG] [REMOTE ] IMAX: Error fetching primary data for 2024-12: 'API call returned an empty response.' [2025-10-15T19:35:18.623327] [WARN ] [REMOTE ] IMAX: No data returned for month 2024-12 [2025-10-15T19:35:18.623418] [FATAL] [REMOTE ] IMAX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-15T19:35:18.623488] [FATAL] [MAIN ] IMAX: Failed to fetch primary data. [2025-10-15T19:35:18.623554] [WARN ] [MAIN ] IMAX: Deleting existing primary and derivative data due to fetch failure. [2025-10-15T19:35:18.623626] [INFO ] [LOCAL ] IMAX: Starting deletion of primary data. [2025-10-15T19:35:18.623725] [DEBUG] [LOCAL ] IMAX: No primary data file found to delete. [2025-10-15T19:35:18.623769] [INFO ] [LOCAL ] IMAX: Starting deletion of derivative data. [2025-10-15T19:35:18.623926] [DEBUG] [LOCAL ] IMAX: Deleted derivative data file. [2025-10-15T19:35:18.624017] [INFO ] [MAIN ] Update Progress: 1103/2369 symbols completed. IMAX took 2.6s. Estimated remaining: 2h 58m 11s. Rate: 7.1 symbols/min [2025-10-15T19:35:18.790306] [INFO ] [MAIN ] INFA: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:35:18.835879] [DEBUG] [LOCAL ] INFA: Loaded 49048 existing records from primary storage. [2025-10-15T19:35:18.836192] [INFO ] [MAIN ] INFA: Loaded 49048 existing records. [2025-10-15T19:35:19.021789] [WARN ] [MAIN ] INFA: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:35:19.022100] [INFO ] [MAIN ] INFA: Wiping existing primary data before full refresh. [2025-10-15T19:35:19.022183] [INFO ] [LOCAL ] INFA: Starting deletion of primary data. [2025-10-15T19:35:19.022837] [DEBUG] [LOCAL ] INFA: Deleted primary data file. [2025-10-15T19:35:19.022896] [INFO ] [MAIN ] INFA: Starting full primary refresh. [2025-10-15T19:35:19.317632] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-05. [2025-10-15T19:35:19.331973] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-15T19:35:19.418289] [INFO ] [REMOTE ] INFA: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:35:20.113981] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-02. [2025-10-15T19:35:20.155150] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-15T19:35:20.913972] [INFO ] [REMOTE ] INFA: Fetching primary data for 2024-12. [2025-10-15T19:35:20.955235] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-15T19:35:21.713991] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-03. [2025-10-15T19:35:22.513965] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-01. [2025-10-15T19:35:22.592036] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-15T19:35:22.784681] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-15T19:35:23.313989] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-04. [2025-10-15T19:35:23.722875] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-15T19:35:24.113972] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-02. [2025-10-15T19:35:24.391887] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-15T19:35:24.913982] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-06. [2025-10-15T19:35:25.040096] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-15T19:35:25.472711] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-15T19:35:25.714000] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-01. [2025-10-15T19:35:26.513999] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-07. [2025-10-15T19:35:27.243441] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-15T19:35:27.292675] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-15T19:35:27.313957] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-02. [2025-10-15T19:35:28.113995] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-05. [2025-10-15T19:35:28.914006] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-08. [2025-10-15T19:35:29.020392] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-15T19:35:29.167831] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-15T19:35:29.713997] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-03. [2025-10-15T19:35:29.744071] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-15T19:35:30.514015] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-03. [2025-10-15T19:35:31.313979] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-06. [2025-10-15T19:35:31.374289] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-15T19:35:31.836688] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-15T19:35:32.114045] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-04. [2025-10-15T19:35:32.297900] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-15T19:35:32.913996] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-09. [2025-10-15T19:35:33.618849] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-15T19:35:33.713968] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-05. [2025-10-15T19:35:33.908543] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-15T19:35:34.513991] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-10. [2025-10-15T19:35:35.275132] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-15T19:35:35.313973] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-06. [2025-10-15T19:35:35.450124] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-15T19:35:35.452458] [INFO ] [REMOTE ] IIM: Full fetch complete (25202 records). [2025-10-15T19:35:35.452532] [DEBUG] [VALIDATOR ] IIM: Validating primary data. [2025-10-15T19:35:35.861141] [DEBUG] [VALIDATOR ] IIM: All expected trading days are present. [2025-10-15T19:35:35.861224] [DEBUG] [VALIDATOR ] IIM: Primary data validation passed. [2025-10-15T19:35:35.861813] [INFO ] [MAIN ] IIM: Fetched primary data is valid. [2025-10-15T19:35:35.861876] [DEBUG] [LOCAL ] IIM: Saving primary data. [2025-10-15T19:35:35.862512] [DEBUG] [LOCAL ] IIM: Trimmed 25202 records to 15661 (keeping 200 days of data) [2025-10-15T19:35:35.968475] [DEBUG] [LOCAL ] IIM: Primary data saved (15661 records). [2025-10-15T19:35:35.968616] [INFO ] [MAIN ] IIM: Full history saved. [2025-10-15T19:35:35.968731] [INFO ] [MAIN ] Update Progress: 1104/2369 symbols completed. IIM took 27.0s. Estimated remaining: 2h 58m 12s. Rate: 7.1 symbols/min [2025-10-15T19:35:36.118203] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-04. [2025-10-15T19:35:36.144442] [INFO ] [MAIN ] INFY: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:35:36.199353] [DEBUG] [LOCAL ] INFY: Loaded 53596 existing records from primary storage. [2025-10-15T19:35:36.199709] [INFO ] [MAIN ] INFY: Loaded 53596 existing records. [2025-10-15T19:35:36.373261] [WARN ] [MAIN ] INFY: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:35:36.373454] [INFO ] [MAIN ] INFY: Wiping existing primary data before full refresh. [2025-10-15T19:35:36.373502] [INFO ] [LOCAL ] INFY: Starting deletion of primary data. [2025-10-15T19:35:36.374000] [DEBUG] [LOCAL ] INFY: Deleted primary data file. [2025-10-15T19:35:36.374055] [INFO ] [MAIN ] INFY: Starting full primary refresh. [2025-10-15T19:35:36.722723] [INFO ] [REMOTE ] INFY: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:35:36.750960] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-15T19:35:36.913959] [INFO ] [REMOTE ] INFY: Fetching primary data for 2024-12. [2025-10-15T19:35:37.626096] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-15T19:35:37.713997] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-05. [2025-10-15T19:35:38.513986] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-07. [2025-10-15T19:35:38.841190] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-10-15T19:35:38.961264] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-15T19:35:39.313988] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-01. [2025-10-15T19:35:39.773992] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-15T19:35:40.114043] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-08. [2025-10-15T19:35:40.913996] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-07. [2025-10-15T19:35:41.074612] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-15T19:35:41.459089] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-15T19:35:41.713984] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-06. [2025-10-15T19:35:41.734814] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-15T19:35:42.514021] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-08. [2025-10-15T19:35:42.962930] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-15T19:35:43.057580] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-10-15T19:35:43.314001] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-02. [2025-10-15T19:35:44.113991] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-09. [2025-10-15T19:35:44.913975] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-09. [2025-10-15T19:35:44.982430] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-15T19:35:45.559324] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-15T19:35:45.713996] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-07. [2025-10-15T19:35:45.761696] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-15T19:35:46.514002] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-03. [2025-10-15T19:35:47.071350] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-15T19:35:47.314008] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-10. [2025-10-15T19:35:48.114002] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-08. [2025-10-15T19:35:48.136593] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-15T19:35:48.138707] [INFO ] [REMOTE ] IIIN: Full fetch complete (24572 records). [2025-10-15T19:35:48.138786] [DEBUG] [VALIDATOR ] IIIN: Validating primary data. [2025-10-15T19:35:48.550538] [DEBUG] [VALIDATOR ] IIIN: All expected trading days are present. [2025-10-15T19:35:48.550670] [DEBUG] [VALIDATOR ] IIIN: Primary data validation passed. [2025-10-15T19:35:48.551251] [INFO ] [MAIN ] IIIN: Fetched primary data is valid. [2025-10-15T19:35:48.551668] [DEBUG] [LOCAL ] IIIN: Saving primary data. [2025-10-15T19:35:48.554436] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-10-15T19:35:48.567282] [DEBUG] [LOCAL ] IIIN: Trimmed 24572 records to 15979 (keeping 200 days of data) [2025-10-15T19:35:48.669775] [DEBUG] [LOCAL ] IIIN: Primary data saved (15979 records). [2025-10-15T19:35:48.669916] [INFO ] [MAIN ] IIIN: Full history saved. [2025-10-15T19:35:48.669994] [INFO ] [MAIN ] Update Progress: 1105/2369 symbols completed. IIIN took 44.1s. Estimated remaining: 2h 58m 9s. Rate: 7.1 symbols/min [2025-10-15T19:35:48.836415] [INFO ] [MAIN ] ING: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:35:48.896926] [DEBUG] [LOCAL ] ING: Loaded 50723 existing records from primary storage. [2025-10-15T19:35:48.897251] [INFO ] [MAIN ] ING: Loaded 50723 existing records. [2025-10-15T19:35:48.919142] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-04. [2025-10-15T19:35:49.074961] [WARN ] [MAIN ] ING: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:35:49.075166] [INFO ] [MAIN ] ING: Wiping existing primary data before full refresh. [2025-10-15T19:35:49.075213] [INFO ] [LOCAL ] ING: Starting deletion of primary data. [2025-10-15T19:35:49.075428] [DEBUG] [LOCAL ] ING: Deleted primary data file. [2025-10-15T19:35:49.075483] [INFO ] [MAIN ] ING: Starting full primary refresh. [2025-10-15T19:35:49.423565] [INFO ] [REMOTE ] ING: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:35:49.442056] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-15T19:35:49.713985] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-09. [2025-10-15T19:35:50.513963] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-10. [2025-10-15T19:35:50.923261] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-15T19:35:51.039941] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-15T19:35:51.314000] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-05. [2025-10-15T19:35:52.072535] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-15T19:35:52.078084] [INFO ] [REMOTE ] INFA: Full fetch complete (70908 records). [2025-10-15T19:35:52.078219] [DEBUG] [VALIDATOR ] INFA: Validating primary data. [2025-10-15T19:35:52.124076] [INFO ] [REMOTE ] ING: Fetching primary data for 2024-12. [2025-10-15T19:35:52.472187] [DEBUG] [VALIDATOR ] INFA: All expected trading days are present. [2025-10-15T19:35:52.472265] [DEBUG] [VALIDATOR ] INFA: Primary data validation passed. [2025-10-15T19:35:52.473226] [INFO ] [MAIN ] INFA: Fetched primary data is valid. [2025-10-15T19:35:52.473288] [DEBUG] [LOCAL ] INFA: Saving primary data. [2025-10-15T19:35:52.474679] [DEBUG] [LOCAL ] INFA: Trimmed 70908 records to 49000 (keeping 200 days of data) [2025-10-15T19:35:52.819007] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-15T19:35:52.820353] [DEBUG] [LOCAL ] INFA: Primary data saved (49000 records). [2025-10-15T19:35:52.830943] [INFO ] [MAIN ] INFA: Full history saved. [2025-10-15T19:35:52.831175] [INFO ] [MAIN ] Update Progress: 1106/2369 symbols completed. INFA took 34.2s. Estimated remaining: 2h 57m 55s. Rate: 7.1 symbols/min [2025-10-15T19:35:52.922205] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-10. [2025-10-15T19:35:53.003422] [INFO ] [MAIN ] INGM: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:35:53.033743] [DEBUG] [LOCAL ] INGM: Loaded 28445 existing records from primary storage. [2025-10-15T19:35:53.034009] [INFO ] [MAIN ] INGM: Loaded 28445 existing records. [2025-10-15T19:35:53.229438] [WARN ] [MAIN ] INGM: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:35:53.229676] [INFO ] [MAIN ] INGM: Wiping existing primary data before full refresh. [2025-10-15T19:35:53.229736] [INFO ] [LOCAL ] INGM: Starting deletion of primary data. [2025-10-15T19:35:53.230050] [DEBUG] [LOCAL ] INGM: Deleted primary data file. [2025-10-15T19:35:53.230090] [INFO ] [MAIN ] INGM: Starting full primary refresh. [2025-10-15T19:35:53.590839] [INFO ] [REMOTE ] INGM: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:35:53.713965] [INFO ] [REMOTE ] INGM: Fetching primary data for 2024-12. [2025-10-15T19:35:54.276357] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2024-12 (2.15 seconds). [2025-10-15T19:35:54.365047] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-15T19:35:54.369177] [INFO ] [REMOTE ] IIPR: Full fetch complete (44297 records). [2025-10-15T19:35:54.369322] [DEBUG] [VALIDATOR ] IIPR: Validating primary data. [2025-10-15T19:35:54.519263] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-01. [2025-10-15T19:35:54.880317] [DEBUG] [VALIDATOR ] IIPR: All expected trading days are present. [2025-10-15T19:35:54.880440] [DEBUG] [VALIDATOR ] IIPR: Primary data validation passed. [2025-10-15T19:35:54.882173] [INFO ] [MAIN ] IIPR: Fetched primary data is valid. [2025-10-15T19:35:54.882272] [DEBUG] [LOCAL ] IIPR: Saving primary data. [2025-10-15T19:35:54.884436] [DEBUG] [LOCAL ] IIPR: Trimmed 44297 records to 29450 (keeping 200 days of data) [2025-10-15T19:35:55.138291] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-15T19:35:55.154569] [DEBUG] [LOCAL ] IIPR: Primary data saved (29450 records). [2025-10-15T19:35:55.154749] [INFO ] [MAIN ] IIPR: Full history saved. [2025-10-15T19:35:55.154838] [INFO ] [MAIN ] Update Progress: 1107/2369 symbols completed. IIPR took 41.6s. Estimated remaining: 2h 57m 40s. Rate: 7.1 symbols/min [2025-10-15T19:35:55.323953] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-06. [2025-10-15T19:35:55.328200] [INFO ] [MAIN ] INGR: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:35:55.368686] [DEBUG] [LOCAL ] INGR: Loaded 33861 existing records from primary storage. [2025-10-15T19:35:55.368964] [INFO ] [MAIN ] INGR: Loaded 33861 existing records. [2025-10-15T19:35:55.554312] [WARN ] [MAIN ] INGR: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:35:55.554590] [INFO ] [MAIN ] INGR: Wiping existing primary data before full refresh. [2025-10-15T19:35:55.554687] [INFO ] [LOCAL ] INGR: Starting deletion of primary data. [2025-10-15T19:35:55.555023] [DEBUG] [LOCAL ] INGR: Deleted primary data file. [2025-10-15T19:35:55.555121] [INFO ] [MAIN ] INGR: Starting full primary refresh. [2025-10-15T19:35:55.926882] [INFO ] [REMOTE ] INGR: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:35:56.113959] [INFO ] [REMOTE ] INGR: Fetching primary data for 2024-12. [2025-10-15T19:35:56.295708] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-15T19:35:56.914070] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-02. [2025-10-15T19:35:56.964991] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-15T19:35:57.542489] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-15T19:35:57.713996] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-07. [2025-10-15T19:35:58.495172] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-15T19:35:58.513993] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-03. [2025-10-15T19:35:59.314023] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-01. [2025-10-15T19:35:59.561756] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-15T19:36:00.114045] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-08. [2025-10-15T19:36:00.378061] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-15T19:36:00.587559] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-15T19:36:00.914045] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-04. [2025-10-15T19:36:01.714019] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-02. [2025-10-15T19:36:01.948108] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-15T19:36:02.513971] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-09. [2025-10-15T19:36:02.705174] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-15T19:36:03.185276] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-15T19:36:03.314000] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-01. [2025-10-15T19:36:04.113976] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-05. [2025-10-15T19:36:04.426407] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-15T19:36:04.455219] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-15T19:36:04.914016] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-10. [2025-10-15T19:36:05.664964] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-15T19:36:05.713947] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-06. [2025-10-15T19:36:06.513983] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-03. [2025-10-15T19:36:06.805509] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-10 (1.89 seconds). [2025-10-15T19:36:06.811958] [INFO ] [REMOTE ] INFY: Full fetch complete (77734 records). [2025-10-15T19:36:06.812077] [DEBUG] [VALIDATOR ] INFY: Validating primary data. [2025-10-15T19:36:07.201498] [DEBUG] [VALIDATOR ] INFY: All expected trading days are present. [2025-10-15T19:36:07.201606] [DEBUG] [VALIDATOR ] INFY: Primary data validation passed. [2025-10-15T19:36:07.202767] [INFO ] [MAIN ] INFY: Fetched primary data is valid. [2025-10-15T19:36:07.202872] [DEBUG] [LOCAL ] INFY: Saving primary data. [2025-10-15T19:36:07.204323] [DEBUG] [LOCAL ] INFY: Trimmed 77734 records to 53597 (keeping 200 days of data) [2025-10-15T19:36:07.320748] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-02. [2025-10-15T19:36:07.469024] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-15T19:36:07.570319] [DEBUG] [LOCAL ] INFY: Primary data saved (53597 records). [2025-10-15T19:36:07.570444] [INFO ] [MAIN ] INFY: Full history saved. [2025-10-15T19:36:07.570520] [INFO ] [MAIN ] Update Progress: 1108/2369 symbols completed. INFY took 31.6s. Estimated remaining: 2h 57m 36s. Rate: 7.1 symbols/min [2025-10-15T19:36:07.756056] [INFO ] [MAIN ] INN: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:36:07.777998] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-15T19:36:07.819348] [DEBUG] [LOCAL ] INN: Loaded 41782 existing records from primary storage. [2025-10-15T19:36:07.819615] [INFO ] [MAIN ] INN: Loaded 41782 existing records. [2025-10-15T19:36:07.990927] [WARN ] [MAIN ] INN: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:36:07.991112] [INFO ] [MAIN ] INN: Wiping existing primary data before full refresh. [2025-10-15T19:36:07.991157] [INFO ] [LOCAL ] INN: Starting deletion of primary data. [2025-10-15T19:36:07.991503] [DEBUG] [LOCAL ] INN: Deleted primary data file. [2025-10-15T19:36:07.991558] [INFO ] [MAIN ] INN: Starting full primary refresh. [2025-10-15T19:36:08.126466] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-07. [2025-10-15T19:36:08.341321] [INFO ] [REMOTE ] INN: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:36:08.552352] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-15T19:36:08.914055] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-03. [2025-10-15T19:36:09.713984] [INFO ] [REMOTE ] INN: Fetching primary data for 2024-12. [2025-10-15T19:36:09.953797] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-15T19:36:10.320133] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-15T19:36:10.514001] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-08. [2025-10-15T19:36:11.104615] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-15T19:36:11.313993] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-01. [2025-10-15T19:36:12.113961] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-04. [2025-10-15T19:36:12.158437] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-15T19:36:12.587061] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-15T19:36:12.914043] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-09. [2025-10-15T19:36:13.347480] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-15T19:36:13.713981] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-04. [2025-10-15T19:36:14.217249] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-15T19:36:14.514004] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-02. [2025-10-15T19:36:14.665127] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-15T19:36:15.314051] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-05. [2025-10-15T19:36:15.816595] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-15T19:36:16.114012] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-03. [2025-10-15T19:36:16.214936] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-15T19:36:16.914035] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-05. [2025-10-15T19:36:17.601415] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-15T19:36:17.713993] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-10. [2025-10-15T19:36:18.512041] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-15T19:36:18.518750] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-06. [2025-10-15T19:36:19.313969] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-06. [2025-10-15T19:36:19.414508] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-15T19:36:19.420806] [INFO ] [REMOTE ] ING: Full fetch complete (73797 records). [2025-10-15T19:36:19.420925] [DEBUG] [VALIDATOR ] ING: Validating primary data. [2025-10-15T19:36:19.832473] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-15T19:36:19.836154] [DEBUG] [VALIDATOR ] ING: All expected trading days are present. [2025-10-15T19:36:19.836229] [DEBUG] [VALIDATOR ] ING: Primary data validation passed. [2025-10-15T19:36:19.842507] [INFO ] [MAIN ] ING: Fetched primary data is valid. [2025-10-15T19:36:19.842838] [DEBUG] [LOCAL ] ING: Saving primary data. [2025-10-15T19:36:19.844491] [DEBUG] [LOCAL ] ING: Trimmed 73797 records to 50732 (keeping 200 days of data) [2025-10-15T19:36:20.117454] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-04. [2025-10-15T19:36:20.150315] [DEBUG] [LOCAL ] ING: Primary data saved (50732 records). [2025-10-15T19:36:20.150400] [INFO ] [MAIN ] ING: Full history saved. [2025-10-15T19:36:20.151453] [INFO ] [MAIN ] Update Progress: 1109/2369 symbols completed. ING took 31.5s. Estimated remaining: 2h 57m 32s. Rate: 7.1 symbols/min [2025-10-15T19:36:20.316121] [INFO ] [MAIN ] INR: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:36:20.316250] [DEBUG] [LOCAL ] INR: No existing data file found in primary storage. [2025-10-15T19:36:20.316286] [WARN ] [MAIN ] INR: No existing data found, performing full refresh instead. [2025-10-15T19:36:20.316391] [INFO ] [MAIN ] INR: Wiping existing primary data before full refresh. [2025-10-15T19:36:20.316431] [INFO ] [LOCAL ] INR: Starting deletion of primary data. [2025-10-15T19:36:20.316471] [DEBUG] [LOCAL ] INR: No primary data file found to delete. [2025-10-15T19:36:20.316502] [INFO ] [MAIN ] INR: Starting full primary refresh. [2025-10-15T19:36:20.662903] [INFO ] [REMOTE ] INR: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:36:20.689571] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-15T19:36:20.913971] [INFO ] [REMOTE ] INR: Fetching primary data for 2024-12. [2025-10-15T19:36:21.107944] [DEBUG] [REMOTE ] INR: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-15T19:36:21.108283] [WARN ] [REMOTE ] INR: No data returned for month 2024-12 [2025-10-15T19:36:21.108367] [FATAL] [REMOTE ] INR: API call failed - aborting fetch to avoid wasting further API calls [2025-10-15T19:36:21.108417] [FATAL] [MAIN ] INR: Failed to fetch primary data. [2025-10-15T19:36:21.108478] [WARN ] [MAIN ] INR: Deleting existing primary and derivative data due to fetch failure. [2025-10-15T19:36:21.108547] [INFO ] [LOCAL ] INR: Starting deletion of primary data. [2025-10-15T19:36:21.108607] [DEBUG] [LOCAL ] INR: No primary data file found to delete. [2025-10-15T19:36:21.108663] [INFO ] [LOCAL ] INR: Starting deletion of derivative data. [2025-10-15T19:36:21.108730] [DEBUG] [LOCAL ] INR: No derivative data file found to delete. [2025-10-15T19:36:21.108777] [INFO ] [MAIN ] Update Progress: 1110/2369 symbols completed. INR took 1.0s. Estimated remaining: 2h 57m 15s. Rate: 7.1 symbols/min [2025-10-15T19:36:21.276455] [INFO ] [MAIN ] INSP: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:36:21.316132] [DEBUG] [LOCAL ] INSP: Loaded 38215 existing records from primary storage. [2025-10-15T19:36:21.316389] [INFO ] [MAIN ] INSP: Loaded 38215 existing records. [2025-10-15T19:36:21.491369] [WARN ] [MAIN ] INSP: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:36:21.491580] [INFO ] [MAIN ] INSP: Wiping existing primary data before full refresh. [2025-10-15T19:36:21.491677] [INFO ] [LOCAL ] INSP: Starting deletion of primary data. [2025-10-15T19:36:21.492468] [DEBUG] [LOCAL ] INSP: Deleted primary data file. [2025-10-15T19:36:21.492525] [INFO ] [MAIN ] INSP: Starting full primary refresh. [2025-10-15T19:36:21.687867] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-15T19:36:21.717024] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-07. [2025-10-15T19:36:21.910891] [INFO ] [REMOTE ] INSP: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:36:22.513998] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-07. [2025-10-15T19:36:23.147170] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-15T19:36:23.313999] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-08. [2025-10-15T19:36:23.736523] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-15T19:36:24.113996] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-08. [2025-10-15T19:36:24.690714] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-15T19:36:24.913968] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-05. [2025-10-15T19:36:25.400697] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-15T19:36:25.714042] [INFO ] [REMOTE ] INSP: Fetching primary data for 2024-12. [2025-10-15T19:36:26.458286] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-15T19:36:26.513957] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-06. [2025-10-15T19:36:26.990502] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-15T19:36:27.313990] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-01. [2025-10-15T19:36:28.112072] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-15T19:36:28.120902] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-09. [2025-10-15T19:36:28.373174] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-15T19:36:28.913968] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-02. [2025-10-15T19:36:29.029901] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-15T19:36:29.714065] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-10. [2025-10-15T19:36:30.366418] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-15T19:36:30.514013] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-09. [2025-10-15T19:36:30.907088] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-15T19:36:30.911750] [INFO ] [REMOTE ] INGM: Full fetch complete (42000 records). [2025-10-15T19:36:30.911895] [DEBUG] [VALIDATOR ] INGM: Validating primary data. [2025-10-15T19:36:31.319198] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-07. [2025-10-15T19:36:31.321137] [DEBUG] [VALIDATOR ] INGM: All expected trading days are present. [2025-10-15T19:36:31.321267] [DEBUG] [VALIDATOR ] INGM: Primary data validation passed. [2025-10-15T19:36:31.323185] [INFO ] [MAIN ] INGM: Fetched primary data is valid. [2025-10-15T19:36:31.323370] [DEBUG] [LOCAL ] INGM: Saving primary data. [2025-10-15T19:36:31.324805] [DEBUG] [LOCAL ] INGM: Trimmed 42000 records to 28330 (keeping 200 days of data) [2025-10-15T19:36:31.509058] [DEBUG] [LOCAL ] INGM: Primary data saved (28330 records). [2025-10-15T19:36:31.509287] [INFO ] [MAIN ] INGM: Full history saved. [2025-10-15T19:36:31.509525] [INFO ] [MAIN ] Update Progress: 1111/2369 symbols completed. INGM took 38.7s. Estimated remaining: 2h 57m 9s. Rate: 7.1 symbols/min [2025-10-15T19:36:31.708261] [INFO ] [MAIN ] INSW: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:36:31.755352] [DEBUG] [LOCAL ] INSW: Loaded 39628 existing records from primary storage. [2025-10-15T19:36:31.755828] [INFO ] [MAIN ] INSW: Loaded 39628 existing records. [2025-10-15T19:36:31.956195] [WARN ] [MAIN ] INSW: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:36:31.956532] [INFO ] [MAIN ] INSW: Wiping existing primary data before full refresh. [2025-10-15T19:36:31.956675] [INFO ] [LOCAL ] INSW: Starting deletion of primary data. [2025-10-15T19:36:31.957075] [DEBUG] [LOCAL ] INSW: Deleted primary data file. [2025-10-15T19:36:31.957137] [INFO ] [MAIN ] INSW: Starting full primary refresh. [2025-10-15T19:36:32.131446] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-03. [2025-10-15T19:36:32.321731] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-15T19:36:32.341497] [INFO ] [REMOTE ] INSW: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:36:32.864953] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-15T19:36:32.913960] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-08. [2025-10-15T19:36:33.674697] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-15T19:36:33.713961] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-04. [2025-10-15T19:36:34.152471] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-15T19:36:34.514006] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-09. [2025-10-15T19:36:35.101151] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-15T19:36:35.313959] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-10. [2025-10-15T19:36:35.454686] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-15T19:36:36.113993] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-05. [2025-10-15T19:36:36.833938] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-15T19:36:36.838843] [INFO ] [REMOTE ] INGR: Full fetch complete (50622 records). [2025-10-15T19:36:36.838975] [DEBUG] [VALIDATOR ] INGR: Validating primary data. [2025-10-15T19:36:36.919090] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-10. [2025-10-15T19:36:37.242261] [DEBUG] [VALIDATOR ] INGR: All expected trading days are present. [2025-10-15T19:36:37.242359] [DEBUG] [VALIDATOR ] INGR: Primary data validation passed. [2025-10-15T19:36:37.243365] [INFO ] [MAIN ] INGR: Fetched primary data is valid. [2025-10-15T19:36:37.243432] [DEBUG] [LOCAL ] INGR: Saving primary data. [2025-10-15T19:36:37.244626] [DEBUG] [LOCAL ] INGR: Trimmed 50622 records to 33816 (keeping 200 days of data) [2025-10-15T19:36:37.453904] [DEBUG] [LOCAL ] INGR: Primary data saved (33816 records). [2025-10-15T19:36:37.454102] [INFO ] [MAIN ] INGR: Full history saved. [2025-10-15T19:36:37.454521] [INFO ] [MAIN ] Update Progress: 1112/2369 symbols completed. INGR took 42.3s. Estimated remaining: 2h 56m 58s. Rate: 7.1 symbols/min [2025-10-15T19:36:37.640437] [INFO ] [MAIN ] INVH: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:36:37.661292] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-15T19:36:37.716373] [INFO ] [REMOTE ] INSW: Fetching primary data for 2024-12. [2025-10-15T19:36:37.718668] [DEBUG] [LOCAL ] INVH: Loaded 53185 existing records from primary storage. [2025-10-15T19:36:37.719016] [INFO ] [MAIN ] INVH: Loaded 53185 existing records. [2025-10-15T19:36:37.907334] [WARN ] [MAIN ] INVH: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:36:37.907495] [INFO ] [MAIN ] INVH: Wiping existing primary data before full refresh. [2025-10-15T19:36:37.907544] [INFO ] [LOCAL ] INVH: Starting deletion of primary data. [2025-10-15T19:36:37.908110] [DEBUG] [LOCAL ] INVH: Deleted primary data file. [2025-10-15T19:36:37.908169] [INFO ] [MAIN ] INVH: Starting full primary refresh. [2025-10-15T19:36:38.283164] [INFO ] [REMOTE ] INVH: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:36:38.374943] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-15T19:36:38.379593] [INFO ] [REMOTE ] INN: Full fetch complete (57796 records). [2025-10-15T19:36:38.379712] [DEBUG] [VALIDATOR ] INN: Validating primary data. [2025-10-15T19:36:38.519119] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-06. [2025-10-15T19:36:38.789429] [DEBUG] [VALIDATOR ] INN: All expected trading days are present. [2025-10-15T19:36:38.789529] [DEBUG] [VALIDATOR ] INN: Primary data validation passed. [2025-10-15T19:36:38.790464] [INFO ] [MAIN ] INN: Fetched primary data is valid. [2025-10-15T19:36:38.790536] [DEBUG] [LOCAL ] INN: Saving primary data. [2025-10-15T19:36:38.791910] [DEBUG] [LOCAL ] INN: Trimmed 57796 records to 41819 (keeping 200 days of data) [2025-10-15T19:36:39.032053] [DEBUG] [LOCAL ] INN: Primary data saved (41819 records). [2025-10-15T19:36:39.032169] [INFO ] [MAIN ] INN: Full history saved. [2025-10-15T19:36:39.032244] [INFO ] [MAIN ] Update Progress: 1113/2369 symbols completed. INN took 31.5s. Estimated remaining: 2h 56m 42s. Rate: 7.1 symbols/min [2025-10-15T19:36:39.204117] [INFO ] [MAIN ] INVX: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:36:39.231508] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-15T19:36:39.264963] [DEBUG] [LOCAL ] INVX: Loaded 29342 existing records from primary storage. [2025-10-15T19:36:39.265232] [INFO ] [MAIN ] INVX: Loaded 29342 existing records. [2025-10-15T19:36:39.326154] [INFO ] [REMOTE ] INVH: Fetching primary data for 2024-12. [2025-10-15T19:36:39.441931] [WARN ] [MAIN ] INVX: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:36:39.442253] [INFO ] [MAIN ] INVX: Wiping existing primary data before full refresh. [2025-10-15T19:36:39.442363] [INFO ] [LOCAL ] INVX: Starting deletion of primary data. [2025-10-15T19:36:39.442612] [DEBUG] [LOCAL ] INVX: Deleted primary data file. [2025-10-15T19:36:39.442709] [INFO ] [MAIN ] INVX: Starting full primary refresh. [2025-10-15T19:36:39.711511] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-15T19:36:39.820764] [INFO ] [REMOTE ] INVX: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:36:40.114046] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-07. [2025-10-15T19:36:40.822931] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-15T19:36:40.913965] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-01. [2025-10-15T19:36:41.582715] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-15T19:36:41.714045] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-01. [2025-10-15T19:36:42.498767] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-15T19:36:42.513956] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-02. [2025-10-15T19:36:43.240251] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-15T19:36:43.313958] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-02. [2025-10-15T19:36:44.109827] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-15T19:36:44.117744] [INFO ] [REMOTE ] INVX: Fetching primary data for 2024-12. [2025-10-15T19:36:44.552149] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-15T19:36:44.913999] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-08. [2025-10-15T19:36:45.377846] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-15T19:36:45.713997] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-03. [2025-10-15T19:36:46.514111] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-03. [2025-10-15T19:36:46.800259] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-15T19:36:47.314112] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-01. [2025-10-15T19:36:47.387571] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-15T19:36:48.114013] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-04. [2025-10-15T19:36:48.303660] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-15T19:36:48.448678] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-15T19:36:48.914013] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-04. [2025-10-15T19:36:49.704480] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-15T19:36:49.714095] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-05. [2025-10-15T19:36:50.408948] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-15T19:36:50.513971] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-05. [2025-10-15T19:36:51.231391] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-15T19:36:51.313978] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-06. [2025-10-15T19:36:51.879366] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-15T19:36:52.114029] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-02. [2025-10-15T19:36:52.893888] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-15T19:36:52.913951] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-07. [2025-10-15T19:36:52.961106] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-15T19:36:53.713994] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-06. [2025-10-15T19:36:54.460793] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-15T19:36:54.513985] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-08. [2025-10-15T19:36:55.314009] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-09. [2025-10-15T19:36:55.462411] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-15T19:36:55.786417] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-15T19:36:56.113990] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-03. [2025-10-15T19:36:56.914020] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-07. [2025-10-15T19:36:56.984477] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-15T19:36:57.051412] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-15T19:36:57.714065] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-04. [2025-10-15T19:36:58.325305] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-15T19:36:58.514028] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-10. [2025-10-15T19:36:59.118170] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-15T19:36:59.314025] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-09. [2025-10-15T19:37:00.113621] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-15T19:37:00.118451] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-05. [2025-10-15T19:37:00.119863] [INFO ] [REMOTE ] INSP: Full fetch complete (53637 records). [2025-10-15T19:37:00.119937] [DEBUG] [VALIDATOR ] INSP: Validating primary data. [2025-10-15T19:37:00.506462] [DEBUG] [VALIDATOR ] INSP: All expected trading days are present. [2025-10-15T19:37:00.506563] [DEBUG] [VALIDATOR ] INSP: Primary data validation passed. [2025-10-15T19:37:00.507561] [INFO ] [MAIN ] INSP: Fetched primary data is valid. [2025-10-15T19:37:00.507683] [DEBUG] [LOCAL ] INSP: Saving primary data. [2025-10-15T19:37:00.509084] [DEBUG] [LOCAL ] INSP: Trimmed 53637 records to 38333 (keeping 200 days of data) [2025-10-15T19:37:00.530732] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-15T19:37:00.763270] [DEBUG] [LOCAL ] INSP: Primary data saved (38333 records). [2025-10-15T19:37:00.763401] [INFO ] [MAIN ] INSP: Full history saved. [2025-10-15T19:37:00.763480] [INFO ] [MAIN ] Update Progress: 1114/2369 symbols completed. INSP took 39.7s. Estimated remaining: 2h 56m 48s. Rate: 7.1 symbols/min [2025-10-15T19:37:00.916157] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-08. [2025-10-15T19:37:00.936545] [INFO ] [MAIN ] IONQ: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:37:00.990266] [DEBUG] [LOCAL ] IONQ: Loaded 53788 existing records from primary storage. [2025-10-15T19:37:00.990610] [INFO ] [MAIN ] IONQ: Loaded 53788 existing records. [2025-10-15T19:37:01.203116] [WARN ] [MAIN ] IONQ: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:37:01.203545] [INFO ] [MAIN ] IONQ: Wiping existing primary data before full refresh. [2025-10-15T19:37:01.203673] [INFO ] [LOCAL ] IONQ: Starting deletion of primary data. [2025-10-15T19:37:01.204761] [DEBUG] [LOCAL ] IONQ: Deleted primary data file. [2025-10-15T19:37:01.204821] [INFO ] [MAIN ] IONQ: Starting full primary refresh. [2025-10-15T19:37:01.607814] [INFO ] [REMOTE ] IONQ: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:37:01.601967] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-15T19:37:01.714044] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-06. [2025-10-15T19:37:02.513979] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2024-12. [2025-10-15T19:37:02.723540] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-15T19:37:02.752601] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-15T19:37:03.313991] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-07. [2025-10-15T19:37:04.114000] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-09. [2025-10-15T19:37:04.624536] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-15T19:37:04.835864] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2024-12 (2.32 seconds). [2025-10-15T19:37:04.914023] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-08. [2025-10-15T19:37:05.713987] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-10. [2025-10-15T19:37:05.866385] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-15T19:37:06.169798] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-15T19:37:06.513996] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-09. [2025-10-15T19:37:06.840154] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-15T19:37:06.844932] [INFO ] [REMOTE ] INSW: Full fetch complete (59996 records). [2025-10-15T19:37:06.845045] [DEBUG] [VALIDATOR ] INSW: Validating primary data. [2025-10-15T19:37:07.216956] [DEBUG] [VALIDATOR ] INSW: All expected trading days are present. [2025-10-15T19:37:07.217043] [DEBUG] [VALIDATOR ] INSW: Primary data validation passed. [2025-10-15T19:37:07.217963] [INFO ] [MAIN ] INSW: Fetched primary data is valid. [2025-10-15T19:37:07.218027] [DEBUG] [LOCAL ] INSW: Saving primary data. [2025-10-15T19:37:07.219265] [DEBUG] [LOCAL ] INSW: Trimmed 59996 records to 39595 (keeping 200 days of data) [2025-10-15T19:37:07.313999] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-10. [2025-10-15T19:37:07.475054] [DEBUG] [LOCAL ] INSW: Primary data saved (39595 records). [2025-10-15T19:37:07.475206] [INFO ] [MAIN ] INSW: Full history saved. [2025-10-15T19:37:07.475314] [INFO ] [MAIN ] Update Progress: 1115/2369 symbols completed. INSW took 36.0s. Estimated remaining: 2h 56m 38s. Rate: 7.1 symbols/min [2025-10-15T19:37:07.642836] [INFO ] [MAIN ] IOT: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:37:07.687616] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-15T19:37:07.717344] [DEBUG] [LOCAL ] IOT: Loaded 53480 existing records from primary storage. [2025-10-15T19:37:07.717728] [INFO ] [MAIN ] IOT: Loaded 53480 existing records. [2025-10-15T19:37:07.889921] [WARN ] [MAIN ] IOT: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:37:07.890112] [INFO ] [MAIN ] IOT: Wiping existing primary data before full refresh. [2025-10-15T19:37:07.890158] [INFO ] [LOCAL ] IOT: Starting deletion of primary data. [2025-10-15T19:37:07.890674] [DEBUG] [LOCAL ] IOT: Deleted primary data file. [2025-10-15T19:37:07.890732] [INFO ] [MAIN ] IOT: Starting full primary refresh. [2025-10-15T19:37:08.121698] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-10. [2025-10-15T19:37:08.235875] [INFO ] [REMOTE ] IOT: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:37:08.913984] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-01. [2025-10-15T19:37:09.212126] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-15T19:37:09.218637] [INFO ] [REMOTE ] INVH: Full fetch complete (76940 records). [2025-10-15T19:37:09.218830] [DEBUG] [VALIDATOR ] INVH: Validating primary data. [2025-10-15T19:37:09.585482] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-15T19:37:09.631018] [DEBUG] [VALIDATOR ] INVH: All expected trading days are present. [2025-10-15T19:37:09.631111] [DEBUG] [VALIDATOR ] INVH: Primary data validation passed. [2025-10-15T19:37:09.632343] [INFO ] [MAIN ] INVH: Fetched primary data is valid. [2025-10-15T19:37:09.632551] [DEBUG] [LOCAL ] INVH: Saving primary data. [2025-10-15T19:37:09.632478] [INFO ] [REMOTE ] INVX: Full fetch complete (43359 records). [2025-10-15T19:37:09.632712] [DEBUG] [VALIDATOR ] INVX: Validating primary data. [2025-10-15T19:37:09.720627] [INFO ] [REMOTE ] IOT: Fetching primary data for 2024-12. [2025-10-15T19:37:09.738501] [DEBUG] [LOCAL ] INVH: Trimmed 76940 records to 53197 (keeping 200 days of data) [2025-10-15T19:37:10.118256] [DEBUG] [VALIDATOR ] INVX: All expected trading days are present. [2025-10-15T19:37:10.118959] [DEBUG] [VALIDATOR ] INVX: Primary data validation passed. [2025-10-15T19:37:10.119916] [INFO ] [MAIN ] INVX: Fetched primary data is valid. [2025-10-15T19:37:10.120255] [DEBUG] [LOCAL ] INVX: Saving primary data. [2025-10-15T19:37:10.123691] [DEBUG] [LOCAL ] INVX: Trimmed 43359 records to 29342 (keeping 200 days of data) [2025-10-15T19:37:10.314905] [DEBUG] [LOCAL ] INVX: Primary data saved (29342 records). [2025-10-15T19:37:10.315093] [INFO ] [MAIN ] INVX: Full history saved. [2025-10-15T19:37:10.315187] [INFO ] [MAIN ] Update Progress: 1116/2369 symbols completed. INVX took 31.3s. Estimated remaining: 2h 56m 23s. Rate: 7.1 symbols/min [2025-10-15T19:37:10.586445] [INFO ] [MAIN ] IP: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:37:10.710518] [DEBUG] [LOCAL ] IP: Loaded 53311 existing records from primary storage. [2025-10-15T19:37:10.712575] [INFO ] [MAIN ] IP: Loaded 53311 existing records. [2025-10-15T19:37:10.903400] [WARN ] [MAIN ] IP: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:37:10.906974] [INFO ] [MAIN ] IP: Wiping existing primary data before full refresh. [2025-10-15T19:37:10.907346] [INFO ] [LOCAL ] IP: Starting deletion of primary data. [2025-10-15T19:37:10.908752] [DEBUG] [LOCAL ] IP: Deleted primary data file. [2025-10-15T19:37:10.909596] [INFO ] [MAIN ] IP: Starting full primary refresh. [2025-10-15T19:37:11.017152] [DEBUG] [LOCAL ] INVH: Primary data saved (53197 records). [2025-10-15T19:37:11.027938] [INFO ] [MAIN ] INVH: Full history saved. [2025-10-15T19:37:11.061388] [INFO ] [MAIN ] Update Progress: 1117/2369 symbols completed. INVH took 33.6s. Estimated remaining: 2h 56m 6s. Rate: 7.1 symbols/min [2025-10-15T19:37:11.280312] [INFO ] [REMOTE ] IP: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:37:11.280744] [INFO ] [REMOTE ] IP: Fetching primary data for 2024-12. [2025-10-15T19:37:11.482596] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-01 (2.57 seconds). [2025-10-15T19:37:11.493878] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-02. [2025-10-15T19:37:11.559264] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-15T19:37:12.113997] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-01. [2025-10-15T19:37:13.230350] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-10-15T19:37:13.241105] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-01. [2025-10-15T19:37:13.928995] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-15T19:37:13.940296] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-02. [2025-10-15T19:37:13.968757] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-02 (2.47 seconds). [2025-10-15T19:37:14.514058] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-03. [2025-10-15T19:37:14.968819] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-15T19:37:15.314008] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-02. [2025-10-15T19:37:15.755318] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-15T19:37:16.113995] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-03. [2025-10-15T19:37:16.915181] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-03 (2.40 seconds). [2025-10-15T19:37:16.926971] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-04. [2025-10-15T19:37:16.989392] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-15T19:37:17.723724] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-03. [2025-10-15T19:37:17.726897] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-15T19:37:18.514046] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-04. [2025-10-15T19:37:19.600556] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-04 (2.67 seconds). [2025-10-15T19:37:19.612401] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-05. [2025-10-15T19:37:19.674534] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-15T19:37:20.114058] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-04. [2025-10-15T19:37:20.377596] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-15T19:37:20.914052] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-05. [2025-10-15T19:37:21.933086] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-15T19:37:21.944563] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-05. [2025-10-15T19:37:22.021511] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-05 (2.41 seconds). [2025-10-15T19:37:22.514020] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-06. [2025-10-15T19:37:22.681733] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-15T19:37:23.313978] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-06. [2025-10-15T19:37:23.692355] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-15T19:37:24.113993] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-06. [2025-10-15T19:37:25.007115] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-06 (2.49 seconds). [2025-10-15T19:37:25.018454] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-07. [2025-10-15T19:37:25.062170] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-15T19:37:25.713958] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-07. [2025-10-15T19:37:25.842809] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-15T19:37:26.514104] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-07. [2025-10-15T19:37:27.659805] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-15T19:37:27.671924] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-08. [2025-10-15T19:37:27.746913] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-07 (2.73 seconds). [2025-10-15T19:37:28.113962] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-08. [2025-10-15T19:37:28.376152] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-15T19:37:28.914048] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-08. [2025-10-15T19:37:29.647565] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-10-15T19:37:29.713971] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-09. [2025-10-15T19:37:30.290288] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-15T19:37:30.513970] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-09. [2025-10-15T19:37:30.806685] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-08 (2.69 seconds). [2025-10-15T19:37:31.314049] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-09. [2025-10-15T19:37:31.747065] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-10-15T19:37:32.071885] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-15T19:37:32.113952] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-10. [2025-10-15T19:37:32.913993] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-10. [2025-10-15T19:37:33.958881] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-15T19:37:33.965674] [INFO ] [REMOTE ] IP: Full fetch complete (77370 records). [2025-10-15T19:37:33.965896] [DEBUG] [VALIDATOR ] IP: Validating primary data. [2025-10-15T19:37:34.149224] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-09 (2.84 seconds). [2025-10-15T19:37:34.244803] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-10. [2025-10-15T19:37:34.411958] [DEBUG] [VALIDATOR ] IP: All expected trading days are present. [2025-10-15T19:37:34.412163] [DEBUG] [VALIDATOR ] IP: Primary data validation passed. [2025-10-15T19:37:34.413229] [INFO ] [MAIN ] IP: Fetched primary data is valid. [2025-10-15T19:37:34.413354] [DEBUG] [LOCAL ] IP: Saving primary data. [2025-10-15T19:37:34.415233] [DEBUG] [LOCAL ] IP: Trimmed 77370 records to 53307 (keeping 200 days of data) [2025-10-15T19:37:34.524280] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-15T19:37:34.535885] [INFO ] [REMOTE ] IOT: Full fetch complete (77550 records). [2025-10-15T19:37:34.537967] [DEBUG] [VALIDATOR ] IOT: Validating primary data. [2025-10-15T19:37:35.064673] [DEBUG] [VALIDATOR ] IOT: All expected trading days are present. [2025-10-15T19:37:35.065348] [DEBUG] [VALIDATOR ] IOT: Primary data validation passed. [2025-10-15T19:37:35.067073] [INFO ] [MAIN ] IOT: Fetched primary data is valid. [2025-10-15T19:37:35.067151] [DEBUG] [LOCAL ] IOT: Saving primary data. [2025-10-15T19:37:35.074054] [DEBUG] [LOCAL ] IOT: Trimmed 77550 records to 53480 (keeping 200 days of data) [2025-10-15T19:37:35.414005] [DEBUG] [LOCAL ] IP: Primary data saved (53307 records). [2025-10-15T19:37:35.415223] [INFO ] [MAIN ] IP: Full history saved. [2025-10-15T19:37:35.416851] [INFO ] [MAIN ] Update Progress: 1118/2369 symbols completed. IP took 25.1s. Estimated remaining: 2h 56m 15s. Rate: 7.1 symbols/min [2025-10-15T19:37:35.499639] [DEBUG] [LOCAL ] IOT: Primary data saved (53480 records). [2025-10-15T19:37:35.499820] [INFO ] [MAIN ] IOT: Full history saved. [2025-10-15T19:37:35.499902] [INFO ] [MAIN ] Update Progress: 1119/2369 symbols completed. IOT took 28.0s. Estimated remaining: 2h 55m 57s. Rate: 7.1 symbols/min [2025-10-15T19:37:37.236145] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-10 (2.99 seconds). [2025-10-15T19:37:37.243265] [INFO ] [REMOTE ] IONQ: Full fetch complete (77968 records). [2025-10-15T19:37:37.243460] [DEBUG] [VALIDATOR ] IONQ: Validating primary data. [2025-10-15T19:37:37.639818] [DEBUG] [VALIDATOR ] IONQ: All expected trading days are present. [2025-10-15T19:37:37.639894] [DEBUG] [VALIDATOR ] IONQ: Primary data validation passed. [2025-10-15T19:37:37.640992] [INFO ] [MAIN ] IONQ: Fetched primary data is valid. [2025-10-15T19:37:37.641059] [DEBUG] [LOCAL ] IONQ: Saving primary data. [2025-10-15T19:37:37.642530] [DEBUG] [LOCAL ] IONQ: Trimmed 77968 records to 53788 (keeping 200 days of data) [2025-10-15T19:37:37.960209] [DEBUG] [LOCAL ] IONQ: Primary data saved (53788 records). [2025-10-15T19:37:37.960338] [INFO ] [MAIN ] IONQ: Full history saved. [2025-10-15T19:37:37.961175] [INFO ] [MAIN ] Update Progress: 1120/2369 symbols completed. IONQ took 37.2s. Estimated remaining: 2h 55m 42s. Rate: 7.1 symbols/min [2025-10-15T19:37:38.575320] [INFO ] [MAIN ] IQV: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:37:38.708526] [INFO ] [MAIN ] IPI: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:37:38.707215] [INFO ] [MAIN ] IPG: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:37:38.710172] [INFO ] [MAIN ] IQI: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:37:38.741336] [DEBUG] [LOCAL ] IQI: Loaded 17823 existing records from primary storage. [2025-10-15T19:37:38.741977] [INFO ] [MAIN ] IQI: Loaded 17823 existing records. [2025-10-15T19:37:38.846452] [DEBUG] [LOCAL ] IPI: Loaded 21301 existing records from primary storage. [2025-10-15T19:37:38.893728] [INFO ] [MAIN ] IPI: Loaded 21301 existing records. [2025-10-15T19:37:39.107871] [DEBUG] [LOCAL ] IPG: Loaded 53331 existing records from primary storage. [2025-10-15T19:37:39.151931] [DEBUG] [LOCAL ] IQV: Loaded 50084 existing records from primary storage. [2025-10-15T19:37:39.171067] [INFO ] [MAIN ] IQV: Loaded 50084 existing records. [2025-10-15T19:37:39.204210] [WARN ] [MAIN ] IQI: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:37:39.165253] [INFO ] [MAIN ] IPG: Loaded 53331 existing records. [2025-10-15T19:37:39.204733] [INFO ] [MAIN ] IQI: Wiping existing primary data before full refresh. [2025-10-15T19:37:39.238180] [INFO ] [LOCAL ] IQI: Starting deletion of primary data. [2025-10-15T19:37:39.290041] [DEBUG] [LOCAL ] IQI: Deleted primary data file. [2025-10-15T19:37:39.312470] [INFO ] [MAIN ] IQI: Starting full primary refresh. [2025-10-15T19:37:39.810547] [WARN ] [MAIN ] IPI: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:37:39.970343] [WARN ] [MAIN ] IPG: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:37:39.956622] [INFO ] [MAIN ] IPI: Wiping existing primary data before full refresh. [2025-10-15T19:37:39.991213] [INFO ] [LOCAL ] IPI: Starting deletion of primary data. [2025-10-15T19:37:40.029324] [INFO ] [MAIN ] IPG: Wiping existing primary data before full refresh. [2025-10-15T19:37:40.050148] [INFO ] [LOCAL ] IPG: Starting deletion of primary data. [2025-10-15T19:37:40.044047] [DEBUG] [LOCAL ] IPI: Deleted primary data file. [2025-10-15T19:37:40.067977] [DEBUG] [LOCAL ] IPG: Deleted primary data file. [2025-10-15T19:37:40.074499] [INFO ] [MAIN ] IPG: Starting full primary refresh. [2025-10-15T19:37:40.077941] [WARN ] [MAIN ] IQV: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:37:40.074452] [INFO ] [MAIN ] IPI: Starting full primary refresh. [2025-10-15T19:37:40.086680] [INFO ] [MAIN ] IQV: Wiping existing primary data before full refresh. [2025-10-15T19:37:40.099252] [INFO ] [LOCAL ] IQV: Starting deletion of primary data. [2025-10-15T19:37:40.264305] [DEBUG] [LOCAL ] IQV: Deleted primary data file. [2025-10-15T19:37:40.298736] [INFO ] [MAIN ] IQV: Starting full primary refresh. [2025-10-15T19:37:40.905698] [INFO ] [REMOTE ] IQI: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:37:41.004772] [INFO ] [REMOTE ] IQI: Fetching primary data for 2024-12. [2025-10-15T19:37:41.256891] [INFO ] [REMOTE ] IPI: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:37:41.279212] [INFO ] [REMOTE ] IPI: Fetching primary data for 2024-12. [2025-10-15T19:37:41.329884] [INFO ] [REMOTE ] IPG: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:37:41.344244] [INFO ] [REMOTE ] IPG: Fetching primary data for 2024-12. [2025-10-15T19:37:41.435384] [INFO ] [REMOTE ] IQV: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:37:41.435677] [INFO ] [REMOTE ] IQV: Fetching primary data for 2024-12. [2025-10-15T19:37:42.111734] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-15T19:37:42.116737] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-01. [2025-10-15T19:37:42.140884] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-10-15T19:37:42.144847] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-01. [2025-10-15T19:37:42.916048] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-15T19:37:42.919869] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-02. [2025-10-15T19:37:43.131877] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-15T19:37:43.136638] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-02. [2025-10-15T19:37:43.312887] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-10-15T19:37:43.323898] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-01. [2025-10-15T19:37:43.426434] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-10-15T19:37:43.436492] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-01. [2025-10-15T19:37:43.766137] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-15T19:37:43.771082] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-03. [2025-10-15T19:37:43.957042] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-15T19:37:43.961173] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-03. [2025-10-15T19:37:44.401720] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-15T19:37:44.405596] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-04. [2025-10-15T19:37:44.617371] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-15T19:37:44.791312] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-15T19:37:44.913988] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-04. [2025-10-15T19:37:45.097406] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-15T19:37:45.168741] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-15T19:37:45.713980] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-05. [2025-10-15T19:37:45.970001] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-15T19:37:46.513956] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-02. [2025-10-15T19:37:46.745738] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-15T19:37:47.314057] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-02. [2025-10-15T19:37:47.837167] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-15T19:37:48.114020] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-03. [2025-10-15T19:37:48.643574] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-15T19:37:48.914035] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-06. [2025-10-15T19:37:49.713965] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-05. [2025-10-15T19:37:49.744044] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-15T19:37:49.837302] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-15T19:37:50.513975] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-04. [2025-10-15T19:37:50.881910] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-15T19:37:51.314083] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-07. [2025-10-15T19:37:52.076282] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-15T19:37:52.113961] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-08. [2025-10-15T19:37:52.271836] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-15T19:37:52.913969] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-06. [2025-10-15T19:37:53.139023] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-15T19:37:53.713972] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-03. [2025-10-15T19:37:53.901899] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-15T19:37:54.514047] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-05. [2025-10-15T19:37:55.127705] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-15T19:37:55.313983] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-04. [2025-10-15T19:37:56.114031] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-09. [2025-10-15T19:37:56.319699] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-15T19:37:56.913971] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-07. [2025-10-15T19:37:57.025087] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-15T19:37:57.126771] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-15T19:37:57.607015] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-15T19:37:57.713985] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-06. [2025-10-15T19:37:58.513995] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-08. [2025-10-15T19:37:59.320733] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-10. [2025-10-15T19:37:59.341827] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-15T19:37:59.534486] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-15T19:38:00.113994] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-09. [2025-10-15T19:38:00.455487] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-15T19:38:00.457858] [INFO ] [REMOTE ] IQI: Full fetch complete (26607 records). [2025-10-15T19:38:00.457932] [DEBUG] [VALIDATOR ] IQI: Validating primary data. [2025-10-15T19:38:00.841021] [DEBUG] [VALIDATOR ] IQI: All expected trading days are present. [2025-10-15T19:38:00.841099] [DEBUG] [VALIDATOR ] IQI: Primary data validation passed. [2025-10-15T19:38:00.841738] [INFO ] [MAIN ] IQI: Fetched primary data is valid. [2025-10-15T19:38:00.841801] [DEBUG] [LOCAL ] IQI: Saving primary data. [2025-10-15T19:38:00.842461] [DEBUG] [LOCAL ] IQI: Trimmed 26607 records to 17837 (keeping 200 days of data) [2025-10-15T19:38:00.921577] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-07. [2025-10-15T19:38:00.954546] [DEBUG] [LOCAL ] IQI: Primary data saved (17837 records). [2025-10-15T19:38:00.954719] [INFO ] [MAIN ] IQI: Full history saved. [2025-10-15T19:38:00.954814] [INFO ] [MAIN ] Update Progress: 1121/2369 symbols completed. IQI took 23.0s. Estimated remaining: 2h 55m 50s. Rate: 7.1 symbols/min [2025-10-15T19:38:01.133632] [INFO ] [MAIN ] IR: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:38:01.192335] [DEBUG] [LOCAL ] IR: Loaded 52781 existing records from primary storage. [2025-10-15T19:38:01.192733] [INFO ] [MAIN ] IR: Loaded 52781 existing records. [2025-10-15T19:38:01.392595] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-15T19:38:01.396864] [WARN ] [MAIN ] IR: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:38:01.402178] [INFO ] [MAIN ] IR: Wiping existing primary data before full refresh. [2025-10-15T19:38:01.402245] [INFO ] [LOCAL ] IR: Starting deletion of primary data. [2025-10-15T19:38:01.403498] [DEBUG] [LOCAL ] IR: Deleted primary data file. [2025-10-15T19:38:01.403563] [INFO ] [MAIN ] IR: Starting full primary refresh. [2025-10-15T19:38:01.722464] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-05. [2025-10-15T19:38:01.762374] [INFO ] [REMOTE ] IR: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:38:02.513974] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-10. [2025-10-15T19:38:02.796754] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-15T19:38:03.080990] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-15T19:38:03.314024] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-08. [2025-10-15T19:38:03.525382] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-15T19:38:03.528610] [INFO ] [REMOTE ] IPI: Full fetch complete (29916 records). [2025-10-15T19:38:03.528715] [DEBUG] [VALIDATOR ] IPI: Validating primary data. [2025-10-15T19:38:03.905717] [DEBUG] [VALIDATOR ] IPI: All expected trading days are present. [2025-10-15T19:38:03.905804] [DEBUG] [VALIDATOR ] IPI: Primary data validation passed. [2025-10-15T19:38:03.906489] [INFO ] [MAIN ] IPI: Fetched primary data is valid. [2025-10-15T19:38:03.906532] [DEBUG] [LOCAL ] IPI: Saving primary data. [2025-10-15T19:38:03.907296] [DEBUG] [LOCAL ] IPI: Trimmed 29916 records to 21357 (keeping 200 days of data) [2025-10-15T19:38:04.030792] [DEBUG] [LOCAL ] IPI: Primary data saved (21357 records). [2025-10-15T19:38:04.030914] [INFO ] [MAIN ] IPI: Full history saved. [2025-10-15T19:38:04.030990] [INFO ] [MAIN ] Update Progress: 1122/2369 symbols completed. IPI took 26.1s. Estimated remaining: 2h 55m 36s. Rate: 7.1 symbols/min [2025-10-15T19:38:04.122160] [INFO ] [REMOTE ] IR: Fetching primary data for 2024-12. [2025-10-15T19:38:04.203302] [INFO ] [MAIN ] IRM: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:38:04.247323] [DEBUG] [LOCAL ] IRM: Loaded 49163 existing records from primary storage. [2025-10-15T19:38:04.247673] [INFO ] [MAIN ] IRM: Loaded 49163 existing records. [2025-10-15T19:38:04.448144] [WARN ] [MAIN ] IRM: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:38:04.448387] [INFO ] [MAIN ] IRM: Wiping existing primary data before full refresh. [2025-10-15T19:38:04.448437] [INFO ] [LOCAL ] IRM: Starting deletion of primary data. [2025-10-15T19:38:04.449292] [DEBUG] [LOCAL ] IRM: Deleted primary data file. [2025-10-15T19:38:04.449351] [INFO ] [MAIN ] IRM: Starting full primary refresh. [2025-10-15T19:38:04.815293] [INFO ] [REMOTE ] IRM: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:38:04.884348] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-15T19:38:04.913961] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-09. [2025-10-15T19:38:05.714022] [INFO ] [REMOTE ] IRM: Fetching primary data for 2024-12. [2025-10-15T19:38:05.803061] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-15T19:38:06.514004] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-01. [2025-10-15T19:38:06.578846] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-15T19:38:07.039695] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-15T19:38:07.313998] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-01. [2025-10-15T19:38:08.113984] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-10. [2025-10-15T19:38:08.160877] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-15T19:38:08.871461] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-15T19:38:08.877396] [INFO ] [REMOTE ] IQV: Full fetch complete (72347 records). [2025-10-15T19:38:08.877516] [DEBUG] [VALIDATOR ] IQV: Validating primary data. [2025-10-15T19:38:08.919368] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-02. [2025-10-15T19:38:09.278518] [DEBUG] [VALIDATOR ] IQV: All expected trading days are present. [2025-10-15T19:38:09.278737] [DEBUG] [VALIDATOR ] IQV: Primary data validation passed. [2025-10-15T19:38:09.279924] [INFO ] [MAIN ] IQV: Fetched primary data is valid. [2025-10-15T19:38:09.280032] [DEBUG] [LOCAL ] IQV: Saving primary data. [2025-10-15T19:38:09.281929] [DEBUG] [LOCAL ] IQV: Trimmed 72347 records to 50051 (keeping 200 days of data) [2025-10-15T19:38:09.399283] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-01 (2.09 seconds). [2025-10-15T19:38:09.653232] [DEBUG] [LOCAL ] IQV: Primary data saved (50051 records). [2025-10-15T19:38:09.653372] [INFO ] [MAIN ] IQV: Full history saved. [2025-10-15T19:38:09.653451] [INFO ] [MAIN ] Update Progress: 1123/2369 symbols completed. IQV took 31.7s. Estimated remaining: 2h 55m 24s. Rate: 7.1 symbols/min [2025-10-15T19:38:09.723739] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-06. [2025-10-15T19:38:09.840369] [INFO ] [MAIN ] IRS: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:38:09.861946] [DEBUG] [LOCAL ] IRS: Loaded 22985 existing records from primary storage. [2025-10-15T19:38:09.862197] [INFO ] [MAIN ] IRS: Loaded 22985 existing records. [2025-10-15T19:38:10.048969] [WARN ] [MAIN ] IRS: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:38:10.049172] [INFO ] [MAIN ] IRS: Wiping existing primary data before full refresh. [2025-10-15T19:38:10.049218] [INFO ] [LOCAL ] IRS: Starting deletion of primary data. [2025-10-15T19:38:10.049911] [DEBUG] [LOCAL ] IRS: Deleted primary data file. [2025-10-15T19:38:10.049968] [INFO ] [MAIN ] IRS: Starting full primary refresh. [2025-10-15T19:38:10.409030] [INFO ] [REMOTE ] IRS: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:38:10.513965] [INFO ] [REMOTE ] IRS: Fetching primary data for 2024-12. [2025-10-15T19:38:10.548776] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-15T19:38:11.314007] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-03. [2025-10-15T19:38:11.460270] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-15T19:38:11.719293] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-15T19:38:12.114015] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-02. [2025-10-15T19:38:12.877188] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-15T19:38:12.914022] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-07. [2025-10-15T19:38:13.713972] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-01. [2025-10-15T19:38:13.836051] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-15T19:38:14.514080] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-04. [2025-10-15T19:38:14.744239] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-15T19:38:14.811998] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-15T19:38:15.314059] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-08. [2025-10-15T19:38:16.022521] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-15T19:38:16.114005] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-02. [2025-10-15T19:38:16.914024] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-03. [2025-10-15T19:38:16.989845] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-15T19:38:17.095141] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-15T19:38:17.714035] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-03. [2025-10-15T19:38:18.400376] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-15T19:38:18.513993] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-04. [2025-10-15T19:38:18.740672] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-15T19:38:19.313973] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-09. [2025-10-15T19:38:19.564444] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-15T19:38:20.114091] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-04. [2025-10-15T19:38:20.913985] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-05. [2025-10-15T19:38:21.022063] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-15T19:38:21.713987] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-10. [2025-10-15T19:38:21.903928] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-15T19:38:21.949157] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-15T19:38:22.514052] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-05. [2025-10-15T19:38:23.314026] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-06. [2025-10-15T19:38:23.602963] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-10 (1.89 seconds). [2025-10-15T19:38:23.609992] [INFO ] [REMOTE ] IPG: Full fetch complete (77429 records). [2025-10-15T19:38:23.610127] [DEBUG] [VALIDATOR ] IPG: Validating primary data. [2025-10-15T19:38:24.055685] [DEBUG] [VALIDATOR ] IPG: All expected trading days are present. [2025-10-15T19:38:24.055919] [DEBUG] [VALIDATOR ] IPG: Primary data validation passed. [2025-10-15T19:38:24.057391] [INFO ] [MAIN ] IPG: Fetched primary data is valid. [2025-10-15T19:38:24.057767] [DEBUG] [LOCAL ] IPG: Saving primary data. [2025-10-15T19:38:24.072078] [DEBUG] [LOCAL ] IPG: Trimmed 77429 records to 53331 (keeping 200 days of data) [2025-10-15T19:38:24.074709] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-15T19:38:24.136482] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-05. [2025-10-15T19:38:24.234834] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-15T19:38:24.480171] [DEBUG] [LOCAL ] IPG: Primary data saved (53331 records). [2025-10-15T19:38:24.480342] [INFO ] [MAIN ] IPG: Full history saved. [2025-10-15T19:38:24.480799] [INFO ] [MAIN ] Update Progress: 1124/2369 symbols completed. IPG took 46.5s. Estimated remaining: 2h 55m 23s. Rate: 7.1 symbols/min [2025-10-15T19:38:24.650768] [INFO ] [MAIN ] IRT: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:38:24.699461] [DEBUG] [LOCAL ] IRT: Loaded 50569 existing records from primary storage. [2025-10-15T19:38:24.699810] [INFO ] [MAIN ] IRT: Loaded 50569 existing records. [2025-10-15T19:38:24.871124] [WARN ] [MAIN ] IRT: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:38:24.871343] [INFO ] [MAIN ] IRT: Wiping existing primary data before full refresh. [2025-10-15T19:38:24.871390] [INFO ] [LOCAL ] IRT: Starting deletion of primary data. [2025-10-15T19:38:24.872375] [DEBUG] [LOCAL ] IRT: Deleted primary data file. [2025-10-15T19:38:24.872432] [INFO ] [MAIN ] IRT: Starting full primary refresh. [2025-10-15T19:38:24.924793] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-06. [2025-10-15T19:38:25.256164] [INFO ] [REMOTE ] IRT: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:38:25.713981] [INFO ] [REMOTE ] IRT: Fetching primary data for 2024-12. [2025-10-15T19:38:25.971131] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-15T19:38:26.513972] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-06. [2025-10-15T19:38:26.609477] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-15T19:38:26.858547] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-15T19:38:27.313997] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-07. [2025-10-15T19:38:28.083363] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-15T19:38:28.113953] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-07. [2025-10-15T19:38:28.359270] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-15T19:38:28.914007] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-07. [2025-10-15T19:38:29.713987] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-01. [2025-10-15T19:38:30.011082] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-15T19:38:30.514067] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-08. [2025-10-15T19:38:30.604490] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-15T19:38:31.172708] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-15T19:38:31.314014] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-02. [2025-10-15T19:38:31.616889] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-15T19:38:32.114008] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-09. [2025-10-15T19:38:32.531786] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-15T19:38:32.914013] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-08. [2025-10-15T19:38:33.035302] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-15T19:38:33.713973] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-10. [2025-10-15T19:38:34.514015] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-08. [2025-10-15T19:38:34.633227] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-15T19:38:34.798877] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-15T19:38:34.803122] [INFO ] [REMOTE ] IRS: Full fetch complete (32728 records). [2025-10-15T19:38:34.803309] [DEBUG] [VALIDATOR ] IRS: Validating primary data. [2025-10-15T19:38:35.202866] [DEBUG] [VALIDATOR ] IRS: All expected trading days are present. [2025-10-15T19:38:35.202969] [DEBUG] [VALIDATOR ] IRS: Primary data validation passed. [2025-10-15T19:38:35.203701] [INFO ] [MAIN ] IRS: Fetched primary data is valid. [2025-10-15T19:38:35.203790] [DEBUG] [LOCAL ] IRS: Saving primary data. [2025-10-15T19:38:35.204875] [DEBUG] [LOCAL ] IRS: Trimmed 32728 records to 23063 (keeping 200 days of data) [2025-10-15T19:38:35.314120] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-03. [2025-10-15T19:38:35.343564] [DEBUG] [LOCAL ] IRS: Primary data saved (23063 records). [2025-10-15T19:38:35.344233] [INFO ] [MAIN ] IRS: Full history saved. [2025-10-15T19:38:35.344358] [INFO ] [MAIN ] Update Progress: 1125/2369 symbols completed. IRS took 25.7s. Estimated remaining: 2h 55m 17s. Rate: 7.1 symbols/min [2025-10-15T19:38:35.515304] [INFO ] [MAIN ] ISD: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:38:35.533205] [DEBUG] [LOCAL ] ISD: Loaded 15926 existing records from primary storage. [2025-10-15T19:38:35.533498] [INFO ] [MAIN ] ISD: Loaded 15926 existing records. [2025-10-15T19:38:35.708871] [WARN ] [MAIN ] ISD: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:38:35.709086] [INFO ] [MAIN ] ISD: Wiping existing primary data before full refresh. [2025-10-15T19:38:35.709134] [INFO ] [LOCAL ] ISD: Starting deletion of primary data. [2025-10-15T19:38:35.709543] [DEBUG] [LOCAL ] ISD: Deleted primary data file. [2025-10-15T19:38:35.709601] [INFO ] [MAIN ] ISD: Starting full primary refresh. [2025-10-15T19:38:36.072859] [INFO ] [REMOTE ] ISD: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:38:36.107492] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-15T19:38:36.118790] [INFO ] [REMOTE ] ISD: Fetching primary data for 2024-12. [2025-10-15T19:38:36.913955] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-09. [2025-10-15T19:38:37.030885] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-15T19:38:37.224976] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-15T19:38:37.714037] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-01. [2025-10-15T19:38:38.484553] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-15T19:38:38.512701] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-15T19:38:38.517418] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-09. [2025-10-15T19:38:39.314007] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-10. [2025-10-15T19:38:40.114018] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-04. [2025-10-15T19:38:40.176320] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-15T19:38:40.914034] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-10. [2025-10-15T19:38:41.176443] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-10 (1.86 seconds). [2025-10-15T19:38:41.183183] [INFO ] [REMOTE ] IR: Full fetch complete (76451 records). [2025-10-15T19:38:41.183331] [DEBUG] [VALIDATOR ] IR: Validating primary data. [2025-10-15T19:38:41.579570] [DEBUG] [VALIDATOR ] IR: All expected trading days are present. [2025-10-15T19:38:41.579684] [DEBUG] [VALIDATOR ] IR: Primary data validation passed. [2025-10-15T19:38:41.580762] [INFO ] [MAIN ] IR: Fetched primary data is valid. [2025-10-15T19:38:41.580823] [DEBUG] [LOCAL ] IR: Saving primary data. [2025-10-15T19:38:41.582265] [DEBUG] [LOCAL ] IR: Trimmed 76451 records to 52780 (keeping 200 days of data) [2025-10-15T19:38:41.760321] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-02. [2025-10-15T19:38:41.833069] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-15T19:38:41.950215] [DEBUG] [LOCAL ] IR: Primary data saved (52780 records). [2025-10-15T19:38:41.950352] [INFO ] [MAIN ] IR: Full history saved. [2025-10-15T19:38:41.950436] [INFO ] [MAIN ] Update Progress: 1126/2369 symbols completed. IR took 41.0s. Estimated remaining: 2h 55m 6s. Rate: 7.1 symbols/min [2025-10-15T19:38:42.114210] [INFO ] [MAIN ] IT: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:38:42.153815] [DEBUG] [LOCAL ] IT: Loaded 42200 existing records from primary storage. [2025-10-15T19:38:42.154095] [INFO ] [MAIN ] IT: Loaded 42200 existing records. [2025-10-15T19:38:42.332341] [WARN ] [MAIN ] IT: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:38:42.332676] [INFO ] [MAIN ] IT: Wiping existing primary data before full refresh. [2025-10-15T19:38:42.332786] [INFO ] [LOCAL ] IT: Starting deletion of primary data. [2025-10-15T19:38:42.348489] [DEBUG] [LOCAL ] IT: Deleted primary data file. [2025-10-15T19:38:42.348659] [INFO ] [MAIN ] IT: Starting full primary refresh. [2025-10-15T19:38:42.375001] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-15T19:38:42.423174] [INFO ] [REMOTE ] IRM: Full fetch complete (72331 records). [2025-10-15T19:38:42.461415] [DEBUG] [VALIDATOR ] IRM: Validating primary data. [2025-10-15T19:38:42.525933] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-05. [2025-10-15T19:38:42.577904] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-15T19:38:43.004040] [INFO ] [REMOTE ] IT: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:38:43.130757] [DEBUG] [VALIDATOR ] IRM: All expected trading days are present. [2025-10-15T19:38:43.130837] [DEBUG] [VALIDATOR ] IRM: Primary data validation passed. [2025-10-15T19:38:43.131781] [INFO ] [MAIN ] IRM: Fetched primary data is valid. [2025-10-15T19:38:43.131843] [DEBUG] [LOCAL ] IRM: Saving primary data. [2025-10-15T19:38:43.133158] [DEBUG] [LOCAL ] IRM: Trimmed 72331 records to 49144 (keeping 200 days of data) [2025-10-15T19:38:43.318074] [INFO ] [REMOTE ] IT: Fetching primary data for 2024-12. [2025-10-15T19:38:43.436639] [DEBUG] [LOCAL ] IRM: Primary data saved (49144 records). [2025-10-15T19:38:43.436852] [INFO ] [MAIN ] IRM: Full history saved. [2025-10-15T19:38:43.436964] [INFO ] [MAIN ] Update Progress: 1127/2369 symbols completed. IRM took 39.4s. Estimated remaining: 2h 54m 50s. Rate: 7.1 symbols/min [2025-10-15T19:38:43.602446] [INFO ] [MAIN ] ITGR: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:38:43.634625] [DEBUG] [LOCAL ] ITGR: Loaded 31233 existing records from primary storage. [2025-10-15T19:38:43.634912] [INFO ] [MAIN ] ITGR: Loaded 31233 existing records. [2025-10-15T19:38:43.807756] [WARN ] [MAIN ] ITGR: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:38:43.807941] [INFO ] [MAIN ] ITGR: Wiping existing primary data before full refresh. [2025-10-15T19:38:43.807987] [INFO ] [LOCAL ] ITGR: Starting deletion of primary data. [2025-10-15T19:38:43.808615] [DEBUG] [LOCAL ] ITGR: Deleted primary data file. [2025-10-15T19:38:43.808705] [INFO ] [MAIN ] ITGR: Starting full primary refresh. [2025-10-15T19:38:44.122859] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-03. [2025-10-15T19:38:44.165914] [INFO ] [REMOTE ] ITGR: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:38:44.272598] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-15T19:38:44.666962] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-15T19:38:44.913951] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-01. [2025-10-15T19:38:45.153453] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-15T19:38:45.713991] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-06. [2025-10-15T19:38:46.358429] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-15T19:38:46.513997] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-02. [2025-10-15T19:38:46.997990] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-15T19:38:47.314076] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2024-12. [2025-10-15T19:38:47.938195] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-15T19:38:48.113995] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-03. [2025-10-15T19:38:48.516702] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-15T19:38:48.913992] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-04. [2025-10-15T19:38:49.547022] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-15T19:38:49.714001] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-01. [2025-10-15T19:38:49.792704] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-15T19:38:50.519089] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-07. [2025-10-15T19:38:50.527594] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-15T19:38:51.314048] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-04. [2025-10-15T19:38:52.114792] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-02. [2025-10-15T19:38:52.120116] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-15T19:38:52.500531] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-15T19:38:52.913974] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-08. [2025-10-15T19:38:53.236667] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-15T19:38:53.714017] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-05. [2025-10-15T19:38:54.519254] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-03. [2025-10-15T19:38:54.537624] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-15T19:38:54.645682] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-15T19:38:55.313992] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-09. [2025-10-15T19:38:55.852302] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-15T19:38:56.114059] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-04. [2025-10-15T19:38:56.913991] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-05. [2025-10-15T19:38:57.012697] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-15T19:38:57.508609] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-15T19:38:57.713997] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-05. [2025-10-15T19:38:58.001085] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-15T19:38:58.514001] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-06. [2025-10-15T19:38:58.959427] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-15T19:38:59.314010] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-06. [2025-10-15T19:38:59.508629] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-15T19:39:00.113963] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-07. [2025-10-15T19:39:00.282309] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-15T19:39:00.913995] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-06. [2025-10-15T19:39:01.035468] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-15T19:39:01.714054] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-07. [2025-10-15T19:39:02.449672] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-15T19:39:02.514005] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-07. [2025-10-15T19:39:03.068322] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-15T19:39:03.314020] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-08. [2025-10-15T19:39:04.017333] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-15T19:39:04.113963] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-08. [2025-10-15T19:39:04.426526] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-15T19:39:04.914027] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-08. [2025-10-15T19:39:05.713993] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-09. [2025-10-15T19:39:05.742525] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-15T19:39:05.875889] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-15T19:39:06.513958] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-09. [2025-10-15T19:39:06.985303] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-15T19:39:07.314019] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-10. [2025-10-15T19:39:07.482167] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-15T19:39:08.114029] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-10. [2025-10-15T19:39:08.913987] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-09. [2025-10-15T19:39:08.949192] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-15T19:39:08.951842] [INFO ] [REMOTE ] ISD: Full fetch complete (24068 records). [2025-10-15T19:39:08.951934] [DEBUG] [VALIDATOR ] ISD: Validating primary data. [2025-10-15T19:39:09.193421] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-10 (1.88 seconds). [2025-10-15T19:39:09.268854] [INFO ] [REMOTE ] IRT: Full fetch complete (72972 records). [2025-10-15T19:39:09.269379] [DEBUG] [VALIDATOR ] IRT: Validating primary data. [2025-10-15T19:39:09.458309] [DEBUG] [VALIDATOR ] ISD: All expected trading days are present. [2025-10-15T19:39:09.458419] [DEBUG] [VALIDATOR ] ISD: Primary data validation passed. [2025-10-15T19:39:09.459002] [INFO ] [MAIN ] ISD: Fetched primary data is valid. [2025-10-15T19:39:09.464796] [DEBUG] [LOCAL ] ISD: Saving primary data. [2025-10-15T19:39:09.510447] [DEBUG] [LOCAL ] ISD: Trimmed 24068 records to 15874 (keeping 200 days of data) [2025-10-15T19:39:09.729030] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-10. [2025-10-15T19:39:09.847775] [DEBUG] [VALIDATOR ] IRT: All expected trading days are present. [2025-10-15T19:39:09.848484] [DEBUG] [VALIDATOR ] IRT: Primary data validation passed. [2025-10-15T19:39:09.849951] [INFO ] [MAIN ] IRT: Fetched primary data is valid. [2025-10-15T19:39:09.850308] [DEBUG] [LOCAL ] IRT: Saving primary data. [2025-10-15T19:39:09.855716] [DEBUG] [LOCAL ] IRT: Trimmed 72972 records to 50567 (keeping 200 days of data) [2025-10-15T19:39:09.962257] [DEBUG] [LOCAL ] ISD: Primary data saved (15874 records). [2025-10-15T19:39:09.968013] [INFO ] [MAIN ] ISD: Full history saved. [2025-10-15T19:39:09.968694] [INFO ] [MAIN ] Update Progress: 1128/2369 symbols completed. ISD took 34.6s. Estimated remaining: 2h 55m 2s. Rate: 7.1 symbols/min [2025-10-15T19:39:10.148891] [INFO ] [MAIN ] ITT: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:39:10.292035] [DEBUG] [LOCAL ] ITT: Loaded 32739 existing records from primary storage. [2025-10-15T19:39:10.296173] [INFO ] [MAIN ] ITT: Loaded 32739 existing records. [2025-10-15T19:39:10.508887] [WARN ] [MAIN ] ITT: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:39:10.539942] [INFO ] [MAIN ] ITT: Wiping existing primary data before full refresh. [2025-10-15T19:39:10.543386] [INFO ] [LOCAL ] ITT: Starting deletion of primary data. [2025-10-15T19:39:10.547226] [DEBUG] [LOCAL ] ITT: Deleted primary data file. [2025-10-15T19:39:10.547054] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-15T19:39:10.557947] [INFO ] [MAIN ] ITT: Starting full primary refresh. [2025-10-15T19:39:10.618419] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-10. [2025-10-15T19:39:10.833017] [DEBUG] [LOCAL ] IRT: Primary data saved (50567 records). [2025-10-15T19:39:10.849781] [INFO ] [MAIN ] IRT: Full history saved. [2025-10-15T19:39:10.858094] [INFO ] [MAIN ] Update Progress: 1129/2369 symbols completed. IRT took 46.4s. Estimated remaining: 2h 54m 45s. Rate: 7.1 symbols/min [2025-10-15T19:39:11.124180] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-15T19:39:11.179284] [INFO ] [REMOTE ] ITGR: Full fetch complete (42705 records). [2025-10-15T19:39:11.263181] [DEBUG] [VALIDATOR ] ITGR: Validating primary data. [2025-10-15T19:39:11.274554] [INFO ] [REMOTE ] ITT: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:39:11.270391] [INFO ] [MAIN ] ITUB: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:39:11.320850] [INFO ] [REMOTE ] ITT: Fetching primary data for 2024-12. [2025-10-15T19:39:11.652449] [DEBUG] [LOCAL ] ITUB: Loaded 53330 existing records from primary storage. [2025-10-15T19:39:11.689189] [INFO ] [MAIN ] ITUB: Loaded 53330 existing records. [2025-10-15T19:39:11.770175] [DEBUG] [VALIDATOR ] ITGR: All expected trading days are present. [2025-10-15T19:39:11.782817] [DEBUG] [VALIDATOR ] ITGR: Primary data validation passed. [2025-10-15T19:39:11.789088] [INFO ] [MAIN ] ITGR: Fetched primary data is valid. [2025-10-15T19:39:11.802158] [DEBUG] [LOCAL ] ITGR: Saving primary data. [2025-10-15T19:39:11.861821] [DEBUG] [LOCAL ] ITGR: Trimmed 42705 records to 31316 (keeping 200 days of data) [2025-10-15T19:39:11.901571] [WARN ] [MAIN ] ITUB: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:39:11.902408] [INFO ] [MAIN ] ITUB: Wiping existing primary data before full refresh. [2025-10-15T19:39:11.902464] [INFO ] [LOCAL ] ITUB: Starting deletion of primary data. [2025-10-15T19:39:11.903530] [DEBUG] [LOCAL ] ITUB: Deleted primary data file. [2025-10-15T19:39:11.903592] [INFO ] [MAIN ] ITUB: Starting full primary refresh. [2025-10-15T19:39:12.479347] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-10 (1.86 seconds). [2025-10-15T19:39:12.509405] [INFO ] [REMOTE ] IT: Full fetch complete (57276 records). [2025-10-15T19:39:12.538814] [DEBUG] [VALIDATOR ] IT: Validating primary data. [2025-10-15T19:39:12.560458] [INFO ] [REMOTE ] ITUB: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:39:12.562591] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2024-12. [2025-10-15T19:39:12.636789] [DEBUG] [LOCAL ] ITGR: Primary data saved (31316 records). [2025-10-15T19:39:12.664726] [INFO ] [MAIN ] ITGR: Full history saved. [2025-10-15T19:39:12.670102] [INFO ] [MAIN ] Update Progress: 1130/2369 symbols completed. ITGR took 29.2s. Estimated remaining: 2h 54m 29s. Rate: 7.1 symbols/min [2025-10-15T19:39:12.972823] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-15T19:39:13.028126] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-01. [2025-10-15T19:39:13.103742] [INFO ] [MAIN ] ITW: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:39:13.215063] [DEBUG] [VALIDATOR ] IT: All expected trading days are present. [2025-10-15T19:39:13.215292] [DEBUG] [VALIDATOR ] IT: Primary data validation passed. [2025-10-15T19:39:13.217155] [INFO ] [MAIN ] IT: Fetched primary data is valid. [2025-10-15T19:39:13.217248] [DEBUG] [LOCAL ] IT: Saving primary data. [2025-10-15T19:39:13.219344] [DEBUG] [LOCAL ] IT: Trimmed 57276 records to 42223 (keeping 200 days of data) [2025-10-15T19:39:13.462504] [DEBUG] [LOCAL ] ITW: Loaded 45801 existing records from primary storage. [2025-10-15T19:39:13.468815] [INFO ] [MAIN ] ITW: Loaded 45801 existing records. [2025-10-15T19:39:13.649741] [DEBUG] [LOCAL ] IT: Primary data saved (42223 records). [2025-10-15T19:39:13.666912] [INFO ] [MAIN ] IT: Full history saved. [2025-10-15T19:39:13.667068] [INFO ] [MAIN ] Update Progress: 1131/2369 symbols completed. IT took 31.7s. Estimated remaining: 2h 54m 13s. Rate: 7.1 symbols/min [2025-10-15T19:39:13.781739] [WARN ] [MAIN ] ITW: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:39:13.819545] [INFO ] [MAIN ] ITW: Wiping existing primary data before full refresh. [2025-10-15T19:39:13.822601] [INFO ] [LOCAL ] ITW: Starting deletion of primary data. [2025-10-15T19:39:13.844906] [DEBUG] [LOCAL ] ITW: Deleted primary data file. [2025-10-15T19:39:13.862529] [INFO ] [MAIN ] ITW: Starting full primary refresh. [2025-10-15T19:39:13.960543] [INFO ] [MAIN ] IVR: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:39:14.304750] [INFO ] [REMOTE ] ITW: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:39:14.307810] [INFO ] [REMOTE ] ITW: Fetching primary data for 2024-12. [2025-10-15T19:39:14.307190] [DEBUG] [LOCAL ] IVR: Loaded 48130 existing records from primary storage. [2025-10-15T19:39:14.309427] [INFO ] [MAIN ] IVR: Loaded 48130 existing records. [2025-10-15T19:39:14.497759] [WARN ] [MAIN ] IVR: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:39:14.514296] [INFO ] [MAIN ] IVR: Wiping existing primary data before full refresh. [2025-10-15T19:39:14.514668] [INFO ] [LOCAL ] IVR: Starting deletion of primary data. [2025-10-15T19:39:14.516142] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-15T19:39:14.522163] [DEBUG] [LOCAL ] IVR: Deleted primary data file. [2025-10-15T19:39:14.523208] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-02. [2025-10-15T19:39:14.524230] [INFO ] [MAIN ] IVR: Starting full primary refresh. [2025-10-15T19:39:14.662316] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2024-12 (2.10 seconds). [2025-10-15T19:39:14.926823] [INFO ] [REMOTE ] IVR: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:39:15.314028] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-01. [2025-10-15T19:39:15.940335] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-15T19:39:15.988327] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-15T19:39:16.114016] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-03. [2025-10-15T19:39:16.913982] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-01. [2025-10-15T19:39:17.109929] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-15T19:39:17.666462] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-15T19:39:17.713976] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-04. [2025-10-15T19:39:18.424629] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-15T19:39:18.514007] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-02. [2025-10-15T19:39:19.314045] [INFO ] [REMOTE ] IVR: Fetching primary data for 2024-12. [2025-10-15T19:39:19.402379] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-15T19:39:20.114002] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-05. [2025-10-15T19:39:20.215823] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-15T19:39:20.782311] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-15T19:39:20.913975] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-01. [2025-10-15T19:39:21.020154] [DEBUG] [REMOTE ] IVR: Error fetching primary data for 2025-01: 'API call returned an empty response.' [2025-10-15T19:39:21.020394] [WARN ] [REMOTE ] IVR: No data returned for month 2025-01 [2025-10-15T19:39:21.020481] [FATAL] [REMOTE ] IVR: API call failed - aborting fetch to avoid wasting further API calls [2025-10-15T19:39:21.020558] [FATAL] [MAIN ] IVR: Failed to fetch primary data. [2025-10-15T19:39:21.020620] [WARN ] [MAIN ] IVR: Deleting existing primary and derivative data due to fetch failure. [2025-10-15T19:39:21.020712] [INFO ] [LOCAL ] IVR: Starting deletion of primary data. [2025-10-15T19:39:21.020771] [DEBUG] [LOCAL ] IVR: No primary data file found to delete. [2025-10-15T19:39:21.020807] [INFO ] [LOCAL ] IVR: Starting deletion of derivative data. [2025-10-15T19:39:21.020949] [DEBUG] [LOCAL ] IVR: Deleted derivative data file. [2025-10-15T19:39:21.021034] [INFO ] [MAIN ] Update Progress: 1132/2369 symbols completed. IVR took 7.3s. Estimated remaining: 2h 54m 3s. Rate: 7.1 symbols/min [2025-10-15T19:39:21.197216] [INFO ] [MAIN ] IVT: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:39:21.229736] [DEBUG] [LOCAL ] IVT: Loaded 31274 existing records from primary storage. [2025-10-15T19:39:21.230023] [INFO ] [MAIN ] IVT: Loaded 31274 existing records. [2025-10-15T19:39:21.410206] [WARN ] [MAIN ] IVT: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:39:21.410530] [INFO ] [MAIN ] IVT: Wiping existing primary data before full refresh. [2025-10-15T19:39:21.410581] [INFO ] [LOCAL ] IVT: Starting deletion of primary data. [2025-10-15T19:39:21.411265] [DEBUG] [LOCAL ] IVT: Deleted primary data file. [2025-10-15T19:39:21.411337] [INFO ] [MAIN ] IVT: Starting full primary refresh. [2025-10-15T19:39:21.718024] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-03. [2025-10-15T19:39:21.803209] [INFO ] [REMOTE ] IVT: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:39:21.806795] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-15T19:39:22.513993] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-02. [2025-10-15T19:39:23.313999] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-06. [2025-10-15T19:39:23.414313] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-15T19:39:23.889686] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-15T19:39:24.113972] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-04. [2025-10-15T19:39:24.255038] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-15T19:39:24.914001] [INFO ] [REMOTE ] IVT: Fetching primary data for 2024-12. [2025-10-15T19:39:25.714011] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-03. [2025-10-15T19:39:25.910930] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-15T19:39:26.189886] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-15T19:39:26.514003] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-07. [2025-10-15T19:39:27.230303] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-15T19:39:27.313997] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-01. [2025-10-15T19:39:27.560064] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-15T19:39:28.114049] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-04. [2025-10-15T19:39:28.601891] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-15T19:39:28.914032] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-08. [2025-10-15T19:39:29.713973] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-05. [2025-10-15T19:39:29.820487] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-15T19:39:29.882617] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-15T19:39:30.513990] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-09. [2025-10-15T19:39:31.313967] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-05. [2025-10-15T19:39:31.353995] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-15T19:39:31.770732] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-15T19:39:32.113994] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-02. [2025-10-15T19:39:32.914010] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-06. [2025-10-15T19:39:33.061869] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-15T19:39:33.389409] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-15T19:39:33.714051] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-06. [2025-10-15T19:39:34.043791] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-15T19:39:34.514067] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-03. [2025-10-15T19:39:35.314046] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-10. [2025-10-15T19:39:35.422452] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-15T19:39:35.967333] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-15T19:39:36.113969] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-04. [2025-10-15T19:39:36.685131] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-15T19:39:36.689443] [INFO ] [REMOTE ] ITT: Full fetch complete (47275 records). [2025-10-15T19:39:36.689587] [DEBUG] [VALIDATOR ] ITT: Validating primary data. [2025-10-15T19:39:36.919186] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-07. [2025-10-15T19:39:37.088818] [DEBUG] [VALIDATOR ] ITT: All expected trading days are present. [2025-10-15T19:39:37.088940] [DEBUG] [VALIDATOR ] ITT: Primary data validation passed. [2025-10-15T19:39:37.090081] [INFO ] [MAIN ] ITT: Fetched primary data is valid. [2025-10-15T19:39:37.090303] [DEBUG] [LOCAL ] ITT: Saving primary data. [2025-10-15T19:39:37.091859] [DEBUG] [LOCAL ] ITT: Trimmed 47275 records to 32710 (keeping 200 days of data) [2025-10-15T19:39:37.112771] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-15T19:39:37.331886] [DEBUG] [LOCAL ] ITT: Primary data saved (32710 records). [2025-10-15T19:39:37.332035] [INFO ] [MAIN ] ITT: Full history saved. [2025-10-15T19:39:37.332118] [INFO ] [MAIN ] Update Progress: 1133/2369 symbols completed. ITT took 27.4s. Estimated remaining: 2h 54m 3s. Rate: 7.1 symbols/min [2025-10-15T19:39:37.499712] [INFO ] [MAIN ] IVZ: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:39:37.550130] [DEBUG] [LOCAL ] IVZ: Loaded 53118 existing records from primary storage. [2025-10-15T19:39:37.550514] [INFO ] [MAIN ] IVZ: Loaded 53118 existing records. [2025-10-15T19:39:37.721160] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-07. [2025-10-15T19:39:37.725712] [WARN ] [MAIN ] IVZ: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:39:37.726909] [INFO ] [MAIN ] IVZ: Wiping existing primary data before full refresh. [2025-10-15T19:39:37.726968] [INFO ] [LOCAL ] IVZ: Starting deletion of primary data. [2025-10-15T19:39:37.728189] [DEBUG] [LOCAL ] IVZ: Deleted primary data file. [2025-10-15T19:39:37.728251] [INFO ] [MAIN ] IVZ: Starting full primary refresh. [2025-10-15T19:39:38.075104] [INFO ] [REMOTE ] IVZ: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:39:38.514044] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2024-12. [2025-10-15T19:39:38.553291] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-15T19:39:39.314010] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-05. [2025-10-15T19:39:39.876455] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-07 (2.16 seconds). [2025-10-15T19:39:40.034929] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-15T19:39:40.114016] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-01. [2025-10-15T19:39:40.599784] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-15T19:39:40.914068] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-06. [2025-10-15T19:39:41.713964] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-08. [2025-10-15T19:39:41.824949] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-15T19:39:41.901255] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-15T19:39:42.514009] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-08. [2025-10-15T19:39:43.319130] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-02. [2025-10-15T19:39:43.330098] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-15T19:39:43.927805] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-15T19:39:44.114025] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-07. [2025-10-15T19:39:44.632291] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-15T19:39:44.914071] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-09. [2025-10-15T19:39:45.389776] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-15T19:39:45.714040] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-09. [2025-10-15T19:39:46.515492] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-03. [2025-10-15T19:39:46.519549] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-15T19:39:47.313999] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-10. [2025-10-15T19:39:47.493413] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-15T19:39:48.095774] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-15T19:39:48.113977] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-04. [2025-10-15T19:39:48.692251] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-15T19:39:48.697781] [INFO ] [REMOTE ] ITW: Full fetch complete (66674 records). [2025-10-15T19:39:48.697890] [DEBUG] [VALIDATOR ] ITW: Validating primary data. [2025-10-15T19:39:48.919175] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-08. [2025-10-15T19:39:49.080847] [DEBUG] [VALIDATOR ] ITW: All expected trading days are present. [2025-10-15T19:39:49.080918] [DEBUG] [VALIDATOR ] ITW: Primary data validation passed. [2025-10-15T19:39:49.082017] [INFO ] [MAIN ] ITW: Fetched primary data is valid. [2025-10-15T19:39:49.082082] [DEBUG] [LOCAL ] ITW: Saving primary data. [2025-10-15T19:39:49.083299] [DEBUG] [LOCAL ] ITW: Trimmed 66674 records to 45789 (keeping 200 days of data) [2025-10-15T19:39:49.376318] [DEBUG] [LOCAL ] ITW: Primary data saved (45789 records). [2025-10-15T19:39:49.376469] [INFO ] [MAIN ] ITW: Full history saved. [2025-10-15T19:39:49.376550] [INFO ] [MAIN ] Update Progress: 1134/2369 symbols completed. ITW took 36.7s. Estimated remaining: 2h 53m 59s. Rate: 7.1 symbols/min [2025-10-15T19:39:49.546450] [INFO ] [MAIN ] IX: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:39:49.568209] [DEBUG] [LOCAL ] IX: Loaded 22281 existing records from primary storage. [2025-10-15T19:39:49.568455] [INFO ] [MAIN ] IX: Loaded 22281 existing records. [2025-10-15T19:39:49.719186] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-10. [2025-10-15T19:39:49.747785] [WARN ] [MAIN ] IX: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:39:49.748119] [INFO ] [MAIN ] IX: Wiping existing primary data before full refresh. [2025-10-15T19:39:49.748245] [INFO ] [LOCAL ] IX: Starting deletion of primary data. [2025-10-15T19:39:49.748556] [DEBUG] [LOCAL ] IX: Deleted primary data file. [2025-10-15T19:39:49.748611] [INFO ] [MAIN ] IX: Starting full primary refresh. [2025-10-15T19:39:50.106593] [INFO ] [REMOTE ] IX: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:39:50.136172] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-10-15T19:39:50.324881] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-15T19:39:50.514019] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-09. [2025-10-15T19:39:51.260331] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-15T19:39:51.266761] [INFO ] [REMOTE ] ITUB: Full fetch complete (77322 records). [2025-10-15T19:39:51.266872] [DEBUG] [VALIDATOR ] ITUB: Validating primary data. [2025-10-15T19:39:51.314002] [INFO ] [REMOTE ] IX: Fetching primary data for 2024-12. [2025-10-15T19:39:51.614300] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-15T19:39:51.692384] [DEBUG] [VALIDATOR ] ITUB: All expected trading days are present. [2025-10-15T19:39:51.692480] [DEBUG] [VALIDATOR ] ITUB: Primary data validation passed. [2025-10-15T19:39:51.693565] [INFO ] [MAIN ] ITUB: Fetched primary data is valid. [2025-10-15T19:39:51.693634] [DEBUG] [LOCAL ] ITUB: Saving primary data. [2025-10-15T19:39:51.695206] [DEBUG] [LOCAL ] ITUB: Trimmed 77322 records to 53332 (keeping 200 days of data) [2025-10-15T19:39:52.004780] [DEBUG] [LOCAL ] ITUB: Primary data saved (53332 records). [2025-10-15T19:39:52.004926] [INFO ] [MAIN ] ITUB: Full history saved. [2025-10-15T19:39:52.005019] [INFO ] [MAIN ] Update Progress: 1135/2369 symbols completed. ITUB took 41.1s. Estimated remaining: 2h 53m 44s. Rate: 7.1 symbols/min [2025-10-15T19:39:52.119159] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-05. [2025-10-15T19:39:52.173690] [INFO ] [MAIN ] J: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:39:52.215817] [DEBUG] [LOCAL ] J: Loaded 40309 existing records from primary storage. [2025-10-15T19:39:52.216095] [INFO ] [MAIN ] J: Loaded 40309 existing records. [2025-10-15T19:39:52.348264] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-15T19:39:52.402080] [WARN ] [MAIN ] J: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:39:52.402280] [INFO ] [MAIN ] J: Wiping existing primary data before full refresh. [2025-10-15T19:39:52.402326] [INFO ] [LOCAL ] J: Starting deletion of primary data. [2025-10-15T19:39:52.402736] [DEBUG] [LOCAL ] J: Deleted primary data file. [2025-10-15T19:39:52.402792] [INFO ] [MAIN ] J: Starting full primary refresh. [2025-10-15T19:39:52.743559] [INFO ] [REMOTE ] J: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:39:52.913996] [INFO ] [REMOTE ] J: Fetching primary data for 2024-12. [2025-10-15T19:39:53.714085] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-10. [2025-10-15T19:39:53.930177] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-15T19:39:54.352012] [INFO ] [REMOTE ] J: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-15T19:39:54.513988] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-06. [2025-10-15T19:39:54.792265] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-15T19:39:54.796941] [INFO ] [REMOTE ] IVT: Full fetch complete (45942 records). [2025-10-15T19:39:54.797029] [DEBUG] [VALIDATOR ] IVT: Validating primary data. [2025-10-15T19:39:55.168388] [DEBUG] [VALIDATOR ] IVT: All expected trading days are present. [2025-10-15T19:39:55.168465] [DEBUG] [VALIDATOR ] IVT: Primary data validation passed. [2025-10-15T19:39:55.169268] [INFO ] [MAIN ] IVT: Fetched primary data is valid. [2025-10-15T19:39:55.169331] [DEBUG] [LOCAL ] IVT: Saving primary data. [2025-10-15T19:39:55.170279] [DEBUG] [LOCAL ] IVT: Trimmed 45942 records to 31347 (keeping 200 days of data) [2025-10-15T19:39:55.322892] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-01. [2025-10-15T19:39:55.363755] [DEBUG] [LOCAL ] IVT: Primary data saved (31347 records). [2025-10-15T19:39:55.363854] [INFO ] [MAIN ] IVT: Full history saved. [2025-10-15T19:39:55.363928] [INFO ] [MAIN ] Update Progress: 1136/2369 symbols completed. IVT took 34.3s. Estimated remaining: 2h 53m 30s. Rate: 7.1 symbols/min [2025-10-15T19:39:55.528468] [INFO ] [MAIN ] JBGS: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:39:55.568297] [DEBUG] [LOCAL ] JBGS: Loaded 42182 existing records from primary storage. [2025-10-15T19:39:55.568572] [INFO ] [MAIN ] JBGS: Loaded 42182 existing records. [2025-10-15T19:39:55.743505] [WARN ] [MAIN ] JBGS: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:39:55.743748] [INFO ] [MAIN ] JBGS: Wiping existing primary data before full refresh. [2025-10-15T19:39:55.743811] [INFO ] [LOCAL ] JBGS: Starting deletion of primary data. [2025-10-15T19:39:55.744220] [DEBUG] [LOCAL ] JBGS: Deleted primary data file. [2025-10-15T19:39:55.744261] [INFO ] [MAIN ] JBGS: Starting full primary refresh. [2025-10-15T19:39:55.991756] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-15T19:39:56.123838] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-02. [2025-10-15T19:39:56.123779] [INFO ] [REMOTE ] JBGS: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:39:56.157887] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-15T19:39:56.892344] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-15T19:39:56.913948] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-03. [2025-10-15T19:39:57.713959] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-07. [2025-10-15T19:39:57.821365] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-15T19:39:58.514009] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-04. [2025-10-15T19:39:59.314002] [INFO ] [REMOTE ] J: Fetching primary data for 2025-01. [2025-10-15T19:39:59.430876] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-15T19:39:59.681093] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-15T19:40:00.113996] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2024-12. [2025-10-15T19:40:00.866560] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-15T19:40:00.913952] [INFO ] [REMOTE ] J: Fetching primary data for 2025-02. [2025-10-15T19:40:01.630732] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-15T19:40:01.714056] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-08. [2025-10-15T19:40:02.206533] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-15T19:40:02.514016] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-05. [2025-10-15T19:40:03.314005] [INFO ] [REMOTE ] J: Fetching primary data for 2025-03. [2025-10-15T19:40:03.540995] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-15T19:40:03.718664] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-10-15T19:40:04.114004] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-06. [2025-10-15T19:40:04.913976] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-09. [2025-10-15T19:40:05.006058] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-15T19:40:05.027816] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-15T19:40:05.713996] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-07. [2025-10-15T19:40:06.514006] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-01. [2025-10-15T19:40:06.646056] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-15T19:40:06.674148] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-15T19:40:07.314023] [INFO ] [REMOTE ] J: Fetching primary data for 2025-04. [2025-10-15T19:40:07.918978] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-15T19:40:08.114049] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-08. [2025-10-15T19:40:08.914049] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-02. [2025-10-15T19:40:09.001612] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-15T19:40:09.240457] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-15T19:40:09.714003] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-09. [2025-10-15T19:40:10.304739] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-15T19:40:10.394987] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-15T19:40:10.514009] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-03. [2025-10-15T19:40:11.314034] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-10. [2025-10-15T19:40:11.912244] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-15T19:40:12.043804] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-15T19:40:12.046586] [INFO ] [REMOTE ] IX: Full fetch complete (28159 records). [2025-10-15T19:40:12.046684] [DEBUG] [VALIDATOR ] IX: Validating primary data. [2025-10-15T19:40:12.119189] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-04. [2025-10-15T19:40:12.419219] [DEBUG] [VALIDATOR ] IX: All expected trading days are present. [2025-10-15T19:40:12.419298] [DEBUG] [VALIDATOR ] IX: Primary data validation passed. [2025-10-15T19:40:12.419941] [INFO ] [MAIN ] IX: Fetched primary data is valid. [2025-10-15T19:40:12.420002] [DEBUG] [LOCAL ] IX: Saving primary data. [2025-10-15T19:40:12.420832] [DEBUG] [LOCAL ] IX: Trimmed 28159 records to 22281 (keeping 200 days of data) [2025-10-15T19:40:12.546634] [DEBUG] [LOCAL ] IX: Primary data saved (22281 records). [2025-10-15T19:40:12.546784] [INFO ] [MAIN ] IX: Full history saved. [2025-10-15T19:40:12.546862] [INFO ] [MAIN ] Update Progress: 1137/2369 symbols completed. IX took 23.2s. Estimated remaining: 2h 53m 31s. Rate: 7.1 symbols/min [2025-10-15T19:40:12.710100] [INFO ] [MAIN ] JBI: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:40:12.749541] [DEBUG] [LOCAL ] JBI: Loaded 43014 existing records from primary storage. [2025-10-15T19:40:12.749861] [INFO ] [MAIN ] JBI: Loaded 43014 existing records. [2025-10-15T19:40:12.930996] [INFO ] [REMOTE ] J: Fetching primary data for 2025-05. [2025-10-15T19:40:12.936730] [WARN ] [MAIN ] JBI: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:40:12.937972] [INFO ] [MAIN ] JBI: Wiping existing primary data before full refresh. [2025-10-15T19:40:12.938043] [INFO ] [LOCAL ] JBI: Starting deletion of primary data. [2025-10-15T19:40:12.938362] [DEBUG] [LOCAL ] JBI: Deleted primary data file. [2025-10-15T19:40:12.938433] [INFO ] [MAIN ] JBI: Starting full primary refresh. [2025-10-15T19:40:13.292279] [INFO ] [REMOTE ] JBI: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:40:13.716237] [INFO ] [REMOTE ] JBI: Fetching primary data for 2024-12. [2025-10-15T19:40:13.719177] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-15T19:40:14.513985] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-05. [2025-10-15T19:40:14.543550] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-15T19:40:15.031562] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-15T19:40:15.314035] [INFO ] [REMOTE ] J: Fetching primary data for 2025-06. [2025-10-15T19:40:16.020792] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-15T19:40:16.113952] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-06. [2025-10-15T19:40:16.700718] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-15T19:40:16.913983] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-10. [2025-10-15T19:40:17.652092] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-15T19:40:17.713952] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-07. [2025-10-15T19:40:18.513966] [INFO ] [REMOTE ] J: Fetching primary data for 2025-07. [2025-10-15T19:40:18.594117] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-15T19:40:18.600512] [INFO ] [REMOTE ] IVZ: Full fetch complete (77016 records). [2025-10-15T19:40:18.600636] [DEBUG] [VALIDATOR ] IVZ: Validating primary data. [2025-10-15T19:40:19.015232] [DEBUG] [VALIDATOR ] IVZ: All expected trading days are present. [2025-10-15T19:40:19.015335] [DEBUG] [VALIDATOR ] IVZ: Primary data validation passed. [2025-10-15T19:40:19.016481] [INFO ] [MAIN ] IVZ: Fetched primary data is valid. [2025-10-15T19:40:19.016572] [DEBUG] [LOCAL ] IVZ: Saving primary data. [2025-10-15T19:40:19.018183] [DEBUG] [LOCAL ] IVZ: Trimmed 77016 records to 53117 (keeping 200 days of data) [2025-10-15T19:40:19.267830] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-15T19:40:19.332698] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-08. [2025-10-15T19:40:19.380557] [DEBUG] [LOCAL ] IVZ: Primary data saved (53117 records). [2025-10-15T19:40:19.380704] [INFO ] [MAIN ] IVZ: Full history saved. [2025-10-15T19:40:19.381537] [INFO ] [MAIN ] Update Progress: 1138/2369 symbols completed. IVZ took 42.0s. Estimated remaining: 2h 53m 21s. Rate: 7.1 symbols/min [2025-10-15T19:40:19.549612] [INFO ] [MAIN ] JBL: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:40:19.596132] [DEBUG] [LOCAL ] JBL: Loaded 48360 existing records from primary storage. [2025-10-15T19:40:19.596605] [INFO ] [MAIN ] JBL: Loaded 48360 existing records. [2025-10-15T19:40:19.773824] [WARN ] [MAIN ] JBL: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:40:19.774115] [INFO ] [MAIN ] JBL: Wiping existing primary data before full refresh. [2025-10-15T19:40:19.774189] [INFO ] [LOCAL ] JBL: Starting deletion of primary data. [2025-10-15T19:40:19.775141] [DEBUG] [LOCAL ] JBL: Deleted primary data file. [2025-10-15T19:40:19.775201] [INFO ] [MAIN ] JBL: Starting full primary refresh. [2025-10-15T19:40:20.147852] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-01. [2025-10-15T19:40:20.173451] [INFO ] [REMOTE ] JBL: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:40:20.167592] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-15T19:40:20.481893] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-15T19:40:20.914003] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-09. [2025-10-15T19:40:21.691555] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-15T19:40:21.713964] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-02. [2025-10-15T19:40:22.391783] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-15T19:40:22.513979] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-10. [2025-10-15T19:40:23.219442] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-15T19:40:23.314027] [INFO ] [REMOTE ] J: Fetching primary data for 2025-08. [2025-10-15T19:40:23.957038] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-15T19:40:23.961700] [INFO ] [REMOTE ] JBGS: Full fetch complete (59337 records). [2025-10-15T19:40:23.961811] [DEBUG] [VALIDATOR ] JBGS: Validating primary data. [2025-10-15T19:40:24.135023] [INFO ] [REMOTE ] JBL: Fetching primary data for 2024-12. [2025-10-15T19:40:24.358256] [DEBUG] [VALIDATOR ] JBGS: All expected trading days are present. [2025-10-15T19:40:24.358409] [DEBUG] [VALIDATOR ] JBGS: Primary data validation passed. [2025-10-15T19:40:24.359357] [INFO ] [MAIN ] JBGS: Fetched primary data is valid. [2025-10-15T19:40:24.359468] [DEBUG] [LOCAL ] JBGS: Saving primary data. [2025-10-15T19:40:24.361140] [DEBUG] [LOCAL ] JBGS: Trimmed 59337 records to 42194 (keeping 200 days of data) [2025-10-15T19:40:24.458333] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-15T19:40:24.655140] [DEBUG] [LOCAL ] JBGS: Primary data saved (42194 records). [2025-10-15T19:40:24.655265] [INFO ] [MAIN ] JBGS: Full history saved. [2025-10-15T19:40:24.655342] [INFO ] [MAIN ] Update Progress: 1139/2369 symbols completed. JBGS took 29.3s. Estimated remaining: 2h 53m 9s. Rate: 7.1 symbols/min [2025-10-15T19:40:24.820723] [INFO ] [MAIN ] JBND: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:40:24.844920] [DEBUG] [LOCAL ] JBND: Loaded 26794 existing records from primary storage. [2025-10-15T19:40:24.845201] [INFO ] [MAIN ] JBND: Loaded 26794 existing records. [2025-10-15T19:40:24.919128] [INFO ] [REMOTE ] J: Fetching primary data for 2025-09. [2025-10-15T19:40:25.020410] [WARN ] [MAIN ] JBND: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:40:25.020581] [INFO ] [MAIN ] JBND: Wiping existing primary data before full refresh. [2025-10-15T19:40:25.020627] [INFO ] [LOCAL ] JBND: Starting deletion of primary data. [2025-10-15T19:40:25.021265] [DEBUG] [LOCAL ] JBND: Deleted primary data file. [2025-10-15T19:40:25.021322] [INFO ] [MAIN ] JBND: Starting full primary refresh. [2025-10-15T19:40:25.370920] [INFO ] [REMOTE ] JBND: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:40:25.713962] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-03. [2025-10-15T19:40:25.786921] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-15T19:40:26.084421] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-15T19:40:26.514013] [INFO ] [REMOTE ] JBND: Fetching primary data for 2024-12. [2025-10-15T19:40:27.300776] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-15T19:40:27.313950] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-01. [2025-10-15T19:40:27.576012] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-10-15T19:40:28.114037] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-01. [2025-10-15T19:40:28.761255] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-15T19:40:28.913962] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-02. [2025-10-15T19:40:29.060322] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-15T19:40:29.714045] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-04. [2025-10-15T19:40:30.514048] [INFO ] [REMOTE ] J: Fetching primary data for 2025-10. [2025-10-15T19:40:30.590571] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-15T19:40:30.839860] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-15T19:40:31.313995] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-02. [2025-10-15T19:40:32.091055] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-15T19:40:32.096375] [INFO ] [REMOTE ] J: Full fetch complete (59529 records). [2025-10-15T19:40:32.096486] [DEBUG] [VALIDATOR ] J: Validating primary data. [2025-10-15T19:40:32.119162] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-05. [2025-10-15T19:40:32.409691] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-15T19:40:32.498313] [DEBUG] [VALIDATOR ] J: All expected trading days are present. [2025-10-15T19:40:32.498391] [DEBUG] [VALIDATOR ] J: Primary data validation passed. [2025-10-15T19:40:32.499356] [INFO ] [MAIN ] J: Fetched primary data is valid. [2025-10-15T19:40:32.499419] [DEBUG] [LOCAL ] J: Saving primary data. [2025-10-15T19:40:32.500546] [DEBUG] [LOCAL ] J: Trimmed 59529 records to 40381 (keeping 200 days of data) [2025-10-15T19:40:32.743092] [DEBUG] [LOCAL ] J: Primary data saved (40381 records). [2025-10-15T19:40:32.743212] [INFO ] [MAIN ] J: Full history saved. [2025-10-15T19:40:32.743761] [INFO ] [MAIN ] Update Progress: 1140/2369 symbols completed. J took 40.7s. Estimated remaining: 2h 52m 60s. Rate: 7.1 symbols/min [2025-10-15T19:40:32.915767] [INFO ] [MAIN ] JBS: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:40:32.915893] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-03. [2025-10-15T19:40:32.917903] [DEBUG] [LOCAL ] JBS: No existing data file found in primary storage. [2025-10-15T19:40:32.917981] [WARN ] [MAIN ] JBS: No existing data found, performing full refresh instead. [2025-10-15T19:40:32.918104] [INFO ] [MAIN ] JBS: Wiping existing primary data before full refresh. [2025-10-15T19:40:32.918147] [INFO ] [LOCAL ] JBS: Starting deletion of primary data. [2025-10-15T19:40:32.918189] [DEBUG] [LOCAL ] JBS: No primary data file found to delete. [2025-10-15T19:40:32.918221] [INFO ] [MAIN ] JBS: Starting full primary refresh. [2025-10-15T19:40:33.405173] [INFO ] [REMOTE ] JBS: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:40:33.709991] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-15T19:40:33.723716] [INFO ] [REMOTE ] JBS: Fetching primary data for 2024-12. [2025-10-15T19:40:33.881504] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-15T19:40:33.990323] [DEBUG] [REMOTE ] JBS: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-15T19:40:33.990878] [WARN ] [REMOTE ] JBS: No data returned for month 2024-12 [2025-10-15T19:40:33.990986] [FATAL] [REMOTE ] JBS: API call failed - aborting fetch to avoid wasting further API calls [2025-10-15T19:40:33.991039] [FATAL] [MAIN ] JBS: Failed to fetch primary data. [2025-10-15T19:40:33.991075] [WARN ] [MAIN ] JBS: Deleting existing primary and derivative data due to fetch failure. [2025-10-15T19:40:33.991122] [INFO ] [LOCAL ] JBS: Starting deletion of primary data. [2025-10-15T19:40:33.991189] [DEBUG] [LOCAL ] JBS: No primary data file found to delete. [2025-10-15T19:40:33.991359] [INFO ] [LOCAL ] JBS: Starting deletion of derivative data. [2025-10-15T19:40:33.991448] [DEBUG] [LOCAL ] JBS: No derivative data file found to delete. [2025-10-15T19:40:33.991523] [INFO ] [MAIN ] Update Progress: 1141/2369 symbols completed. JBS took 1.2s. Estimated remaining: 2h 52m 44s. Rate: 7.1 symbols/min [2025-10-15T19:40:34.192565] [INFO ] [MAIN ] JBTM: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:40:34.192771] [DEBUG] [LOCAL ] JBTM: No existing data file found in primary storage. [2025-10-15T19:40:34.192818] [WARN ] [MAIN ] JBTM: No existing data found, performing full refresh instead. [2025-10-15T19:40:34.192936] [INFO ] [MAIN ] JBTM: Wiping existing primary data before full refresh. [2025-10-15T19:40:34.192980] [INFO ] [LOCAL ] JBTM: Starting deletion of primary data. [2025-10-15T19:40:34.193023] [DEBUG] [LOCAL ] JBTM: No primary data file found to delete. [2025-10-15T19:40:34.193056] [INFO ] [MAIN ] JBTM: Starting full primary refresh. [2025-10-15T19:40:34.519175] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-03. [2025-10-15T19:40:34.556798] [INFO ] [REMOTE ] JBTM: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:40:35.314049] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-06. [2025-10-15T19:40:36.114012] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2024-12. [2025-10-15T19:40:36.422390] [DEBUG] [REMOTE ] JBTM: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-15T19:40:36.423064] [WARN ] [REMOTE ] JBTM: No data returned for month 2024-12 [2025-10-15T19:40:36.423404] [FATAL] [REMOTE ] JBTM: API call failed - aborting fetch to avoid wasting further API calls [2025-10-15T19:40:36.423493] [FATAL] [MAIN ] JBTM: Failed to fetch primary data. [2025-10-15T19:40:36.439865] [WARN ] [MAIN ] JBTM: Deleting existing primary and derivative data due to fetch failure. [2025-10-15T19:40:36.453277] [INFO ] [LOCAL ] JBTM: Starting deletion of primary data. [2025-10-15T19:40:36.453409] [DEBUG] [LOCAL ] JBTM: No primary data file found to delete. [2025-10-15T19:40:36.453492] [INFO ] [LOCAL ] JBTM: Starting deletion of derivative data. [2025-10-15T19:40:36.454305] [DEBUG] [LOCAL ] JBTM: No derivative data file found to delete. [2025-10-15T19:40:36.455544] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-15T19:40:36.455913] [INFO ] [MAIN ] Update Progress: 1142/2369 symbols completed. JBTM took 2.5s. Estimated remaining: 2h 52m 29s. Rate: 7.1 symbols/min [2025-10-15T19:40:36.671229] [INFO ] [MAIN ] JCE: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:40:36.682632] [DEBUG] [LOCAL ] JCE: Loaded 7424 existing records from primary storage. [2025-10-15T19:40:36.682965] [INFO ] [MAIN ] JCE: Loaded 7424 existing records. [2025-10-15T19:40:36.908142] [WARN ] [MAIN ] JCE: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:40:36.908503] [INFO ] [MAIN ] JCE: Wiping existing primary data before full refresh. [2025-10-15T19:40:36.908753] [INFO ] [LOCAL ] JCE: Starting deletion of primary data. [2025-10-15T19:40:36.918825] [DEBUG] [LOCAL ] JCE: Deleted primary data file. [2025-10-15T19:40:36.918690] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-04. [2025-10-15T19:40:36.924721] [INFO ] [MAIN ] JCE: Starting full primary refresh. [2025-10-15T19:40:36.988523] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-15T19:40:37.335227] [INFO ] [REMOTE ] JCE: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:40:37.713999] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-07. [2025-10-15T19:40:38.513978] [INFO ] [REMOTE ] JCE: Fetching primary data for 2024-12. [2025-10-15T19:40:38.752365] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-15T19:40:39.168912] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-15T19:40:39.217811] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-10-15T19:40:39.313958] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-01. [2025-10-15T19:40:39.930134] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-15T19:40:40.114037] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-02. [2025-10-15T19:40:40.660891] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-15T19:40:40.914035] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-08. [2025-10-15T19:40:41.714023] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-05. [2025-10-15T19:40:42.462858] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-15T19:40:42.513966] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-09. [2025-10-15T19:40:43.323379] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-03. [2025-10-15T19:40:43.329359] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-15T19:40:43.859993] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-10-15T19:40:43.883151] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-15T19:40:44.114025] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-04. [2025-10-15T19:40:44.699336] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-15T19:40:44.913975] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-04. [2025-10-15T19:40:45.713994] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-05. [2025-10-15T19:40:45.805398] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-15T19:40:46.341160] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-15T19:40:46.514028] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-10. [2025-10-15T19:40:47.314052] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-05. [2025-10-15T19:40:47.901894] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-15T19:40:47.906807] [INFO ] [REMOTE ] JBI: Full fetch complete (63977 records). [2025-10-15T19:40:47.906922] [DEBUG] [VALIDATOR ] JBI: Validating primary data. [2025-10-15T19:40:48.119092] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-06. [2025-10-15T19:40:48.223274] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-15T19:40:48.321372] [DEBUG] [VALIDATOR ] JBI: All expected trading days are present. [2025-10-15T19:40:48.321453] [DEBUG] [VALIDATOR ] JBI: Primary data validation passed. [2025-10-15T19:40:48.322396] [INFO ] [MAIN ] JBI: Fetched primary data is valid. [2025-10-15T19:40:48.322458] [DEBUG] [LOCAL ] JBI: Saving primary data. [2025-10-15T19:40:48.323614] [DEBUG] [LOCAL ] JBI: Trimmed 63977 records to 42989 (keeping 200 days of data) [2025-10-15T19:40:48.561796] [DEBUG] [LOCAL ] JBI: Primary data saved (42989 records). [2025-10-15T19:40:48.561918] [INFO ] [MAIN ] JBI: Full history saved. [2025-10-15T19:40:48.561993] [INFO ] [MAIN ] Update Progress: 1143/2369 symbols completed. JBI took 36.0s. Estimated remaining: 2h 52m 24s. Rate: 7.1 symbols/min [2025-10-15T19:40:48.728093] [INFO ] [MAIN ] JCI: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:40:48.779458] [DEBUG] [LOCAL ] JCI: Loaded 53530 existing records from primary storage. [2025-10-15T19:40:48.779786] [INFO ] [MAIN ] JCI: Loaded 53530 existing records. [2025-10-15T19:40:48.919151] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-06. [2025-10-15T19:40:48.964857] [WARN ] [MAIN ] JCI: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:40:48.965058] [INFO ] [MAIN ] JCI: Wiping existing primary data before full refresh. [2025-10-15T19:40:48.965111] [INFO ] [LOCAL ] JCI: Starting deletion of primary data. [2025-10-15T19:40:48.966211] [DEBUG] [LOCAL ] JCI: Deleted primary data file. [2025-10-15T19:40:48.966269] [INFO ] [MAIN ] JCI: Starting full primary refresh. [2025-10-15T19:40:49.326513] [INFO ] [REMOTE ] JCI: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:40:49.713969] [INFO ] [REMOTE ] JCI: Fetching primary data for 2024-12. [2025-10-15T19:40:49.848319] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-15T19:40:50.012080] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-15T19:40:50.514068] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-06. [2025-10-15T19:40:51.221285] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-15T19:40:51.313971] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-07. [2025-10-15T19:40:51.430511] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-15T19:40:52.024690] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-15T19:40:52.114007] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-01. [2025-10-15T19:40:52.914013] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-07. [2025-10-15T19:40:53.713992] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-07. [2025-10-15T19:40:53.810310] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-15T19:40:54.070342] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-15T19:40:54.514035] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-02. [2025-10-15T19:40:55.313965] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-08. [2025-10-15T19:40:55.417769] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-15T19:40:56.113962] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-08. [2025-10-15T19:40:56.230025] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-15T19:40:56.292172] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-15T19:40:56.815358] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-15T19:40:56.914021] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-09. [2025-10-15T19:40:57.713963] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-08. [2025-10-15T19:40:57.727527] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-15T19:40:58.514046] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-09. [2025-10-15T19:40:59.314050] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-03. [2025-10-15T19:40:59.826445] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-15T19:41:00.113994] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-10. [2025-10-15T19:41:00.914066] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-10. [2025-10-15T19:41:01.036751] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-15T19:41:01.038885] [INFO ] [REMOTE ] JCE: Full fetch complete (9802 records). [2025-10-15T19:41:01.038970] [DEBUG] [VALIDATOR ] JCE: Validating primary data. [2025-10-15T19:41:01.412259] [DEBUG] [VALIDATOR ] JCE: All expected trading days are present. [2025-10-15T19:41:01.412385] [DEBUG] [VALIDATOR ] JCE: Primary data validation passed. [2025-10-15T19:41:01.412670] [INFO ] [MAIN ] JCE: Fetched primary data is valid. [2025-10-15T19:41:01.412732] [DEBUG] [LOCAL ] JCE: Saving primary data. [2025-10-15T19:41:01.413315] [DEBUG] [LOCAL ] JCE: Trimmed 9802 records to 7439 (keeping 200 days of data) [2025-10-15T19:41:01.458098] [DEBUG] [LOCAL ] JCE: Primary data saved (7439 records). [2025-10-15T19:41:01.458222] [INFO ] [MAIN ] JCE: Full history saved. [2025-10-15T19:41:01.458298] [INFO ] [MAIN ] Update Progress: 1144/2369 symbols completed. JCE took 25.0s. Estimated remaining: 2h 52m 21s. Rate: 7.1 symbols/min [2025-10-15T19:41:01.623100] [INFO ] [MAIN ] JEF: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:41:01.666363] [DEBUG] [LOCAL ] JEF: Loaded 50173 existing records from primary storage. [2025-10-15T19:41:01.666728] [INFO ] [MAIN ] JEF: Loaded 50173 existing records. [2025-10-15T19:41:01.837785] [WARN ] [MAIN ] JEF: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:41:01.838017] [INFO ] [MAIN ] JEF: Wiping existing primary data before full refresh. [2025-10-15T19:41:01.838064] [INFO ] [LOCAL ] JEF: Starting deletion of primary data. [2025-10-15T19:41:01.839040] [DEBUG] [LOCAL ] JEF: Deleted primary data file. [2025-10-15T19:41:01.839098] [INFO ] [MAIN ] JEF: Starting full primary refresh. [2025-10-15T19:41:02.191999] [INFO ] [REMOTE ] JEF: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:41:02.197638] [INFO ] [REMOTE ] JEF: Fetching primary data for 2024-12. [2025-10-15T19:41:02.206317] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-15T19:41:02.211364] [INFO ] [REMOTE ] JBND: Full fetch complete (35457 records). [2025-10-15T19:41:02.211501] [DEBUG] [VALIDATOR ] JBND: Validating primary data. [2025-10-15T19:41:02.584343] [DEBUG] [VALIDATOR ] JBND: All expected trading days are present. [2025-10-15T19:41:02.584586] [DEBUG] [VALIDATOR ] JBND: Primary data validation passed. [2025-10-15T19:41:02.585474] [INFO ] [MAIN ] JBND: Fetched primary data is valid. [2025-10-15T19:41:02.585539] [DEBUG] [LOCAL ] JBND: Saving primary data. [2025-10-15T19:41:02.586409] [DEBUG] [LOCAL ] JBND: Trimmed 35457 records to 26907 (keeping 200 days of data) [2025-10-15T19:41:02.751852] [DEBUG] [LOCAL ] JBND: Primary data saved (26907 records). [2025-10-15T19:41:02.751984] [INFO ] [MAIN ] JBND: Full history saved. [2025-10-15T19:41:02.752065] [INFO ] [MAIN ] Update Progress: 1145/2369 symbols completed. JBND took 38.1s. Estimated remaining: 2h 52m 5s. Rate: 7.1 symbols/min [2025-10-15T19:41:02.919016] [INFO ] [MAIN ] JELD: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:41:02.958630] [DEBUG] [LOCAL ] JELD: Loaded 46081 existing records from primary storage. [2025-10-15T19:41:02.958956] [INFO ] [MAIN ] JELD: Loaded 46081 existing records. [2025-10-15T19:41:03.176606] [WARN ] [MAIN ] JELD: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:41:03.177262] [INFO ] [MAIN ] JELD: Wiping existing primary data before full refresh. [2025-10-15T19:41:03.179390] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-08 (5.47 seconds). [2025-10-15T19:41:03.177884] [INFO ] [LOCAL ] JELD: Starting deletion of primary data. [2025-10-15T19:41:03.190364] [DEBUG] [LOCAL ] JELD: Deleted primary data file. [2025-10-15T19:41:03.190301] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-09. [2025-10-15T19:41:03.190538] [INFO ] [MAIN ] JELD: Starting full primary refresh. [2025-10-15T19:41:03.555639] [INFO ] [REMOTE ] JELD: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:41:03.556195] [INFO ] [REMOTE ] JELD: Fetching primary data for 2024-12. [2025-10-15T19:41:03.630454] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-15T19:41:04.113975] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-01. [2025-10-15T19:41:05.064772] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-15T19:41:05.075599] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-10. [2025-10-15T19:41:05.352228] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-03 (6.04 seconds). [2025-10-15T19:41:05.714000] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-04. [2025-10-15T19:41:05.908927] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-15T19:41:06.166147] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2024-12 (2.61 seconds). [2025-10-15T19:41:06.513954] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-01. [2025-10-15T19:41:06.970368] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-10 (1.89 seconds). [2025-10-15T19:41:06.976374] [INFO ] [REMOTE ] JBL: Full fetch complete (70540 records). [2025-10-15T19:41:06.976502] [DEBUG] [VALIDATOR ] JBL: Validating primary data. [2025-10-15T19:41:07.324536] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-02. [2025-10-15T19:41:07.386203] [DEBUG] [VALIDATOR ] JBL: All expected trading days are present. [2025-10-15T19:41:07.386398] [DEBUG] [VALIDATOR ] JBL: Primary data validation passed. [2025-10-15T19:41:07.387750] [INFO ] [MAIN ] JBL: Fetched primary data is valid. [2025-10-15T19:41:07.387820] [DEBUG] [LOCAL ] JBL: Saving primary data. [2025-10-15T19:41:07.389369] [DEBUG] [LOCAL ] JBL: Trimmed 70540 records to 48349 (keeping 200 days of data) [2025-10-15T19:41:07.666297] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-15T19:41:07.771611] [DEBUG] [LOCAL ] JBL: Primary data saved (48349 records). [2025-10-15T19:41:07.771798] [INFO ] [MAIN ] JBL: Full history saved. [2025-10-15T19:41:07.772810] [INFO ] [MAIN ] Update Progress: 1146/2369 symbols completed. JBL took 48.4s. Estimated remaining: 2h 51m 53s. Rate: 7.1 symbols/min [2025-10-15T19:41:07.946869] [INFO ] [MAIN ] JFR: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:41:07.979479] [DEBUG] [LOCAL ] JFR: Loaded 30884 existing records from primary storage. [2025-10-15T19:41:07.979810] [INFO ] [MAIN ] JFR: Loaded 30884 existing records. [2025-10-15T19:41:08.122074] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-02. [2025-10-15T19:41:08.163211] [WARN ] [MAIN ] JFR: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:41:08.163710] [INFO ] [MAIN ] JFR: Wiping existing primary data before full refresh. [2025-10-15T19:41:08.163836] [INFO ] [LOCAL ] JFR: Starting deletion of primary data. [2025-10-15T19:41:08.180280] [DEBUG] [LOCAL ] JFR: Deleted primary data file. [2025-10-15T19:41:08.193370] [INFO ] [MAIN ] JFR: Starting full primary refresh. [2025-10-15T19:41:08.269410] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-04 (2.56 seconds). [2025-10-15T19:41:08.552238] [INFO ] [REMOTE ] JFR: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:41:08.908190] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-15T19:41:08.917409] [INFO ] [REMOTE ] JFR: Fetching primary data for 2024-12. [2025-10-15T19:41:09.609390] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-15T19:41:09.713995] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-05. [2025-10-15T19:41:10.325003] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-15T19:41:10.513992] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-01. [2025-10-15T19:41:11.313970] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-03. [2025-10-15T19:41:11.643393] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-15T19:41:11.961337] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-15T19:41:12.113979] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-03. [2025-10-15T19:41:12.913973] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-02. [2025-10-15T19:41:13.122519] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-15T19:41:13.690257] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-15T19:41:13.713954] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-04. [2025-10-15T19:41:14.441692] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-15T19:41:14.513961] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-06. [2025-10-15T19:41:15.314010] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-03. [2025-10-15T19:41:15.469779] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-15T19:41:16.114000] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-04. [2025-10-15T19:41:16.504232] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-10-15T19:41:16.545703] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-15T19:41:16.914030] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-05. [2025-10-15T19:41:17.492622] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-15T19:41:17.714008] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-04. [2025-10-15T19:41:18.514025] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-05. [2025-10-15T19:41:18.554068] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-15T19:41:19.118024] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-15T19:41:19.314028] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-05. [2025-10-15T19:41:20.113980] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-06. [2025-10-15T19:41:20.173548] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-15T19:41:20.355938] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-15T19:41:20.914047] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-07. [2025-10-15T19:41:21.574231] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-15T19:41:21.713975] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-07. [2025-10-15T19:41:22.514019] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-06. [2025-10-15T19:41:22.856216] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-15T19:41:23.313966] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-06. [2025-10-15T19:41:23.460826] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-15T19:41:23.800253] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-15T19:41:24.113964] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-08. [2025-10-15T19:41:24.458443] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-15T19:41:24.913973] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-07. [2025-10-15T19:41:25.686850] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-15T19:41:25.714034] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-08. [2025-10-15T19:41:26.339704] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-15T19:41:26.513994] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-07. [2025-10-15T19:41:27.313974] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-09. [2025-10-15T19:41:27.644087] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-10-15T19:41:28.011491] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-15T19:41:28.113979] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-09. [2025-10-15T19:41:28.819908] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-15T19:41:28.914016] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-08. [2025-10-15T19:41:29.714020] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-08. [2025-10-15T19:41:29.919512] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-15T19:41:30.184282] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-15T19:41:30.513997] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-09. [2025-10-15T19:41:31.313968] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-10. [2025-10-15T19:41:31.408623] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-15T19:41:31.862696] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-15T19:41:31.986347] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-15T19:41:31.996066] [INFO ] [REMOTE ] JCI: Full fetch complete (77591 records). [2025-10-15T19:41:31.996208] [DEBUG] [VALIDATOR ] JCI: Validating primary data. [2025-10-15T19:41:32.119067] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-10. [2025-10-15T19:41:32.382966] [DEBUG] [VALIDATOR ] JCI: All expected trading days are present. [2025-10-15T19:41:32.383049] [DEBUG] [VALIDATOR ] JCI: Primary data validation passed. [2025-10-15T19:41:32.384115] [INFO ] [MAIN ] JCI: Fetched primary data is valid. [2025-10-15T19:41:32.384179] [DEBUG] [LOCAL ] JCI: Saving primary data. [2025-10-15T19:41:32.385611] [DEBUG] [LOCAL ] JCI: Trimmed 77591 records to 53527 (keeping 200 days of data) [2025-10-15T19:41:32.740233] [DEBUG] [LOCAL ] JCI: Primary data saved (53527 records). [2025-10-15T19:41:32.740415] [INFO ] [MAIN ] JCI: Full history saved. [2025-10-15T19:41:32.740536] [INFO ] [MAIN ] Update Progress: 1147/2369 symbols completed. JCI took 44.2s. Estimated remaining: 2h 52m 2s. Rate: 7.1 symbols/min [2025-10-15T19:41:32.908037] [INFO ] [MAIN ] JGH: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:41:32.914182] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-10. [2025-10-15T19:41:32.921304] [DEBUG] [LOCAL ] JGH: Loaded 12243 existing records from primary storage. [2025-10-15T19:41:32.921535] [INFO ] [MAIN ] JGH: Loaded 12243 existing records. [2025-10-15T19:41:33.133151] [WARN ] [MAIN ] JGH: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:41:33.133361] [INFO ] [MAIN ] JGH: Wiping existing primary data before full refresh. [2025-10-15T19:41:33.133410] [INFO ] [LOCAL ] JGH: Starting deletion of primary data. [2025-10-15T19:41:33.133740] [DEBUG] [LOCAL ] JGH: Deleted primary data file. [2025-10-15T19:41:33.133797] [INFO ] [MAIN ] JGH: Starting full primary refresh. [2025-10-15T19:41:33.497283] [INFO ] [REMOTE ] JGH: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:41:33.574907] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-15T19:41:33.580006] [INFO ] [REMOTE ] JFR: Full fetch complete (48391 records). [2025-10-15T19:41:33.580102] [DEBUG] [VALIDATOR ] JFR: Validating primary data. [2025-10-15T19:41:33.719103] [INFO ] [REMOTE ] JGH: Fetching primary data for 2024-12. [2025-10-15T19:41:33.964122] [DEBUG] [VALIDATOR ] JFR: All expected trading days are present. [2025-10-15T19:41:33.964189] [DEBUG] [VALIDATOR ] JFR: Primary data validation passed. [2025-10-15T19:41:33.965036] [INFO ] [MAIN ] JFR: Fetched primary data is valid. [2025-10-15T19:41:33.965096] [DEBUG] [LOCAL ] JFR: Saving primary data. [2025-10-15T19:41:33.966191] [DEBUG] [LOCAL ] JFR: Trimmed 48391 records to 30985 (keeping 200 days of data) [2025-10-15T19:41:34.162176] [DEBUG] [LOCAL ] JFR: Primary data saved (30985 records). [2025-10-15T19:41:34.162331] [INFO ] [MAIN ] JFR: Full history saved. [2025-10-15T19:41:34.162417] [INFO ] [MAIN ] Update Progress: 1148/2369 symbols completed. JFR took 26.4s. Estimated remaining: 2h 51m 46s. Rate: 7.1 symbols/min [2025-10-15T19:41:34.341017] [INFO ] [MAIN ] JHG: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:41:34.381665] [DEBUG] [LOCAL ] JHG: Loaded 47608 existing records from primary storage. [2025-10-15T19:41:34.382033] [INFO ] [MAIN ] JHG: Loaded 47608 existing records. [2025-10-15T19:41:34.515040] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-09. [2025-10-15T19:41:34.581317] [WARN ] [MAIN ] JHG: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:41:34.582689] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-15T19:41:34.582919] [INFO ] [MAIN ] JHG: Wiping existing primary data before full refresh. [2025-10-15T19:41:34.589369] [INFO ] [LOCAL ] JHG: Starting deletion of primary data. [2025-10-15T19:41:34.595951] [INFO ] [REMOTE ] JELD: Full fetch complete (64418 records). [2025-10-15T19:41:34.596490] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-15T19:41:34.596674] [DEBUG] [LOCAL ] JHG: Deleted primary data file. [2025-10-15T19:41:34.597019] [INFO ] [MAIN ] JHG: Starting full primary refresh. [2025-10-15T19:41:34.596961] [DEBUG] [VALIDATOR ] JELD: Validating primary data. [2025-10-15T19:41:35.338218] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-01. [2025-10-15T19:41:35.358453] [DEBUG] [VALIDATOR ] JELD: All expected trading days are present. [2025-10-15T19:41:35.362917] [INFO ] [REMOTE ] JHG: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:41:35.364085] [DEBUG] [VALIDATOR ] JELD: Primary data validation passed. [2025-10-15T19:41:35.365337] [INFO ] [MAIN ] JELD: Fetched primary data is valid. [2025-10-15T19:41:35.365510] [DEBUG] [LOCAL ] JELD: Saving primary data. [2025-10-15T19:41:35.366990] [DEBUG] [LOCAL ] JELD: Trimmed 64418 records to 46134 (keeping 200 days of data) [2025-10-15T19:41:35.623240] [DEBUG] [LOCAL ] JELD: Primary data saved (46134 records). [2025-10-15T19:41:35.623374] [INFO ] [MAIN ] JELD: Full history saved. [2025-10-15T19:41:35.623467] [INFO ] [MAIN ] Update Progress: 1149/2369 symbols completed. JELD took 32.9s. Estimated remaining: 2h 51m 30s. Rate: 7.1 symbols/min [2025-10-15T19:41:35.788797] [INFO ] [MAIN ] JHI: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:41:35.789003] [DEBUG] [LOCAL ] JHI: No existing data file found in primary storage. [2025-10-15T19:41:35.789043] [WARN ] [MAIN ] JHI: No existing data found, performing full refresh instead. [2025-10-15T19:41:35.789114] [INFO ] [MAIN ] JHI: Wiping existing primary data before full refresh. [2025-10-15T19:41:35.789149] [INFO ] [LOCAL ] JHI: Starting deletion of primary data. [2025-10-15T19:41:35.789187] [DEBUG] [LOCAL ] JHI: No primary data file found to delete. [2025-10-15T19:41:35.789217] [INFO ] [MAIN ] JHI: Starting full primary refresh. [2025-10-15T19:41:36.114798] [INFO ] [REMOTE ] JHG: Fetching primary data for 2024-12. [2025-10-15T19:41:36.139615] [INFO ] [REMOTE ] JHI: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:41:36.199745] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-15T19:41:36.233612] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-15T19:41:36.914054] [INFO ] [REMOTE ] JHI: Fetching primary data for 2024-12. [2025-10-15T19:41:37.483100] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-10-15T19:41:37.670529] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-15T19:41:37.713982] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-01. [2025-10-15T19:41:38.250611] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-10-15T19:41:38.514003] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-10. [2025-10-15T19:41:39.313995] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-02. [2025-10-15T19:41:39.915970] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-15T19:41:40.113972] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-03. [2025-10-15T19:41:40.418506] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-15T19:41:40.424822] [INFO ] [REMOTE ] JEF: Full fetch complete (73279 records). [2025-10-15T19:41:40.424941] [DEBUG] [VALIDATOR ] JEF: Validating primary data. [2025-10-15T19:41:40.622253] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-10-15T19:41:40.821153] [DEBUG] [VALIDATOR ] JEF: All expected trading days are present. [2025-10-15T19:41:40.821228] [DEBUG] [VALIDATOR ] JEF: Primary data validation passed. [2025-10-15T19:41:40.822220] [INFO ] [MAIN ] JEF: Fetched primary data is valid. [2025-10-15T19:41:40.822283] [DEBUG] [LOCAL ] JEF: Saving primary data. [2025-10-15T19:41:40.823663] [DEBUG] [LOCAL ] JEF: Trimmed 73279 records to 50171 (keeping 200 days of data) [2025-10-15T19:41:40.914005] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-01. [2025-10-15T19:41:41.127293] [DEBUG] [LOCAL ] JEF: Primary data saved (50171 records). [2025-10-15T19:41:41.127554] [INFO ] [MAIN ] JEF: Full history saved. [2025-10-15T19:41:41.127950] [INFO ] [MAIN ] Update Progress: 1150/2369 symbols completed. JEF took 39.7s. Estimated remaining: 2h 51m 18s. Rate: 7.1 symbols/min [2025-10-15T19:41:41.291558] [INFO ] [MAIN ] JHS: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:41:41.296509] [DEBUG] [LOCAL ] JHS: Loaded 2944 existing records from primary storage. [2025-10-15T19:41:41.296726] [INFO ] [MAIN ] JHS: Loaded 2944 existing records. [2025-10-15T19:41:41.469445] [WARN ] [MAIN ] JHS: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:41:41.469716] [INFO ] [MAIN ] JHS: Wiping existing primary data before full refresh. [2025-10-15T19:41:41.469771] [INFO ] [LOCAL ] JHS: Starting deletion of primary data. [2025-10-15T19:41:41.469978] [DEBUG] [LOCAL ] JHS: Deleted primary data file. [2025-10-15T19:41:41.470036] [INFO ] [MAIN ] JHS: Starting full primary refresh. [2025-10-15T19:41:41.719180] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-04. [2025-10-15T19:41:41.818414] [INFO ] [REMOTE ] JHS: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:41:42.461258] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-15T19:41:42.514035] [INFO ] [REMOTE ] JHS: Fetching primary data for 2024-12. [2025-10-15T19:41:42.550461] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-15T19:41:43.008547] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2024-12 (0.49 seconds). [2025-10-15T19:41:43.314063] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-05. [2025-10-15T19:41:44.095249] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-15T19:41:44.113958] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-06. [2025-10-15T19:41:44.761121] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-15T19:41:44.913984] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-07. [2025-10-15T19:41:45.614269] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-15T19:41:45.714062] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-02. [2025-10-15T19:41:46.164966] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-15T19:41:46.514057] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-08. [2025-10-15T19:41:47.314040] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-01. [2025-10-15T19:41:47.331844] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-15T19:41:47.871819] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-15T19:41:48.114048] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-02. [2025-10-15T19:41:48.698356] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-15T19:41:48.914020] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-03. [2025-10-15T19:41:49.425847] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-10-15T19:41:49.713971] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-09. [2025-10-15T19:41:50.513972] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-02. [2025-10-15T19:41:50.602705] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-15T19:41:51.314031] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-10. [2025-10-15T19:41:52.081756] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-15T19:41:52.113980] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-03. [2025-10-15T19:41:52.184401] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-15T19:41:52.187672] [INFO ] [REMOTE ] JGH: Full fetch complete (16098 records). [2025-10-15T19:41:52.187770] [DEBUG] [VALIDATOR ] JGH: Validating primary data. [2025-10-15T19:41:52.544070] [DEBUG] [VALIDATOR ] JGH: All expected trading days are present. [2025-10-15T19:41:52.544178] [DEBUG] [VALIDATOR ] JGH: Primary data validation passed. [2025-10-15T19:41:52.544525] [INFO ] [MAIN ] JGH: Fetched primary data is valid. [2025-10-15T19:41:52.544565] [DEBUG] [LOCAL ] JGH: Saving primary data. [2025-10-15T19:41:52.545075] [DEBUG] [LOCAL ] JGH: Trimmed 16098 records to 12453 (keeping 200 days of data) [2025-10-15T19:41:52.618599] [DEBUG] [LOCAL ] JGH: Primary data saved (12453 records). [2025-10-15T19:41:52.618741] [INFO ] [MAIN ] JGH: Full history saved. [2025-10-15T19:41:52.618870] [INFO ] [MAIN ] Update Progress: 1151/2369 symbols completed. JGH took 19.9s. Estimated remaining: 2h 51m 13s. Rate: 7.1 symbols/min [2025-10-15T19:41:52.786567] [INFO ] [MAIN ] JHX: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:41:52.834141] [DEBUG] [LOCAL ] JHX: Loaded 53155 existing records from primary storage. [2025-10-15T19:41:52.834481] [INFO ] [MAIN ] JHX: Loaded 53155 existing records. [2025-10-15T19:41:52.921400] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-03. [2025-10-15T19:41:53.008432] [WARN ] [MAIN ] JHX: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:41:53.008629] [INFO ] [MAIN ] JHX: Wiping existing primary data before full refresh. [2025-10-15T19:41:53.008711] [INFO ] [LOCAL ] JHX: Starting deletion of primary data. [2025-10-15T19:41:53.009622] [DEBUG] [LOCAL ] JHX: Deleted primary data file. [2025-10-15T19:41:53.009714] [INFO ] [MAIN ] JHX: Starting full primary refresh. [2025-10-15T19:41:53.360247] [INFO ] [REMOTE ] JHX: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:41:53.524944] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-15T19:41:53.713968] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-04. [2025-10-15T19:41:53.786009] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-15T19:41:54.209827] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-10-15T19:41:54.514003] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-05. [2025-10-15T19:41:54.980010] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-15T19:41:55.313979] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-06. [2025-10-15T19:41:55.881411] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-15T19:41:56.113983] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-07. [2025-10-15T19:41:56.672689] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-15T19:41:56.914049] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-04. [2025-10-15T19:41:57.422751] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-10-15T19:41:57.714019] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-05. [2025-10-15T19:41:58.463908] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-15T19:41:58.513967] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-08. [2025-10-15T19:41:58.971913] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-10-15T19:41:59.314001] [INFO ] [REMOTE ] JHX: Fetching primary data for 2024-12. [2025-10-15T19:42:00.113984] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-06. [2025-10-15T19:42:00.342983] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-15T19:42:00.714417] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-15T19:42:00.913970] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-04. [2025-10-15T19:42:01.713997] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-09. [2025-10-15T19:42:02.301827] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-15T19:42:02.514030] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-07. [2025-10-15T19:42:02.597633] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-15T19:42:02.845145] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-07 (0.33 seconds). [2025-10-15T19:42:03.314093] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-05. [2025-10-15T19:42:04.113996] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-08. [2025-10-15T19:42:04.663086] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-15T19:42:04.913971] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-10. [2025-10-15T19:42:05.065695] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-15T19:42:05.325425] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-10 (0.41 seconds). [2025-10-15T19:42:05.326350] [INFO ] [REMOTE ] JHS: Full fetch complete (4498 records). [2025-10-15T19:42:05.326419] [DEBUG] [VALIDATOR ] JHS: Validating primary data. [2025-10-15T19:42:05.676516] [DEBUG] [VALIDATOR ] JHS: All expected trading days are present. [2025-10-15T19:42:05.676595] [DEBUG] [VALIDATOR ] JHS: Primary data validation passed. [2025-10-15T19:42:05.676748] [INFO ] [MAIN ] JHS: Fetched primary data is valid. [2025-10-15T19:42:05.676810] [DEBUG] [LOCAL ] JHS: Saving primary data. [2025-10-15T19:42:05.677160] [DEBUG] [LOCAL ] JHS: Trimmed 4498 records to 2933 (keeping 200 days of data) [2025-10-15T19:42:05.694825] [DEBUG] [LOCAL ] JHS: Primary data saved (2933 records). [2025-10-15T19:42:05.694891] [INFO ] [MAIN ] JHS: Full history saved. [2025-10-15T19:42:05.694959] [INFO ] [MAIN ] Update Progress: 1152/2369 symbols completed. JHS took 24.6s. Estimated remaining: 2h 51m 10s. Rate: 7.1 symbols/min [2025-10-15T19:42:05.719132] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-06. [2025-10-15T19:42:05.865091] [INFO ] [MAIN ] JILL: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:42:05.881625] [DEBUG] [LOCAL ] JILL: Loaded 16017 existing records from primary storage. [2025-10-15T19:42:05.881890] [INFO ] [MAIN ] JILL: Loaded 16017 existing records. [2025-10-15T19:42:06.054237] [WARN ] [MAIN ] JILL: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:42:06.054459] [INFO ] [MAIN ] JILL: Wiping existing primary data before full refresh. [2025-10-15T19:42:06.054507] [INFO ] [LOCAL ] JILL: Starting deletion of primary data. [2025-10-15T19:42:06.054885] [DEBUG] [LOCAL ] JILL: Deleted primary data file. [2025-10-15T19:42:06.054943] [INFO ] [MAIN ] JILL: Starting full primary refresh. [2025-10-15T19:42:06.398226] [INFO ] [REMOTE ] JILL: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:42:06.513997] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-09. [2025-10-15T19:42:07.313974] [INFO ] [REMOTE ] JILL: Fetching primary data for 2024-12. [2025-10-15T19:42:07.333268] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-15T19:42:07.362082] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-15T19:42:08.113970] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-07. [2025-10-15T19:42:08.491678] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-15T19:42:08.914000] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-01. [2025-10-15T19:42:09.395396] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-15T19:42:09.713982] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-01. [2025-10-15T19:42:09.880685] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-15T19:42:10.247778] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-10-15T19:42:10.514004] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-02. [2025-10-15T19:42:11.114785] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-15T19:42:11.314005] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-08. [2025-10-15T19:42:12.114085] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-02. [2025-10-15T19:42:12.874870] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-15T19:42:12.925034] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-10. [2025-10-15T19:42:12.927841] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-15T19:42:13.673186] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-15T19:42:13.674781] [INFO ] [REMOTE ] JHI: Full fetch complete (5697 records). [2025-10-15T19:42:13.674851] [DEBUG] [VALIDATOR ] JHI: Validating primary data. [2025-10-15T19:42:13.719103] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-03. [2025-10-15T19:42:14.022208] [DEBUG] [VALIDATOR ] JHI: All expected trading days are present. [2025-10-15T19:42:14.022282] [DEBUG] [VALIDATOR ] JHI: Primary data validation passed. [2025-10-15T19:42:14.022434] [INFO ] [MAIN ] JHI: Fetched primary data is valid. [2025-10-15T19:42:14.022472] [DEBUG] [LOCAL ] JHI: Saving primary data. [2025-10-15T19:42:14.022858] [DEBUG] [LOCAL ] JHI: Trimmed 5697 records to 4041 (keeping 200 days of data) [2025-10-15T19:42:14.046273] [DEBUG] [LOCAL ] JHI: Primary data saved (4041 records). [2025-10-15T19:42:14.046347] [INFO ] [MAIN ] JHI: Full history saved. [2025-10-15T19:42:14.046409] [INFO ] [MAIN ] Update Progress: 1153/2369 symbols completed. JHI took 38.4s. Estimated remaining: 2h 51m 1s. Rate: 7.1 symbols/min [2025-10-15T19:42:14.208593] [INFO ] [MAIN ] JKS: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:42:14.247585] [DEBUG] [LOCAL ] JKS: Loaded 39715 existing records from primary storage. [2025-10-15T19:42:14.247908] [INFO ] [MAIN ] JKS: Loaded 39715 existing records. [2025-10-15T19:42:14.420091] [WARN ] [MAIN ] JKS: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:42:14.420301] [INFO ] [MAIN ] JKS: Wiping existing primary data before full refresh. [2025-10-15T19:42:14.420359] [INFO ] [LOCAL ] JKS: Starting deletion of primary data. [2025-10-15T19:42:14.420673] [DEBUG] [LOCAL ] JKS: Deleted primary data file. [2025-10-15T19:42:14.420728] [INFO ] [MAIN ] JKS: Starting full primary refresh. [2025-10-15T19:42:14.517369] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-03. [2025-10-15T19:42:14.785619] [INFO ] [REMOTE ] JKS: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:42:14.797381] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-15T19:42:15.314030] [INFO ] [REMOTE ] JKS: Fetching primary data for 2024-12. [2025-10-15T19:42:15.809844] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-15T19:42:16.113983] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-04. [2025-10-15T19:42:16.914056] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-04. [2025-10-15T19:42:17.041957] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-15T19:42:17.714086] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-01. [2025-10-15T19:42:17.927573] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-15T19:42:17.931625] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-15T19:42:18.514002] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-05. [2025-10-15T19:42:18.956910] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-15T19:42:19.209758] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-15T19:42:19.313987] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-09. [2025-10-15T19:42:20.114017] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-06. [2025-10-15T19:42:20.616370] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-15T19:42:20.913994] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-05. [2025-10-15T19:42:21.213547] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-15T19:42:21.714039] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-02. [2025-10-15T19:42:22.513985] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-10. [2025-10-15T19:42:22.627145] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-15T19:42:22.815452] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-15T19:42:23.313991] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-06. [2025-10-15T19:42:23.884200] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-15T19:42:23.889947] [INFO ] [REMOTE ] JHG: Full fetch complete (68466 records). [2025-10-15T19:42:23.890068] [DEBUG] [VALIDATOR ] JHG: Validating primary data. [2025-10-15T19:42:24.119575] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-03. [2025-10-15T19:42:24.297063] [DEBUG] [VALIDATOR ] JHG: All expected trading days are present. [2025-10-15T19:42:24.297149] [DEBUG] [VALIDATOR ] JHG: Primary data validation passed. [2025-10-15T19:42:24.298175] [INFO ] [MAIN ] JHG: Fetched primary data is valid. [2025-10-15T19:42:24.298239] [DEBUG] [LOCAL ] JHG: Saving primary data. [2025-10-15T19:42:24.299638] [DEBUG] [LOCAL ] JHG: Trimmed 68466 records to 47560 (keeping 200 days of data) [2025-10-15T19:42:24.597390] [DEBUG] [LOCAL ] JHG: Primary data saved (47560 records). [2025-10-15T19:42:24.597536] [INFO ] [MAIN ] JHG: Full history saved. [2025-10-15T19:42:24.598352] [INFO ] [MAIN ] Update Progress: 1154/2369 symbols completed. JHG took 50.4s. Estimated remaining: 2h 50m 55s. Rate: 7.1 symbols/min [2025-10-15T19:42:24.773405] [INFO ] [MAIN ] JLL: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:42:24.809103] [DEBUG] [LOCAL ] JLL: Loaded 31732 existing records from primary storage. [2025-10-15T19:42:24.809434] [INFO ] [MAIN ] JLL: Loaded 31732 existing records. [2025-10-15T19:42:24.924068] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-07. [2025-10-15T19:42:24.988893] [WARN ] [MAIN ] JLL: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:42:24.989341] [INFO ] [MAIN ] JLL: Wiping existing primary data before full refresh. [2025-10-15T19:42:24.989460] [INFO ] [LOCAL ] JLL: Starting deletion of primary data. [2025-10-15T19:42:24.989951] [DEBUG] [LOCAL ] JLL: Deleted primary data file. [2025-10-15T19:42:24.990019] [INFO ] [MAIN ] JLL: Starting full primary refresh. [2025-10-15T19:42:25.129243] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-15T19:42:25.391445] [INFO ] [REMOTE ] JLL: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:42:25.713971] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-07. [2025-10-15T19:42:25.781899] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-15T19:42:25.846692] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-15T19:42:26.513991] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-08. [2025-10-15T19:42:27.313967] [INFO ] [REMOTE ] JLL: Fetching primary data for 2024-12. [2025-10-15T19:42:27.502291] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-15T19:42:27.501466] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-15T19:42:28.114009] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-08. [2025-10-15T19:42:28.456951] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-15T19:42:28.914037] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-04. [2025-10-15T19:42:29.648712] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-15T19:42:29.713964] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-09. [2025-10-15T19:42:30.513963] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-01. [2025-10-15T19:42:30.612724] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-15T19:42:31.313985] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-09. [2025-10-15T19:42:31.394734] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-15T19:42:31.818698] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-15T19:42:32.087511] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-15T19:42:32.113954] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-10. [2025-10-15T19:42:32.914044] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-05. [2025-10-15T19:42:33.050686] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-15T19:42:33.052860] [INFO ] [REMOTE ] JILL: Full fetch complete (22636 records). [2025-10-15T19:42:33.052947] [DEBUG] [VALIDATOR ] JILL: Validating primary data. [2025-10-15T19:42:33.427069] [DEBUG] [VALIDATOR ] JILL: All expected trading days are present. [2025-10-15T19:42:33.427144] [DEBUG] [VALIDATOR ] JILL: Primary data validation passed. [2025-10-15T19:42:33.427594] [INFO ] [MAIN ] JILL: Fetched primary data is valid. [2025-10-15T19:42:33.427633] [DEBUG] [LOCAL ] JILL: Saving primary data. [2025-10-15T19:42:33.428302] [DEBUG] [LOCAL ] JILL: Trimmed 22636 records to 15931 (keeping 200 days of data) [2025-10-15T19:42:33.525677] [DEBUG] [LOCAL ] JILL: Primary data saved (15931 records). [2025-10-15T19:42:33.525833] [INFO ] [MAIN ] JILL: Full history saved. [2025-10-15T19:42:33.525913] [INFO ] [MAIN ] Update Progress: 1155/2369 symbols completed. JILL took 27.8s. Estimated remaining: 2h 50m 47s. Rate: 7.1 symbols/min [2025-10-15T19:42:33.719772] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-02. [2025-10-15T19:42:33.719631] [INFO ] [MAIN ] JLS: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:42:33.727580] [DEBUG] [LOCAL ] JLS: Loaded 4203 existing records from primary storage. [2025-10-15T19:42:33.727956] [INFO ] [MAIN ] JLS: Loaded 4203 existing records. [2025-10-15T19:42:33.932957] [WARN ] [MAIN ] JLS: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:42:33.934334] [INFO ] [MAIN ] JLS: Wiping existing primary data before full refresh. [2025-10-15T19:42:33.934395] [INFO ] [LOCAL ] JLS: Starting deletion of primary data. [2025-10-15T19:42:33.935101] [DEBUG] [LOCAL ] JLS: Deleted primary data file. [2025-10-15T19:42:33.935173] [INFO ] [MAIN ] JLS: Starting full primary refresh. [2025-10-15T19:42:34.286879] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-15T19:42:34.337750] [INFO ] [REMOTE ] JLS: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:42:34.514008] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-06. [2025-10-15T19:42:35.129847] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-15T19:42:35.313977] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-10. [2025-10-15T19:42:35.937924] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-15T19:42:36.114043] [INFO ] [REMOTE ] JLS: Fetching primary data for 2024-12. [2025-10-15T19:42:36.667314] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2024-12 (0.55 seconds). [2025-10-15T19:42:36.913975] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-01. [2025-10-15T19:42:36.999765] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-15T19:42:37.006033] [INFO ] [REMOTE ] JHX: Full fetch complete (61213 records). [2025-10-15T19:42:37.006148] [DEBUG] [VALIDATOR ] JHX: Validating primary data. [2025-10-15T19:42:37.392065] [DEBUG] [VALIDATOR ] JHX: All expected trading days are present. [2025-10-15T19:42:37.392271] [DEBUG] [VALIDATOR ] JHX: Primary data validation passed. [2025-10-15T19:42:37.393327] [INFO ] [MAIN ] JHX: Fetched primary data is valid. [2025-10-15T19:42:37.393392] [DEBUG] [LOCAL ] JHX: Saving primary data. [2025-10-15T19:42:37.394805] [DEBUG] [LOCAL ] JHX: Trimmed 61213 records to 53161 (keeping 200 days of data) [2025-10-15T19:42:37.499205] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-15T19:42:37.715691] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-02. [2025-10-15T19:42:37.724424] [DEBUG] [LOCAL ] JHX: Primary data saved (53161 records). [2025-10-15T19:42:37.724508] [INFO ] [MAIN ] JHX: Full history saved. [2025-10-15T19:42:37.724585] [INFO ] [MAIN ] Update Progress: 1156/2369 symbols completed. JHX took 45.1s. Estimated remaining: 2h 50m 34s. Rate: 7.1 symbols/min [2025-10-15T19:42:37.892480] [INFO ] [MAIN ] JMIA: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:42:37.943623] [DEBUG] [LOCAL ] JMIA: Loaded 51026 existing records from primary storage. [2025-10-15T19:42:37.943972] [INFO ] [MAIN ] JMIA: Loaded 51026 existing records. [2025-10-15T19:42:38.120134] [WARN ] [MAIN ] JMIA: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:42:38.120369] [INFO ] [MAIN ] JMIA: Wiping existing primary data before full refresh. [2025-10-15T19:42:38.120418] [INFO ] [LOCAL ] JMIA: Starting deletion of primary data. [2025-10-15T19:42:38.120845] [DEBUG] [LOCAL ] JMIA: Deleted primary data file. [2025-10-15T19:42:38.120901] [INFO ] [MAIN ] JMIA: Starting full primary refresh. [2025-10-15T19:42:38.397744] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-15T19:42:38.474262] [INFO ] [REMOTE ] JMIA: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:42:38.513951] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2024-12. [2025-10-15T19:42:39.314025] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-03. [2025-10-15T19:42:39.879914] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-15T19:42:40.113999] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-07. [2025-10-15T19:42:40.534476] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2024-12 (2.02 seconds). [2025-10-15T19:42:40.914011] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-04. [2025-10-15T19:42:41.422479] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-15T19:42:41.513570] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-10-15T19:42:41.714019] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-08. [2025-10-15T19:42:42.514010] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-03. [2025-10-15T19:42:43.314055] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-01. [2025-10-15T19:42:43.378799] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-15T19:42:43.785103] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-15T19:42:44.114018] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-04. [2025-10-15T19:42:44.798514] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-15T19:42:44.913963] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-02. [2025-10-15T19:42:45.579572] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-15T19:42:45.713981] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-09. [2025-10-15T19:42:46.464691] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-15T19:42:46.513962] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-05. [2025-10-15T19:42:47.319060] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-05. [2025-10-15T19:42:47.333990] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-15T19:42:47.837837] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-15T19:42:47.909248] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-15T19:42:48.114031] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-10. [2025-10-15T19:42:48.913999] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-03. [2025-10-15T19:42:49.587098] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-15T19:42:49.592407] [INFO ] [REMOTE ] JKS: Full fetch complete (58834 records). [2025-10-15T19:42:49.592519] [DEBUG] [VALIDATOR ] JKS: Validating primary data. [2025-10-15T19:42:49.719182] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-06. [2025-10-15T19:42:49.977558] [DEBUG] [VALIDATOR ] JKS: All expected trading days are present. [2025-10-15T19:42:49.977661] [DEBUG] [VALIDATOR ] JKS: Primary data validation passed. [2025-10-15T19:42:49.978627] [INFO ] [MAIN ] JKS: Fetched primary data is valid. [2025-10-15T19:42:49.978713] [DEBUG] [LOCAL ] JKS: Saving primary data. [2025-10-15T19:42:49.979890] [DEBUG] [LOCAL ] JKS: Trimmed 58834 records to 39674 (keeping 200 days of data) [2025-10-15T19:42:50.219301] [DEBUG] [LOCAL ] JKS: Primary data saved (39674 records). [2025-10-15T19:42:50.219502] [INFO ] [MAIN ] JKS: Full history saved. [2025-10-15T19:42:50.219688] [INFO ] [MAIN ] Update Progress: 1157/2369 symbols completed. JKS took 36.2s. Estimated remaining: 2h 50m 30s. Rate: 7.1 symbols/min [2025-10-15T19:42:50.514093] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-06. [2025-10-15T19:42:50.666422] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-15T19:42:50.968374] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-15T19:42:51.191576] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-15T19:42:51.313967] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-07. [2025-10-15T19:42:51.721727] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-07 (0.41 seconds). [2025-10-15T19:42:52.113988] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-07. [2025-10-15T19:42:52.914055] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-04. [2025-10-15T19:42:53.350857] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-15T19:42:53.714009] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-08. [2025-10-15T19:42:54.514098] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-08. [2025-10-15T19:42:54.611440] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-15T19:42:55.085143] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-15T19:42:55.086308] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-15T19:42:55.314024] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-09. [2025-10-15T19:42:56.114070] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-05. [2025-10-15T19:42:56.661023] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-15T19:42:56.913989] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-09. [2025-10-15T19:42:57.506324] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-15T19:42:57.713990] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-10. [2025-10-15T19:42:58.016660] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-15T19:42:58.514022] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-10. [2025-10-15T19:42:58.927523] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-15T19:42:58.931084] [INFO ] [REMOTE ] JLL: Full fetch complete (44973 records). [2025-10-15T19:42:58.931188] [DEBUG] [VALIDATOR ] JLL: Validating primary data. [2025-10-15T19:42:59.094912] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-15T19:42:59.117093] [INFO ] [REMOTE ] JLS: Full fetch complete (5850 records). [2025-10-15T19:42:59.158815] [DEBUG] [VALIDATOR ] JLS: Validating primary data. [2025-10-15T19:42:59.325166] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-06. [2025-10-15T19:42:59.479170] [DEBUG] [VALIDATOR ] JLL: All expected trading days are present. [2025-10-15T19:42:59.494495] [DEBUG] [VALIDATOR ] JLL: Primary data validation passed. [2025-10-15T19:42:59.565802] [INFO ] [MAIN ] JLL: Fetched primary data is valid. [2025-10-15T19:42:59.577244] [DEBUG] [LOCAL ] JLL: Saving primary data. [2025-10-15T19:42:59.629728] [DEBUG] [LOCAL ] JLL: Trimmed 44973 records to 31768 (keeping 200 days of data) [2025-10-15T19:42:59.741700] [DEBUG] [VALIDATOR ] JLS: All expected trading days are present. [2025-10-15T19:42:59.741790] [DEBUG] [VALIDATOR ] JLS: Primary data validation passed. [2025-10-15T19:42:59.741907] [INFO ] [MAIN ] JLS: Fetched primary data is valid. [2025-10-15T19:42:59.741974] [DEBUG] [LOCAL ] JLS: Saving primary data. [2025-10-15T19:42:59.780809] [DEBUG] [LOCAL ] JLS: Trimmed 5850 records to 4209 (keeping 200 days of data) [2025-10-15T19:42:59.818841] [DEBUG] [LOCAL ] JLS: Primary data saved (4209 records). [2025-10-15T19:42:59.819242] [INFO ] [MAIN ] JLS: Full history saved. [2025-10-15T19:42:59.819609] [INFO ] [MAIN ] Update Progress: 1158/2369 symbols completed. JLS took 26.3s. Estimated remaining: 2h 50m 23s. Rate: 7.1 symbols/min [2025-10-15T19:42:59.901011] [DEBUG] [LOCAL ] JLL: Primary data saved (31768 records). [2025-10-15T19:42:59.901157] [INFO ] [MAIN ] JLL: Full history saved. [2025-10-15T19:42:59.901241] [INFO ] [MAIN ] Update Progress: 1159/2369 symbols completed. JLL took 35.3s. Estimated remaining: 2h 50m 6s. Rate: 7.1 symbols/min [2025-10-15T19:43:01.403693] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-06 (2.08 seconds). [2025-10-15T19:43:01.413901] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-07. [2025-10-15T19:43:03.143825] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-15T19:43:03.156567] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-08. [2025-10-15T19:43:05.024799] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-15T19:43:05.035936] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-09. [2025-10-15T19:43:07.126844] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-09 (2.09 seconds). [2025-10-15T19:43:07.138456] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-10. [2025-10-15T19:43:09.255219] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-10 (2.12 seconds). [2025-10-15T19:43:09.261935] [INFO ] [REMOTE ] JMIA: Full fetch complete (73435 records). [2025-10-15T19:43:09.262097] [DEBUG] [VALIDATOR ] JMIA: Validating primary data. [2025-10-15T19:43:09.655503] [DEBUG] [VALIDATOR ] JMIA: All expected trading days are present. [2025-10-15T19:43:09.655594] [DEBUG] [VALIDATOR ] JMIA: Primary data validation passed. [2025-10-15T19:43:09.656603] [INFO ] [MAIN ] JMIA: Fetched primary data is valid. [2025-10-15T19:43:09.656724] [DEBUG] [LOCAL ] JMIA: Saving primary data. [2025-10-15T19:43:09.658208] [DEBUG] [LOCAL ] JMIA: Trimmed 73435 records to 51055 (keeping 200 days of data) [2025-10-15T19:43:09.945190] [DEBUG] [LOCAL ] JMIA: Primary data saved (51055 records). [2025-10-15T19:43:09.945320] [INFO ] [MAIN ] JMIA: Full history saved. [2025-10-15T19:43:09.945416] [INFO ] [MAIN ] Update Progress: 1160/2369 symbols completed. JMIA took 32.2s. Estimated remaining: 2h 49m 59s. Rate: 7.1 symbols/min [2025-10-15T19:43:10.496782] [INFO ] [MAIN ] JOE: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:43:10.614433] [INFO ] [MAIN ] JOBY: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:43:10.652546] [INFO ] [MAIN ] JMM: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:43:10.653084] [DEBUG] [LOCAL ] JMM: No existing data file found in primary storage. [2025-10-15T19:43:10.653245] [WARN ] [MAIN ] JMM: No existing data found, performing full refresh instead. [2025-10-15T19:43:10.674123] [INFO ] [MAIN ] JMM: Wiping existing primary data before full refresh. [2025-10-15T19:43:10.675406] [INFO ] [LOCAL ] JMM: Starting deletion of primary data. [2025-10-15T19:43:10.675261] [INFO ] [MAIN ] JNJ: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:43:10.675629] [DEBUG] [LOCAL ] JMM: No primary data file found to delete. [2025-10-15T19:43:10.676022] [INFO ] [MAIN ] JMM: Starting full primary refresh. [2025-10-15T19:43:10.851599] [DEBUG] [LOCAL ] JOE: Loaded 23904 existing records from primary storage. [2025-10-15T19:43:10.930853] [INFO ] [MAIN ] JOE: Loaded 23904 existing records. [2025-10-15T19:43:11.104514] [DEBUG] [LOCAL ] JOBY: Loaded 53808 existing records from primary storage. [2025-10-15T19:43:11.169059] [INFO ] [MAIN ] JOBY: Loaded 53808 existing records. [2025-10-15T19:43:11.300498] [INFO ] [REMOTE ] JMM: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:43:11.356134] [INFO ] [REMOTE ] JMM: Fetching primary data for 2024-12. [2025-10-15T19:43:11.347921] [DEBUG] [LOCAL ] JNJ: Loaded 53753 existing records from primary storage. [2025-10-15T19:43:11.364623] [WARN ] [MAIN ] JOE: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:43:11.420051] [INFO ] [MAIN ] JOE: Wiping existing primary data before full refresh. [2025-10-15T19:43:11.402954] [INFO ] [MAIN ] JNJ: Loaded 53753 existing records. [2025-10-15T19:43:11.427992] [INFO ] [LOCAL ] JOE: Starting deletion of primary data. [2025-10-15T19:43:11.473090] [DEBUG] [LOCAL ] JOE: Deleted primary data file. [2025-10-15T19:43:11.488762] [INFO ] [MAIN ] JOE: Starting full primary refresh. [2025-10-15T19:43:11.654113] [WARN ] [MAIN ] JOBY: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:43:11.700473] [INFO ] [MAIN ] JOBY: Wiping existing primary data before full refresh. [2025-10-15T19:43:11.768384] [INFO ] [LOCAL ] JOBY: Starting deletion of primary data. [2025-10-15T19:43:11.805127] [DEBUG] [LOCAL ] JOBY: Deleted primary data file. [2025-10-15T19:43:11.805268] [INFO ] [MAIN ] JOBY: Starting full primary refresh. [2025-10-15T19:43:11.805074] [WARN ] [MAIN ] JNJ: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:43:11.881274] [INFO ] [MAIN ] JNJ: Wiping existing primary data before full refresh. [2025-10-15T19:43:11.931203] [INFO ] [LOCAL ] JNJ: Starting deletion of primary data. [2025-10-15T19:43:12.010724] [DEBUG] [LOCAL ] JNJ: Deleted primary data file. [2025-10-15T19:43:12.033553] [INFO ] [MAIN ] JNJ: Starting full primary refresh. [2025-10-15T19:43:12.101748] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-10-15T19:43:12.203510] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-01. [2025-10-15T19:43:12.513631] [INFO ] [REMOTE ] JOE: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:43:12.576022] [INFO ] [REMOTE ] JOE: Fetching primary data for 2024-12. [2025-10-15T19:43:12.590277] [INFO ] [REMOTE ] JOBY: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:43:12.630921] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2024-12. [2025-10-15T19:43:12.758212] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-15T19:43:12.764507] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-02. [2025-10-15T19:43:12.832183] [INFO ] [REMOTE ] JNJ: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:43:12.832482] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2024-12. [2025-10-15T19:43:13.253198] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-15T19:43:13.254252] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-03. [2025-10-15T19:43:13.705186] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-15T19:43:13.710901] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-01. [2025-10-15T19:43:13.751879] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-10-15T19:43:13.752824] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-04. [2025-10-15T19:43:14.141971] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-04 (0.39 seconds). [2025-10-15T19:43:14.143047] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-05. [2025-10-15T19:43:14.604091] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-10-15T19:43:14.605385] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-06. [2025-10-15T19:43:14.745842] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-15T19:43:14.751685] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-02. [2025-10-15T19:43:14.970263] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2024-12 (2.14 seconds). [2025-10-15T19:43:14.981829] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-01. [2025-10-15T19:43:15.076274] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-10-15T19:43:15.077535] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-07. [2025-10-15T19:43:15.124723] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2024-12 (2.49 seconds). [2025-10-15T19:43:15.135693] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-01. [2025-10-15T19:43:15.482797] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-07 (0.41 seconds). [2025-10-15T19:43:15.484323] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-08. [2025-10-15T19:43:15.613759] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-15T19:43:15.917236] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-10-15T19:43:16.114042] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-03. [2025-10-15T19:43:16.914076] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-09. [2025-10-15T19:43:17.238993] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-01 (2.26 seconds). [2025-10-15T19:43:17.414872] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-15T19:43:17.539884] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-15T19:43:17.615723] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-01 (2.48 seconds). [2025-10-15T19:43:17.713983] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-02. [2025-10-15T19:43:18.513994] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-04. [2025-10-15T19:43:19.313997] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-02. [2025-10-15T19:43:19.745319] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-15T19:43:19.913925] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-02 (2.20 seconds). [2025-10-15T19:43:20.114017] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-05. [2025-10-15T19:43:20.914002] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-03. [2025-10-15T19:43:21.378765] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-02 (2.06 seconds). [2025-10-15T19:43:21.444915] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-15T19:43:21.713988] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-06. [2025-10-15T19:43:22.514033] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-10. [2025-10-15T19:43:22.818472] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-15T19:43:22.968779] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-15T19:43:22.969510] [INFO ] [REMOTE ] JMM: Full fetch complete (2304 records). [2025-10-15T19:43:22.969575] [DEBUG] [VALIDATOR ] JMM: Validating primary data. [2025-10-15T19:43:23.147525] [WARN ] [VALIDATOR ] JMM: Validation failed - insufficient historical data. Have 194 unique days, need 200 days [2025-10-15T19:43:23.147733] [FATAL] [MAIN ] JMM: Fetched primary data is invalid. Refusing to save it. [2025-10-15T19:43:23.147805] [WARN ] [MAIN ] JMM: Deleting existing primary and derivative data due to validation failure. [2025-10-15T19:43:23.147880] [INFO ] [LOCAL ] JMM: Starting deletion of primary data. [2025-10-15T19:43:23.147941] [DEBUG] [LOCAL ] JMM: No primary data file found to delete. [2025-10-15T19:43:23.147977] [INFO ] [LOCAL ] JMM: Starting deletion of derivative data. [2025-10-15T19:43:23.148016] [DEBUG] [LOCAL ] JMM: No derivative data file found to delete. [2025-10-15T19:43:23.148074] [INFO ] [MAIN ] Update Progress: 1161/2369 symbols completed. JMM took 13.2s. Estimated remaining: 2h 49m 55s. Rate: 7.1 symbols/min [2025-10-15T19:43:23.315161] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-07. [2025-10-15T19:43:23.318066] [INFO ] [MAIN ] JOF: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:43:23.332917] [DEBUG] [LOCAL ] JOF: Loaded 6886 existing records from primary storage. [2025-10-15T19:43:23.333151] [INFO ] [MAIN ] JOF: Loaded 6886 existing records. [2025-10-15T19:43:23.512455] [WARN ] [MAIN ] JOF: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:43:23.512785] [INFO ] [MAIN ] JOF: Wiping existing primary data before full refresh. [2025-10-15T19:43:23.512847] [INFO ] [LOCAL ] JOF: Starting deletion of primary data. [2025-10-15T19:43:23.537761] [DEBUG] [LOCAL ] JOF: Deleted primary data file. [2025-10-15T19:43:23.540795] [INFO ] [MAIN ] JOF: Starting full primary refresh. [2025-10-15T19:43:23.616937] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-03 (2.70 seconds). [2025-10-15T19:43:23.898935] [INFO ] [REMOTE ] JOF: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:43:24.113970] [INFO ] [REMOTE ] JOF: Fetching primary data for 2024-12. [2025-10-15T19:43:24.314551] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-15T19:43:24.709265] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-10-15T19:43:24.913993] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-01. [2025-10-15T19:43:25.544612] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-15T19:43:25.714005] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-08. [2025-10-15T19:43:26.514049] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-04. [2025-10-15T19:43:26.787426] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-15T19:43:27.314017] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-02. [2025-10-15T19:43:27.927024] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-15T19:43:28.114008] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-09. [2025-10-15T19:43:28.853232] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-04 (2.34 seconds). [2025-10-15T19:43:28.913983] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-05. [2025-10-15T19:43:28.978343] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-15T19:43:29.714017] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-03. [2025-10-15T19:43:30.513999] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-03. [2025-10-15T19:43:31.007011] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-10-15T19:43:31.314040] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-04. [2025-10-15T19:43:31.509920] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-05 (2.60 seconds). [2025-10-15T19:43:31.726137] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-04 (0.41 seconds). [2025-10-15T19:43:32.022612] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-03 (2.31 seconds). [2025-10-15T19:43:32.114005] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-06. [2025-10-15T19:43:32.914020] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-04. [2025-10-15T19:43:33.713997] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-10. [2025-10-15T19:43:34.514002] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-05. [2025-10-15T19:43:34.625586] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-06 (2.51 seconds). [2025-10-15T19:43:34.762296] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-15T19:43:34.765632] [INFO ] [REMOTE ] JOE: Full fetch complete (35707 records). [2025-10-15T19:43:34.765778] [DEBUG] [VALIDATOR ] JOE: Validating primary data. [2025-10-15T19:43:35.064195] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-10-15T19:43:35.180393] [DEBUG] [VALIDATOR ] JOE: All expected trading days are present. [2025-10-15T19:43:35.180513] [DEBUG] [VALIDATOR ] JOE: Primary data validation passed. [2025-10-15T19:43:35.181350] [INFO ] [MAIN ] JOE: Fetched primary data is valid. [2025-10-15T19:43:35.181449] [DEBUG] [LOCAL ] JOE: Saving primary data. [2025-10-15T19:43:35.183756] [DEBUG] [LOCAL ] JOE: Trimmed 35707 records to 23893 (keeping 200 days of data) [2025-10-15T19:43:35.305934] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-04 (2.39 seconds). [2025-10-15T19:43:35.321612] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-06. [2025-10-15T19:43:35.375009] [DEBUG] [LOCAL ] JOE: Primary data saved (23893 records). [2025-10-15T19:43:35.375129] [INFO ] [MAIN ] JOE: Full history saved. [2025-10-15T19:43:35.375209] [INFO ] [MAIN ] Update Progress: 1162/2369 symbols completed. JOE took 25.4s. Estimated remaining: 2h 49m 51s. Rate: 7.1 symbols/min [2025-10-15T19:43:35.540388] [INFO ] [MAIN ] JPC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:43:35.576603] [DEBUG] [LOCAL ] JPC: Loaded 37244 existing records from primary storage. [2025-10-15T19:43:35.576903] [INFO ] [MAIN ] JPC: Loaded 37244 existing records. [2025-10-15T19:43:35.778405] [WARN ] [MAIN ] JPC: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:43:35.778616] [INFO ] [MAIN ] JPC: Wiping existing primary data before full refresh. [2025-10-15T19:43:35.778691] [INFO ] [LOCAL ] JPC: Starting deletion of primary data. [2025-10-15T19:43:35.779031] [DEBUG] [LOCAL ] JPC: Deleted primary data file. [2025-10-15T19:43:35.779070] [INFO ] [MAIN ] JPC: Starting full primary refresh. [2025-10-15T19:43:36.038315] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-15T19:43:36.119117] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-05. [2025-10-15T19:43:36.147239] [INFO ] [REMOTE ] JPC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:43:36.914054] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-07. [2025-10-15T19:43:37.534490] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-15T19:43:37.714093] [INFO ] [REMOTE ] JPC: Fetching primary data for 2024-12. [2025-10-15T19:43:38.296093] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-05 (2.18 seconds). [2025-10-15T19:43:38.514029] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-06. [2025-10-15T19:43:39.195709] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-15T19:43:39.314044] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-01. [2025-10-15T19:43:40.114017] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-08. [2025-10-15T19:43:40.639949] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-06 (2.13 seconds). [2025-10-15T19:43:40.680690] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-15T19:43:40.835197] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-15T19:43:40.913967] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-07. [2025-10-15T19:43:41.714008] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-09. [2025-10-15T19:43:42.421749] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-15T19:43:42.513954] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-10. [2025-10-15T19:43:43.135619] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-15T19:43:43.136964] [INFO ] [REMOTE ] JOF: Full fetch complete (9527 records). [2025-10-15T19:43:43.137032] [DEBUG] [VALIDATOR ] JOF: Validating primary data. [2025-10-15T19:43:43.325854] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-02. [2025-10-15T19:43:43.469899] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-07 (2.56 seconds). [2025-10-15T19:43:43.545476] [DEBUG] [VALIDATOR ] JOF: All expected trading days are present. [2025-10-15T19:43:43.545549] [DEBUG] [VALIDATOR ] JOF: Primary data validation passed. [2025-10-15T19:43:43.545870] [INFO ] [MAIN ] JOF: Fetched primary data is valid. [2025-10-15T19:43:43.545931] [DEBUG] [LOCAL ] JOF: Saving primary data. [2025-10-15T19:43:43.546342] [DEBUG] [LOCAL ] JOF: Trimmed 9527 records to 6891 (keeping 200 days of data) [2025-10-15T19:43:43.586814] [DEBUG] [LOCAL ] JOF: Primary data saved (6891 records). [2025-10-15T19:43:43.586941] [INFO ] [MAIN ] JOF: Full history saved. [2025-10-15T19:43:43.587024] [INFO ] [MAIN ] Update Progress: 1163/2369 symbols completed. JOF took 20.4s. Estimated remaining: 2h 49m 42s. Rate: 7.1 symbols/min [2025-10-15T19:43:43.752120] [INFO ] [MAIN ] JPM: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:43:43.805221] [DEBUG] [LOCAL ] JPM: Loaded 53794 existing records from primary storage. [2025-10-15T19:43:43.805563] [INFO ] [MAIN ] JPM: Loaded 53794 existing records. [2025-10-15T19:43:43.988635] [WARN ] [MAIN ] JPM: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:43:43.988885] [INFO ] [MAIN ] JPM: Wiping existing primary data before full refresh. [2025-10-15T19:43:43.988937] [INFO ] [LOCAL ] JPM: Starting deletion of primary data. [2025-10-15T19:43:43.989428] [DEBUG] [LOCAL ] JPM: Deleted primary data file. [2025-10-15T19:43:43.989493] [INFO ] [MAIN ] JPM: Starting full primary refresh. [2025-10-15T19:43:44.127105] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-08. [2025-10-15T19:43:44.358700] [INFO ] [REMOTE ] JPM: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:43:44.724848] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-15T19:43:44.914058] [INFO ] [REMOTE ] JPM: Fetching primary data for 2024-12. [2025-10-15T19:43:45.714000] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-03. [2025-10-15T19:43:46.165202] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-10-15T19:43:46.514067] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-07. [2025-10-15T19:43:46.987986] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2024-12 (2.07 seconds). [2025-10-15T19:43:47.139412] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-15T19:43:47.314018] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-09. [2025-10-15T19:43:48.114052] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-01. [2025-10-15T19:43:48.914031] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-04. [2025-10-15T19:43:49.095550] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-07 (2.58 seconds). [2025-10-15T19:43:49.204701] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-15T19:43:49.714066] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-08. [2025-10-15T19:43:49.973620] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-15T19:43:50.423308] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-15T19:43:50.513961] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-05. [2025-10-15T19:43:51.314051] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-10. [2025-10-15T19:43:51.912129] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-15T19:43:52.113968] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-02. [2025-10-15T19:43:52.220130] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-08 (2.51 seconds). [2025-10-15T19:43:52.913998] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-06. [2025-10-15T19:43:53.298236] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-10 (1.98 seconds). [2025-10-15T19:43:53.304586] [INFO ] [REMOTE ] JNJ: Full fetch complete (77933 records). [2025-10-15T19:43:53.304747] [DEBUG] [VALIDATOR ] JNJ: Validating primary data. [2025-10-15T19:43:53.690275] [DEBUG] [VALIDATOR ] JNJ: All expected trading days are present. [2025-10-15T19:43:53.690394] [DEBUG] [VALIDATOR ] JNJ: Primary data validation passed. [2025-10-15T19:43:53.691443] [INFO ] [MAIN ] JNJ: Fetched primary data is valid. [2025-10-15T19:43:53.691506] [DEBUG] [LOCAL ] JNJ: Saving primary data. [2025-10-15T19:43:53.692914] [DEBUG] [LOCAL ] JNJ: Trimmed 77933 records to 53753 (keeping 200 days of data) [2025-10-15T19:43:53.747896] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-09. [2025-10-15T19:43:54.030889] [DEBUG] [LOCAL ] JNJ: Primary data saved (53753 records). [2025-10-15T19:43:54.031127] [INFO ] [MAIN ] JNJ: Full history saved. [2025-10-15T19:43:54.031225] [INFO ] [MAIN ] Update Progress: 1164/2369 symbols completed. JNJ took 44.1s. Estimated remaining: 2h 49m 36s. Rate: 7.1 symbols/min [2025-10-15T19:43:54.199809] [INFO ] [MAIN ] JQC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:43:54.230610] [DEBUG] [LOCAL ] JQC: Loaded 33824 existing records from primary storage. [2025-10-15T19:43:54.230933] [INFO ] [MAIN ] JQC: Loaded 33824 existing records. [2025-10-15T19:43:54.410910] [WARN ] [MAIN ] JQC: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:43:54.411782] [INFO ] [MAIN ] JQC: Wiping existing primary data before full refresh. [2025-10-15T19:43:54.426481] [INFO ] [LOCAL ] JQC: Starting deletion of primary data. [2025-10-15T19:43:54.450737] [DEBUG] [LOCAL ] JQC: Deleted primary data file. [2025-10-15T19:43:54.454776] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-02 (2.34 seconds). [2025-10-15T19:43:54.464775] [INFO ] [MAIN ] JQC: Starting full primary refresh. [2025-10-15T19:43:54.497273] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-15T19:43:54.529278] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-03. [2025-10-15T19:43:54.822766] [INFO ] [REMOTE ] JQC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:43:55.314053] [INFO ] [REMOTE ] JQC: Fetching primary data for 2024-12. [2025-10-15T19:43:56.113967] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-07. [2025-10-15T19:43:56.301856] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-09 (2.55 seconds). [2025-10-15T19:43:56.616857] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-15T19:43:56.914042] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-10. [2025-10-15T19:43:57.109620] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-03 (2.58 seconds). [2025-10-15T19:43:57.189814] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-15T19:43:57.714013] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-08. [2025-10-15T19:43:58.514050] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-04. [2025-10-15T19:43:59.206834] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-15T19:43:59.313950] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-09. [2025-10-15T19:43:59.825255] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-10 (2.91 seconds). [2025-10-15T19:43:59.831623] [INFO ] [REMOTE ] JOBY: Full fetch complete (77974 records). [2025-10-15T19:43:59.831775] [DEBUG] [VALIDATOR ] JOBY: Validating primary data. [2025-10-15T19:44:00.120632] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-01. [2025-10-15T19:44:00.218479] [DEBUG] [VALIDATOR ] JOBY: All expected trading days are present. [2025-10-15T19:44:00.218556] [DEBUG] [VALIDATOR ] JOBY: Primary data validation passed. [2025-10-15T19:44:00.219622] [INFO ] [MAIN ] JOBY: Fetched primary data is valid. [2025-10-15T19:44:00.219706] [DEBUG] [LOCAL ] JOBY: Saving primary data. [2025-10-15T19:44:00.221185] [DEBUG] [LOCAL ] JOBY: Trimmed 77974 records to 53808 (keeping 200 days of data) [2025-10-15T19:44:00.476364] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-15T19:44:00.574936] [DEBUG] [LOCAL ] JOBY: Primary data saved (53808 records). [2025-10-15T19:44:00.575091] [INFO ] [MAIN ] JOBY: Full history saved. [2025-10-15T19:44:00.575202] [INFO ] [MAIN ] Update Progress: 1165/2369 symbols completed. JOBY took 50.6s. Estimated remaining: 2h 49m 25s. Rate: 7.1 symbols/min [2025-10-15T19:44:00.752069] [INFO ] [MAIN ] JRI: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:44:00.789688] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-04 (2.28 seconds). [2025-10-15T19:44:00.806672] [DEBUG] [LOCAL ] JRI: Loaded 15431 existing records from primary storage. [2025-10-15T19:44:00.806915] [INFO ] [MAIN ] JRI: Loaded 15431 existing records. [2025-10-15T19:44:00.919154] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-10. [2025-10-15T19:44:00.993814] [WARN ] [MAIN ] JRI: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:44:00.994087] [INFO ] [MAIN ] JRI: Wiping existing primary data before full refresh. [2025-10-15T19:44:00.994134] [INFO ] [LOCAL ] JRI: Starting deletion of primary data. [2025-10-15T19:44:00.994381] [DEBUG] [LOCAL ] JRI: Deleted primary data file. [2025-10-15T19:44:00.994437] [INFO ] [MAIN ] JRI: Starting full primary refresh. [2025-10-15T19:44:01.398781] [INFO ] [REMOTE ] JRI: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:44:01.645862] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-15T19:44:01.714003] [INFO ] [REMOTE ] JRI: Fetching primary data for 2024-12. [2025-10-15T19:44:02.378670] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-15T19:44:02.383722] [INFO ] [REMOTE ] JPC: Full fetch complete (55333 records). [2025-10-15T19:44:02.383828] [DEBUG] [VALIDATOR ] JPC: Validating primary data. [2025-10-15T19:44:02.532184] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-02. [2025-10-15T19:44:02.572618] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-10-15T19:44:02.791689] [DEBUG] [VALIDATOR ] JPC: All expected trading days are present. [2025-10-15T19:44:02.791781] [DEBUG] [VALIDATOR ] JPC: Primary data validation passed. [2025-10-15T19:44:02.792760] [INFO ] [MAIN ] JPC: Fetched primary data is valid. [2025-10-15T19:44:02.792825] [DEBUG] [LOCAL ] JPC: Saving primary data. [2025-10-15T19:44:02.794005] [DEBUG] [LOCAL ] JPC: Trimmed 55333 records to 37227 (keeping 200 days of data) [2025-10-15T19:44:03.009110] [DEBUG] [LOCAL ] JPC: Primary data saved (37227 records). [2025-10-15T19:44:03.009255] [INFO ] [MAIN ] JPC: Full history saved. [2025-10-15T19:44:03.009334] [INFO ] [MAIN ] Update Progress: 1166/2369 symbols completed. JPC took 27.6s. Estimated remaining: 2h 49m 11s. Rate: 7.1 symbols/min [2025-10-15T19:44:03.171927] [INFO ] [MAIN ] JRS: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:44:03.183435] [DEBUG] [LOCAL ] JRS: Loaded 11664 existing records from primary storage. [2025-10-15T19:44:03.183684] [INFO ] [MAIN ] JRS: Loaded 11664 existing records. [2025-10-15T19:44:03.319210] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-05. [2025-10-15T19:44:03.359145] [WARN ] [MAIN ] JRS: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:44:03.359312] [INFO ] [MAIN ] JRS: Wiping existing primary data before full refresh. [2025-10-15T19:44:03.359359] [INFO ] [LOCAL ] JRS: Starting deletion of primary data. [2025-10-15T19:44:03.359534] [DEBUG] [LOCAL ] JRS: Deleted primary data file. [2025-10-15T19:44:03.359588] [INFO ] [MAIN ] JRS: Starting full primary refresh. [2025-10-15T19:44:03.714495] [INFO ] [REMOTE ] JRS: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:44:03.863514] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-15T19:44:04.114001] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-01. [2025-10-15T19:44:04.914011] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-03. [2025-10-15T19:44:05.186873] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-15T19:44:05.715256] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-02. [2025-10-15T19:44:05.715176] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-05 (2.40 seconds). [2025-10-15T19:44:06.283434] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-15T19:44:06.514001] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-06. [2025-10-15T19:44:06.926106] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-15T19:44:07.314017] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-04. [2025-10-15T19:44:08.113976] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-03. [2025-10-15T19:44:08.806843] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-15T19:44:08.842733] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-15T19:44:08.858862] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-06 (2.34 seconds). [2025-10-15T19:44:08.914021] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-07. [2025-10-15T19:44:09.713986] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-05. [2025-10-15T19:44:10.514005] [INFO ] [REMOTE ] JRS: Fetching primary data for 2024-12. [2025-10-15T19:44:11.035912] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-15T19:44:11.179325] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-07 (2.27 seconds). [2025-10-15T19:44:11.237060] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-10-15T19:44:11.313953] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-08. [2025-10-15T19:44:12.114016] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-01. [2025-10-15T19:44:12.736577] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-15T19:44:12.914028] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-06. [2025-10-15T19:44:13.687591] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-08 (2.37 seconds). [2025-10-15T19:44:13.713956] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-09. [2025-10-15T19:44:14.144084] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-15T19:44:14.514008] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-07. [2025-10-15T19:44:15.314004] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-02. [2025-10-15T19:44:15.922538] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-15T19:44:15.983870] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-15T19:44:16.113974] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-08. [2025-10-15T19:44:16.151113] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-09 (2.44 seconds). [2025-10-15T19:44:16.913992] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-10. [2025-10-15T19:44:17.295634] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-15T19:44:17.713992] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-09. [2025-10-15T19:44:18.514063] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-03. [2025-10-15T19:44:19.127365] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-15T19:44:19.313998] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-10. [2025-10-15T19:44:19.337048] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-15T19:44:19.395536] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-10 (2.48 seconds). [2025-10-15T19:44:19.402465] [INFO ] [REMOTE ] JPM: Full fetch complete (77973 records). [2025-10-15T19:44:19.402678] [DEBUG] [VALIDATOR ] JPM: Validating primary data. [2025-10-15T19:44:19.945451] [DEBUG] [VALIDATOR ] JPM: All expected trading days are present. [2025-10-15T19:44:19.945527] [DEBUG] [VALIDATOR ] JPM: Primary data validation passed. [2025-10-15T19:44:19.946579] [INFO ] [MAIN ] JPM: Fetched primary data is valid. [2025-10-15T19:44:19.946663] [DEBUG] [LOCAL ] JPM: Saving primary data. [2025-10-15T19:44:19.948076] [DEBUG] [LOCAL ] JPM: Trimmed 77973 records to 53794 (keeping 200 days of data) [2025-10-15T19:44:20.126018] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-04. [2025-10-15T19:44:20.283702] [DEBUG] [LOCAL ] JPM: Primary data saved (53794 records). [2025-10-15T19:44:20.283827] [INFO ] [MAIN ] JPM: Full history saved. [2025-10-15T19:44:20.283904] [INFO ] [MAIN ] Update Progress: 1167/2369 symbols completed. JPM took 36.7s. Estimated remaining: 2h 49m 11s. Rate: 7.1 symbols/min [2025-10-15T19:44:20.460097] [INFO ] [MAIN ] JXN: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:44:20.476520] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-15T19:44:20.483862] [INFO ] [REMOTE ] JQC: Full fetch complete (49626 records). [2025-10-15T19:44:20.484007] [DEBUG] [VALIDATOR ] JQC: Validating primary data. [2025-10-15T19:44:20.808585] [DEBUG] [LOCAL ] JXN: Loaded 44808 existing records from primary storage. [2025-10-15T19:44:20.825015] [INFO ] [MAIN ] JXN: Loaded 44808 existing records. [2025-10-15T19:44:20.915172] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-04. [2025-10-15T19:44:21.004152] [DEBUG] [VALIDATOR ] JQC: All expected trading days are present. [2025-10-15T19:44:21.025714] [DEBUG] [VALIDATOR ] JQC: Primary data validation passed. [2025-10-15T19:44:21.031831] [INFO ] [MAIN ] JQC: Fetched primary data is valid. [2025-10-15T19:44:21.045328] [DEBUG] [LOCAL ] JQC: Saving primary data. [2025-10-15T19:44:21.088121] [WARN ] [MAIN ] JXN: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:44:21.096793] [INFO ] [MAIN ] JXN: Wiping existing primary data before full refresh. [2025-10-15T19:44:21.096987] [INFO ] [LOCAL ] JXN: Starting deletion of primary data. [2025-10-15T19:44:21.098345] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-15T19:44:21.098426] [DEBUG] [LOCAL ] JXN: Deleted primary data file. [2025-10-15T19:44:21.098593] [INFO ] [MAIN ] JXN: Starting full primary refresh. [2025-10-15T19:44:21.097815] [DEBUG] [LOCAL ] JQC: Trimmed 49626 records to 33645 (keeping 200 days of data) [2025-10-15T19:44:21.593741] [INFO ] [REMOTE ] JXN: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:44:21.675285] [DEBUG] [LOCAL ] JQC: Primary data saved (33645 records). [2025-10-15T19:44:21.675428] [INFO ] [MAIN ] JQC: Full history saved. [2025-10-15T19:44:21.675888] [INFO ] [MAIN ] Update Progress: 1168/2369 symbols completed. JQC took 27.6s. Estimated remaining: 2h 48m 56s. Rate: 7.1 symbols/min [2025-10-15T19:44:21.717635] [INFO ] [REMOTE ] JXN: Fetching primary data for 2024-12. [2025-10-15T19:44:21.850271] [INFO ] [MAIN ] K: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:44:21.869775] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-15T19:44:21.906009] [DEBUG] [LOCAL ] K: Loaded 50400 existing records from primary storage. [2025-10-15T19:44:21.906314] [INFO ] [MAIN ] K: Loaded 50400 existing records. [2025-10-15T19:44:22.093491] [WARN ] [MAIN ] K: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:44:22.093740] [INFO ] [MAIN ] K: Wiping existing primary data before full refresh. [2025-10-15T19:44:22.093794] [INFO ] [LOCAL ] K: Starting deletion of primary data. [2025-10-15T19:44:22.094254] [DEBUG] [LOCAL ] K: Deleted primary data file. [2025-10-15T19:44:22.094310] [INFO ] [MAIN ] K: Starting full primary refresh. [2025-10-15T19:44:22.463374] [INFO ] [REMOTE ] K: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:44:22.513962] [INFO ] [REMOTE ] K: Fetching primary data for 2024-12. [2025-10-15T19:44:23.018960] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-15T19:44:23.314010] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-05. [2025-10-15T19:44:24.018382] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-15T19:44:24.113964] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-05. [2025-10-15T19:44:24.150260] [INFO ] [REMOTE ] K: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-15T19:44:24.856264] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-15T19:44:24.913981] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-06. [2025-10-15T19:44:25.714004] [INFO ] [REMOTE ] K: Fetching primary data for 2025-01. [2025-10-15T19:44:25.859251] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-15T19:44:26.513995] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-07. [2025-10-15T19:44:27.049200] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-15T19:44:27.313968] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-06. [2025-10-15T19:44:27.523595] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-15T19:44:28.113978] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-08. [2025-10-15T19:44:28.156681] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-15T19:44:28.914055] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-07. [2025-10-15T19:44:28.924742] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-15T19:44:29.714041] [INFO ] [REMOTE ] K: Fetching primary data for 2025-02. [2025-10-15T19:44:29.829566] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-15T19:44:30.514063] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-01. [2025-10-15T19:44:31.004831] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-15T19:44:31.314008] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-09. [2025-10-15T19:44:32.008777] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-15T19:44:32.062020] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-15T19:44:32.114023] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-10. [2025-10-15T19:44:32.914025] [INFO ] [REMOTE ] K: Fetching primary data for 2025-03. [2025-10-15T19:44:33.127286] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-15T19:44:33.129915] [INFO ] [REMOTE ] JRI: Full fetch complete (23251 records). [2025-10-15T19:44:33.129997] [DEBUG] [VALIDATOR ] JRI: Validating primary data. [2025-10-15T19:44:33.488480] [DEBUG] [VALIDATOR ] JRI: All expected trading days are present. [2025-10-15T19:44:33.488558] [DEBUG] [VALIDATOR ] JRI: Primary data validation passed. [2025-10-15T19:44:33.489053] [INFO ] [MAIN ] JRI: Fetched primary data is valid. [2025-10-15T19:44:33.489115] [DEBUG] [LOCAL ] JRI: Saving primary data. [2025-10-15T19:44:33.489812] [DEBUG] [LOCAL ] JRI: Trimmed 23251 records to 15410 (keeping 200 days of data) [2025-10-15T19:44:33.584606] [DEBUG] [LOCAL ] JRI: Primary data saved (15410 records). [2025-10-15T19:44:33.584762] [INFO ] [MAIN ] JRI: Full history saved. [2025-10-15T19:44:33.584845] [INFO ] [MAIN ] Update Progress: 1169/2369 symbols completed. JRI took 33.0s. Estimated remaining: 2h 48m 51s. Rate: 7.1 symbols/min [2025-10-15T19:44:33.723871] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-08. [2025-10-15T19:44:33.756261] [INFO ] [MAIN ] KAI: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:44:33.771532] [DEBUG] [LOCAL ] KAI: Loaded 13548 existing records from primary storage. [2025-10-15T19:44:33.771896] [INFO ] [MAIN ] KAI: Loaded 13548 existing records. [2025-10-15T19:44:33.948566] [WARN ] [MAIN ] KAI: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:44:33.948834] [INFO ] [MAIN ] KAI: Wiping existing primary data before full refresh. [2025-10-15T19:44:33.948885] [INFO ] [LOCAL ] KAI: Starting deletion of primary data. [2025-10-15T19:44:33.949109] [DEBUG] [LOCAL ] KAI: Deleted primary data file. [2025-10-15T19:44:33.949168] [INFO ] [MAIN ] KAI: Starting full primary refresh. [2025-10-15T19:44:34.304255] [INFO ] [REMOTE ] KAI: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:44:34.351172] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-15T19:44:34.513968] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-02. [2025-10-15T19:44:34.543882] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-15T19:44:35.314020] [INFO ] [REMOTE ] KAI: Fetching primary data for 2024-12. [2025-10-15T19:44:36.112546] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-15T19:44:36.113341] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-10-15T19:44:36.121574] [INFO ] [REMOTE ] K: Fetching primary data for 2025-04. [2025-10-15T19:44:36.914038] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-09. [2025-10-15T19:44:37.714058] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-03. [2025-10-15T19:44:37.817617] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-15T19:44:37.867868] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-15T19:44:38.514009] [INFO ] [REMOTE ] K: Fetching primary data for 2025-05. [2025-10-15T19:44:39.313988] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-10. [2025-10-15T19:44:39.567163] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-15T19:44:39.924256] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-15T19:44:39.940563] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-15T19:44:39.942764] [INFO ] [REMOTE ] JRS: Full fetch complete (16339 records). [2025-10-15T19:44:39.942840] [DEBUG] [VALIDATOR ] JRS: Validating primary data. [2025-10-15T19:44:40.118682] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-04. [2025-10-15T19:44:40.310509] [DEBUG] [VALIDATOR ] JRS: All expected trading days are present. [2025-10-15T19:44:40.310628] [DEBUG] [VALIDATOR ] JRS: Primary data validation passed. [2025-10-15T19:44:40.311025] [INFO ] [MAIN ] JRS: Fetched primary data is valid. [2025-10-15T19:44:40.311072] [DEBUG] [LOCAL ] JRS: Saving primary data. [2025-10-15T19:44:40.311702] [DEBUG] [LOCAL ] JRS: Trimmed 16339 records to 11669 (keeping 200 days of data) [2025-10-15T19:44:40.383635] [DEBUG] [LOCAL ] JRS: Primary data saved (11669 records). [2025-10-15T19:44:40.383792] [INFO ] [MAIN ] JRS: Full history saved. [2025-10-15T19:44:40.383873] [INFO ] [MAIN ] Update Progress: 1170/2369 symbols completed. JRS took 37.4s. Estimated remaining: 2h 48m 41s. Rate: 7.1 symbols/min [2025-10-15T19:44:40.547161] [INFO ] [MAIN ] KAR: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:44:40.584482] [DEBUG] [LOCAL ] KAR: Loaded 40095 existing records from primary storage. [2025-10-15T19:44:40.584807] [INFO ] [MAIN ] KAR: Loaded 40095 existing records. [2025-10-15T19:44:40.755899] [WARN ] [MAIN ] KAR: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:44:40.756082] [INFO ] [MAIN ] KAR: Wiping existing primary data before full refresh. [2025-10-15T19:44:40.756130] [INFO ] [LOCAL ] KAR: Starting deletion of primary data. [2025-10-15T19:44:40.756476] [DEBUG] [LOCAL ] KAR: Deleted primary data file. [2025-10-15T19:44:40.756515] [INFO ] [MAIN ] KAR: Starting full primary refresh. [2025-10-15T19:44:40.922460] [INFO ] [REMOTE ] K: Fetching primary data for 2025-06. [2025-10-15T19:44:41.098762] [INFO ] [REMOTE ] KAR: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:44:41.660930] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-15T19:44:41.713961] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-01. [2025-10-15T19:44:42.484204] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-15T19:44:42.513947] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-02. [2025-10-15T19:44:42.800768] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-15T19:44:43.313957] [INFO ] [REMOTE ] K: Fetching primary data for 2025-07. [2025-10-15T19:44:43.491534] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-15T19:44:44.114054] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-03. [2025-10-15T19:44:44.913981] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-05. [2025-10-15T19:44:44.998483] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-15T19:44:45.060128] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-15T19:44:45.714052] [INFO ] [REMOTE ] K: Fetching primary data for 2025-08. [2025-10-15T19:44:46.472420] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-15T19:44:46.513962] [INFO ] [REMOTE ] KAR: Fetching primary data for 2024-12. [2025-10-15T19:44:47.313969] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-04. [2025-10-15T19:44:47.424867] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-15T19:44:47.961707] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-15T19:44:48.107436] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-15T19:44:48.113945] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-05. [2025-10-15T19:44:48.913955] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-06. [2025-10-15T19:44:49.074352] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-15T19:44:49.714044] [INFO ] [REMOTE ] K: Fetching primary data for 2025-09. [2025-10-15T19:44:50.462927] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-15T19:44:50.514040] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-01. [2025-10-15T19:44:51.313964] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-06. [2025-10-15T19:44:51.427154] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-15T19:44:51.869885] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-15T19:44:51.887150] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-15T19:44:52.114006] [INFO ] [REMOTE ] K: Fetching primary data for 2025-10. [2025-10-15T19:44:52.914028] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-07. [2025-10-15T19:44:53.713968] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-02. [2025-10-15T19:44:53.746519] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-15T19:44:53.753164] [INFO ] [REMOTE ] K: Full fetch complete (72298 records). [2025-10-15T19:44:53.753390] [DEBUG] [VALIDATOR ] K: Validating primary data. [2025-10-15T19:44:53.952629] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-15T19:44:54.219221] [DEBUG] [VALIDATOR ] K: All expected trading days are present. [2025-10-15T19:44:54.219332] [DEBUG] [VALIDATOR ] K: Primary data validation passed. [2025-10-15T19:44:54.220449] [INFO ] [MAIN ] K: Fetched primary data is valid. [2025-10-15T19:44:54.220514] [DEBUG] [LOCAL ] K: Saving primary data. [2025-10-15T19:44:54.221893] [DEBUG] [LOCAL ] K: Trimmed 72298 records to 50422 (keeping 200 days of data) [2025-10-15T19:44:54.514172] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-08. [2025-10-15T19:44:54.532605] [DEBUG] [LOCAL ] K: Primary data saved (50422 records). [2025-10-15T19:44:54.532867] [INFO ] [MAIN ] K: Full history saved. [2025-10-15T19:44:54.533391] [INFO ] [MAIN ] Update Progress: 1171/2369 symbols completed. K took 32.9s. Estimated remaining: 2h 48m 38s. Rate: 7.1 symbols/min [2025-10-15T19:44:54.712598] [INFO ] [MAIN ] KB: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:44:54.736242] [DEBUG] [LOCAL ] KB: Loaded 23417 existing records from primary storage. [2025-10-15T19:44:54.736519] [INFO ] [MAIN ] KB: Loaded 23417 existing records. [2025-10-15T19:44:54.926094] [WARN ] [MAIN ] KB: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:44:54.926354] [INFO ] [MAIN ] KB: Wiping existing primary data before full refresh. [2025-10-15T19:44:54.926409] [INFO ] [LOCAL ] KB: Starting deletion of primary data. [2025-10-15T19:44:54.926756] [DEBUG] [LOCAL ] KB: Deleted primary data file. [2025-10-15T19:44:54.926814] [INFO ] [MAIN ] KB: Starting full primary refresh. [2025-10-15T19:44:55.318577] [INFO ] [REMOTE ] KB: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:44:55.314559] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-07. [2025-10-15T19:44:55.353814] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-15T19:44:55.358738] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-15T19:44:56.114035] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-03. [2025-10-15T19:44:56.868025] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-15T19:44:56.913950] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-08. [2025-10-15T19:44:57.393264] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-15T19:44:57.714055] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-04. [2025-10-15T19:44:58.498303] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-15T19:44:58.513955] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-09. [2025-10-15T19:44:59.225153] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-15T19:44:59.313960] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-05. [2025-10-15T19:45:00.072185] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-15T19:45:00.113954] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-10. [2025-10-15T19:45:00.480585] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-15T19:45:00.914004] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-06. [2025-10-15T19:45:01.646732] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-15T19:45:01.653129] [INFO ] [REMOTE ] JXN: Full fetch complete (65500 records). [2025-10-15T19:45:01.653341] [DEBUG] [VALIDATOR ] JXN: Validating primary data. [2025-10-15T19:45:01.719784] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-09. [2025-10-15T19:45:02.050861] [DEBUG] [VALIDATOR ] JXN: All expected trading days are present. [2025-10-15T19:45:02.050954] [DEBUG] [VALIDATOR ] JXN: Primary data validation passed. [2025-10-15T19:45:02.051943] [INFO ] [MAIN ] JXN: Fetched primary data is valid. [2025-10-15T19:45:02.052008] [DEBUG] [LOCAL ] JXN: Saving primary data. [2025-10-15T19:45:02.053386] [DEBUG] [LOCAL ] JXN: Trimmed 65500 records to 44730 (keeping 200 days of data) [2025-10-15T19:45:02.333539] [DEBUG] [LOCAL ] JXN: Primary data saved (44730 records). [2025-10-15T19:45:02.333900] [INFO ] [MAIN ] JXN: Full history saved. [2025-10-15T19:45:02.334057] [INFO ] [MAIN ] Update Progress: 1172/2369 symbols completed. JXN took 42.1s. Estimated remaining: 2h 48m 29s. Rate: 7.1 symbols/min [2025-10-15T19:45:02.525255] [INFO ] [MAIN ] KBDC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:45:02.525413] [INFO ] [REMOTE ] KB: Fetching primary data for 2024-12. [2025-10-15T19:45:02.549933] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-15T19:45:02.581506] [DEBUG] [LOCAL ] KBDC: Loaded 22139 existing records from primary storage. [2025-10-15T19:45:02.581868] [INFO ] [MAIN ] KBDC: Loaded 22139 existing records. [2025-10-15T19:45:02.793254] [WARN ] [MAIN ] KBDC: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:45:02.793698] [INFO ] [MAIN ] KBDC: Wiping existing primary data before full refresh. [2025-10-15T19:45:02.799713] [INFO ] [LOCAL ] KBDC: Starting deletion of primary data. [2025-10-15T19:45:02.802583] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-15T19:45:02.802686] [DEBUG] [LOCAL ] KBDC: Deleted primary data file. [2025-10-15T19:45:02.802865] [INFO ] [MAIN ] KBDC: Starting full primary refresh. [2025-10-15T19:45:03.177771] [INFO ] [REMOTE ] KBDC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:45:03.314018] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2024-12. [2025-10-15T19:45:03.837750] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-15T19:45:04.114021] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-01. [2025-10-15T19:45:04.290681] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-10-15T19:45:04.869775] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-15T19:45:04.913955] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-02. [2025-10-15T19:45:05.714059] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-01. [2025-10-15T19:45:06.063037] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-15T19:45:06.514040] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-07. [2025-10-15T19:45:06.650841] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-15T19:45:07.314008] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-02. [2025-10-15T19:45:07.921639] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-15T19:45:07.941050] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-15T19:45:08.114006] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-03. [2025-10-15T19:45:08.914049] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-03. [2025-10-15T19:45:09.167846] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-15T19:45:09.713959] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-08. [2025-10-15T19:45:10.122925] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-15T19:45:10.514063] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-04. [2025-10-15T19:45:11.177576] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-15T19:45:11.314042] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-09. [2025-10-15T19:45:11.762764] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-15T19:45:12.114011] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-05. [2025-10-15T19:45:12.613461] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-15T19:45:12.914031] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-10. [2025-10-15T19:45:13.359369] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-15T19:45:13.714000] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-06. [2025-10-15T19:45:14.359833] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-15T19:45:14.364637] [INFO ] [REMOTE ] KAR: Full fetch complete (57044 records). [2025-10-15T19:45:14.364774] [DEBUG] [VALIDATOR ] KAR: Validating primary data. [2025-10-15T19:45:14.517597] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-10. [2025-10-15T19:45:14.757010] [DEBUG] [VALIDATOR ] KAR: All expected trading days are present. [2025-10-15T19:45:14.757109] [DEBUG] [VALIDATOR ] KAR: Primary data validation passed. [2025-10-15T19:45:14.758140] [INFO ] [MAIN ] KAR: Fetched primary data is valid. [2025-10-15T19:45:14.758216] [DEBUG] [LOCAL ] KAR: Saving primary data. [2025-10-15T19:45:14.759362] [DEBUG] [LOCAL ] KAR: Trimmed 57044 records to 40054 (keeping 200 days of data) [2025-10-15T19:45:15.000257] [DEBUG] [LOCAL ] KAR: Primary data saved (40054 records). [2025-10-15T19:45:15.000409] [INFO ] [MAIN ] KAR: Full history saved. [2025-10-15T19:45:15.000602] [INFO ] [MAIN ] Update Progress: 1173/2369 symbols completed. KAR took 34.6s. Estimated remaining: 2h 48m 25s. Rate: 7.1 symbols/min [2025-10-15T19:45:15.080103] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-15T19:45:15.193487] [INFO ] [MAIN ] KBH: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:45:15.241700] [DEBUG] [LOCAL ] KBH: Loaded 48836 existing records from primary storage. [2025-10-15T19:45:15.241990] [INFO ] [MAIN ] KBH: Loaded 48836 existing records. [2025-10-15T19:45:15.315556] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-07. [2025-10-15T19:45:15.420503] [WARN ] [MAIN ] KBH: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:45:15.420709] [INFO ] [MAIN ] KBH: Wiping existing primary data before full refresh. [2025-10-15T19:45:15.420778] [INFO ] [LOCAL ] KBH: Starting deletion of primary data. [2025-10-15T19:45:15.421202] [DEBUG] [LOCAL ] KBH: Deleted primary data file. [2025-10-15T19:45:15.421257] [INFO ] [MAIN ] KBH: Starting full primary refresh. [2025-10-15T19:45:15.531847] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-15T19:45:15.554635] [INFO ] [REMOTE ] KAI: Full fetch complete (19121 records). [2025-10-15T19:45:15.572048] [DEBUG] [VALIDATOR ] KAI: Validating primary data. [2025-10-15T19:45:16.037010] [INFO ] [REMOTE ] KBH: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:45:16.123698] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-04. [2025-10-15T19:45:16.169531] [DEBUG] [VALIDATOR ] KAI: All expected trading days are present. [2025-10-15T19:45:16.169625] [DEBUG] [VALIDATOR ] KAI: Primary data validation passed. [2025-10-15T19:45:16.170145] [INFO ] [MAIN ] KAI: Fetched primary data is valid. [2025-10-15T19:45:16.170209] [DEBUG] [LOCAL ] KAI: Saving primary data. [2025-10-15T19:45:16.170840] [DEBUG] [LOCAL ] KAI: Trimmed 19121 records to 13579 (keeping 200 days of data) [2025-10-15T19:45:16.256695] [DEBUG] [LOCAL ] KAI: Primary data saved (13579 records). [2025-10-15T19:45:16.256851] [INFO ] [MAIN ] KAI: Full history saved. [2025-10-15T19:45:16.256932] [INFO ] [MAIN ] Update Progress: 1174/2369 symbols completed. KAI took 42.7s. Estimated remaining: 2h 48m 9s. Rate: 7.1 symbols/min [2025-10-15T19:45:16.434690] [INFO ] [MAIN ] KBR: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:45:16.451605] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-15T19:45:16.497292] [DEBUG] [LOCAL ] KBR: Loaded 48037 existing records from primary storage. [2025-10-15T19:45:16.497632] [INFO ] [MAIN ] KBR: Loaded 48037 existing records. [2025-10-15T19:45:16.671398] [WARN ] [MAIN ] KBR: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:45:16.671631] [INFO ] [MAIN ] KBR: Wiping existing primary data before full refresh. [2025-10-15T19:45:16.671713] [INFO ] [LOCAL ] KBR: Starting deletion of primary data. [2025-10-15T19:45:16.672080] [DEBUG] [LOCAL ] KBR: Deleted primary data file. [2025-10-15T19:45:16.672146] [INFO ] [MAIN ] KBR: Starting full primary refresh. [2025-10-15T19:45:16.919154] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-08. [2025-10-15T19:45:17.021045] [INFO ] [REMOTE ] KBR: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:45:17.595243] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-15T19:45:17.714023] [INFO ] [REMOTE ] KBR: Fetching primary data for 2024-12. [2025-10-15T19:45:18.072857] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-15T19:45:18.514050] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-09. [2025-10-15T19:45:19.320935] [INFO ] [REMOTE ] KBH: Fetching primary data for 2024-12. [2025-10-15T19:45:19.328086] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-15T19:45:19.610735] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-15T19:45:20.114061] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-01. [2025-10-15T19:45:20.913989] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-10. [2025-10-15T19:45:20.968073] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-15T19:45:21.525983] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-15T19:45:21.714021] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-01. [2025-10-15T19:45:21.931900] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-15T19:45:21.934465] [INFO ] [REMOTE ] KB: Full fetch complete (33681 records). [2025-10-15T19:45:21.934544] [DEBUG] [VALIDATOR ] KB: Validating primary data. [2025-10-15T19:45:22.307815] [DEBUG] [VALIDATOR ] KB: All expected trading days are present. [2025-10-15T19:45:22.307928] [DEBUG] [VALIDATOR ] KB: Primary data validation passed. [2025-10-15T19:45:22.308705] [INFO ] [MAIN ] KB: Fetched primary data is valid. [2025-10-15T19:45:22.308783] [DEBUG] [LOCAL ] KB: Saving primary data. [2025-10-15T19:45:22.309840] [DEBUG] [LOCAL ] KB: Trimmed 33681 records to 23340 (keeping 200 days of data) [2025-10-15T19:45:22.455420] [DEBUG] [LOCAL ] KB: Primary data saved (23340 records). [2025-10-15T19:45:22.455543] [INFO ] [MAIN ] KB: Full history saved. [2025-10-15T19:45:22.455620] [INFO ] [MAIN ] Update Progress: 1175/2369 symbols completed. KB took 27.9s. Estimated remaining: 2h 47m 58s. Rate: 7.1 symbols/min [2025-10-15T19:45:22.519333] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-02. [2025-10-15T19:45:22.647332] [INFO ] [MAIN ] KD: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:45:22.695199] [DEBUG] [LOCAL ] KD: Loaded 52358 existing records from primary storage. [2025-10-15T19:45:22.695520] [INFO ] [MAIN ] KD: Loaded 52358 existing records. [2025-10-15T19:45:22.867685] [WARN ] [MAIN ] KD: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:45:22.867873] [INFO ] [MAIN ] KD: Wiping existing primary data before full refresh. [2025-10-15T19:45:22.867919] [INFO ] [LOCAL ] KD: Starting deletion of primary data. [2025-10-15T19:45:22.868297] [DEBUG] [LOCAL ] KD: Deleted primary data file. [2025-10-15T19:45:22.868352] [INFO ] [MAIN ] KD: Starting full primary refresh. [2025-10-15T19:45:23.215204] [INFO ] [REMOTE ] KD: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:45:23.313961] [INFO ] [REMOTE ] KD: Fetching primary data for 2024-12. [2025-10-15T19:45:23.466938] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-15T19:45:24.114053] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-02. [2025-10-15T19:45:24.183766] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-15T19:45:24.878660] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-15T19:45:24.913974] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-01. [2025-10-15T19:45:25.692335] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-15T19:45:25.713987] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-03. [2025-10-15T19:45:26.514008] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-03. [2025-10-15T19:45:26.761747] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-15T19:45:27.313994] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-05. [2025-10-15T19:45:27.485564] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-15T19:45:27.975902] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-15T19:45:28.113970] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-04. [2025-10-15T19:45:28.309036] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-15T19:45:28.914014] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-04. [2025-10-15T19:45:29.713976] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-06. [2025-10-15T19:45:29.819310] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-15T19:45:30.473767] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-15T19:45:30.513959] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-05. [2025-10-15T19:45:30.654390] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-15T19:45:31.314042] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-05. [2025-10-15T19:45:32.113982] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-07. [2025-10-15T19:45:32.155072] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-15T19:45:32.919074] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-02. [2025-10-15T19:45:32.937568] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-15T19:45:33.145157] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-15T19:45:33.714036] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-08. [2025-10-15T19:45:34.514043] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-06. [2025-10-15T19:45:34.674383] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-15T19:45:34.773813] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-15T19:45:35.314025] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-09. [2025-10-15T19:45:35.713120] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-15T19:45:36.113993] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-07. [2025-10-15T19:45:36.646297] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-15T19:45:36.914028] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-10. [2025-10-15T19:45:37.713974] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-03. [2025-10-15T19:45:37.955675] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-15T19:45:38.236883] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-15T19:45:38.241001] [INFO ] [REMOTE ] KBDC: Full fetch complete (30201 records). [2025-10-15T19:45:38.241075] [DEBUG] [VALIDATOR ] KBDC: Validating primary data. [2025-10-15T19:45:38.519238] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-06. [2025-10-15T19:45:38.620016] [DEBUG] [VALIDATOR ] KBDC: All expected trading days are present. [2025-10-15T19:45:38.620107] [DEBUG] [VALIDATOR ] KBDC: Primary data validation passed. [2025-10-15T19:45:38.620837] [INFO ] [MAIN ] KBDC: Fetched primary data is valid. [2025-10-15T19:45:38.620934] [DEBUG] [LOCAL ] KBDC: Saving primary data. [2025-10-15T19:45:38.621789] [DEBUG] [LOCAL ] KBDC: Trimmed 30201 records to 22209 (keeping 200 days of data) [2025-10-15T19:45:38.757849] [DEBUG] [LOCAL ] KBDC: Primary data saved (22209 records). [2025-10-15T19:45:38.757972] [INFO ] [MAIN ] KBDC: Full history saved. [2025-10-15T19:45:38.758048] [INFO ] [MAIN ] Update Progress: 1176/2369 symbols completed. KBDC took 36.4s. Estimated remaining: 2h 47m 58s. Rate: 7.1 symbols/min [2025-10-15T19:45:38.923895] [INFO ] [MAIN ] KEN: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:45:38.930032] [DEBUG] [LOCAL ] KEN: Loaded 4689 existing records from primary storage. [2025-10-15T19:45:38.930238] [INFO ] [MAIN ] KEN: Loaded 4689 existing records. [2025-10-15T19:45:39.104833] [WARN ] [MAIN ] KEN: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:45:39.105037] [INFO ] [MAIN ] KEN: Wiping existing primary data before full refresh. [2025-10-15T19:45:39.105084] [INFO ] [LOCAL ] KEN: Starting deletion of primary data. [2025-10-15T19:45:39.105222] [DEBUG] [LOCAL ] KEN: Deleted primary data file. [2025-10-15T19:45:39.105263] [INFO ] [MAIN ] KEN: Starting full primary refresh. [2025-10-15T19:45:39.320816] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-08. [2025-10-15T19:45:39.472636] [INFO ] [REMOTE ] KEN: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:45:39.537214] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-15T19:45:40.123093] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-04. [2025-10-15T19:45:40.147696] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-15T19:45:40.913968] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-07. [2025-10-15T19:45:41.106420] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-15T19:45:41.714028] [INFO ] [REMOTE ] KEN: Fetching primary data for 2024-12. [2025-10-15T19:45:41.744758] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-15T19:45:42.386234] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-10-15T19:45:42.514041] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-05. [2025-10-15T19:45:42.726999] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-15T19:45:43.314057] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-08. [2025-10-15T19:45:44.113981] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-01. [2025-10-15T19:45:44.208980] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-15T19:45:44.736634] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-15T19:45:44.914039] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-02. [2025-10-15T19:45:44.950012] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-15T19:45:45.352205] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-15T19:45:45.714007] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-09. [2025-10-15T19:45:46.514046] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-03. [2025-10-15T19:45:47.072950] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-10-15T19:45:47.314024] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-04. [2025-10-15T19:45:47.473847] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-15T19:45:48.054709] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-15T19:45:48.114015] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-05. [2025-10-15T19:45:48.697477] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-15T19:45:48.914005] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-10. [2025-10-15T19:45:49.714091] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-06. [2025-10-15T19:45:50.514017] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-09. [2025-10-15T19:45:50.582223] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-15T19:45:50.588368] [INFO ] [REMOTE ] KBH: Full fetch complete (71086 records). [2025-10-15T19:45:50.588521] [DEBUG] [VALIDATOR ] KBH: Validating primary data. [2025-10-15T19:45:50.971282] [DEBUG] [VALIDATOR ] KBH: All expected trading days are present. [2025-10-15T19:45:50.971360] [DEBUG] [VALIDATOR ] KBH: Primary data validation passed. [2025-10-15T19:45:50.972365] [INFO ] [MAIN ] KBH: Fetched primary data is valid. [2025-10-15T19:45:50.972429] [DEBUG] [LOCAL ] KBH: Saving primary data. [2025-10-15T19:45:50.973838] [DEBUG] [LOCAL ] KBH: Trimmed 71086 records to 48840 (keeping 200 days of data) [2025-10-15T19:45:51.274560] [DEBUG] [LOCAL ] KBH: Primary data saved (48840 records). [2025-10-15T19:45:51.274746] [INFO ] [MAIN ] KBH: Full history saved. [2025-10-15T19:45:51.274839] [INFO ] [MAIN ] Update Progress: 1177/2369 symbols completed. KBH took 36.3s. Estimated remaining: 2h 47m 54s. Rate: 7.1 symbols/min [2025-10-15T19:45:51.318026] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-06. [2025-10-15T19:45:51.449073] [INFO ] [MAIN ] KEP: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:45:51.478233] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-15T19:45:51.514186] [DEBUG] [LOCAL ] KEP: Loaded 31864 existing records from primary storage. [2025-10-15T19:45:51.514473] [INFO ] [MAIN ] KEP: Loaded 31864 existing records. [2025-10-15T19:45:51.691696] [WARN ] [MAIN ] KEP: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:45:51.691893] [INFO ] [MAIN ] KEP: Wiping existing primary data before full refresh. [2025-10-15T19:45:51.691953] [INFO ] [LOCAL ] KEP: Starting deletion of primary data. [2025-10-15T19:45:51.692259] [DEBUG] [LOCAL ] KEP: Deleted primary data file. [2025-10-15T19:45:51.692298] [INFO ] [MAIN ] KEP: Starting full primary refresh. [2025-10-15T19:45:52.048184] [INFO ] [REMOTE ] KEP: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:45:52.075166] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-15T19:45:52.088836] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-15T19:45:52.113952] [INFO ] [REMOTE ] KEP: Fetching primary data for 2024-12. [2025-10-15T19:45:52.914074] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-07. [2025-10-15T19:45:53.492059] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-15T19:45:53.714011] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-01. [2025-10-15T19:45:54.514030] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-10. [2025-10-15T19:45:54.695524] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-15T19:45:54.730362] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-15T19:45:55.314004] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-02. [2025-10-15T19:45:55.810604] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-15T19:45:55.816587] [INFO ] [REMOTE ] KBR: Full fetch complete (69970 records). [2025-10-15T19:45:55.816747] [DEBUG] [VALIDATOR ] KBR: Validating primary data. [2025-10-15T19:45:56.122096] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-08. [2025-10-15T19:45:56.267398] [DEBUG] [VALIDATOR ] KBR: All expected trading days are present. [2025-10-15T19:45:56.267506] [DEBUG] [VALIDATOR ] KBR: Primary data validation passed. [2025-10-15T19:45:56.268632] [INFO ] [MAIN ] KBR: Fetched primary data is valid. [2025-10-15T19:45:56.268724] [DEBUG] [LOCAL ] KBR: Saving primary data. [2025-10-15T19:45:56.270181] [DEBUG] [LOCAL ] KBR: Trimmed 69970 records to 48081 (keeping 200 days of data) [2025-10-15T19:45:56.486450] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-15T19:45:56.628062] [DEBUG] [LOCAL ] KBR: Primary data saved (48081 records). [2025-10-15T19:45:56.628299] [INFO ] [MAIN ] KBR: Full history saved. [2025-10-15T19:45:56.629287] [INFO ] [MAIN ] Update Progress: 1178/2369 symbols completed. KBR took 40.4s. Estimated remaining: 2h 47m 42s. Rate: 7.1 symbols/min [2025-10-15T19:45:56.815422] [INFO ] [MAIN ] KEX: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:45:56.854781] [DEBUG] [LOCAL ] KEX: Loaded 38548 existing records from primary storage. [2025-10-15T19:45:56.855082] [INFO ] [MAIN ] KEX: Loaded 38548 existing records. [2025-10-15T19:45:56.919162] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-07. [2025-10-15T19:45:57.039979] [WARN ] [MAIN ] KEX: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:45:57.040207] [INFO ] [MAIN ] KEX: Wiping existing primary data before full refresh. [2025-10-15T19:45:57.040255] [INFO ] [LOCAL ] KEX: Starting deletion of primary data. [2025-10-15T19:45:57.040689] [DEBUG] [LOCAL ] KEX: Deleted primary data file. [2025-10-15T19:45:57.040747] [INFO ] [MAIN ] KEX: Starting full primary refresh. [2025-10-15T19:45:57.394989] [INFO ] [REMOTE ] KEX: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:45:57.585254] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-10-15T19:45:57.713979] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-03. [2025-10-15T19:45:58.143594] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-10-15T19:45:58.514025] [INFO ] [REMOTE ] KEX: Fetching primary data for 2024-12. [2025-10-15T19:45:58.855360] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-15T19:45:59.314006] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-04. [2025-10-15T19:46:00.054728] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-15T19:46:00.113967] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-01. [2025-10-15T19:46:00.530381] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-15T19:46:00.914001] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-08. [2025-10-15T19:46:01.654708] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-15T19:46:01.713999] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-09. [2025-10-15T19:46:01.785878] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-15T19:46:02.281973] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-15T19:46:02.514035] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-09. [2025-10-15T19:46:03.314311] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-10. [2025-10-15T19:46:03.979855] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-15T19:46:03.980975] [INFO ] [REMOTE ] KEN: Full fetch complete (5971 records). [2025-10-15T19:46:03.981046] [DEBUG] [VALIDATOR ] KEN: Validating primary data. [2025-10-15T19:46:04.126759] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-02. [2025-10-15T19:46:04.384578] [DEBUG] [VALIDATOR ] KEN: All expected trading days are present. [2025-10-15T19:46:04.384682] [DEBUG] [VALIDATOR ] KEN: Primary data validation passed. [2025-10-15T19:46:04.384886] [INFO ] [MAIN ] KEN: Fetched primary data is valid. [2025-10-15T19:46:04.384926] [DEBUG] [LOCAL ] KEN: Saving primary data. [2025-10-15T19:46:04.385289] [DEBUG] [LOCAL ] KEN: Trimmed 5971 records to 4705 (keeping 200 days of data) [2025-10-15T19:46:04.413708] [DEBUG] [LOCAL ] KEN: Primary data saved (4705 records). [2025-10-15T19:46:04.413855] [INFO ] [MAIN ] KEN: Full history saved. [2025-10-15T19:46:04.413943] [INFO ] [MAIN ] Update Progress: 1179/2369 symbols completed. KEN took 25.7s. Estimated remaining: 2h 47m 33s. Rate: 7.1 symbols/min [2025-10-15T19:46:04.559694] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-10-15T19:46:04.633375] [INFO ] [MAIN ] KEY: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:46:04.633765] [DEBUG] [LOCAL ] KEY: No existing data file found in primary storage. [2025-10-15T19:46:04.633820] [WARN ] [MAIN ] KEY: No existing data found, performing full refresh instead. [2025-10-15T19:46:04.633970] [INFO ] [MAIN ] KEY: Wiping existing primary data before full refresh. [2025-10-15T19:46:04.634011] [INFO ] [LOCAL ] KEY: Starting deletion of primary data. [2025-10-15T19:46:04.634051] [DEBUG] [LOCAL ] KEY: No primary data file found to delete. [2025-10-15T19:46:04.634082] [INFO ] [MAIN ] KEY: Starting full primary refresh. [2025-10-15T19:46:04.919163] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-05. [2025-10-15T19:46:04.983966] [INFO ] [REMOTE ] KEY: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:46:05.255334] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-15T19:46:05.714064] [INFO ] [REMOTE ] KEY: Fetching primary data for 2024-12. [2025-10-15T19:46:06.320758] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-15T19:46:06.513992] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-06. [2025-10-15T19:46:07.313990] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-03. [2025-10-15T19:46:07.588302] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-10-15T19:46:08.054359] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-15T19:46:08.113993] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-07. [2025-10-15T19:46:08.480509] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-15T19:46:08.913985] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-01. [2025-10-15T19:46:09.619996] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-15T19:46:09.713985] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-08. [2025-10-15T19:46:10.386922] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-15T19:46:10.513990] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-02. [2025-10-15T19:46:11.112067] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-15T19:46:11.314000] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-09. [2025-10-15T19:46:12.010725] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-15T19:46:12.113948] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-03. [2025-10-15T19:46:12.717078] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-15T19:46:12.913979] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-10. [2025-10-15T19:46:13.714057] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-04. [2025-10-15T19:46:13.880533] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-15T19:46:14.514065] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-04. [2025-10-15T19:46:14.549177] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-15T19:46:14.555430] [INFO ] [REMOTE ] KD: Full fetch complete (76015 records). [2025-10-15T19:46:14.555558] [DEBUG] [VALIDATOR ] KD: Validating primary data. [2025-10-15T19:46:14.961580] [DEBUG] [VALIDATOR ] KD: All expected trading days are present. [2025-10-15T19:46:14.961715] [DEBUG] [VALIDATOR ] KD: Primary data validation passed. [2025-10-15T19:46:14.962827] [INFO ] [MAIN ] KD: Fetched primary data is valid. [2025-10-15T19:46:14.962912] [DEBUG] [LOCAL ] KD: Saving primary data. [2025-10-15T19:46:14.964574] [DEBUG] [LOCAL ] KD: Trimmed 76015 records to 52354 (keeping 200 days of data) [2025-10-15T19:46:15.070983] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-15T19:46:15.303346] [DEBUG] [LOCAL ] KD: Primary data saved (52354 records). [2025-10-15T19:46:15.303496] [INFO ] [MAIN ] KD: Full history saved. [2025-10-15T19:46:15.303896] [INFO ] [MAIN ] Update Progress: 1180/2369 symbols completed. KD took 52.8s. Estimated remaining: 2h 47m 27s. Rate: 7.1 symbols/min [2025-10-15T19:46:15.319131] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-05. [2025-10-15T19:46:15.478544] [INFO ] [MAIN ] KEYS: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:46:15.524793] [DEBUG] [LOCAL ] KEYS: Loaded 43320 existing records from primary storage. [2025-10-15T19:46:15.525098] [INFO ] [MAIN ] KEYS: Loaded 43320 existing records. [2025-10-15T19:46:15.700568] [WARN ] [MAIN ] KEYS: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:46:15.700834] [INFO ] [MAIN ] KEYS: Wiping existing primary data before full refresh. [2025-10-15T19:46:15.700887] [INFO ] [LOCAL ] KEYS: Starting deletion of primary data. [2025-10-15T19:46:15.701230] [DEBUG] [LOCAL ] KEYS: Deleted primary data file. [2025-10-15T19:46:15.701287] [INFO ] [MAIN ] KEYS: Starting full primary refresh. [2025-10-15T19:46:16.066385] [INFO ] [REMOTE ] KEYS: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:46:16.114018] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2024-12. [2025-10-15T19:46:16.437603] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-15T19:46:16.914042] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-10. [2025-10-15T19:46:16.938118] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-15T19:46:17.407527] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-15T19:46:17.714054] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-06. [2025-10-15T19:46:17.928458] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-15T19:46:17.932362] [INFO ] [REMOTE ] KEP: Full fetch complete (42091 records). [2025-10-15T19:46:17.932442] [DEBUG] [VALIDATOR ] KEP: Validating primary data. [2025-10-15T19:46:18.298037] [DEBUG] [VALIDATOR ] KEP: All expected trading days are present. [2025-10-15T19:46:18.298115] [DEBUG] [VALIDATOR ] KEP: Primary data validation passed. [2025-10-15T19:46:18.298903] [INFO ] [MAIN ] KEP: Fetched primary data is valid. [2025-10-15T19:46:18.298967] [DEBUG] [LOCAL ] KEP: Saving primary data. [2025-10-15T19:46:18.300012] [DEBUG] [LOCAL ] KEP: Trimmed 42091 records to 31996 (keeping 200 days of data) [2025-10-15T19:46:18.484719] [DEBUG] [LOCAL ] KEP: Primary data saved (31996 records). [2025-10-15T19:46:18.484871] [INFO ] [MAIN ] KEP: Full history saved. [2025-10-15T19:46:18.484953] [INFO ] [MAIN ] Update Progress: 1181/2369 symbols completed. KEP took 27.2s. Estimated remaining: 2h 47m 13s. Rate: 7.1 symbols/min [2025-10-15T19:46:18.519145] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-05. [2025-10-15T19:46:18.668335] [INFO ] [MAIN ] KF: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:46:18.672506] [DEBUG] [LOCAL ] KF: Loaded 2339 existing records from primary storage. [2025-10-15T19:46:18.672717] [INFO ] [MAIN ] KF: Loaded 2339 existing records. [2025-10-15T19:46:18.887435] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-15T19:46:18.892185] [WARN ] [MAIN ] KF: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:46:18.899053] [INFO ] [MAIN ] KF: Wiping existing primary data before full refresh. [2025-10-15T19:46:18.899159] [INFO ] [LOCAL ] KF: Starting deletion of primary data. [2025-10-15T19:46:18.899554] [DEBUG] [LOCAL ] KF: Deleted primary data file. [2025-10-15T19:46:18.899617] [INFO ] [MAIN ] KF: Starting full primary refresh. [2025-10-15T19:46:19.245435] [INFO ] [REMOTE ] KF: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:46:19.313989] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-01. [2025-10-15T19:46:20.113972] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-07. [2025-10-15T19:46:20.363695] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-15T19:46:20.803317] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-15T19:46:20.914029] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-06. [2025-10-15T19:46:21.166532] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-15T19:46:21.714029] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-02. [2025-10-15T19:46:22.513998] [INFO ] [REMOTE ] KF: Fetching primary data for 2024-12. [2025-10-15T19:46:22.816985] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-15T19:46:23.170917] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-10-15T19:46:23.322484] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-07. [2025-10-15T19:46:23.324907] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-15T19:46:24.113985] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-03. [2025-10-15T19:46:24.914033] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-01. [2025-10-15T19:46:25.020408] [DEBUG] [REMOTE ] KF: Error fetching primary data for 2025-01: 'API call returned an empty response.' [2025-10-15T19:46:25.020744] [WARN ] [REMOTE ] KF: No data returned for month 2025-01 [2025-10-15T19:46:25.020835] [FATAL] [REMOTE ] KF: API call failed - aborting fetch to avoid wasting further API calls [2025-10-15T19:46:25.020947] [FATAL] [MAIN ] KF: Failed to fetch primary data. [2025-10-15T19:46:25.021026] [WARN ] [MAIN ] KF: Deleting existing primary and derivative data due to fetch failure. [2025-10-15T19:46:25.021111] [INFO ] [LOCAL ] KF: Starting deletion of primary data. [2025-10-15T19:46:25.021188] [DEBUG] [LOCAL ] KF: No primary data file found to delete. [2025-10-15T19:46:25.021239] [INFO ] [LOCAL ] KF: Starting deletion of derivative data. [2025-10-15T19:46:25.021462] [DEBUG] [LOCAL ] KF: Deleted derivative data file. [2025-10-15T19:46:25.021562] [INFO ] [MAIN ] Update Progress: 1182/2369 symbols completed. KF took 6.5s. Estimated remaining: 2h 47m 3s. Rate: 7.1 symbols/min [2025-10-15T19:46:25.193934] [INFO ] [MAIN ] KFRC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:46:25.213034] [DEBUG] [LOCAL ] KFRC: Loaded 20396 existing records from primary storage. [2025-10-15T19:46:25.213292] [INFO ] [MAIN ] KFRC: Loaded 20396 existing records. [2025-10-15T19:46:25.401156] [WARN ] [MAIN ] KFRC: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:46:25.401490] [INFO ] [MAIN ] KFRC: Wiping existing primary data before full refresh. [2025-10-15T19:46:25.401623] [INFO ] [LOCAL ] KFRC: Starting deletion of primary data. [2025-10-15T19:46:25.402010] [DEBUG] [LOCAL ] KFRC: Deleted primary data file. [2025-10-15T19:46:25.431327] [INFO ] [MAIN ] KFRC: Starting full primary refresh. [2025-10-15T19:46:25.477363] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-07 (2.15 seconds). [2025-10-15T19:46:25.714582] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-08. [2025-10-15T19:46:25.836677] [INFO ] [REMOTE ] KFRC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:46:25.873949] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-15T19:46:26.513999] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2024-12. [2025-10-15T19:46:26.925067] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-15T19:46:27.314040] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-04. [2025-10-15T19:46:27.394432] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-15T19:46:28.114073] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-09. [2025-10-15T19:46:28.914031] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-08. [2025-10-15T19:46:29.006085] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-15T19:46:29.719133] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-01. [2025-10-15T19:46:29.732193] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-15T19:46:30.297187] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-15T19:46:30.513970] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-05. [2025-10-15T19:46:30.728321] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-15T19:46:31.314002] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-02. [2025-10-15T19:46:32.097149] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-15T19:46:32.113991] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-06. [2025-10-15T19:46:32.148405] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-15T19:46:32.913982] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-10. [2025-10-15T19:46:33.668672] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-15T19:46:33.713962] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-07. [2025-10-15T19:46:34.459408] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-15T19:46:34.464515] [INFO ] [REMOTE ] KEX: Full fetch complete (55940 records). [2025-10-15T19:46:34.464610] [DEBUG] [VALIDATOR ] KEX: Validating primary data. [2025-10-15T19:46:34.526116] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-09. [2025-10-15T19:46:34.841793] [DEBUG] [VALIDATOR ] KEX: All expected trading days are present. [2025-10-15T19:46:34.841886] [DEBUG] [VALIDATOR ] KEX: Primary data validation passed. [2025-10-15T19:46:34.842809] [INFO ] [MAIN ] KEX: Fetched primary data is valid. [2025-10-15T19:46:34.842871] [DEBUG] [LOCAL ] KEX: Saving primary data. [2025-10-15T19:46:34.843955] [DEBUG] [LOCAL ] KEX: Trimmed 55940 records to 38604 (keeping 200 days of data) [2025-10-15T19:46:35.074532] [DEBUG] [LOCAL ] KEX: Primary data saved (38604 records). [2025-10-15T19:46:35.074698] [INFO ] [MAIN ] KEX: Full history saved. [2025-10-15T19:46:35.074790] [INFO ] [MAIN ] Update Progress: 1183/2369 symbols completed. KEX took 38.4s. Estimated remaining: 2h 46m 56s. Rate: 7.1 symbols/min [2025-10-15T19:46:35.260916] [INFO ] [MAIN ] KFS: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:46:35.271292] [DEBUG] [LOCAL ] KFS: Loaded 8695 existing records from primary storage. [2025-10-15T19:46:35.271701] [INFO ] [MAIN ] KFS: Loaded 8695 existing records. [2025-10-15T19:46:35.318412] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-03. [2025-10-15T19:46:35.456372] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-15T19:46:35.507774] [WARN ] [MAIN ] KFS: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:46:35.508039] [INFO ] [MAIN ] KFS: Wiping existing primary data before full refresh. [2025-10-15T19:46:35.508094] [INFO ] [LOCAL ] KFS: Starting deletion of primary data. [2025-10-15T19:46:35.508257] [DEBUG] [LOCAL ] KFS: Deleted primary data file. [2025-10-15T19:46:35.508315] [INFO ] [MAIN ] KFS: Starting full primary refresh. [2025-10-15T19:46:35.881700] [INFO ] [REMOTE ] KFS: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:46:36.113965] [INFO ] [REMOTE ] KFS: Fetching primary data for 2024-12. [2025-10-15T19:46:36.315604] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-15T19:46:36.354460] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-15T19:46:36.447243] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2024-12 (0.33 seconds). [2025-10-15T19:46:36.914027] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-01. [2025-10-15T19:46:37.574430] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-10-15T19:46:37.713997] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-02. [2025-10-15T19:46:38.346847] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-15T19:46:38.513992] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-04. [2025-10-15T19:46:39.313973] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-08. [2025-10-15T19:46:39.461248] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-15T19:46:40.113987] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-03. [2025-10-15T19:46:40.680506] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-15T19:46:40.707060] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-15T19:46:40.913986] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-09. [2025-10-15T19:46:41.714033] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-05. [2025-10-15T19:46:42.488061] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-15T19:46:42.513958] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-10. [2025-10-15T19:46:42.769539] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-15T19:46:43.314012] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-04. [2025-10-15T19:46:43.999099] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-15T19:46:44.010605] [INFO ] [REMOTE ] KEYS: Full fetch complete (62900 records). [2025-10-15T19:46:44.011369] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-10-15T19:46:44.011474] [DEBUG] [VALIDATOR ] KEYS: Validating primary data. [2025-10-15T19:46:44.119061] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-06. [2025-10-15T19:46:44.436924] [DEBUG] [VALIDATOR ] KEYS: All expected trading days are present. [2025-10-15T19:46:44.437014] [DEBUG] [VALIDATOR ] KEYS: Primary data validation passed. [2025-10-15T19:46:44.438170] [INFO ] [MAIN ] KEYS: Fetched primary data is valid. [2025-10-15T19:46:44.438243] [DEBUG] [LOCAL ] KEYS: Saving primary data. [2025-10-15T19:46:44.439582] [DEBUG] [LOCAL ] KEYS: Trimmed 62900 records to 43274 (keeping 200 days of data) [2025-10-15T19:46:44.706873] [DEBUG] [LOCAL ] KEYS: Primary data saved (43274 records). [2025-10-15T19:46:44.706998] [INFO ] [MAIN ] KEYS: Full history saved. [2025-10-15T19:46:44.707240] [INFO ] [MAIN ] Update Progress: 1184/2369 symbols completed. KEYS took 29.4s. Estimated remaining: 2h 46m 49s. Rate: 7.1 symbols/min [2025-10-15T19:46:44.876449] [INFO ] [MAIN ] KFY: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:46:44.905417] [DEBUG] [LOCAL ] KFY: Loaded 29975 existing records from primary storage. [2025-10-15T19:46:44.905700] [INFO ] [MAIN ] KFY: Loaded 29975 existing records. [2025-10-15T19:46:44.919173] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-05. [2025-10-15T19:46:45.023843] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-15T19:46:45.099423] [WARN ] [MAIN ] KFY: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:46:45.099683] [INFO ] [MAIN ] KFY: Wiping existing primary data before full refresh. [2025-10-15T19:46:45.100445] [INFO ] [LOCAL ] KFY: Starting deletion of primary data. [2025-10-15T19:46:45.100724] [DEBUG] [LOCAL ] KFY: Deleted primary data file. [2025-10-15T19:46:45.100780] [INFO ] [MAIN ] KFY: Starting full primary refresh. [2025-10-15T19:46:45.457530] [INFO ] [REMOTE ] KFY: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:46:45.671239] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-15T19:46:45.713960] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-06. [2025-10-15T19:46:46.461612] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-15T19:46:46.514012] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-07. [2025-10-15T19:46:47.241537] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-15T19:46:47.314014] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-07. [2025-10-15T19:46:48.114021] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-08. [2025-10-15T19:46:48.378451] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-15T19:46:48.911776] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-15T19:46:48.914137] [INFO ] [REMOTE ] KFY: Fetching primary data for 2024-12. [2025-10-15T19:46:49.714054] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-09. [2025-10-15T19:46:50.084394] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-15T19:46:50.501056] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-15T19:46:50.513950] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-10. [2025-10-15T19:46:51.312913] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-15T19:46:51.314283] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-10. [2025-10-15T19:46:51.315799] [INFO ] [REMOTE ] KFS: Full fetch complete (10979 records). [2025-10-15T19:46:51.315875] [DEBUG] [VALIDATOR ] KFS: Validating primary data. [2025-10-15T19:46:51.688723] [DEBUG] [VALIDATOR ] KFS: All expected trading days are present. [2025-10-15T19:46:51.688796] [DEBUG] [VALIDATOR ] KFS: Primary data validation passed. [2025-10-15T19:46:51.689089] [INFO ] [MAIN ] KFS: Fetched primary data is valid. [2025-10-15T19:46:51.689128] [DEBUG] [LOCAL ] KFS: Saving primary data. [2025-10-15T19:46:51.689570] [DEBUG] [LOCAL ] KFS: Trimmed 10979 records to 8664 (keeping 200 days of data) [2025-10-15T19:46:51.738914] [DEBUG] [LOCAL ] KFS: Primary data saved (8664 records). [2025-10-15T19:46:51.739037] [INFO ] [MAIN ] KFS: Full history saved. [2025-10-15T19:46:51.739112] [INFO ] [MAIN ] Update Progress: 1185/2369 symbols completed. KFS took 16.7s. Estimated remaining: 2h 46m 39s. Rate: 7.1 symbols/min [2025-10-15T19:46:51.908730] [INFO ] [MAIN ] KGC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:46:51.963058] [DEBUG] [LOCAL ] KGC: Loaded 53700 existing records from primary storage. [2025-10-15T19:46:51.963415] [INFO ] [MAIN ] KGC: Loaded 53700 existing records. [2025-10-15T19:46:52.120614] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-01. [2025-10-15T19:46:52.142726] [WARN ] [MAIN ] KGC: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:46:52.142964] [INFO ] [MAIN ] KGC: Wiping existing primary data before full refresh. [2025-10-15T19:46:52.143076] [INFO ] [LOCAL ] KGC: Starting deletion of primary data. [2025-10-15T19:46:52.143744] [DEBUG] [LOCAL ] KGC: Deleted primary data file. [2025-10-15T19:46:52.143823] [INFO ] [MAIN ] KGC: Starting full primary refresh. [2025-10-15T19:46:52.498971] [INFO ] [REMOTE ] KGC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:46:52.913969] [INFO ] [REMOTE ] KGC: Fetching primary data for 2024-12. [2025-10-15T19:46:53.165895] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-10 (1.85 seconds). [2025-10-15T19:46:53.175023] [INFO ] [REMOTE ] KEY: Full fetch complete (77427 records). [2025-10-15T19:46:53.175237] [DEBUG] [VALIDATOR ] KEY: Validating primary data. [2025-10-15T19:46:53.380418] [WARN ] [VALIDATOR ] KEY: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-15T19:46:53.381392] [FATAL] [MAIN ] KEY: Fetched primary data is invalid. Refusing to save it. [2025-10-15T19:46:53.381508] [WARN ] [MAIN ] KEY: Deleting existing primary and derivative data due to validation failure. [2025-10-15T19:46:53.381737] [INFO ] [LOCAL ] KEY: Starting deletion of primary data. [2025-10-15T19:46:53.381831] [DEBUG] [LOCAL ] KEY: No primary data file found to delete. [2025-10-15T19:46:53.381900] [INFO ] [LOCAL ] KEY: Starting deletion of derivative data. [2025-10-15T19:46:53.381981] [DEBUG] [LOCAL ] KEY: No derivative data file found to delete. [2025-10-15T19:46:53.382112] [INFO ] [MAIN ] Update Progress: 1186/2369 symbols completed. KEY took 49.0s. Estimated remaining: 2h 46m 24s. Rate: 7.1 symbols/min [2025-10-15T19:46:53.563429] [INFO ] [MAIN ] KGS: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:46:53.588307] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-15T19:46:53.636676] [DEBUG] [LOCAL ] KGS: Loaded 46153 existing records from primary storage. [2025-10-15T19:46:53.637000] [INFO ] [MAIN ] KGS: Loaded 46153 existing records. [2025-10-15T19:46:53.719221] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-02. [2025-10-15T19:46:53.823672] [WARN ] [MAIN ] KGS: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:46:53.823877] [INFO ] [MAIN ] KGS: Wiping existing primary data before full refresh. [2025-10-15T19:46:53.823927] [INFO ] [LOCAL ] KGS: Starting deletion of primary data. [2025-10-15T19:46:53.824314] [DEBUG] [LOCAL ] KGS: Deleted primary data file. [2025-10-15T19:46:53.824371] [INFO ] [MAIN ] KGS: Starting full primary refresh. [2025-10-15T19:46:54.212000] [INFO ] [REMOTE ] KGS: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:46:54.514004] [INFO ] [REMOTE ] KGS: Fetching primary data for 2024-12. [2025-10-15T19:46:54.680739] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-15T19:46:54.932822] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-15T19:46:55.314021] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-03. [2025-10-15T19:46:56.064625] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-15T19:46:56.113962] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-01. [2025-10-15T19:46:56.704431] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-15T19:46:56.914037] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-04. [2025-10-15T19:46:57.334234] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-15T19:46:57.713968] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-08. [2025-10-15T19:46:58.444121] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-15T19:46:58.513984] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-02. [2025-10-15T19:46:58.850122] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-15T19:46:59.314050] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-01. [2025-10-15T19:46:59.901452] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-15T19:47:00.114006] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-09. [2025-10-15T19:47:00.914059] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-03. [2025-10-15T19:47:01.361491] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-15T19:47:01.546457] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-01 (2.23 seconds). [2025-10-15T19:47:01.714014] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-10. [2025-10-15T19:47:02.247354] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-15T19:47:02.514072] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-02. [2025-10-15T19:47:02.995457] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-15T19:47:02.999123] [INFO ] [REMOTE ] KFRC: Full fetch complete (26496 records). [2025-10-15T19:47:02.999203] [DEBUG] [VALIDATOR ] KFRC: Validating primary data. [2025-10-15T19:47:03.319117] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-04. [2025-10-15T19:47:03.377763] [DEBUG] [VALIDATOR ] KFRC: All expected trading days are present. [2025-10-15T19:47:03.377843] [DEBUG] [VALIDATOR ] KFRC: Primary data validation passed. [2025-10-15T19:47:03.378422] [INFO ] [MAIN ] KFRC: Fetched primary data is valid. [2025-10-15T19:47:03.378461] [DEBUG] [LOCAL ] KFRC: Saving primary data. [2025-10-15T19:47:03.379274] [DEBUG] [LOCAL ] KFRC: Trimmed 26496 records to 20493 (keeping 200 days of data) [2025-10-15T19:47:03.503404] [DEBUG] [LOCAL ] KFRC: Primary data saved (20493 records). [2025-10-15T19:47:03.503527] [INFO ] [MAIN ] KFRC: Full history saved. [2025-10-15T19:47:03.503605] [INFO ] [MAIN ] Update Progress: 1187/2369 symbols completed. KFRC took 38.5s. Estimated remaining: 2h 46m 17s. Rate: 7.1 symbols/min [2025-10-15T19:47:03.670745] [INFO ] [MAIN ] KIM: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:47:03.726312] [DEBUG] [LOCAL ] KIM: Loaded 52997 existing records from primary storage. [2025-10-15T19:47:03.726615] [INFO ] [MAIN ] KIM: Loaded 52997 existing records. [2025-10-15T19:47:03.905680] [WARN ] [MAIN ] KIM: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:47:03.905918] [INFO ] [MAIN ] KIM: Wiping existing primary data before full refresh. [2025-10-15T19:47:03.905965] [INFO ] [LOCAL ] KIM: Starting deletion of primary data. [2025-10-15T19:47:03.906487] [DEBUG] [LOCAL ] KIM: Deleted primary data file. [2025-10-15T19:47:03.906545] [INFO ] [MAIN ] KIM: Starting full primary refresh. [2025-10-15T19:47:04.134760] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-05. [2025-10-15T19:47:04.279695] [INFO ] [REMOTE ] KIM: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:47:04.421439] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-10-15T19:47:04.914025] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-03. [2025-10-15T19:47:05.033579] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-15T19:47:05.512480] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-15T19:47:05.714024] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-06. [2025-10-15T19:47:06.514001] [INFO ] [REMOTE ] KIM: Fetching primary data for 2024-12. [2025-10-15T19:47:06.685100] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-15T19:47:07.054213] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-15T19:47:07.314011] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-05. [2025-10-15T19:47:08.114011] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-07. [2025-10-15T19:47:08.203185] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-15T19:47:08.736824] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-15T19:47:08.914011] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-06. [2025-10-15T19:47:09.489212] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-15T19:47:09.713985] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-04. [2025-10-15T19:47:10.383778] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-15T19:47:10.513995] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-01. [2025-10-15T19:47:11.314067] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-08. [2025-10-15T19:47:11.846905] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-10-15T19:47:11.897616] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-15T19:47:12.114001] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-05. [2025-10-15T19:47:12.469575] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-15T19:47:12.913983] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-02. [2025-10-15T19:47:13.713979] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-09. [2025-10-15T19:47:14.192675] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-05 (2.08 seconds). [2025-10-15T19:47:14.495593] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-15T19:47:14.513950] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-03. [2025-10-15T19:47:14.980444] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-15T19:47:15.314048] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-06. [2025-10-15T19:47:16.113998] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-10. [2025-10-15T19:47:16.492336] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-10-15T19:47:16.752143] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-15T19:47:16.914016] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-07. [2025-10-15T19:47:17.321623] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-15T19:47:17.325958] [INFO ] [REMOTE ] KFY: Full fetch complete (43402 records). [2025-10-15T19:47:17.326084] [DEBUG] [VALIDATOR ] KFY: Validating primary data. [2025-10-15T19:47:17.719346] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-07. [2025-10-15T19:47:17.767571] [DEBUG] [VALIDATOR ] KFY: All expected trading days are present. [2025-10-15T19:47:17.767744] [DEBUG] [VALIDATOR ] KFY: Primary data validation passed. [2025-10-15T19:47:17.768856] [INFO ] [MAIN ] KFY: Fetched primary data is valid. [2025-10-15T19:47:17.768925] [DEBUG] [LOCAL ] KFY: Saving primary data. [2025-10-15T19:47:17.770389] [DEBUG] [LOCAL ] KFY: Trimmed 43402 records to 29991 (keeping 200 days of data) [2025-10-15T19:47:17.969852] [DEBUG] [LOCAL ] KFY: Primary data saved (29991 records). [2025-10-15T19:47:17.969983] [INFO ] [MAIN ] KFY: Full history saved. [2025-10-15T19:47:17.970065] [INFO ] [MAIN ] Update Progress: 1188/2369 symbols completed. KFY took 33.3s. Estimated remaining: 2h 46m 14s. Rate: 7.1 symbols/min [2025-10-15T19:47:18.150796] [INFO ] [MAIN ] KIO: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:47:18.172763] [DEBUG] [LOCAL ] KIO: Loaded 21606 existing records from primary storage. [2025-10-15T19:47:18.173077] [INFO ] [MAIN ] KIO: Loaded 21606 existing records. [2025-10-15T19:47:18.351547] [WARN ] [MAIN ] KIO: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:47:18.351938] [INFO ] [MAIN ] KIO: Wiping existing primary data before full refresh. [2025-10-15T19:47:18.352080] [INFO ] [LOCAL ] KIO: Starting deletion of primary data. [2025-10-15T19:47:18.352392] [DEBUG] [LOCAL ] KIO: Deleted primary data file. [2025-10-15T19:47:18.352453] [INFO ] [MAIN ] KIO: Starting full primary refresh. [2025-10-15T19:47:18.527995] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-04. [2025-10-15T19:47:18.744219] [INFO ] [REMOTE ] KIO: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:47:18.747092] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-15T19:47:19.314046] [INFO ] [REMOTE ] KIO: Fetching primary data for 2024-12. [2025-10-15T19:47:19.816117] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-10-15T19:47:20.114065] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-08. [2025-10-15T19:47:20.167541] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-15T19:47:20.537562] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-15T19:47:20.914053] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-01. [2025-10-15T19:47:21.714030] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-05. [2025-10-15T19:47:21.928230] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-15T19:47:22.257214] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-08 (2.14 seconds). [2025-10-15T19:47:22.514001] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-09. [2025-10-15T19:47:23.240246] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-15T19:47:23.314005] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-06. [2025-10-15T19:47:24.114002] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-08. [2025-10-15T19:47:24.461763] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-15T19:47:24.913965] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-10. [2025-10-15T19:47:25.012146] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-15T19:47:25.713985] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-07. [2025-10-15T19:47:25.857907] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-15T19:47:26.514019] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-09. [2025-10-15T19:47:27.313990] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-02. [2025-10-15T19:47:27.410383] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-10 (2.50 seconds). [2025-10-15T19:47:27.416883] [INFO ] [REMOTE ] KGC: Full fetch complete (77870 records). [2025-10-15T19:47:27.417012] [DEBUG] [VALIDATOR ] KGC: Validating primary data. [2025-10-15T19:47:27.749133] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-10-15T19:47:27.872799] [DEBUG] [VALIDATOR ] KGC: All expected trading days are present. [2025-10-15T19:47:27.872895] [DEBUG] [VALIDATOR ] KGC: Primary data validation passed. [2025-10-15T19:47:27.874079] [INFO ] [MAIN ] KGC: Fetched primary data is valid. [2025-10-15T19:47:27.874148] [DEBUG] [LOCAL ] KGC: Saving primary data. [2025-10-15T19:47:27.875871] [DEBUG] [LOCAL ] KGC: Trimmed 77870 records to 53700 (keeping 200 days of data) [2025-10-15T19:47:28.114747] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-08. [2025-10-15T19:47:28.157555] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-15T19:47:28.191766] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-15T19:47:28.286067] [DEBUG] [LOCAL ] KGC: Primary data saved (53700 records). [2025-10-15T19:47:28.286201] [INFO ] [MAIN ] KGC: Full history saved. [2025-10-15T19:47:28.287218] [INFO ] [MAIN ] Update Progress: 1189/2369 symbols completed. KGC took 36.5s. Estimated remaining: 2h 46m 8s. Rate: 7.1 symbols/min [2025-10-15T19:47:28.460052] [INFO ] [MAIN ] KKR: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:47:28.460215] [DEBUG] [LOCAL ] KKR: No existing data file found in primary storage. [2025-10-15T19:47:28.460251] [WARN ] [MAIN ] KKR: No existing data found, performing full refresh instead. [2025-10-15T19:47:28.460356] [INFO ] [MAIN ] KKR: Wiping existing primary data before full refresh. [2025-10-15T19:47:28.460397] [INFO ] [LOCAL ] KKR: Starting deletion of primary data. [2025-10-15T19:47:28.460437] [DEBUG] [LOCAL ] KKR: No primary data file found to delete. [2025-10-15T19:47:28.460468] [INFO ] [MAIN ] KKR: Starting full primary refresh. [2025-10-15T19:47:28.830681] [INFO ] [REMOTE ] KKR: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:47:28.914003] [INFO ] [REMOTE ] KKR: Fetching primary data for 2024-12. [2025-10-15T19:47:29.714026] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-10. [2025-10-15T19:47:29.828164] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-15T19:47:30.514065] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-09. [2025-10-15T19:47:30.812806] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-10-15T19:47:31.313983] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-03. [2025-10-15T19:47:31.334026] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-15T19:47:31.339960] [INFO ] [REMOTE ] KGS: Full fetch complete (66538 records). [2025-10-15T19:47:31.340085] [DEBUG] [VALIDATOR ] KGS: Validating primary data. [2025-10-15T19:47:31.730258] [DEBUG] [VALIDATOR ] KGS: All expected trading days are present. [2025-10-15T19:47:31.730347] [DEBUG] [VALIDATOR ] KGS: Primary data validation passed. [2025-10-15T19:47:31.731494] [INFO ] [MAIN ] KGS: Fetched primary data is valid. [2025-10-15T19:47:31.731575] [DEBUG] [LOCAL ] KGS: Saving primary data. [2025-10-15T19:47:31.733018] [DEBUG] [LOCAL ] KGS: Trimmed 66538 records to 46135 (keeping 200 days of data) [2025-10-15T19:47:32.018976] [DEBUG] [LOCAL ] KGS: Primary data saved (46135 records). [2025-10-15T19:47:32.019148] [INFO ] [MAIN ] KGS: Full history saved. [2025-10-15T19:47:32.019239] [INFO ] [MAIN ] Update Progress: 1190/2369 symbols completed. KGS took 38.6s. Estimated remaining: 2h 45m 55s. Rate: 7.1 symbols/min [2025-10-15T19:47:32.116359] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-01. [2025-10-15T19:47:32.193020] [INFO ] [MAIN ] KKRS: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:47:32.226933] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-15T19:47:32.230361] [DEBUG] [LOCAL ] KKRS: Loaded 5647 existing records from primary storage. [2025-10-15T19:47:32.242381] [INFO ] [MAIN ] KKRS: Loaded 5647 existing records. [2025-10-15T19:47:32.357144] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-15T19:47:32.440802] [WARN ] [MAIN ] KKRS: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:47:32.441045] [INFO ] [MAIN ] KKRS: Wiping existing primary data before full refresh. [2025-10-15T19:47:32.441129] [INFO ] [LOCAL ] KKRS: Starting deletion of primary data. [2025-10-15T19:47:32.441323] [DEBUG] [LOCAL ] KKRS: Deleted primary data file. [2025-10-15T19:47:32.441380] [INFO ] [MAIN ] KKRS: Starting full primary refresh. [2025-10-15T19:47:32.799864] [INFO ] [REMOTE ] KKRS: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:47:32.914008] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-04. [2025-10-15T19:47:33.713977] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-10. [2025-10-15T19:47:33.864781] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-15T19:47:34.039968] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-15T19:47:34.514008] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-02. [2025-10-15T19:47:35.313996] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2024-12. [2025-10-15T19:47:35.467758] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-15T19:47:35.474063] [INFO ] [REMOTE ] KIM: Full fetch complete (76965 records). [2025-10-15T19:47:35.474185] [DEBUG] [VALIDATOR ] KIM: Validating primary data. [2025-10-15T19:47:35.884154] [DEBUG] [VALIDATOR ] KIM: All expected trading days are present. [2025-10-15T19:47:35.884310] [DEBUG] [VALIDATOR ] KIM: Primary data validation passed. [2025-10-15T19:47:35.885378] [INFO ] [MAIN ] KIM: Fetched primary data is valid. [2025-10-15T19:47:35.885443] [DEBUG] [LOCAL ] KIM: Saving primary data. [2025-10-15T19:47:35.886979] [DEBUG] [LOCAL ] KIM: Trimmed 76965 records to 53004 (keeping 200 days of data) [2025-10-15T19:47:35.989798] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-10-15T19:47:36.114317] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-01. [2025-10-15T19:47:36.152805] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-15T19:47:36.267355] [DEBUG] [LOCAL ] KIM: Primary data saved (53004 records). [2025-10-15T19:47:36.267484] [INFO ] [MAIN ] KIM: Full history saved. [2025-10-15T19:47:36.267573] [INFO ] [MAIN ] Update Progress: 1191/2369 symbols completed. KIM took 32.8s. Estimated remaining: 2h 45m 42s. Rate: 7.1 symbols/min [2025-10-15T19:47:36.437288] [INFO ] [MAIN ] KKRT: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:47:36.437465] [DEBUG] [LOCAL ] KKRT: No existing data file found in primary storage. [2025-10-15T19:47:36.437503] [WARN ] [MAIN ] KKRT: No existing data found, performing full refresh instead. [2025-10-15T19:47:36.437612] [INFO ] [MAIN ] KKRT: Wiping existing primary data before full refresh. [2025-10-15T19:47:36.437681] [INFO ] [LOCAL ] KKRT: Starting deletion of primary data. [2025-10-15T19:47:36.437787] [DEBUG] [LOCAL ] KKRT: No primary data file found to delete. [2025-10-15T19:47:36.437835] [INFO ] [MAIN ] KKRT: Starting full primary refresh. [2025-10-15T19:47:36.719399] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-15T19:47:36.805834] [INFO ] [REMOTE ] KKRT: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:47:36.913961] [INFO ] [REMOTE ] KKRT: Fetching primary data for 2024-12. [2025-10-15T19:47:37.100044] [DEBUG] [REMOTE ] KKRT: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-15T19:47:37.100349] [WARN ] [REMOTE ] KKRT: No data returned for month 2024-12 [2025-10-15T19:47:37.100439] [FATAL] [REMOTE ] KKRT: API call failed - aborting fetch to avoid wasting further API calls [2025-10-15T19:47:37.100507] [FATAL] [MAIN ] KKRT: Failed to fetch primary data. [2025-10-15T19:47:37.100572] [WARN ] [MAIN ] KKRT: Deleting existing primary and derivative data due to fetch failure. [2025-10-15T19:47:37.100701] [INFO ] [LOCAL ] KKRT: Starting deletion of primary data. [2025-10-15T19:47:37.100785] [DEBUG] [LOCAL ] KKRT: No primary data file found to delete. [2025-10-15T19:47:37.100825] [INFO ] [LOCAL ] KKRT: Starting deletion of derivative data. [2025-10-15T19:47:37.100910] [DEBUG] [LOCAL ] KKRT: No derivative data file found to delete. [2025-10-15T19:47:37.100966] [INFO ] [MAIN ] Update Progress: 1192/2369 symbols completed. KKRT took 0.8s. Estimated remaining: 2h 45m 26s. Rate: 7.1 symbols/min [2025-10-15T19:47:37.283383] [INFO ] [MAIN ] KLAR: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:47:37.283583] [DEBUG] [LOCAL ] KLAR: No existing data file found in primary storage. [2025-10-15T19:47:37.283640] [WARN ] [MAIN ] KLAR: No existing data found, performing full refresh instead. [2025-10-15T19:47:37.283771] [INFO ] [MAIN ] KLAR: Wiping existing primary data before full refresh. [2025-10-15T19:47:37.283812] [INFO ] [LOCAL ] KLAR: Starting deletion of primary data. [2025-10-15T19:47:37.283854] [DEBUG] [LOCAL ] KLAR: No primary data file found to delete. [2025-10-15T19:47:37.283888] [INFO ] [MAIN ] KLAR: Starting full primary refresh. [2025-10-15T19:47:37.637196] [INFO ] [REMOTE ] KLAR: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:47:37.713969] [INFO ] [REMOTE ] KLAR: Fetching primary data for 2024-12. [2025-10-15T19:47:37.896743] [DEBUG] [REMOTE ] KLAR: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-15T19:47:37.897056] [WARN ] [REMOTE ] KLAR: No data returned for month 2024-12 [2025-10-15T19:47:37.897139] [FATAL] [REMOTE ] KLAR: API call failed - aborting fetch to avoid wasting further API calls [2025-10-15T19:47:37.897187] [FATAL] [MAIN ] KLAR: Failed to fetch primary data. [2025-10-15T19:47:37.897246] [WARN ] [MAIN ] KLAR: Deleting existing primary and derivative data due to fetch failure. [2025-10-15T19:47:37.897316] [INFO ] [LOCAL ] KLAR: Starting deletion of primary data. [2025-10-15T19:47:37.897377] [DEBUG] [LOCAL ] KLAR: No primary data file found to delete. [2025-10-15T19:47:37.897411] [INFO ] [LOCAL ] KLAR: Starting deletion of derivative data. [2025-10-15T19:47:37.897449] [DEBUG] [LOCAL ] KLAR: No derivative data file found to delete. [2025-10-15T19:47:37.897494] [INFO ] [MAIN ] Update Progress: 1193/2369 symbols completed. KLAR took 0.8s. Estimated remaining: 2h 45m 10s. Rate: 7.1 symbols/min [2025-10-15T19:47:38.067588] [INFO ] [MAIN ] KLC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:47:38.103871] [DEBUG] [LOCAL ] KLC: Loaded 36536 existing records from primary storage. [2025-10-15T19:47:38.104135] [INFO ] [MAIN ] KLC: Loaded 36536 existing records. [2025-10-15T19:47:38.277251] [WARN ] [MAIN ] KLC: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:47:38.277465] [INFO ] [MAIN ] KLC: Wiping existing primary data before full refresh. [2025-10-15T19:47:38.277511] [INFO ] [LOCAL ] KLC: Starting deletion of primary data. [2025-10-15T19:47:38.277834] [DEBUG] [LOCAL ] KLC: Deleted primary data file. [2025-10-15T19:47:38.277891] [INFO ] [MAIN ] KLC: Starting full primary refresh. [2025-10-15T19:47:38.520471] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-02. [2025-10-15T19:47:38.639163] [INFO ] [REMOTE ] KLC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:47:39.131481] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-15T19:47:39.313982] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-03. [2025-10-15T19:47:40.113996] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-03. [2025-10-15T19:47:40.665984] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-10-15T19:47:40.914056] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-04. [2025-10-15T19:47:41.427967] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-03 (2.11 seconds). [2025-10-15T19:47:41.645384] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-15T19:47:41.714005] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-05. [2025-10-15T19:47:42.419298] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-15T19:47:42.513991] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-06. [2025-10-15T19:47:43.095049] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-15T19:47:43.313997] [INFO ] [REMOTE ] KLC: Fetching primary data for 2024-12. [2025-10-15T19:47:44.114011] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-07. [2025-10-15T19:47:44.678752] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-15T19:47:44.770626] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-15T19:47:44.913999] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-08. [2025-10-15T19:47:45.482397] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-15T19:47:45.713998] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-01. [2025-10-15T19:47:46.513965] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-05. [2025-10-15T19:47:46.987478] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-15T19:47:47.313968] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-02. [2025-10-15T19:47:47.545580] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-15T19:47:48.113970] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-06. [2025-10-15T19:47:48.428774] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-15T19:47:48.820451] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-15T19:47:48.914002] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-09. [2025-10-15T19:47:49.396783] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-10-15T19:47:49.714008] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-07. [2025-10-15T19:47:50.513987] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-10. [2025-10-15T19:47:50.719168] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-15T19:47:51.075774] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-15T19:47:51.076973] [INFO ] [REMOTE ] KKRS: Full fetch complete (7681 records). [2025-10-15T19:47:51.077047] [DEBUG] [VALIDATOR ] KKRS: Validating primary data. [2025-10-15T19:47:51.322868] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-03. [2025-10-15T19:47:51.464267] [DEBUG] [VALIDATOR ] KKRS: All expected trading days are present. [2025-10-15T19:47:51.464377] [DEBUG] [VALIDATOR ] KKRS: Primary data validation passed. [2025-10-15T19:47:51.464704] [INFO ] [MAIN ] KKRS: Fetched primary data is valid. [2025-10-15T19:47:51.464772] [DEBUG] [LOCAL ] KKRS: Saving primary data. [2025-10-15T19:47:51.465403] [DEBUG] [LOCAL ] KKRS: Trimmed 7681 records to 5638 (keeping 200 days of data) [2025-10-15T19:47:51.504056] [DEBUG] [LOCAL ] KKRS: Primary data saved (5638 records). [2025-10-15T19:47:51.504268] [INFO ] [MAIN ] KKRS: Full history saved. [2025-10-15T19:47:51.504377] [INFO ] [MAIN ] Update Progress: 1194/2369 symbols completed. KKRS took 19.5s. Estimated remaining: 2h 45m 7s. Rate: 7.1 symbols/min [2025-10-15T19:47:51.733132] [INFO ] [MAIN ] KMI: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:47:51.794409] [DEBUG] [LOCAL ] KMI: Loaded 53693 existing records from primary storage. [2025-10-15T19:47:51.794899] [INFO ] [MAIN ] KMI: Loaded 53693 existing records. [2025-10-15T19:47:51.977876] [WARN ] [MAIN ] KMI: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:47:51.978117] [INFO ] [MAIN ] KMI: Wiping existing primary data before full refresh. [2025-10-15T19:47:51.978167] [INFO ] [LOCAL ] KMI: Starting deletion of primary data. [2025-10-15T19:47:51.978581] [DEBUG] [LOCAL ] KMI: Deleted primary data file. [2025-10-15T19:47:51.978694] [INFO ] [MAIN ] KMI: Starting full primary refresh. [2025-10-15T19:47:52.119235] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-04. [2025-10-15T19:47:52.383839] [INFO ] [REMOTE ] KMI: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:47:52.786101] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-15T19:47:52.913994] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-04. [2025-10-15T19:47:53.714006] [INFO ] [REMOTE ] KMI: Fetching primary data for 2024-12. [2025-10-15T19:47:53.903292] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-15T19:47:54.393513] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-15T19:47:54.514015] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-05. [2025-10-15T19:47:55.217475] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-15T19:47:55.313976] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-01. [2025-10-15T19:47:56.113979] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-08. [2025-10-15T19:47:56.441855] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-15T19:47:56.904908] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-15T19:47:56.913951] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-09. [2025-10-15T19:47:57.107804] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-15T19:47:57.714008] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-06. [2025-10-15T19:47:58.011569] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-15T19:47:58.514003] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-05. [2025-10-15T19:47:59.314037] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-02. [2025-10-15T19:47:59.420191] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-15T19:47:59.713465] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-15T19:48:00.113996] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-10. [2025-10-15T19:48:00.914021] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-07. [2025-10-15T19:48:01.336173] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-15T19:48:01.339490] [INFO ] [REMOTE ] KIO: Full fetch complete (31837 records). [2025-10-15T19:48:01.339569] [DEBUG] [VALIDATOR ] KIO: Validating primary data. [2025-10-15T19:48:01.678515] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-02 (2.36 seconds). [2025-10-15T19:48:01.715264] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-06. [2025-10-15T19:48:01.781897] [DEBUG] [VALIDATOR ] KIO: All expected trading days are present. [2025-10-15T19:48:01.781988] [DEBUG] [VALIDATOR ] KIO: Primary data validation passed. [2025-10-15T19:48:01.782726] [INFO ] [MAIN ] KIO: Fetched primary data is valid. [2025-10-15T19:48:01.782792] [DEBUG] [LOCAL ] KIO: Saving primary data. [2025-10-15T19:48:01.783743] [DEBUG] [LOCAL ] KIO: Trimmed 31837 records to 21606 (keeping 200 days of data) [2025-10-15T19:48:01.920364] [DEBUG] [LOCAL ] KIO: Primary data saved (21606 records). [2025-10-15T19:48:01.920498] [INFO ] [MAIN ] KIO: Full history saved. [2025-10-15T19:48:01.920576] [INFO ] [MAIN ] Update Progress: 1195/2369 symbols completed. KIO took 44.0s. Estimated remaining: 2h 45m 0s. Rate: 7.1 symbols/min [2025-10-15T19:48:02.084377] [INFO ] [MAIN ] KMPB: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:48:02.089522] [DEBUG] [LOCAL ] KMPB: Loaded 3693 existing records from primary storage. [2025-10-15T19:48:02.089710] [INFO ] [MAIN ] KMPB: Loaded 3693 existing records. [2025-10-15T19:48:02.265591] [WARN ] [MAIN ] KMPB: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:48:02.265823] [INFO ] [MAIN ] KMPB: Wiping existing primary data before full refresh. [2025-10-15T19:48:02.265876] [INFO ] [LOCAL ] KMPB: Starting deletion of primary data. [2025-10-15T19:48:02.266012] [DEBUG] [LOCAL ] KMPB: Deleted primary data file. [2025-10-15T19:48:02.266049] [INFO ] [MAIN ] KMPB: Starting full primary refresh. [2025-10-15T19:48:02.519077] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-03. [2025-10-15T19:48:02.628936] [INFO ] [REMOTE ] KMPB: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:48:02.877490] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-15T19:48:03.044219] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-15T19:48:03.314071] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-08. [2025-10-15T19:48:04.114007] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2024-12. [2025-10-15T19:48:04.267288] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-15T19:48:04.658997] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2024-12 (0.54 seconds). [2025-10-15T19:48:04.914030] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-01. [2025-10-15T19:48:05.262589] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-10-15T19:48:05.279702] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-01 (0.37 seconds). [2025-10-15T19:48:05.714061] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-07. [2025-10-15T19:48:06.513996] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-04. [2025-10-15T19:48:07.035509] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-15T19:48:07.313988] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-08. [2025-10-15T19:48:08.113964] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-09. [2025-10-15T19:48:08.441877] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-15T19:48:08.779929] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-15T19:48:08.914001] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-09. [2025-10-15T19:48:09.713998] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-05. [2025-10-15T19:48:09.929095] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-15T19:48:10.374601] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-15T19:48:10.514005] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-02. [2025-10-15T19:48:10.987268] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-15T19:48:11.313960] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-10. [2025-10-15T19:48:11.393557] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-15T19:48:12.113995] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-06. [2025-10-15T19:48:12.733561] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-15T19:48:12.738225] [INFO ] [REMOTE ] KLC: Full fetch complete (50544 records). [2025-10-15T19:48:12.738329] [DEBUG] [VALIDATOR ] KLC: Validating primary data. [2025-10-15T19:48:12.922545] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-03. [2025-10-15T19:48:13.122302] [DEBUG] [VALIDATOR ] KLC: All expected trading days are present. [2025-10-15T19:48:13.122400] [DEBUG] [VALIDATOR ] KLC: Primary data validation passed. [2025-10-15T19:48:13.123286] [INFO ] [MAIN ] KLC: Fetched primary data is valid. [2025-10-15T19:48:13.123347] [DEBUG] [LOCAL ] KLC: Saving primary data. [2025-10-15T19:48:13.124511] [DEBUG] [LOCAL ] KLC: Trimmed 50544 records to 36505 (keeping 200 days of data) [2025-10-15T19:48:13.329906] [DEBUG] [LOCAL ] KLC: Primary data saved (36505 records). [2025-10-15T19:48:13.330038] [INFO ] [MAIN ] KLC: Full history saved. [2025-10-15T19:48:13.330116] [INFO ] [MAIN ] Update Progress: 1196/2369 symbols completed. KLC took 35.4s. Estimated remaining: 2h 44m 55s. Rate: 7.1 symbols/min [2025-10-15T19:48:13.515321] [INFO ] [MAIN ] KMPR: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:48:13.552582] [DEBUG] [LOCAL ] KMPR: Loaded 39849 existing records from primary storage. [2025-10-15T19:48:13.552916] [INFO ] [MAIN ] KMPR: Loaded 39849 existing records. [2025-10-15T19:48:13.666233] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-15T19:48:13.718832] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-04. [2025-10-15T19:48:13.760916] [WARN ] [MAIN ] KMPR: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:48:13.761165] [INFO ] [MAIN ] KMPR: Wiping existing primary data before full refresh. [2025-10-15T19:48:13.761213] [INFO ] [LOCAL ] KMPR: Starting deletion of primary data. [2025-10-15T19:48:13.761612] [DEBUG] [LOCAL ] KMPR: Deleted primary data file. [2025-10-15T19:48:13.761696] [INFO ] [MAIN ] KMPR: Starting full primary refresh. [2025-10-15T19:48:14.124916] [INFO ] [REMOTE ] KMPR: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:48:14.156342] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-06 (2.04 seconds). [2025-10-15T19:48:14.280224] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-10-15T19:48:14.513994] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-05. [2025-10-15T19:48:14.964228] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-10-15T19:48:15.314007] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-07. [2025-10-15T19:48:16.114006] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-10. [2025-10-15T19:48:16.914027] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-06. [2025-10-15T19:48:17.465476] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-07 (2.15 seconds). [2025-10-15T19:48:17.482323] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-15T19:48:17.714054] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-07. [2025-10-15T19:48:17.785807] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-15T19:48:17.792234] [INFO ] [REMOTE ] KKR: Full fetch complete (77624 records). [2025-10-15T19:48:17.792380] [DEBUG] [VALIDATOR ] KKR: Validating primary data. [2025-10-15T19:48:18.170851] [DEBUG] [VALIDATOR ] KKR: All expected trading days are present. [2025-10-15T19:48:18.170934] [DEBUG] [VALIDATOR ] KKR: Primary data validation passed. [2025-10-15T19:48:18.172003] [INFO ] [MAIN ] KKR: Fetched primary data is valid. [2025-10-15T19:48:18.172068] [DEBUG] [LOCAL ] KKR: Saving primary data. [2025-10-15T19:48:18.173523] [DEBUG] [LOCAL ] KKR: Trimmed 77624 records to 53503 (keeping 200 days of data) [2025-10-15T19:48:18.498706] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-15T19:48:18.519195] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2024-12. [2025-10-15T19:48:18.524257] [DEBUG] [LOCAL ] KKR: Primary data saved (53503 records). [2025-10-15T19:48:18.524410] [INFO ] [MAIN ] KKR: Full history saved. [2025-10-15T19:48:18.524490] [INFO ] [MAIN ] Update Progress: 1197/2369 symbols completed. KKR took 50.2s. Estimated remaining: 2h 44m 43s. Rate: 7.1 symbols/min [2025-10-15T19:48:19.314029] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-08. [2025-10-15T19:48:19.668540] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-15T19:48:19.723126] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-08 (0.41 seconds). [2025-10-15T19:48:20.114073] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-01. [2025-10-15T19:48:20.913967] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-08. [2025-10-15T19:48:21.300683] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-15T19:48:21.714000] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-09. [2025-10-15T19:48:22.268617] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-15T19:48:22.514039] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-10. [2025-10-15T19:48:23.314035] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-02. [2025-10-15T19:48:24.505759] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-15T19:48:24.512275] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-03. [2025-10-15T19:48:24.872154] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-08 (3.96 seconds). [2025-10-15T19:48:24.888488] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-10 (2.37 seconds). [2025-10-15T19:48:24.889916] [INFO ] [REMOTE ] KMPB: Full fetch complete (5030 records). [2025-10-15T19:48:24.890067] [DEBUG] [VALIDATOR ] KMPB: Validating primary data. [2025-10-15T19:48:24.925453] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-09. [2025-10-15T19:48:25.278422] [DEBUG] [VALIDATOR ] KMPB: All expected trading days are present. [2025-10-15T19:48:25.278498] [DEBUG] [VALIDATOR ] KMPB: Primary data validation passed. [2025-10-15T19:48:25.278677] [INFO ] [MAIN ] KMPB: Fetched primary data is valid. [2025-10-15T19:48:25.278738] [DEBUG] [LOCAL ] KMPB: Saving primary data. [2025-10-15T19:48:25.279091] [DEBUG] [LOCAL ] KMPB: Trimmed 5030 records to 3652 (keeping 200 days of data) [2025-10-15T19:48:25.301068] [DEBUG] [LOCAL ] KMPB: Primary data saved (3652 records). [2025-10-15T19:48:25.301199] [INFO ] [MAIN ] KMPB: Full history saved. [2025-10-15T19:48:25.301285] [INFO ] [MAIN ] Update Progress: 1198/2369 symbols completed. KMPB took 23.4s. Estimated remaining: 2h 44m 33s. Rate: 7.1 symbols/min [2025-10-15T19:48:25.857430] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-15T19:48:25.864418] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-04. [2025-10-15T19:48:27.006749] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-10-15T19:48:27.030606] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-10. [2025-10-15T19:48:27.039548] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-15T19:48:27.313974] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-05. [2025-10-15T19:48:27.642381] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-15T19:48:27.649836] [INFO ] [REMOTE ] KMI: Full fetch complete (77873 records). [2025-10-15T19:48:27.649967] [DEBUG] [VALIDATOR ] KMI: Validating primary data. [2025-10-15T19:48:28.048845] [DEBUG] [VALIDATOR ] KMI: All expected trading days are present. [2025-10-15T19:48:28.048978] [DEBUG] [VALIDATOR ] KMI: Primary data validation passed. [2025-10-15T19:48:28.050040] [INFO ] [MAIN ] KMI: Fetched primary data is valid. [2025-10-15T19:48:28.050107] [DEBUG] [LOCAL ] KMI: Saving primary data. [2025-10-15T19:48:28.051681] [DEBUG] [LOCAL ] KMI: Trimmed 77873 records to 53693 (keeping 200 days of data) [2025-10-15T19:48:28.407856] [DEBUG] [LOCAL ] KMI: Primary data saved (53693 records). [2025-10-15T19:48:28.408036] [INFO ] [MAIN ] KMI: Full history saved. [2025-10-15T19:48:28.408382] [INFO ] [MAIN ] Update Progress: 1199/2369 symbols completed. KMI took 36.9s. Estimated remaining: 2h 44m 20s. Rate: 7.1 symbols/min [2025-10-15T19:48:28.409583] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-15T19:48:28.416909] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-06. [2025-10-15T19:48:29.828571] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-15T19:48:29.836206] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-07. [2025-10-15T19:48:34.150924] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-07 (4.31 seconds). [2025-10-15T19:48:34.159711] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-08. [2025-10-15T19:48:35.884165] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-15T19:48:35.893997] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-09. [2025-10-15T19:48:37.420047] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-15T19:48:37.430187] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-10. [2025-10-15T19:48:38.585544] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-15T19:48:38.590890] [INFO ] [REMOTE ] KMPR: Full fetch complete (52828 records). [2025-10-15T19:48:38.590995] [DEBUG] [VALIDATOR ] KMPR: Validating primary data. [2025-10-15T19:48:38.964516] [DEBUG] [VALIDATOR ] KMPR: All expected trading days are present. [2025-10-15T19:48:38.964602] [DEBUG] [VALIDATOR ] KMPR: Primary data validation passed. [2025-10-15T19:48:38.965480] [INFO ] [MAIN ] KMPR: Fetched primary data is valid. [2025-10-15T19:48:38.965535] [DEBUG] [LOCAL ] KMPR: Saving primary data. [2025-10-15T19:48:38.966606] [DEBUG] [LOCAL ] KMPR: Trimmed 52828 records to 39987 (keeping 200 days of data) [2025-10-15T19:48:39.199234] [DEBUG] [LOCAL ] KMPR: Primary data saved (39987 records). [2025-10-15T19:48:39.199374] [INFO ] [MAIN ] KMPR: Full history saved. [2025-10-15T19:48:39.199464] [INFO ] [MAIN ] Update Progress: 1200/2369 symbols completed. KMPR took 25.9s. Estimated remaining: 2h 44m 13s. Rate: 7.1 symbols/min [2025-10-15T19:48:39.760113] [INFO ] [MAIN ] KMX: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:48:39.791749] [INFO ] [MAIN ] KN: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:48:39.881597] [INFO ] [MAIN ] KNF: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:48:39.916806] [INFO ] [MAIN ] KMT: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:48:39.959211] [DEBUG] [LOCAL ] KN: Loaded 38607 existing records from primary storage. [2025-10-15T19:48:39.959750] [INFO ] [MAIN ] KN: Loaded 38607 existing records. [2025-10-15T19:48:40.079235] [DEBUG] [LOCAL ] KNF: Loaded 36549 existing records from primary storage. [2025-10-15T19:48:40.111058] [INFO ] [MAIN ] KNF: Loaded 36549 existing records. [2025-10-15T19:48:40.151679] [DEBUG] [LOCAL ] KMT: Loaded 42914 existing records from primary storage. [2025-10-15T19:48:40.196751] [INFO ] [MAIN ] KMT: Loaded 42914 existing records. [2025-10-15T19:48:40.325520] [DEBUG] [LOCAL ] KMX: Loaded 53268 existing records from primary storage. [2025-10-15T19:48:40.305571] [WARN ] [MAIN ] KN: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:48:40.341355] [INFO ] [MAIN ] KMX: Loaded 53268 existing records. [2025-10-15T19:48:40.401420] [INFO ] [MAIN ] KN: Wiping existing primary data before full refresh. [2025-10-15T19:48:40.471684] [INFO ] [LOCAL ] KN: Starting deletion of primary data. [2025-10-15T19:48:40.522522] [DEBUG] [LOCAL ] KN: Deleted primary data file. [2025-10-15T19:48:40.522776] [INFO ] [MAIN ] KN: Starting full primary refresh. [2025-10-15T19:48:40.855970] [WARN ] [MAIN ] KNF: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:48:40.880070] [WARN ] [MAIN ] KMT: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:48:40.859823] [WARN ] [MAIN ] KMX: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:48:40.880532] [INFO ] [MAIN ] KNF: Wiping existing primary data before full refresh. [2025-10-15T19:48:40.880937] [INFO ] [LOCAL ] KNF: Starting deletion of primary data. [2025-10-15T19:48:40.880991] [INFO ] [MAIN ] KMT: Wiping existing primary data before full refresh. [2025-10-15T19:48:40.881464] [INFO ] [MAIN ] KMX: Wiping existing primary data before full refresh. [2025-10-15T19:48:40.886974] [INFO ] [LOCAL ] KMT: Starting deletion of primary data. [2025-10-15T19:48:40.907743] [DEBUG] [LOCAL ] KNF: Deleted primary data file. [2025-10-15T19:48:40.897371] [INFO ] [LOCAL ] KMX: Starting deletion of primary data. [2025-10-15T19:48:40.921236] [INFO ] [MAIN ] KNF: Starting full primary refresh. [2025-10-15T19:48:40.931610] [DEBUG] [LOCAL ] KMX: Deleted primary data file. [2025-10-15T19:48:40.939829] [DEBUG] [LOCAL ] KMT: Deleted primary data file. [2025-10-15T19:48:40.940021] [INFO ] [MAIN ] KMX: Starting full primary refresh. [2025-10-15T19:48:40.946013] [INFO ] [MAIN ] KMT: Starting full primary refresh. [2025-10-15T19:48:41.852019] [INFO ] [REMOTE ] KN: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:48:41.940570] [INFO ] [REMOTE ] KN: Fetching primary data for 2024-12. [2025-10-15T19:48:42.121200] [INFO ] [REMOTE ] KNF: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:48:42.143501] [INFO ] [REMOTE ] KNF: Fetching primary data for 2024-12. [2025-10-15T19:48:42.262640] [INFO ] [REMOTE ] KMT: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:48:42.265026] [INFO ] [REMOTE ] KMT: Fetching primary data for 2024-12. [2025-10-15T19:48:42.284356] [INFO ] [REMOTE ] KMX: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:48:42.284668] [INFO ] [REMOTE ] KMX: Fetching primary data for 2024-12. [2025-10-15T19:48:43.293825] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-15T19:48:43.301303] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-01. [2025-10-15T19:48:43.590830] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-15T19:48:43.597841] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-01. [2025-10-15T19:48:43.705424] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-15T19:48:43.716115] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-01. [2025-10-15T19:48:43.807175] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-15T19:48:43.815439] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-01. [2025-10-15T19:48:44.506456] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-15T19:48:44.513046] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-02. [2025-10-15T19:48:44.630051] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-15T19:48:44.637904] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-02. [2025-10-15T19:48:45.128637] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-15T19:48:45.138986] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-02. [2025-10-15T19:48:45.523934] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-15T19:48:45.530680] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-03. [2025-10-15T19:48:45.692296] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-15T19:48:45.700908] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-03. [2025-10-15T19:48:45.725580] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-15T19:48:45.734144] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-02. [2025-10-15T19:48:46.522335] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-15T19:48:46.529855] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-04. [2025-10-15T19:48:47.164785] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-15T19:48:47.173527] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-04. [2025-10-15T19:48:47.246967] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-15T19:48:47.255477] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-03. [2025-10-15T19:48:47.323345] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-02 (2.18 seconds). [2025-10-15T19:48:47.332791] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-03. [2025-10-15T19:48:47.472319] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-15T19:48:47.479888] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-05. [2025-10-15T19:48:48.475239] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-15T19:48:48.484068] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-04. [2025-10-15T19:48:48.726742] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-15T19:48:48.736462] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-05. [2025-10-15T19:48:48.800907] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-15T19:48:48.897983] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-15T19:48:48.913952] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-04. [2025-10-15T19:48:49.714027] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-06. [2025-10-15T19:48:49.755793] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-15T19:48:49.927404] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-15T19:48:50.514023] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-05. [2025-10-15T19:48:50.787835] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-15T19:48:50.821827] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-15T19:48:51.313997] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-06. [2025-10-15T19:48:52.114015] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-05. [2025-10-15T19:48:52.433084] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-15T19:48:52.913971] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-07. [2025-10-15T19:48:53.548885] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-05 (3.03 seconds). [2025-10-15T19:48:53.713970] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-06. [2025-10-15T19:48:54.117484] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-10-15T19:48:54.332272] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-15T19:48:54.513996] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-08. [2025-10-15T19:48:55.147417] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-15T19:48:55.313995] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-07. [2025-10-15T19:48:55.871580] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-15T19:48:56.114055] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-06. [2025-10-15T19:48:56.402932] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-15T19:48:56.914055] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-07. [2025-10-15T19:48:57.714060] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-09. [2025-10-15T19:48:57.867224] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-15T19:48:58.417631] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-15T19:48:58.513989] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-07. [2025-10-15T19:48:58.995731] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-15T19:48:59.313998] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-10. [2025-10-15T19:49:00.114015] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-08. [2025-10-15T19:49:00.305431] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-15T19:49:00.680557] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-15T19:49:00.685316] [INFO ] [REMOTE ] KN: Full fetch complete (56587 records). [2025-10-15T19:49:00.685428] [DEBUG] [VALIDATOR ] KN: Validating primary data. [2025-10-15T19:49:00.919097] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-08. [2025-10-15T19:49:01.064385] [DEBUG] [VALIDATOR ] KN: All expected trading days are present. [2025-10-15T19:49:01.064460] [DEBUG] [VALIDATOR ] KN: Primary data validation passed. [2025-10-15T19:49:01.065336] [INFO ] [MAIN ] KN: Fetched primary data is valid. [2025-10-15T19:49:01.065399] [DEBUG] [LOCAL ] KN: Saving primary data. [2025-10-15T19:49:01.066542] [DEBUG] [LOCAL ] KN: Trimmed 56587 records to 38621 (keeping 200 days of data) [2025-10-15T19:49:01.290187] [DEBUG] [LOCAL ] KN: Primary data saved (38621 records). [2025-10-15T19:49:01.290331] [INFO ] [MAIN ] KN: Full history saved. [2025-10-15T19:49:01.290413] [INFO ] [MAIN ] Update Progress: 1201/2369 symbols completed. KN took 22.1s. Estimated remaining: 2h 44m 18s. Rate: 7.1 symbols/min [2025-10-15T19:49:01.474680] [INFO ] [MAIN ] KNOP: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:49:01.486961] [DEBUG] [LOCAL ] KNOP: Loaded 10475 existing records from primary storage. [2025-10-15T19:49:01.487162] [INFO ] [MAIN ] KNOP: Loaded 10475 existing records. [2025-10-15T19:49:01.701444] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-15T19:49:01.707114] [WARN ] [MAIN ] KNOP: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:49:01.719310] [INFO ] [MAIN ] KNOP: Wiping existing primary data before full refresh. [2025-10-15T19:49:01.719552] [INFO ] [LOCAL ] KNOP: Starting deletion of primary data. [2025-10-15T19:49:01.719222] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-08. [2025-10-15T19:49:01.720869] [DEBUG] [LOCAL ] KNOP: Deleted primary data file. [2025-10-15T19:49:01.720947] [INFO ] [MAIN ] KNOP: Starting full primary refresh. [2025-10-15T19:49:02.090249] [INFO ] [REMOTE ] KNOP: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:49:02.513986] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-09. [2025-10-15T19:49:02.807329] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-15T19:49:03.314061] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2024-12. [2025-10-15T19:49:03.442249] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-15T19:49:03.577346] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-15T19:49:03.866409] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2024-12 (0.55 seconds). [2025-10-15T19:49:04.114004] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-01. [2025-10-15T19:49:04.705606] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-15T19:49:04.914059] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-09. [2025-10-15T19:49:05.714051] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-10. [2025-10-15T19:49:06.513994] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-09. [2025-10-15T19:49:06.952877] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-10-15T19:49:07.175898] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-15T19:49:07.183448] [INFO ] [REMOTE ] KNF: Full fetch complete (51286 records). [2025-10-15T19:49:07.183704] [DEBUG] [VALIDATOR ] KNF: Validating primary data. [2025-10-15T19:49:07.319183] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-10. [2025-10-15T19:49:07.581587] [DEBUG] [VALIDATOR ] KNF: All expected trading days are present. [2025-10-15T19:49:07.581702] [DEBUG] [VALIDATOR ] KNF: Primary data validation passed. [2025-10-15T19:49:07.582557] [INFO ] [MAIN ] KNF: Fetched primary data is valid. [2025-10-15T19:49:07.582603] [DEBUG] [LOCAL ] KNF: Saving primary data. [2025-10-15T19:49:07.583811] [DEBUG] [LOCAL ] KNF: Trimmed 51286 records to 36599 (keeping 200 days of data) [2025-10-15T19:49:07.801140] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-15T19:49:07.841854] [DEBUG] [LOCAL ] KNF: Primary data saved (36599 records). [2025-10-15T19:49:07.841988] [INFO ] [MAIN ] KNF: Full history saved. [2025-10-15T19:49:07.842066] [INFO ] [MAIN ] Update Progress: 1202/2369 symbols completed. KNF took 28.6s. Estimated remaining: 2h 44m 8s. Rate: 7.1 symbols/min [2025-10-15T19:49:08.048391] [INFO ] [MAIN ] KNSL: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:49:08.067477] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-15T19:49:08.074303] [INFO ] [REMOTE ] KMX: Full fetch complete (76309 records). [2025-10-15T19:49:08.074483] [DEBUG] [VALIDATOR ] KMX: Validating primary data. [2025-10-15T19:49:08.118672] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-02. [2025-10-15T19:49:08.244006] [DEBUG] [LOCAL ] KNSL: Loaded 18386 existing records from primary storage. [2025-10-15T19:49:08.268180] [INFO ] [MAIN ] KNSL: Loaded 18386 existing records. [2025-10-15T19:49:08.629991] [WARN ] [MAIN ] KNSL: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:49:08.664168] [INFO ] [MAIN ] KNSL: Wiping existing primary data before full refresh. [2025-10-15T19:49:08.667740] [INFO ] [LOCAL ] KNSL: Starting deletion of primary data. [2025-10-15T19:49:08.667872] [DEBUG] [VALIDATOR ] KMX: All expected trading days are present. [2025-10-15T19:49:08.667946] [DEBUG] [VALIDATOR ] KMX: Primary data validation passed. [2025-10-15T19:49:08.669114] [DEBUG] [LOCAL ] KNSL: Deleted primary data file. [2025-10-15T19:49:08.669070] [INFO ] [MAIN ] KMX: Fetched primary data is valid. [2025-10-15T19:49:08.669229] [INFO ] [MAIN ] KNSL: Starting full primary refresh. [2025-10-15T19:49:08.669284] [DEBUG] [LOCAL ] KMX: Saving primary data. [2025-10-15T19:49:08.769991] [DEBUG] [LOCAL ] KMX: Trimmed 76309 records to 53277 (keeping 200 days of data) [2025-10-15T19:49:08.916854] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-10. [2025-10-15T19:49:09.022843] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-15T19:49:09.136237] [INFO ] [REMOTE ] KNSL: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:49:09.349358] [DEBUG] [LOCAL ] KMX: Primary data saved (53277 records). [2025-10-15T19:49:09.349495] [INFO ] [MAIN ] KMX: Full history saved. [2025-10-15T19:49:09.349574] [INFO ] [MAIN ] Update Progress: 1203/2369 symbols completed. KMX took 30.1s. Estimated remaining: 2h 43m 53s. Rate: 7.1 symbols/min [2025-10-15T19:49:09.519227] [INFO ] [MAIN ] KNTK: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:49:09.558987] [DEBUG] [LOCAL ] KNTK: Loaded 46985 existing records from primary storage. [2025-10-15T19:49:09.559278] [INFO ] [MAIN ] KNTK: Loaded 46985 existing records. [2025-10-15T19:49:09.731204] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-03. [2025-10-15T19:49:09.736834] [WARN ] [MAIN ] KNTK: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:49:09.738035] [INFO ] [MAIN ] KNTK: Wiping existing primary data before full refresh. [2025-10-15T19:49:09.738091] [INFO ] [LOCAL ] KNTK: Starting deletion of primary data. [2025-10-15T19:49:09.738504] [DEBUG] [LOCAL ] KNTK: Deleted primary data file. [2025-10-15T19:49:09.738546] [INFO ] [MAIN ] KNTK: Starting full primary refresh. [2025-10-15T19:49:10.094585] [INFO ] [REMOTE ] KNTK: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:49:10.514028] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2024-12. [2025-10-15T19:49:10.592094] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-15T19:49:10.597197] [INFO ] [REMOTE ] KMT: Full fetch complete (61950 records). [2025-10-15T19:49:10.597346] [DEBUG] [VALIDATOR ] KMT: Validating primary data. [2025-10-15T19:49:10.715450] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-15T19:49:11.000978] [DEBUG] [VALIDATOR ] KMT: All expected trading days are present. [2025-10-15T19:49:11.001081] [DEBUG] [VALIDATOR ] KMT: Primary data validation passed. [2025-10-15T19:49:11.002268] [INFO ] [MAIN ] KMT: Fetched primary data is valid. [2025-10-15T19:49:11.002332] [DEBUG] [LOCAL ] KMT: Saving primary data. [2025-10-15T19:49:11.003699] [DEBUG] [LOCAL ] KMT: Trimmed 61950 records to 42946 (keeping 200 days of data) [2025-10-15T19:49:11.262121] [DEBUG] [LOCAL ] KMT: Primary data saved (42946 records). [2025-10-15T19:49:11.262264] [INFO ] [MAIN ] KMT: Full history saved. [2025-10-15T19:49:11.262365] [INFO ] [MAIN ] Update Progress: 1204/2369 symbols completed. KMT took 32.1s. Estimated remaining: 2h 43m 38s. Rate: 7.1 symbols/min [2025-10-15T19:49:11.323669] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2024-12. [2025-10-15T19:49:11.436789] [INFO ] [MAIN ] KNX: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:49:11.486869] [DEBUG] [LOCAL ] KNX: Loaded 52607 existing records from primary storage. [2025-10-15T19:49:11.487199] [INFO ] [MAIN ] KNX: Loaded 52607 existing records. [2025-10-15T19:49:11.634703] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-15T19:49:11.691976] [WARN ] [MAIN ] KNX: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:49:11.692228] [INFO ] [MAIN ] KNX: Wiping existing primary data before full refresh. [2025-10-15T19:49:11.692287] [INFO ] [LOCAL ] KNX: Starting deletion of primary data. [2025-10-15T19:49:11.693261] [DEBUG] [LOCAL ] KNX: Deleted primary data file. [2025-10-15T19:49:11.693318] [INFO ] [MAIN ] KNX: Starting full primary refresh. [2025-10-15T19:49:12.036703] [INFO ] [REMOTE ] KNX: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:49:12.114018] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-01. [2025-10-15T19:49:12.777686] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-15T19:49:12.913969] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-01. [2025-10-15T19:49:13.249113] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-15T19:49:13.713989] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-04. [2025-10-15T19:49:14.284571] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-15T19:49:14.300975] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-15T19:49:14.513991] [INFO ] [REMOTE ] KNX: Fetching primary data for 2024-12. [2025-10-15T19:49:15.313994] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-05. [2025-10-15T19:49:16.113971] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-02. [2025-10-15T19:49:16.213959] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-15T19:49:16.246397] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-15T19:49:16.913975] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-06. [2025-10-15T19:49:17.322461] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-10-15T19:49:17.345056] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-15T19:49:17.713973] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-07. [2025-10-15T19:49:18.513970] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-02. [2025-10-15T19:49:18.592983] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-15T19:49:19.313997] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-08. [2025-10-15T19:49:19.958893] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-15T19:49:20.082002] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-15T19:49:20.114008] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-09. [2025-10-15T19:49:20.768790] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-15T19:49:20.914002] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-10. [2025-10-15T19:49:21.714010] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-03. [2025-10-15T19:49:21.891398] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-15T19:49:21.893560] [INFO ] [REMOTE ] KNOP: Full fetch complete (14716 records). [2025-10-15T19:49:21.893674] [DEBUG] [VALIDATOR ] KNOP: Validating primary data. [2025-10-15T19:49:22.254941] [DEBUG] [VALIDATOR ] KNOP: All expected trading days are present. [2025-10-15T19:49:22.255015] [DEBUG] [VALIDATOR ] KNOP: Primary data validation passed. [2025-10-15T19:49:22.255376] [INFO ] [MAIN ] KNOP: Fetched primary data is valid. [2025-10-15T19:49:22.255418] [DEBUG] [LOCAL ] KNOP: Saving primary data. [2025-10-15T19:49:22.255919] [DEBUG] [LOCAL ] KNOP: Trimmed 14716 records to 10486 (keeping 200 days of data) [2025-10-15T19:49:22.314876] [DEBUG] [LOCAL ] KNOP: Primary data saved (10486 records). [2025-10-15T19:49:22.314989] [INFO ] [MAIN ] KNOP: Full history saved. [2025-10-15T19:49:22.315089] [INFO ] [MAIN ] Update Progress: 1205/2369 symbols completed. KNOP took 21.0s. Estimated remaining: 2h 43m 32s. Rate: 7.1 symbols/min [2025-10-15T19:49:22.481632] [INFO ] [MAIN ] KO: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:49:22.481825] [DEBUG] [LOCAL ] KO: No existing data file found in primary storage. [2025-10-15T19:49:22.481867] [WARN ] [MAIN ] KO: No existing data found, performing full refresh instead. [2025-10-15T19:49:22.481975] [INFO ] [MAIN ] KO: Wiping existing primary data before full refresh. [2025-10-15T19:49:22.482017] [INFO ] [LOCAL ] KO: Starting deletion of primary data. [2025-10-15T19:49:22.482079] [DEBUG] [LOCAL ] KO: No primary data file found to delete. [2025-10-15T19:49:22.482114] [INFO ] [MAIN ] KO: Starting full primary refresh. [2025-10-15T19:49:22.519169] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-03. [2025-10-15T19:49:22.843753] [INFO ] [REMOTE ] KO: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:49:23.314052] [INFO ] [REMOTE ] KO: Fetching primary data for 2024-12. [2025-10-15T19:49:23.587233] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-15T19:49:23.644600] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-15T19:49:24.113990] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-04. [2025-10-15T19:49:24.914011] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-01. [2025-10-15T19:49:25.047012] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-15T19:49:25.713966] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-05. [2025-10-15T19:49:26.016895] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2024-12 (2.70 seconds). [2025-10-15T19:49:26.503883] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-15T19:49:26.519695] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-06. [2025-10-15T19:49:26.540964] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-15T19:49:27.313995] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-04. [2025-10-15T19:49:27.527586] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-15T19:49:28.114057] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-02. [2025-10-15T19:49:28.874678] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-15T19:49:28.913944] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-05. [2025-10-15T19:49:29.713997] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-01. [2025-10-15T19:49:29.759897] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-15T19:49:30.476988] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-15T19:49:30.513955] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-06. [2025-10-15T19:49:31.314010] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-03. [2025-10-15T19:49:31.993229] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-15T19:49:32.113959] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-07. [2025-10-15T19:49:32.507570] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-01 (2.79 seconds). [2025-10-15T19:49:32.914008] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-02. [2025-10-15T19:49:32.980339] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-15T19:49:33.426140] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-15T19:49:33.714028] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-04. [2025-10-15T19:49:34.514004] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-07. [2025-10-15T19:49:34.939427] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-02 (2.03 seconds). [2025-10-15T19:49:35.313971] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-03. [2025-10-15T19:49:35.472469] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-15T19:49:35.619005] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-15T19:49:36.114007] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-08. [2025-10-15T19:49:36.913985] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-05. [2025-10-15T19:49:37.087719] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-15T19:49:37.713977] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-09. [2025-10-15T19:49:37.856310] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-03 (2.54 seconds). [2025-10-15T19:49:38.513995] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-08. [2025-10-15T19:49:38.710566] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-15T19:49:38.749350] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-15T19:49:39.314058] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-06. [2025-10-15T19:49:40.068042] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-15T19:49:40.113951] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-09. [2025-10-15T19:49:40.639141] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-15T19:49:40.913989] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-07. [2025-10-15T19:49:41.300835] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-15T19:49:41.713991] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-10. [2025-10-15T19:49:42.513999] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-10. [2025-10-15T19:49:42.681868] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-15T19:49:42.954456] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-15T19:49:42.960351] [INFO ] [REMOTE ] KNTK: Full fetch complete (65409 records). [2025-10-15T19:49:42.960494] [DEBUG] [VALIDATOR ] KNTK: Validating primary data. [2025-10-15T19:49:43.317807] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-04. [2025-10-15T19:49:43.338320] [DEBUG] [VALIDATOR ] KNTK: All expected trading days are present. [2025-10-15T19:49:43.339398] [DEBUG] [VALIDATOR ] KNTK: Primary data validation passed. [2025-10-15T19:49:43.340478] [INFO ] [MAIN ] KNTK: Fetched primary data is valid. [2025-10-15T19:49:43.340682] [DEBUG] [LOCAL ] KNTK: Saving primary data. [2025-10-15T19:49:43.342015] [DEBUG] [LOCAL ] KNTK: Trimmed 65409 records to 47085 (keeping 200 days of data) [2025-10-15T19:49:43.619130] [DEBUG] [LOCAL ] KNTK: Primary data saved (47085 records). [2025-10-15T19:49:43.619257] [INFO ] [MAIN ] KNTK: Full history saved. [2025-10-15T19:49:43.619715] [INFO ] [MAIN ] Update Progress: 1206/2369 symbols completed. KNTK took 34.3s. Estimated remaining: 2h 43m 36s. Rate: 7.1 symbols/min [2025-10-15T19:49:43.746995] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-15T19:49:43.787801] [INFO ] [REMOTE ] KNSL: Full fetch complete (26959 records). [2025-10-15T19:49:43.811587] [INFO ] [MAIN ] KODK: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:49:43.811730] [DEBUG] [VALIDATOR ] KNSL: Validating primary data. [2025-10-15T19:49:44.106147] [DEBUG] [LOCAL ] KODK: Loaded 43707 existing records from primary storage. [2025-10-15T19:49:44.130213] [INFO ] [MAIN ] KODK: Loaded 43707 existing records. [2025-10-15T19:49:44.119339] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-08. [2025-10-15T19:49:44.426037] [DEBUG] [VALIDATOR ] KNSL: All expected trading days are present. [2025-10-15T19:49:44.438955] [WARN ] [MAIN ] KODK: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:49:44.439259] [INFO ] [MAIN ] KODK: Wiping existing primary data before full refresh. [2025-10-15T19:49:44.439101] [DEBUG] [VALIDATOR ] KNSL: Primary data validation passed. [2025-10-15T19:49:44.439350] [INFO ] [LOCAL ] KODK: Starting deletion of primary data. [2025-10-15T19:49:44.440018] [INFO ] [MAIN ] KNSL: Fetched primary data is valid. [2025-10-15T19:49:44.440063] [DEBUG] [LOCAL ] KODK: Deleted primary data file. [2025-10-15T19:49:44.440163] [INFO ] [MAIN ] KODK: Starting full primary refresh. [2025-10-15T19:49:44.483798] [DEBUG] [LOCAL ] KNSL: Saving primary data. [2025-10-15T19:49:44.546958] [DEBUG] [LOCAL ] KNSL: Trimmed 26959 records to 18426 (keeping 200 days of data) [2025-10-15T19:49:44.906627] [INFO ] [REMOTE ] KODK: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:49:44.913955] [INFO ] [REMOTE ] KODK: Fetching primary data for 2024-12. [2025-10-15T19:49:44.921976] [DEBUG] [LOCAL ] KNSL: Primary data saved (18426 records). [2025-10-15T19:49:44.922090] [INFO ] [MAIN ] KNSL: Full history saved. [2025-10-15T19:49:44.922167] [INFO ] [MAIN ] Update Progress: 1207/2369 symbols completed. KNSL took 37.1s. Estimated remaining: 2h 43m 21s. Rate: 7.1 symbols/min [2025-10-15T19:49:45.089366] [INFO ] [MAIN ] KOF: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:49:45.113822] [DEBUG] [LOCAL ] KOF: Loaded 26602 existing records from primary storage. [2025-10-15T19:49:45.114072] [INFO ] [MAIN ] KOF: Loaded 26602 existing records. [2025-10-15T19:49:45.285042] [WARN ] [MAIN ] KOF: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:49:45.285213] [INFO ] [MAIN ] KOF: Wiping existing primary data before full refresh. [2025-10-15T19:49:45.285267] [INFO ] [LOCAL ] KOF: Starting deletion of primary data. [2025-10-15T19:49:45.285849] [DEBUG] [LOCAL ] KOF: Deleted primary data file. [2025-10-15T19:49:45.285908] [INFO ] [MAIN ] KOF: Starting full primary refresh. [2025-10-15T19:49:45.647490] [INFO ] [REMOTE ] KOF: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:49:45.713954] [INFO ] [REMOTE ] KOF: Fetching primary data for 2024-12. [2025-10-15T19:49:45.937007] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-04 (2.62 seconds). [2025-10-15T19:49:46.283287] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-08 (2.16 seconds). [2025-10-15T19:49:46.514110] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-09. [2025-10-15T19:49:46.640810] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-15T19:49:46.690197] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-10-15T19:49:47.314048] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-01. [2025-10-15T19:49:47.921185] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-15T19:49:48.065273] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-15T19:49:48.114034] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-02. [2025-10-15T19:49:48.914085] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-01. [2025-10-15T19:49:49.282447] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-15T19:49:49.714011] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-05. [2025-10-15T19:49:50.521411] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-03. [2025-10-15T19:49:50.526815] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-15T19:49:51.304599] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-15T19:49:51.313951] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-04. [2025-10-15T19:49:52.113973] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-10. [2025-10-15T19:49:52.376920] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-05 (2.66 seconds). [2025-10-15T19:49:52.584160] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-15T19:49:52.652853] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-15T19:49:52.659368] [INFO ] [REMOTE ] KNX: Full fetch complete (76172 records). [2025-10-15T19:49:52.659532] [DEBUG] [VALIDATOR ] KNX: Validating primary data. [2025-10-15T19:49:52.919187] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-06. [2025-10-15T19:49:53.060007] [DEBUG] [VALIDATOR ] KNX: All expected trading days are present. [2025-10-15T19:49:53.060106] [DEBUG] [VALIDATOR ] KNX: Primary data validation passed. [2025-10-15T19:49:53.061221] [INFO ] [MAIN ] KNX: Fetched primary data is valid. [2025-10-15T19:49:53.061289] [DEBUG] [LOCAL ] KNX: Saving primary data. [2025-10-15T19:49:53.062842] [DEBUG] [LOCAL ] KNX: Trimmed 76172 records to 52615 (keeping 200 days of data) [2025-10-15T19:49:53.384706] [DEBUG] [LOCAL ] KNX: Primary data saved (52615 records). [2025-10-15T19:49:53.384841] [INFO ] [MAIN ] KNX: Full history saved. [2025-10-15T19:49:53.385874] [INFO ] [MAIN ] Update Progress: 1208/2369 symbols completed. KNX took 42.1s. Estimated remaining: 2h 43m 12s. Rate: 7.1 symbols/min [2025-10-15T19:49:53.586570] [INFO ] [MAIN ] KOP: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:49:53.608762] [DEBUG] [LOCAL ] KOP: Loaded 17462 existing records from primary storage. [2025-10-15T19:49:53.609058] [INFO ] [MAIN ] KOP: Loaded 17462 existing records. [2025-10-15T19:49:53.719231] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-02. [2025-10-15T19:49:53.847950] [WARN ] [MAIN ] KOP: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:49:53.848180] [INFO ] [MAIN ] KOP: Wiping existing primary data before full refresh. [2025-10-15T19:49:53.848230] [INFO ] [LOCAL ] KOP: Starting deletion of primary data. [2025-10-15T19:49:53.848826] [DEBUG] [LOCAL ] KOP: Deleted primary data file. [2025-10-15T19:49:53.848884] [INFO ] [MAIN ] KOP: Starting full primary refresh. [2025-10-15T19:49:54.199207] [INFO ] [REMOTE ] KOP: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:49:54.514002] [INFO ] [REMOTE ] KOP: Fetching primary data for 2024-12. [2025-10-15T19:49:55.282149] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-06 (2.36 seconds). [2025-10-15T19:49:55.315463] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-15T19:49:55.314070] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-05. [2025-10-15T19:49:55.340999] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-10-15T19:49:56.113956] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-03. [2025-10-15T19:49:56.580188] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-15T19:49:56.914006] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-01. [2025-10-15T19:49:57.625678] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-15T19:49:57.713952] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-04. [2025-10-15T19:49:57.915603] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-15T19:49:58.513989] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-06. [2025-10-15T19:49:59.314024] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-02. [2025-10-15T19:49:59.347175] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-15T19:49:59.759768] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-15T19:50:00.114048] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-07. [2025-10-15T19:50:00.310536] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-15T19:50:00.914043] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-05. [2025-10-15T19:50:01.714052] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-07. [2025-10-15T19:50:02.347352] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-15T19:50:02.513968] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-03. [2025-10-15T19:50:03.058149] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-07 (2.94 seconds). [2025-10-15T19:50:03.088610] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-15T19:50:03.313974] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-08. [2025-10-15T19:50:03.495073] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-15T19:50:04.114008] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-06. [2025-10-15T19:50:04.913984] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-08. [2025-10-15T19:50:05.587521] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-15T19:50:05.694898] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-08 (2.38 seconds). [2025-10-15T19:50:05.713951] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-07. [2025-10-15T19:50:06.070183] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-15T19:50:06.513995] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-09. [2025-10-15T19:50:07.263325] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-15T19:50:07.313954] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-08. [2025-10-15T19:50:08.113996] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-09. [2025-10-15T19:50:08.913994] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-04. [2025-10-15T19:50:08.948149] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-15T19:50:08.989081] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-09 (2.48 seconds). [2025-10-15T19:50:09.030711] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-15T19:50:09.713990] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-09. [2025-10-15T19:50:09.809523] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-15T19:50:10.514050] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-05. [2025-10-15T19:50:11.314051] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-10. [2025-10-15T19:50:11.345868] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-15T19:50:11.402428] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-15T19:50:12.114014] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-10. [2025-10-15T19:50:12.816806] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-15T19:50:12.820529] [INFO ] [REMOTE ] KOF: Full fetch complete (37952 records). [2025-10-15T19:50:12.820632] [DEBUG] [VALIDATOR ] KOF: Validating primary data. [2025-10-15T19:50:12.919164] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-06. [2025-10-15T19:50:13.197348] [DEBUG] [VALIDATOR ] KOF: All expected trading days are present. [2025-10-15T19:50:13.197447] [DEBUG] [VALIDATOR ] KOF: Primary data validation passed. [2025-10-15T19:50:13.198369] [INFO ] [MAIN ] KOF: Fetched primary data is valid. [2025-10-15T19:50:13.198437] [DEBUG] [LOCAL ] KOF: Saving primary data. [2025-10-15T19:50:13.199502] [DEBUG] [LOCAL ] KOF: Trimmed 37952 records to 26616 (keeping 200 days of data) [2025-10-15T19:50:13.370872] [DEBUG] [LOCAL ] KOF: Primary data saved (26616 records). [2025-10-15T19:50:13.371045] [INFO ] [MAIN ] KOF: Full history saved. [2025-10-15T19:50:13.371137] [INFO ] [MAIN ] Update Progress: 1209/2369 symbols completed. KOF took 28.4s. Estimated remaining: 2h 43m 15s. Rate: 7.1 symbols/min [2025-10-15T19:50:13.542555] [INFO ] [MAIN ] KORE: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:50:13.546375] [DEBUG] [LOCAL ] KORE: Loaded 2171 existing records from primary storage. [2025-10-15T19:50:13.546545] [INFO ] [MAIN ] KORE: Loaded 2171 existing records. [2025-10-15T19:50:13.723433] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-10. [2025-10-15T19:50:13.729681] [WARN ] [MAIN ] KORE: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:50:13.731069] [INFO ] [MAIN ] KORE: Wiping existing primary data before full refresh. [2025-10-15T19:50:13.731245] [INFO ] [LOCAL ] KORE: Starting deletion of primary data. [2025-10-15T19:50:13.731517] [DEBUG] [LOCAL ] KORE: Deleted primary data file. [2025-10-15T19:50:13.731740] [INFO ] [MAIN ] KORE: Starting full primary refresh. [2025-10-15T19:50:13.842477] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-15T19:50:13.881279] [INFO ] [REMOTE ] KODK: Full fetch complete (63471 records). [2025-10-15T19:50:13.909554] [DEBUG] [VALIDATOR ] KODK: Validating primary data. [2025-10-15T19:50:14.156414] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-15T19:50:14.321921] [INFO ] [REMOTE ] KORE: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:50:14.520521] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-07. [2025-10-15T19:50:14.538960] [DEBUG] [VALIDATOR ] KODK: All expected trading days are present. [2025-10-15T19:50:14.539747] [DEBUG] [VALIDATOR ] KODK: Primary data validation passed. [2025-10-15T19:50:14.540888] [INFO ] [MAIN ] KODK: Fetched primary data is valid. [2025-10-15T19:50:14.541097] [DEBUG] [LOCAL ] KODK: Saving primary data. [2025-10-15T19:50:14.542565] [DEBUG] [LOCAL ] KODK: Trimmed 63471 records to 43766 (keeping 200 days of data) [2025-10-15T19:50:14.786101] [DEBUG] [LOCAL ] KODK: Primary data saved (43766 records). [2025-10-15T19:50:14.786235] [INFO ] [MAIN ] KODK: Full history saved. [2025-10-15T19:50:14.786314] [INFO ] [MAIN ] Update Progress: 1210/2369 symbols completed. KODK took 31.2s. Estimated remaining: 2h 42m 60s. Rate: 7.1 symbols/min [2025-10-15T19:50:14.984956] [INFO ] [MAIN ] KOS: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:50:15.033973] [DEBUG] [LOCAL ] KOS: Loaded 53091 existing records from primary storage. [2025-10-15T19:50:15.034290] [INFO ] [MAIN ] KOS: Loaded 53091 existing records. [2025-10-15T19:50:15.208745] [WARN ] [MAIN ] KOS: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:50:15.208951] [INFO ] [MAIN ] KOS: Wiping existing primary data before full refresh. [2025-10-15T19:50:15.208999] [INFO ] [LOCAL ] KOS: Starting deletion of primary data. [2025-10-15T19:50:15.209813] [DEBUG] [LOCAL ] KOS: Deleted primary data file. [2025-10-15T19:50:15.209871] [INFO ] [MAIN ] KOS: Starting full primary refresh. [2025-10-15T19:50:15.316069] [INFO ] [REMOTE ] KORE: Fetching primary data for 2024-12. [2025-10-15T19:50:15.584050] [INFO ] [REMOTE ] KOS: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:50:15.585600] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-15T19:50:16.114013] [INFO ] [REMOTE ] KOS: Fetching primary data for 2024-12. [2025-10-15T19:50:16.177539] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-10-15T19:50:16.424465] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-10 (2.70 seconds). [2025-10-15T19:50:16.430922] [INFO ] [REMOTE ] KO: Full fetch complete (76828 records). [2025-10-15T19:50:16.431075] [DEBUG] [VALIDATOR ] KO: Validating primary data. [2025-10-15T19:50:16.431823] [FATAL] [VALIDATOR ] KO: Data is stale - most recent date (2025-10-14) is before last completed trading day (2025-10-15). Symbol may be delisted or halted. [2025-10-15T19:50:16.431916] [FATAL] [MAIN ] KO: Fetched primary data is invalid. Refusing to save it. [2025-10-15T19:50:16.431959] [WARN ] [MAIN ] KO: Deleting existing primary and derivative data due to validation failure. [2025-10-15T19:50:16.432016] [INFO ] [LOCAL ] KO: Starting deletion of primary data. [2025-10-15T19:50:16.432072] [DEBUG] [LOCAL ] KO: No primary data file found to delete. [2025-10-15T19:50:16.432106] [INFO ] [LOCAL ] KO: Starting deletion of derivative data. [2025-10-15T19:50:16.432152] [DEBUG] [LOCAL ] KO: No derivative data file found to delete. [2025-10-15T19:50:16.432235] [INFO ] [MAIN ] Update Progress: 1211/2369 symbols completed. KO took 54.1s. Estimated remaining: 2h 42m 45s. Rate: 7.1 symbols/min [2025-10-15T19:50:16.628808] [INFO ] [MAIN ] KR: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:50:16.680340] [DEBUG] [LOCAL ] KR: Loaded 53681 existing records from primary storage. [2025-10-15T19:50:16.680680] [INFO ] [MAIN ] KR: Loaded 53681 existing records. [2025-10-15T19:50:16.858702] [WARN ] [MAIN ] KR: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:50:16.858950] [INFO ] [MAIN ] KR: Wiping existing primary data before full refresh. [2025-10-15T19:50:16.859008] [INFO ] [LOCAL ] KR: Starting deletion of primary data. [2025-10-15T19:50:16.859981] [DEBUG] [LOCAL ] KR: Deleted primary data file. [2025-10-15T19:50:16.860039] [INFO ] [MAIN ] KR: Starting full primary refresh. [2025-10-15T19:50:16.921930] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-01. [2025-10-15T19:50:17.219427] [INFO ] [REMOTE ] KR: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:50:17.679506] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-15T19:50:17.717850] [INFO ] [REMOTE ] KR: Fetching primary data for 2024-12. [2025-10-15T19:50:17.725867] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-15T19:50:18.514001] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-01. [2025-10-15T19:50:19.314016] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-02. [2025-10-15T19:50:19.570794] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-15T19:50:19.648516] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-10-15T19:50:20.113999] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-03. [2025-10-15T19:50:20.207707] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-15T19:50:20.390176] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-03 (0.28 seconds). [2025-10-15T19:50:20.913996] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-08. [2025-10-15T19:50:21.713985] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-04. [2025-10-15T19:50:21.958732] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-15T19:50:22.065460] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-04 (0.35 seconds). [2025-10-15T19:50:22.514008] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-09. [2025-10-15T19:50:23.313984] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-05. [2025-10-15T19:50:23.469087] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-15T19:50:23.839328] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-10-15T19:50:24.113998] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-06. [2025-10-15T19:50:24.613342] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-10-15T19:50:24.913995] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-10. [2025-10-15T19:50:25.714037] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-07. [2025-10-15T19:50:25.959099] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-15T19:50:25.961625] [INFO ] [REMOTE ] KOP: Full fetch complete (25435 records). [2025-10-15T19:50:25.961750] [DEBUG] [VALIDATOR ] KOP: Validating primary data. [2025-10-15T19:50:26.273100] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-15T19:50:26.362829] [DEBUG] [VALIDATOR ] KOP: All expected trading days are present. [2025-10-15T19:50:26.362928] [DEBUG] [VALIDATOR ] KOP: Primary data validation passed. [2025-10-15T19:50:26.363518] [INFO ] [MAIN ] KOP: Fetched primary data is valid. [2025-10-15T19:50:26.363596] [DEBUG] [LOCAL ] KOP: Saving primary data. [2025-10-15T19:50:26.364404] [DEBUG] [LOCAL ] KOP: Trimmed 25435 records to 17433 (keeping 200 days of data) [2025-10-15T19:50:26.475454] [DEBUG] [LOCAL ] KOP: Primary data saved (17433 records). [2025-10-15T19:50:26.475605] [INFO ] [MAIN ] KOP: Full history saved. [2025-10-15T19:50:26.475730] [INFO ] [MAIN ] Update Progress: 1212/2369 symbols completed. KOP took 33.1s. Estimated remaining: 2h 42m 38s. Rate: 7.1 symbols/min [2025-10-15T19:50:26.519199] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-02. [2025-10-15T19:50:26.650055] [INFO ] [MAIN ] KRC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:50:26.695843] [DEBUG] [LOCAL ] KRC: Loaded 48299 existing records from primary storage. [2025-10-15T19:50:26.696179] [INFO ] [MAIN ] KRC: Loaded 48299 existing records. [2025-10-15T19:50:26.869755] [WARN ] [MAIN ] KRC: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:50:26.869990] [INFO ] [MAIN ] KRC: Wiping existing primary data before full refresh. [2025-10-15T19:50:26.870038] [INFO ] [LOCAL ] KRC: Starting deletion of primary data. [2025-10-15T19:50:26.870944] [DEBUG] [LOCAL ] KRC: Deleted primary data file. [2025-10-15T19:50:26.871002] [INFO ] [MAIN ] KRC: Starting full primary refresh. [2025-10-15T19:50:27.234895] [INFO ] [REMOTE ] KRC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:50:27.313992] [INFO ] [REMOTE ] KRC: Fetching primary data for 2024-12. [2025-10-15T19:50:27.419241] [DEBUG] [REMOTE ] KRC: Error fetching primary data for 2024-12: 'API call returned an empty response.' [2025-10-15T19:50:27.419703] [WARN ] [REMOTE ] KRC: No data returned for month 2024-12 [2025-10-15T19:50:27.419806] [FATAL] [REMOTE ] KRC: API call failed - aborting fetch to avoid wasting further API calls [2025-10-15T19:50:27.419857] [FATAL] [MAIN ] KRC: Failed to fetch primary data. [2025-10-15T19:50:27.419920] [WARN ] [MAIN ] KRC: Deleting existing primary and derivative data due to fetch failure. [2025-10-15T19:50:27.419996] [INFO ] [LOCAL ] KRC: Starting deletion of primary data. [2025-10-15T19:50:27.420066] [DEBUG] [LOCAL ] KRC: No primary data file found to delete. [2025-10-15T19:50:27.420104] [INFO ] [LOCAL ] KRC: Starting deletion of derivative data. [2025-10-15T19:50:27.420541] [DEBUG] [LOCAL ] KRC: Deleted derivative data file. [2025-10-15T19:50:27.421747] [INFO ] [MAIN ] Update Progress: 1213/2369 symbols completed. KRC took 0.9s. Estimated remaining: 2h 42m 23s. Rate: 7.1 symbols/min [2025-10-15T19:50:27.587462] [INFO ] [MAIN ] KREF: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:50:27.626487] [DEBUG] [LOCAL ] KREF: Loaded 38003 existing records from primary storage. [2025-10-15T19:50:27.626848] [INFO ] [MAIN ] KREF: Loaded 38003 existing records. [2025-10-15T19:50:27.807849] [WARN ] [MAIN ] KREF: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:50:27.808084] [INFO ] [MAIN ] KREF: Wiping existing primary data before full refresh. [2025-10-15T19:50:27.808134] [INFO ] [LOCAL ] KREF: Starting deletion of primary data. [2025-10-15T19:50:27.808895] [DEBUG] [LOCAL ] KREF: Deleted primary data file. [2025-10-15T19:50:27.808955] [INFO ] [MAIN ] KREF: Starting full primary refresh. [2025-10-15T19:50:28.115433] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-08. [2025-10-15T19:50:28.217082] [INFO ] [REMOTE ] KREF: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:50:28.257157] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-15T19:50:28.569055] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-15T19:50:28.913994] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-03. [2025-10-15T19:50:29.714027] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-01. [2025-10-15T19:50:30.514017] [INFO ] [REMOTE ] KREF: Fetching primary data for 2024-12. [2025-10-15T19:50:30.657558] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-15T19:50:31.313962] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-09. [2025-10-15T19:50:31.511333] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-15T19:50:31.605309] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-09 (0.29 seconds). [2025-10-15T19:50:31.919791] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-15T19:50:32.113979] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-10. [2025-10-15T19:50:32.795837] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-15T19:50:32.797077] [INFO ] [REMOTE ] KORE: Full fetch complete (5305 records). [2025-10-15T19:50:32.797149] [DEBUG] [VALIDATOR ] KORE: Validating primary data. [2025-10-15T19:50:32.919126] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-01. [2025-10-15T19:50:33.160076] [DEBUG] [VALIDATOR ] KORE: All expected trading days are present. [2025-10-15T19:50:33.160150] [DEBUG] [VALIDATOR ] KORE: Primary data validation passed. [2025-10-15T19:50:33.160293] [INFO ] [MAIN ] KORE: Fetched primary data is valid. [2025-10-15T19:50:33.160330] [DEBUG] [LOCAL ] KORE: Saving primary data. [2025-10-15T19:50:33.160697] [DEBUG] [LOCAL ] KORE: Trimmed 5305 records to 2164 (keeping 200 days of data) [2025-10-15T19:50:33.172744] [DEBUG] [LOCAL ] KORE: Primary data saved (2164 records). [2025-10-15T19:50:33.172807] [INFO ] [MAIN ] KORE: Full history saved. [2025-10-15T19:50:33.172872] [INFO ] [MAIN ] Update Progress: 1214/2369 symbols completed. KORE took 19.8s. Estimated remaining: 2h 42m 12s. Rate: 7.1 symbols/min [2025-10-15T19:50:33.336055] [INFO ] [MAIN ] KRG: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:50:33.379812] [DEBUG] [LOCAL ] KRG: Loaded 49267 existing records from primary storage. [2025-10-15T19:50:33.380186] [INFO ] [MAIN ] KRG: Loaded 49267 existing records. [2025-10-15T19:50:33.551055] [WARN ] [MAIN ] KRG: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:50:33.551274] [INFO ] [MAIN ] KRG: Wiping existing primary data before full refresh. [2025-10-15T19:50:33.551334] [INFO ] [LOCAL ] KRG: Starting deletion of primary data. [2025-10-15T19:50:33.552270] [DEBUG] [LOCAL ] KRG: Deleted primary data file. [2025-10-15T19:50:33.552327] [INFO ] [MAIN ] KRG: Starting full primary refresh. [2025-10-15T19:50:33.719731] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-04. [2025-10-15T19:50:33.898205] [INFO ] [REMOTE ] KRG: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:50:34.293112] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-15T19:50:34.514005] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-02. [2025-10-15T19:50:35.313987] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-02. [2025-10-15T19:50:35.468732] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-15T19:50:36.114010] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-05. [2025-10-15T19:50:36.181996] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-15T19:50:36.211585] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-15T19:50:36.914015] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-03. [2025-10-15T19:50:37.716321] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-03. [2025-10-15T19:50:37.719606] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-15T19:50:38.514076] [INFO ] [REMOTE ] KRG: Fetching primary data for 2024-12. [2025-10-15T19:50:38.775990] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-15T19:50:38.815880] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-15T19:50:39.314013] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-04. [2025-10-15T19:50:39.678058] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-15T19:50:40.114009] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-04. [2025-10-15T19:50:40.816429] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-15T19:50:40.913994] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-06. [2025-10-15T19:50:41.636422] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-15T19:50:41.713952] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-05. [2025-10-15T19:50:42.513991] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-01. [2025-10-15T19:50:42.724431] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-15T19:50:43.183199] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-15T19:50:43.314025] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-05. [2025-10-15T19:50:44.114041] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-07. [2025-10-15T19:50:44.175523] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-15T19:50:44.919134] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-06. [2025-10-15T19:50:44.939035] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-15T19:50:45.714030] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-02. [2025-10-15T19:50:45.949094] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-15T19:50:46.514056] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-08. [2025-10-15T19:50:46.565705] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-15T19:50:47.260118] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-15T19:50:47.313952] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-03. [2025-10-15T19:50:48.114003] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-06. [2025-10-15T19:50:48.824189] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-08 (2.31 seconds). [2025-10-15T19:50:48.913974] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-09. [2025-10-15T19:50:49.034306] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-15T19:50:49.490405] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-15T19:50:49.713987] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-07. [2025-10-15T19:50:50.514008] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-04. [2025-10-15T19:50:50.639835] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-15T19:50:51.215692] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-15T19:50:51.313979] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-10. [2025-10-15T19:50:51.793448] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-15T19:50:52.114049] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-07. [2025-10-15T19:50:52.850168] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-15T19:50:52.856406] [INFO ] [REMOTE ] KOS: Full fetch complete (77036 records). [2025-10-15T19:50:52.856520] [DEBUG] [VALIDATOR ] KOS: Validating primary data. [2025-10-15T19:50:52.922178] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-08. [2025-10-15T19:50:53.263209] [DEBUG] [VALIDATOR ] KOS: All expected trading days are present. [2025-10-15T19:50:53.263296] [DEBUG] [VALIDATOR ] KOS: Primary data validation passed. [2025-10-15T19:50:53.264515] [INFO ] [MAIN ] KOS: Fetched primary data is valid. [2025-10-15T19:50:53.264580] [DEBUG] [LOCAL ] KOS: Saving primary data. [2025-10-15T19:50:53.266025] [DEBUG] [LOCAL ] KOS: Trimmed 77036 records to 53097 (keeping 200 days of data) [2025-10-15T19:50:53.562263] [DEBUG] [LOCAL ] KOS: Primary data saved (53097 records). [2025-10-15T19:50:53.562434] [INFO ] [MAIN ] KOS: Full history saved. [2025-10-15T19:50:53.563186] [INFO ] [MAIN ] Update Progress: 1215/2369 symbols completed. KOS took 38.8s. Estimated remaining: 2h 42m 14s. Rate: 7.1 symbols/min [2025-10-15T19:50:53.714736] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-05. [2025-10-15T19:50:53.740501] [INFO ] [MAIN ] KRMN: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:50:53.741623] [DEBUG] [LOCAL ] KRMN: No existing data file found in primary storage. [2025-10-15T19:50:53.741713] [WARN ] [MAIN ] KRMN: No existing data found, performing full refresh instead. [2025-10-15T19:50:53.741969] [INFO ] [MAIN ] KRMN: Wiping existing primary data before full refresh. [2025-10-15T19:50:53.742270] [INFO ] [LOCAL ] KRMN: Starting deletion of primary data. [2025-10-15T19:50:53.742360] [DEBUG] [LOCAL ] KRMN: No primary data file found to delete. [2025-10-15T19:50:53.758191] [INFO ] [MAIN ] KRMN: Starting full primary refresh. [2025-10-15T19:50:53.849987] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-15T19:50:54.159871] [INFO ] [REMOTE ] KRMN: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:50:54.514010] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-08. [2025-10-15T19:50:54.696116] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-15T19:50:55.314052] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-09. [2025-10-15T19:50:55.474183] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-15T19:50:55.503374] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-15T19:50:56.114080] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-09. [2025-10-15T19:50:56.914099] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-06. [2025-10-15T19:50:57.330924] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-10-15T19:50:57.607115] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-15T19:50:57.714110] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-10. [2025-10-15T19:50:58.353548] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-15T19:50:58.522225] [INFO ] [REMOTE ] KRMN: Fetching primary data for 2024-12. [2025-10-15T19:50:58.527270] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-15T19:50:58.534168] [INFO ] [REMOTE ] KR: Full fetch complete (77841 records). [2025-10-15T19:50:58.534361] [DEBUG] [VALIDATOR ] KR: Validating primary data. [2025-10-15T19:50:58.799825] [DEBUG] [REMOTE ] KRMN: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-15T19:50:58.832960] [WARN ] [REMOTE ] KRMN: No data returned for month 2024-12 [2025-10-15T19:50:58.833492] [FATAL] [REMOTE ] KRMN: API call failed - aborting fetch to avoid wasting further API calls [2025-10-15T19:50:58.844211] [FATAL] [MAIN ] KRMN: Failed to fetch primary data. [2025-10-15T19:50:58.854588] [WARN ] [MAIN ] KRMN: Deleting existing primary and derivative data due to fetch failure. [2025-10-15T19:50:58.883288] [INFO ] [LOCAL ] KRMN: Starting deletion of primary data. [2025-10-15T19:50:58.940373] [DEBUG] [LOCAL ] KRMN: No primary data file found to delete. [2025-10-15T19:50:58.940774] [DEBUG] [VALIDATOR ] KR: All expected trading days are present. [2025-10-15T19:50:58.940903] [INFO ] [LOCAL ] KRMN: Starting deletion of derivative data. [2025-10-15T19:50:58.940971] [DEBUG] [VALIDATOR ] KR: Primary data validation passed. [2025-10-15T19:50:58.942400] [INFO ] [MAIN ] KR: Fetched primary data is valid. [2025-10-15T19:50:58.941130] [DEBUG] [LOCAL ] KRMN: No derivative data file found to delete. [2025-10-15T19:50:58.942550] [DEBUG] [LOCAL ] KR: Saving primary data. [2025-10-15T19:50:58.942892] [INFO ] [MAIN ] Update Progress: 1216/2369 symbols completed. KRMN took 5.4s. Estimated remaining: 2h 42m 3s. Rate: 7.1 symbols/min [2025-10-15T19:50:59.052003] [DEBUG] [LOCAL ] KR: Trimmed 77841 records to 53680 (keeping 200 days of data) [2025-10-15T19:50:59.186876] [INFO ] [MAIN ] KRO: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:50:59.265342] [DEBUG] [LOCAL ] KRO: Loaded 26420 existing records from primary storage. [2025-10-15T19:50:59.269057] [INFO ] [MAIN ] KRO: Loaded 26420 existing records. [2025-10-15T19:50:59.357602] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-07. [2025-10-15T19:50:59.563986] [WARN ] [MAIN ] KRO: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:50:59.565002] [INFO ] [MAIN ] KRO: Wiping existing primary data before full refresh. [2025-10-15T19:50:59.565412] [INFO ] [LOCAL ] KRO: Starting deletion of primary data. [2025-10-15T19:50:59.569043] [DEBUG] [LOCAL ] KRO: Deleted primary data file. [2025-10-15T19:50:59.569964] [INFO ] [MAIN ] KRO: Starting full primary refresh. [2025-10-15T19:51:00.005617] [INFO ] [REMOTE ] KRO: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:51:00.114378] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-10. [2025-10-15T19:51:00.118457] [DEBUG] [LOCAL ] KR: Primary data saved (53680 records). [2025-10-15T19:51:00.118636] [INFO ] [MAIN ] KR: Full history saved. [2025-10-15T19:51:00.118792] [INFO ] [MAIN ] Update Progress: 1217/2369 symbols completed. KR took 43.7s. Estimated remaining: 2h 41m 48s. Rate: 7.1 symbols/min [2025-10-15T19:51:00.292961] [INFO ] [MAIN ] KRP: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:51:00.326503] [DEBUG] [LOCAL ] KRP: Loaded 36430 existing records from primary storage. [2025-10-15T19:51:00.326801] [INFO ] [MAIN ] KRP: Loaded 36430 existing records. [2025-10-15T19:51:00.503622] [WARN ] [MAIN ] KRP: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:51:00.503899] [INFO ] [MAIN ] KRP: Wiping existing primary data before full refresh. [2025-10-15T19:51:00.503979] [INFO ] [LOCAL ] KRP: Starting deletion of primary data. [2025-10-15T19:51:00.504870] [DEBUG] [LOCAL ] KRP: Deleted primary data file. [2025-10-15T19:51:00.504932] [INFO ] [MAIN ] KRP: Starting full primary refresh. [2025-10-15T19:51:00.858215] [INFO ] [REMOTE ] KRP: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:51:00.913976] [INFO ] [REMOTE ] KRO: Fetching primary data for 2024-12. [2025-10-15T19:51:01.031132] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-15T19:51:01.714047] [INFO ] [REMOTE ] KRP: Fetching primary data for 2024-12. [2025-10-15T19:51:01.754482] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-15T19:51:01.759789] [INFO ] [REMOTE ] KREF: Full fetch complete (52810 records). [2025-10-15T19:51:01.759953] [DEBUG] [VALIDATOR ] KREF: Validating primary data. [2025-10-15T19:51:02.187931] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-15T19:51:02.186870] [DEBUG] [VALIDATOR ] KREF: All expected trading days are present. [2025-10-15T19:51:02.188103] [DEBUG] [VALIDATOR ] KREF: Primary data validation passed. [2025-10-15T19:51:02.189147] [INFO ] [MAIN ] KREF: Fetched primary data is valid. [2025-10-15T19:51:02.194817] [DEBUG] [LOCAL ] KREF: Saving primary data. [2025-10-15T19:51:02.196279] [DEBUG] [LOCAL ] KREF: Trimmed 52810 records to 37941 (keeping 200 days of data) [2025-10-15T19:51:02.436791] [DEBUG] [LOCAL ] KREF: Primary data saved (37941 records). [2025-10-15T19:51:02.436962] [INFO ] [MAIN ] KREF: Full history saved. [2025-10-15T19:51:02.437050] [INFO ] [MAIN ] Update Progress: 1218/2369 symbols completed. KREF took 35.0s. Estimated remaining: 2h 41m 34s. Rate: 7.1 symbols/min [2025-10-15T19:51:02.519180] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-01. [2025-10-15T19:51:02.611491] [INFO ] [MAIN ] KSS: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:51:02.662276] [DEBUG] [LOCAL ] KSS: Loaded 53595 existing records from primary storage. [2025-10-15T19:51:02.662584] [INFO ] [MAIN ] KSS: Loaded 53595 existing records. [2025-10-15T19:51:02.838922] [WARN ] [MAIN ] KSS: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:51:02.839132] [INFO ] [MAIN ] KSS: Wiping existing primary data before full refresh. [2025-10-15T19:51:02.839179] [INFO ] [LOCAL ] KSS: Starting deletion of primary data. [2025-10-15T19:51:02.840228] [DEBUG] [LOCAL ] KSS: Deleted primary data file. [2025-10-15T19:51:02.840286] [INFO ] [MAIN ] KSS: Starting full primary refresh. [2025-10-15T19:51:03.211811] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-15T19:51:03.249006] [INFO ] [REMOTE ] KSS: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:51:03.313987] [INFO ] [REMOTE ] KSS: Fetching primary data for 2024-12. [2025-10-15T19:51:03.581120] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-15T19:51:04.114007] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-02. [2025-10-15T19:51:04.791937] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-15T19:51:04.913980] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-01. [2025-10-15T19:51:05.314872] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2024-12 (2.00 seconds). [2025-10-15T19:51:05.714005] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-03. [2025-10-15T19:51:06.362444] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-15T19:51:06.514003] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-08. [2025-10-15T19:51:06.785742] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-15T19:51:07.313995] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-04. [2025-10-15T19:51:08.114017] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-02. [2025-10-15T19:51:08.173260] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-15T19:51:08.393214] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-15T19:51:08.914041] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-05. [2025-10-15T19:51:09.224748] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-15T19:51:09.713984] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-09. [2025-10-15T19:51:09.913082] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-15T19:51:10.514003] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-03. [2025-10-15T19:51:10.979351] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-15T19:51:11.313977] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-01. [2025-10-15T19:51:12.114052] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-06. [2025-10-15T19:51:12.149874] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-15T19:51:12.913963] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-04. [2025-10-15T19:51:13.014770] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-15T19:51:13.199137] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-15T19:51:13.714020] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-07. [2025-10-15T19:51:14.115981] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-15T19:51:14.513966] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-02. [2025-10-15T19:51:14.896991] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-15T19:51:15.313988] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-08. [2025-10-15T19:51:16.113974] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-05. [2025-10-15T19:51:16.585014] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-02 (2.07 seconds). [2025-10-15T19:51:16.596278] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-15T19:51:16.914012] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-10. [2025-10-15T19:51:17.316449] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-15T19:51:17.714048] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-06. [2025-10-15T19:51:18.514032] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-03. [2025-10-15T19:51:18.740408] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-15T19:51:18.746381] [INFO ] [REMOTE ] KRG: Full fetch complete (71296 records). [2025-10-15T19:51:18.746491] [DEBUG] [VALIDATOR ] KRG: Validating primary data. [2025-10-15T19:51:19.155832] [DEBUG] [VALIDATOR ] KRG: All expected trading days are present. [2025-10-15T19:51:19.155953] [DEBUG] [VALIDATOR ] KRG: Primary data validation passed. [2025-10-15T19:51:19.157201] [INFO ] [MAIN ] KRG: Fetched primary data is valid. [2025-10-15T19:51:19.157364] [DEBUG] [LOCAL ] KRG: Saving primary data. [2025-10-15T19:51:19.179247] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-15T19:51:19.179456] [DEBUG] [LOCAL ] KRG: Trimmed 71296 records to 49285 (keeping 200 days of data) [2025-10-15T19:51:19.361020] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-07. [2025-10-15T19:51:19.488563] [DEBUG] [LOCAL ] KRG: Primary data saved (49285 records). [2025-10-15T19:51:19.488731] [INFO ] [MAIN ] KRG: Full history saved. [2025-10-15T19:51:19.488823] [INFO ] [MAIN ] Update Progress: 1219/2369 symbols completed. KRG took 46.3s. Estimated remaining: 2h 41m 33s. Rate: 7.1 symbols/min [2025-10-15T19:51:19.664026] [INFO ] [MAIN ] KT: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:51:19.706595] [DEBUG] [LOCAL ] KT: Loaded 45503 existing records from primary storage. [2025-10-15T19:51:19.706960] [INFO ] [MAIN ] KT: Loaded 45503 existing records. [2025-10-15T19:51:19.898815] [WARN ] [MAIN ] KT: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:51:19.899135] [INFO ] [MAIN ] KT: Wiping existing primary data before full refresh. [2025-10-15T19:51:19.899333] [INFO ] [LOCAL ] KT: Starting deletion of primary data. [2025-10-15T19:51:19.900613] [DEBUG] [LOCAL ] KT: Deleted primary data file. [2025-10-15T19:51:19.900735] [INFO ] [MAIN ] KT: Starting full primary refresh. [2025-10-15T19:51:20.125546] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-09. [2025-10-15T19:51:20.315132] [INFO ] [REMOTE ] KT: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:51:20.581057] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-10-15T19:51:20.679226] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-15T19:51:20.913968] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-04. [2025-10-15T19:51:21.377636] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-15T19:51:21.714014] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-10. [2025-10-15T19:51:22.513971] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-08. [2025-10-15T19:51:22.822044] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-15T19:51:22.825340] [INFO ] [REMOTE ] KRO: Full fetch complete (35207 records). [2025-10-15T19:51:22.825423] [DEBUG] [VALIDATOR ] KRO: Validating primary data. [2025-10-15T19:51:23.252684] [DEBUG] [VALIDATOR ] KRO: All expected trading days are present. [2025-10-15T19:51:23.252515] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-04 (2.34 seconds). [2025-10-15T19:51:23.252891] [DEBUG] [VALIDATOR ] KRO: Primary data validation passed. [2025-10-15T19:51:23.264595] [INFO ] [MAIN ] KRO: Fetched primary data is valid. [2025-10-15T19:51:23.264709] [DEBUG] [LOCAL ] KRO: Saving primary data. [2025-10-15T19:51:23.266090] [DEBUG] [LOCAL ] KRO: Trimmed 35207 records to 26413 (keeping 200 days of data) [2025-10-15T19:51:23.322052] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-05. [2025-10-15T19:51:23.422999] [DEBUG] [LOCAL ] KRO: Primary data saved (26413 records). [2025-10-15T19:51:23.423142] [INFO ] [MAIN ] KRO: Full history saved. [2025-10-15T19:51:23.423226] [INFO ] [MAIN ] Update Progress: 1220/2369 symbols completed. KRO took 24.5s. Estimated remaining: 2h 41m 21s. Rate: 7.1 symbols/min [2025-10-15T19:51:23.597042] [INFO ] [MAIN ] KTB: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:51:23.626388] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-15T19:51:23.670576] [DEBUG] [LOCAL ] KTB: Loaded 40489 existing records from primary storage. [2025-10-15T19:51:23.670892] [INFO ] [MAIN ] KTB: Loaded 40489 existing records. [2025-10-15T19:51:23.866842] [WARN ] [MAIN ] KTB: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:51:23.867053] [INFO ] [MAIN ] KTB: Wiping existing primary data before full refresh. [2025-10-15T19:51:23.867101] [INFO ] [LOCAL ] KTB: Starting deletion of primary data. [2025-10-15T19:51:23.867869] [DEBUG] [LOCAL ] KTB: Deleted primary data file. [2025-10-15T19:51:23.867927] [INFO ] [MAIN ] KTB: Starting full primary refresh. [2025-10-15T19:51:24.119168] [INFO ] [REMOTE ] KT: Fetching primary data for 2024-12. [2025-10-15T19:51:24.238172] [INFO ] [REMOTE ] KTB: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:51:24.913984] [INFO ] [REMOTE ] KTB: Fetching primary data for 2024-12. [2025-10-15T19:51:25.411783] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-10-15T19:51:25.719482] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-09. [2025-10-15T19:51:25.738661] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-15T19:51:25.829491] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-10-15T19:51:26.513981] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-06. [2025-10-15T19:51:26.755553] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-15T19:51:27.314009] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-01. [2025-10-15T19:51:28.114016] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-10. [2025-10-15T19:51:28.264807] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-15T19:51:28.752528] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-15T19:51:28.913990] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-02. [2025-10-15T19:51:29.103935] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-15T19:51:29.108497] [INFO ] [REMOTE ] KRP: Full fetch complete (54993 records). [2025-10-15T19:51:29.108622] [DEBUG] [VALIDATOR ] KRP: Validating primary data. [2025-10-15T19:51:29.541984] [DEBUG] [VALIDATOR ] KRP: All expected trading days are present. [2025-10-15T19:51:29.542067] [DEBUG] [VALIDATOR ] KRP: Primary data validation passed. [2025-10-15T19:51:29.543241] [INFO ] [MAIN ] KRP: Fetched primary data is valid. [2025-10-15T19:51:29.543310] [DEBUG] [LOCAL ] KRP: Saving primary data. [2025-10-15T19:51:29.544666] [DEBUG] [LOCAL ] KRP: Trimmed 54993 records to 36348 (keeping 200 days of data) [2025-10-15T19:51:29.725184] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-07. [2025-10-15T19:51:29.789098] [DEBUG] [LOCAL ] KRP: Primary data saved (36348 records). [2025-10-15T19:51:29.789252] [INFO ] [MAIN ] KRP: Full history saved. [2025-10-15T19:51:29.790139] [INFO ] [MAIN ] Update Progress: 1221/2369 symbols completed. KRP took 29.7s. Estimated remaining: 2h 41m 10s. Rate: 7.1 symbols/min [2025-10-15T19:51:29.979340] [INFO ] [MAIN ] KTF: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:51:29.992762] [DEBUG] [LOCAL ] KTF: Loaded 11831 existing records from primary storage. [2025-10-15T19:51:29.992996] [INFO ] [MAIN ] KTF: Loaded 11831 existing records. [2025-10-15T19:51:30.167617] [WARN ] [MAIN ] KTF: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:51:30.167898] [INFO ] [MAIN ] KTF: Wiping existing primary data before full refresh. [2025-10-15T19:51:30.167949] [INFO ] [LOCAL ] KTF: Starting deletion of primary data. [2025-10-15T19:51:30.168241] [DEBUG] [LOCAL ] KTF: Deleted primary data file. [2025-10-15T19:51:30.168422] [INFO ] [MAIN ] KTF: Starting full primary refresh. [2025-10-15T19:51:30.534515] [INFO ] [REMOTE ] KTF: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:51:30.528857] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-01. [2025-10-15T19:51:30.557060] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-15T19:51:31.314015] [INFO ] [REMOTE ] KTF: Fetching primary data for 2024-12. [2025-10-15T19:51:31.926417] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-07 (2.20 seconds). [2025-10-15T19:51:31.953486] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-10-15T19:51:32.099338] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-15T19:51:32.113960] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-02. [2025-10-15T19:51:32.914082] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-03. [2025-10-15T19:51:33.468149] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-15T19:51:33.714006] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-03. [2025-10-15T19:51:34.499829] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-15T19:51:34.513946] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-04. [2025-10-15T19:51:35.263179] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-15T19:51:35.313972] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-04. [2025-10-15T19:51:35.890967] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-15T19:51:36.114066] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-05. [2025-10-15T19:51:36.913986] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-08. [2025-10-15T19:51:36.956174] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-15T19:51:37.591482] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-15T19:51:37.714011] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-05. [2025-10-15T19:51:38.514024] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-01. [2025-10-15T19:51:38.886984] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-10-15T19:51:39.115457] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-15T19:51:39.219583] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-15T19:51:39.314018] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-06. [2025-10-15T19:51:40.114053] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-06. [2025-10-15T19:51:40.510115] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-15T19:51:40.914033] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-07. [2025-10-15T19:51:41.589761] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-15T19:51:41.713976] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-09. [2025-10-15T19:51:42.463601] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-15T19:51:42.513949] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-08. [2025-10-15T19:51:43.314019] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-07. [2025-10-15T19:51:43.692690] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-15T19:51:43.733218] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-15T19:51:44.114038] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-09. [2025-10-15T19:51:44.914043] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-10. [2025-10-15T19:51:44.949509] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-15T19:51:45.714328] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-02. [2025-10-15T19:51:45.714235] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-15T19:51:46.516938] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-10. [2025-10-15T19:51:46.528290] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-15T19:51:46.529283] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-15T19:51:46.537023] [INFO ] [REMOTE ] KSS: Full fetch complete (77754 records). [2025-10-15T19:51:46.539366] [DEBUG] [VALIDATOR ] KSS: Validating primary data. [2025-10-15T19:51:46.933382] [DEBUG] [VALIDATOR ] KSS: All expected trading days are present. [2025-10-15T19:51:46.933497] [DEBUG] [VALIDATOR ] KSS: Primary data validation passed. [2025-10-15T19:51:46.934555] [INFO ] [MAIN ] KSS: Fetched primary data is valid. [2025-10-15T19:51:46.934616] [DEBUG] [LOCAL ] KSS: Saving primary data. [2025-10-15T19:51:46.936297] [DEBUG] [LOCAL ] KSS: Trimmed 77754 records to 53593 (keeping 200 days of data) [2025-10-15T19:51:47.258079] [DEBUG] [LOCAL ] KSS: Primary data saved (53593 records). [2025-10-15T19:51:47.258206] [INFO ] [MAIN ] KSS: Full history saved. [2025-10-15T19:51:47.259027] [INFO ] [MAIN ] Update Progress: 1222/2369 symbols completed. KSS took 44.8s. Estimated remaining: 2h 41m 10s. Rate: 7.1 symbols/min [2025-10-15T19:51:47.320886] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-03. [2025-10-15T19:51:47.432817] [INFO ] [MAIN ] KUKE: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:51:47.432974] [DEBUG] [LOCAL ] KUKE: No existing data file found in primary storage. [2025-10-15T19:51:47.433016] [WARN ] [MAIN ] KUKE: No existing data found, performing full refresh instead. [2025-10-15T19:51:47.433137] [INFO ] [MAIN ] KUKE: Wiping existing primary data before full refresh. [2025-10-15T19:51:47.433209] [INFO ] [LOCAL ] KUKE: Starting deletion of primary data. [2025-10-15T19:51:47.433281] [DEBUG] [LOCAL ] KUKE: No primary data file found to delete. [2025-10-15T19:51:47.433326] [INFO ] [MAIN ] KUKE: Starting full primary refresh. [2025-10-15T19:51:47.789962] [INFO ] [REMOTE ] KUKE: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:51:48.114069] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-08. [2025-10-15T19:51:48.148705] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-15T19:51:48.154250] [INFO ] [REMOTE ] KT: Full fetch complete (66719 records). [2025-10-15T19:51:48.154413] [DEBUG] [VALIDATOR ] KT: Validating primary data. [2025-10-15T19:51:48.483885] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-15T19:51:48.572579] [DEBUG] [VALIDATOR ] KT: All expected trading days are present. [2025-10-15T19:51:48.572684] [DEBUG] [VALIDATOR ] KT: Primary data validation passed. [2025-10-15T19:51:48.573790] [INFO ] [MAIN ] KT: Fetched primary data is valid. [2025-10-15T19:51:48.573855] [DEBUG] [LOCAL ] KT: Saving primary data. [2025-10-15T19:51:48.576359] [DEBUG] [LOCAL ] KT: Trimmed 66719 records to 45480 (keeping 200 days of data) [2025-10-15T19:51:48.883545] [DEBUG] [LOCAL ] KT: Primary data saved (45480 records). [2025-10-15T19:51:48.883734] [INFO ] [MAIN ] KT: Full history saved. [2025-10-15T19:51:48.883878] [INFO ] [MAIN ] Update Progress: 1223/2369 symbols completed. KT took 29.4s. Estimated remaining: 2h 40m 56s. Rate: 7.1 symbols/min [2025-10-15T19:51:48.921329] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-04. [2025-10-15T19:51:49.112008] [INFO ] [MAIN ] KVUE: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:51:49.186256] [DEBUG] [LOCAL ] KVUE: Loaded 53667 existing records from primary storage. [2025-10-15T19:51:49.186781] [INFO ] [MAIN ] KVUE: Loaded 53667 existing records. [2025-10-15T19:51:49.422599] [WARN ] [MAIN ] KVUE: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:51:49.423089] [INFO ] [MAIN ] KVUE: Wiping existing primary data before full refresh. [2025-10-15T19:51:49.423149] [INFO ] [LOCAL ] KVUE: Starting deletion of primary data. [2025-10-15T19:51:49.424195] [DEBUG] [LOCAL ] KVUE: Deleted primary data file. [2025-10-15T19:51:49.424256] [INFO ] [MAIN ] KVUE: Starting full primary refresh. [2025-10-15T19:51:49.719185] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2024-12. [2025-10-15T19:51:49.855954] [INFO ] [REMOTE ] KVUE: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:51:49.857151] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-15T19:51:49.887723] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-15T19:51:50.476507] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-10-15T19:51:50.514036] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-01. [2025-10-15T19:51:51.314005] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2024-12. [2025-10-15T19:51:51.454536] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-15T19:51:52.114064] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-02. [2025-10-15T19:51:52.675408] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-15T19:51:52.919078] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-03. [2025-10-15T19:51:52.936382] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-15T19:51:53.713958] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-01. [2025-10-15T19:51:53.859498] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-15T19:51:54.514060] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-05. [2025-10-15T19:51:55.248410] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-15T19:51:55.267871] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-15T19:51:55.313964] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-02. [2025-10-15T19:51:56.114012] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-04. [2025-10-15T19:51:56.649900] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-10-15T19:51:56.731671] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-15T19:51:56.914007] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-09. [2025-10-15T19:51:57.714013] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-03. [2025-10-15T19:51:58.310061] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-15T19:51:58.514020] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-06. [2025-10-15T19:51:59.314005] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-10. [2025-10-15T19:51:59.472411] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-15T19:51:59.475857] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-15T19:52:00.114000] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-04. [2025-10-15T19:52:00.401002] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-15T19:52:00.405980] [INFO ] [REMOTE ] KTB: Full fetch complete (58182 records). [2025-10-15T19:52:00.406158] [DEBUG] [VALIDATOR ] KTB: Validating primary data. [2025-10-15T19:52:00.840627] [DEBUG] [VALIDATOR ] KTB: All expected trading days are present. [2025-10-15T19:52:00.840746] [DEBUG] [VALIDATOR ] KTB: Primary data validation passed. [2025-10-15T19:52:00.841626] [INFO ] [MAIN ] KTB: Fetched primary data is valid. [2025-10-15T19:52:00.841703] [DEBUG] [LOCAL ] KTB: Saving primary data. [2025-10-15T19:52:00.842908] [DEBUG] [LOCAL ] KTB: Trimmed 58182 records to 40516 (keeping 200 days of data) [2025-10-15T19:52:00.929474] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-07. [2025-10-15T19:52:01.087912] [DEBUG] [LOCAL ] KTB: Primary data saved (40516 records). [2025-10-15T19:52:01.088039] [INFO ] [MAIN ] KTB: Full history saved. [2025-10-15T19:52:01.088409] [INFO ] [MAIN ] Update Progress: 1224/2369 symbols completed. KTB took 37.7s. Estimated remaining: 2h 40m 51s. Rate: 7.1 symbols/min [2025-10-15T19:52:01.254969] [INFO ] [MAIN ] KVYO: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:52:01.302697] [DEBUG] [LOCAL ] KVYO: Loaded 50745 existing records from primary storage. [2025-10-15T19:52:01.303015] [INFO ] [MAIN ] KVYO: Loaded 50745 existing records. [2025-10-15T19:52:01.479661] [WARN ] [MAIN ] KVYO: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:52:01.479883] [INFO ] [MAIN ] KVYO: Wiping existing primary data before full refresh. [2025-10-15T19:52:01.479948] [INFO ] [LOCAL ] KVYO: Starting deletion of primary data. [2025-10-15T19:52:01.480889] [DEBUG] [LOCAL ] KVYO: Deleted primary data file. [2025-10-15T19:52:01.480949] [INFO ] [MAIN ] KVYO: Starting full primary refresh. [2025-10-15T19:52:01.715697] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-05. [2025-10-15T19:52:01.861858] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-15T19:52:01.897314] [INFO ] [REMOTE ] KVYO: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:52:02.122964] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-15T19:52:02.255284] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-10-15T19:52:02.513988] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-08. [2025-10-15T19:52:03.314088] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-05. [2025-10-15T19:52:03.314570] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-15T19:52:04.114019] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-09. [2025-10-15T19:52:04.876782] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-15T19:52:04.913997] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-10. [2025-10-15T19:52:05.155369] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-15T19:52:05.630682] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-15T19:52:05.632104] [INFO ] [REMOTE ] KTF: Full fetch complete (17429 records). [2025-10-15T19:52:05.632174] [DEBUG] [VALIDATOR ] KTF: Validating primary data. [2025-10-15T19:52:05.719151] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-06. [2025-10-15T19:52:06.003914] [DEBUG] [VALIDATOR ] KTF: All expected trading days are present. [2025-10-15T19:52:06.003991] [DEBUG] [VALIDATOR ] KTF: Primary data validation passed. [2025-10-15T19:52:06.004358] [INFO ] [MAIN ] KTF: Fetched primary data is valid. [2025-10-15T19:52:06.004397] [DEBUG] [LOCAL ] KTF: Saving primary data. [2025-10-15T19:52:06.005005] [DEBUG] [LOCAL ] KTF: Trimmed 17429 records to 11799 (keeping 200 days of data) [2025-10-15T19:52:06.079288] [DEBUG] [LOCAL ] KTF: Primary data saved (11799 records). [2025-10-15T19:52:06.079433] [INFO ] [MAIN ] KTF: Full history saved. [2025-10-15T19:52:06.079514] [INFO ] [MAIN ] Update Progress: 1225/2369 symbols completed. KTF took 36.3s. Estimated remaining: 2h 40m 39s. Rate: 7.1 symbols/min [2025-10-15T19:52:06.180797] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-10-15T19:52:06.249555] [INFO ] [MAIN ] KW: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:52:06.288640] [DEBUG] [LOCAL ] KW: Loaded 40532 existing records from primary storage. [2025-10-15T19:52:06.288972] [INFO ] [MAIN ] KW: Loaded 40532 existing records. [2025-10-15T19:52:06.467972] [WARN ] [MAIN ] KW: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:52:06.468251] [INFO ] [MAIN ] KW: Wiping existing primary data before full refresh. [2025-10-15T19:52:06.468323] [INFO ] [LOCAL ] KW: Starting deletion of primary data. [2025-10-15T19:52:06.469103] [DEBUG] [LOCAL ] KW: Deleted primary data file. [2025-10-15T19:52:06.469159] [INFO ] [MAIN ] KW: Starting full primary refresh. [2025-10-15T19:52:06.520502] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-07. [2025-10-15T19:52:06.822993] [INFO ] [REMOTE ] KW: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:52:06.891526] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-07 (0.37 seconds). [2025-10-15T19:52:07.313995] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-08. [2025-10-15T19:52:07.783703] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-10-15T19:52:08.114032] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-09. [2025-10-15T19:52:08.913966] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2024-12. [2025-10-15T19:52:08.936260] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-15T19:52:09.713989] [INFO ] [REMOTE ] KW: Fetching primary data for 2024-12. [2025-10-15T19:52:10.513969] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-10. [2025-10-15T19:52:10.586312] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-15T19:52:11.055986] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-15T19:52:11.310309] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-15T19:52:11.312219] [INFO ] [REMOTE ] KUKE: Full fetch complete (8930 records). [2025-10-15T19:52:11.312286] [DEBUG] [VALIDATOR ] KUKE: Validating primary data. [2025-10-15T19:52:11.318676] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-06. [2025-10-15T19:52:11.516808] [WARN ] [VALIDATOR ] KUKE: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-15T19:52:11.517059] [FATAL] [MAIN ] KUKE: Fetched primary data is invalid. Refusing to save it. [2025-10-15T19:52:11.517128] [WARN ] [MAIN ] KUKE: Deleting existing primary and derivative data due to validation failure. [2025-10-15T19:52:11.517197] [INFO ] [LOCAL ] KUKE: Starting deletion of primary data. [2025-10-15T19:52:11.517260] [DEBUG] [LOCAL ] KUKE: No primary data file found to delete. [2025-10-15T19:52:11.517296] [INFO ] [LOCAL ] KUKE: Starting deletion of derivative data. [2025-10-15T19:52:11.517341] [DEBUG] [LOCAL ] KUKE: No derivative data file found to delete. [2025-10-15T19:52:11.517396] [INFO ] [MAIN ] Update Progress: 1226/2369 symbols completed. KUKE took 24.3s. Estimated remaining: 2h 40m 28s. Rate: 7.1 symbols/min [2025-10-15T19:52:11.684569] [INFO ] [MAIN ] KWR: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:52:11.700858] [DEBUG] [LOCAL ] KWR: Loaded 16121 existing records from primary storage. [2025-10-15T19:52:11.701116] [INFO ] [MAIN ] KWR: Loaded 16121 existing records. [2025-10-15T19:52:11.877233] [WARN ] [MAIN ] KWR: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:52:11.877410] [INFO ] [MAIN ] KWR: Wiping existing primary data before full refresh. [2025-10-15T19:52:11.877457] [INFO ] [LOCAL ] KWR: Starting deletion of primary data. [2025-10-15T19:52:11.877858] [DEBUG] [LOCAL ] KWR: Deleted primary data file. [2025-10-15T19:52:11.877914] [INFO ] [MAIN ] KWR: Starting full primary refresh. [2025-10-15T19:52:12.119129] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-01. [2025-10-15T19:52:12.230087] [INFO ] [REMOTE ] KWR: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:52:12.914027] [INFO ] [REMOTE ] KWR: Fetching primary data for 2024-12. [2025-10-15T19:52:13.136923] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-15T19:52:13.575771] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-15T19:52:13.657830] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-10-15T19:52:13.713955] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-01. [2025-10-15T19:52:14.514004] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-01. [2025-10-15T19:52:14.751860] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-15T19:52:15.314056] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-02. [2025-10-15T19:52:16.113975] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-02. [2025-10-15T19:52:16.124636] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-15T19:52:16.269851] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-15T19:52:16.913995] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-03. [2025-10-15T19:52:17.458912] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-15T19:52:17.714055] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-02. [2025-10-15T19:52:17.885153] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-15T19:52:18.514023] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-03. [2025-10-15T19:52:19.056672] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-15T19:52:19.314074] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-04. [2025-10-15T19:52:19.902807] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-15T19:52:20.114070] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-07. [2025-10-15T19:52:20.381824] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-15T19:52:20.914032] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-03. [2025-10-15T19:52:21.724367] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-04. [2025-10-15T19:52:21.730469] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-15T19:52:22.522360] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-08. [2025-10-15T19:52:22.542215] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-15T19:52:23.240418] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-15T19:52:23.313986] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-05. [2025-10-15T19:52:24.113982] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-04. [2025-10-15T19:52:24.644829] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-08 (2.12 seconds). [2025-10-15T19:52:24.764389] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-15T19:52:24.913983] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-06. [2025-10-15T19:52:25.469285] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-15T19:52:25.714054] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-05. [2025-10-15T19:52:26.330996] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-15T19:52:26.520920] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-05. [2025-10-15T19:52:26.527419] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-15T19:52:27.313994] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-09. [2025-10-15T19:52:28.114031] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-07. [2025-10-15T19:52:28.195410] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-15T19:52:28.914013] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-06. [2025-10-15T19:52:29.548364] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-15T19:52:29.620965] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-09 (2.31 seconds). [2025-10-15T19:52:29.714045] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-08. [2025-10-15T19:52:30.047407] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-15T19:52:30.514031] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-06. [2025-10-15T19:52:30.834418] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-15T19:52:31.314006] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-07. [2025-10-15T19:52:31.485499] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-15T19:52:32.114049] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-07. [2025-10-15T19:52:32.793509] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-15T19:52:32.913968] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-08. [2025-10-15T19:52:33.714017] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-10. [2025-10-15T19:52:33.773597] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-15T19:52:34.381199] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-15T19:52:34.514004] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-08. [2025-10-15T19:52:34.540535] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-15T19:52:34.547729] [INFO ] [REMOTE ] KVUE: Full fetch complete (77842 records). [2025-10-15T19:52:34.547964] [DEBUG] [VALIDATOR ] KVUE: Validating primary data. [2025-10-15T19:52:34.961125] [DEBUG] [VALIDATOR ] KVUE: All expected trading days are present. [2025-10-15T19:52:34.961275] [DEBUG] [VALIDATOR ] KVUE: Primary data validation passed. [2025-10-15T19:52:34.962454] [INFO ] [MAIN ] KVUE: Fetched primary data is valid. [2025-10-15T19:52:34.962520] [DEBUG] [LOCAL ] KVUE: Saving primary data. [2025-10-15T19:52:34.964174] [DEBUG] [LOCAL ] KVUE: Trimmed 77842 records to 53667 (keeping 200 days of data) [2025-10-15T19:52:35.310340] [DEBUG] [LOCAL ] KVUE: Primary data saved (53667 records). [2025-10-15T19:52:35.310488] [INFO ] [MAIN ] KVUE: Full history saved. [2025-10-15T19:52:35.310572] [INFO ] [MAIN ] Update Progress: 1227/2369 symbols completed. KVUE took 46.4s. Estimated remaining: 2h 40m 34s. Rate: 7.1 symbols/min [2025-10-15T19:52:35.321940] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-09. [2025-10-15T19:52:35.524723] [INFO ] [MAIN ] KYN: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:52:35.536509] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-15T19:52:35.568403] [DEBUG] [LOCAL ] KYN: Loaded 30240 existing records from primary storage. [2025-10-15T19:52:35.568697] [INFO ] [MAIN ] KYN: Loaded 30240 existing records. [2025-10-15T19:52:35.755263] [WARN ] [MAIN ] KYN: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:52:35.755531] [INFO ] [MAIN ] KYN: Wiping existing primary data before full refresh. [2025-10-15T19:52:35.755581] [INFO ] [LOCAL ] KYN: Starting deletion of primary data. [2025-10-15T19:52:35.756332] [DEBUG] [LOCAL ] KYN: Deleted primary data file. [2025-10-15T19:52:35.756393] [INFO ] [MAIN ] KYN: Starting full primary refresh. [2025-10-15T19:52:36.124998] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-09. [2025-10-15T19:52:36.131339] [INFO ] [REMOTE ] KYN: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:52:36.845331] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-15T19:52:36.914021] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-09. [2025-10-15T19:52:37.714021] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-10. [2025-10-15T19:52:37.800721] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-15T19:52:37.822346] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-15T19:52:38.514052] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-10. [2025-10-15T19:52:39.022868] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-15T19:52:39.027789] [INFO ] [REMOTE ] KW: Full fetch complete (57248 records). [2025-10-15T19:52:39.027901] [DEBUG] [VALIDATOR ] KW: Validating primary data. [2025-10-15T19:52:39.319166] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-10. [2025-10-15T19:52:39.401458] [DEBUG] [VALIDATOR ] KW: All expected trading days are present. [2025-10-15T19:52:39.401531] [DEBUG] [VALIDATOR ] KW: Primary data validation passed. [2025-10-15T19:52:39.402428] [INFO ] [MAIN ] KW: Fetched primary data is valid. [2025-10-15T19:52:39.402490] [DEBUG] [LOCAL ] KW: Saving primary data. [2025-10-15T19:52:39.403595] [DEBUG] [LOCAL ] KW: Trimmed 57248 records to 40511 (keeping 200 days of data) [2025-10-15T19:52:39.635208] [DEBUG] [LOCAL ] KW: Primary data saved (40511 records). [2025-10-15T19:52:39.635329] [INFO ] [MAIN ] KW: Full history saved. [2025-10-15T19:52:39.635403] [INFO ] [MAIN ] Update Progress: 1228/2369 symbols completed. KW took 33.6s. Estimated remaining: 2h 40m 21s. Rate: 7.1 symbols/min [2025-10-15T19:52:39.798256] [INFO ] [MAIN ] L: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:52:39.798421] [DEBUG] [LOCAL ] L: No existing data file found in primary storage. [2025-10-15T19:52:39.798458] [WARN ] [MAIN ] L: No existing data found, performing full refresh instead. [2025-10-15T19:52:39.798567] [INFO ] [MAIN ] L: Wiping existing primary data before full refresh. [2025-10-15T19:52:39.798607] [INFO ] [LOCAL ] L: Starting deletion of primary data. [2025-10-15T19:52:39.798671] [DEBUG] [LOCAL ] L: No primary data file found to delete. [2025-10-15T19:52:39.798724] [INFO ] [MAIN ] L: Starting full primary refresh. [2025-10-15T19:52:40.114042] [INFO ] [REMOTE ] KYN: Fetching primary data for 2024-12. [2025-10-15T19:52:40.157283] [INFO ] [REMOTE ] L: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:52:40.180957] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-15T19:52:40.181734] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-15T19:52:40.191308] [INFO ] [REMOTE ] KWR: Full fetch complete (23630 records). [2025-10-15T19:52:40.191417] [INFO ] [REMOTE ] KVYO: Full fetch complete (72032 records). [2025-10-15T19:52:40.191624] [DEBUG] [VALIDATOR ] KVYO: Validating primary data. [2025-10-15T19:52:40.191715] [DEBUG] [VALIDATOR ] KWR: Validating primary data. [2025-10-15T19:52:40.917975] [INFO ] [REMOTE ] L: Fetching primary data for 2024-12. [2025-10-15T19:52:41.120240] [DEBUG] [VALIDATOR ] KVYO: All expected trading days are present. [2025-10-15T19:52:41.120552] [DEBUG] [VALIDATOR ] KWR: All expected trading days are present. [2025-10-15T19:52:41.120698] [DEBUG] [VALIDATOR ] KVYO: Primary data validation passed. [2025-10-15T19:52:41.122194] [INFO ] [MAIN ] KVYO: Fetched primary data is valid. [2025-10-15T19:52:41.122401] [DEBUG] [LOCAL ] KVYO: Saving primary data. [2025-10-15T19:52:41.122301] [DEBUG] [VALIDATOR ] KWR: Primary data validation passed. [2025-10-15T19:52:41.123710] [INFO ] [MAIN ] KWR: Fetched primary data is valid. [2025-10-15T19:52:41.123813] [DEBUG] [LOCAL ] KWR: Saving primary data. [2025-10-15T19:52:41.125972] [DEBUG] [LOCAL ] KWR: Trimmed 23630 records to 16108 (keeping 200 days of data) [2025-10-15T19:52:41.126914] [DEBUG] [LOCAL ] KVYO: Trimmed 72032 records to 50785 (keeping 200 days of data) [2025-10-15T19:52:41.553401] [DEBUG] [LOCAL ] KWR: Primary data saved (16108 records). [2025-10-15T19:52:41.589561] [INFO ] [MAIN ] KWR: Full history saved. [2025-10-15T19:52:41.613480] [INFO ] [MAIN ] Update Progress: 1229/2369 symbols completed. KWR took 30.1s. Estimated remaining: 2h 40m 7s. Rate: 7.1 symbols/min [2025-10-15T19:52:41.644272] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-15T19:52:41.716985] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-01. [2025-10-15T19:52:41.908884] [INFO ] [MAIN ] LAC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:52:42.003801] [DEBUG] [LOCAL ] KVYO: Primary data saved (50785 records). [2025-10-15T19:52:42.003977] [INFO ] [MAIN ] KVYO: Full history saved. [2025-10-15T19:52:42.004532] [INFO ] [MAIN ] Update Progress: 1230/2369 symbols completed. KVYO took 40.9s. Estimated remaining: 2h 39m 51s. Rate: 7.1 symbols/min [2025-10-15T19:52:42.216190] [INFO ] [MAIN ] LAD: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:52:42.217190] [DEBUG] [LOCAL ] LAC: Loaded 52499 existing records from primary storage. [2025-10-15T19:52:42.218146] [INFO ] [MAIN ] LAC: Loaded 52499 existing records. [2025-10-15T19:52:42.414434] [WARN ] [MAIN ] LAC: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:52:42.415113] [DEBUG] [LOCAL ] LAD: Loaded 23409 existing records from primary storage. [2025-10-15T19:52:42.415474] [INFO ] [MAIN ] LAD: Loaded 23409 existing records. [2025-10-15T19:52:42.426747] [INFO ] [MAIN ] LAC: Wiping existing primary data before full refresh. [2025-10-15T19:52:42.426882] [INFO ] [LOCAL ] LAC: Starting deletion of primary data. [2025-10-15T19:52:42.452784] [DEBUG] [LOCAL ] LAC: Deleted primary data file. [2025-10-15T19:52:42.491359] [INFO ] [MAIN ] LAC: Starting full primary refresh. [2025-10-15T19:52:42.700138] [WARN ] [MAIN ] LAD: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:52:42.774476] [INFO ] [MAIN ] LAD: Wiping existing primary data before full refresh. [2025-10-15T19:52:42.825494] [INFO ] [LOCAL ] LAD: Starting deletion of primary data. [2025-10-15T19:52:42.850360] [INFO ] [REMOTE ] L: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-10-15T19:52:42.887927] [INFO ] [REMOTE ] L: Fetching primary data for 2025-01. [2025-10-15T19:52:42.905516] [DEBUG] [LOCAL ] LAD: Deleted primary data file. [2025-10-15T19:52:42.923757] [INFO ] [MAIN ] LAD: Starting full primary refresh. [2025-10-15T19:52:43.124990] [INFO ] [REMOTE ] LAC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:52:43.317339] [INFO ] [REMOTE ] LAC: Fetching primary data for 2024-12. [2025-10-15T19:52:43.330554] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-15T19:52:43.428692] [INFO ] [REMOTE ] LAD: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:52:44.113982] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-02. [2025-10-15T19:52:44.522479] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-15T19:52:44.913964] [INFO ] [REMOTE ] L: Fetching primary data for 2025-02. [2025-10-15T19:52:45.023815] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-15T19:52:45.265475] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-15T19:52:45.714063] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-01. [2025-10-15T19:52:46.339132] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-15T19:52:46.514007] [INFO ] [REMOTE ] LAD: Fetching primary data for 2024-12. [2025-10-15T19:52:47.314068] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-03. [2025-10-15T19:52:47.612247] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-10-15T19:52:47.672094] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-15T19:52:48.113991] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-01. [2025-10-15T19:52:48.417513] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-15T19:52:48.913987] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-02. [2025-10-15T19:52:49.371472] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-15T19:52:49.713988] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-02. [2025-10-15T19:52:50.514010] [INFO ] [REMOTE ] L: Fetching primary data for 2025-03. [2025-10-15T19:52:50.809839] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-10-15T19:52:50.947209] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-15T19:52:51.314036] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-04. [2025-10-15T19:52:51.947065] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-15T19:52:52.113974] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-03. [2025-10-15T19:52:52.713557] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-15T19:52:52.913990] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-05. [2025-10-15T19:52:53.714036] [INFO ] [REMOTE ] L: Fetching primary data for 2025-04. [2025-10-15T19:52:53.934158] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-15T19:52:54.272570] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-15T19:52:54.513998] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-06. [2025-10-15T19:52:55.320727] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-04. [2025-10-15T19:52:55.339216] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-15T19:52:55.413918] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-15T19:52:56.114039] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-03. [2025-10-15T19:52:56.913995] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-07. [2025-10-15T19:52:57.377234] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-10-15T19:52:57.449707] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-15T19:52:57.714054] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-05. [2025-10-15T19:52:58.250295] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-15T19:52:58.513991] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-08. [2025-10-15T19:52:59.313981] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-04. [2025-10-15T19:52:59.720747] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-10-15T19:52:59.819592] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-15T19:53:00.114009] [INFO ] [REMOTE ] L: Fetching primary data for 2025-05. [2025-10-15T19:53:00.581217] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-15T19:53:00.914001] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-05. [2025-10-15T19:53:01.713980] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-09. [2025-10-15T19:53:01.785410] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-15T19:53:02.032382] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-15T19:53:02.514008] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-06. [2025-10-15T19:53:03.040299] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-15T19:53:03.314050] [INFO ] [REMOTE ] L: Fetching primary data for 2025-06. [2025-10-15T19:53:03.508881] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-15T19:53:04.114082] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-07. [2025-10-15T19:53:04.815248] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-15T19:53:04.914019] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-10. [2025-10-15T19:53:05.008133] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-15T19:53:05.714004] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-06. [2025-10-15T19:53:05.874779] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-15T19:53:05.880370] [INFO ] [REMOTE ] KYN: Full fetch complete (44546 records). [2025-10-15T19:53:05.880512] [DEBUG] [VALIDATOR ] KYN: Validating primary data. [2025-10-15T19:53:06.288294] [DEBUG] [VALIDATOR ] KYN: All expected trading days are present. [2025-10-15T19:53:06.288419] [DEBUG] [VALIDATOR ] KYN: Primary data validation passed. [2025-10-15T19:53:06.289241] [INFO ] [MAIN ] KYN: Fetched primary data is valid. [2025-10-15T19:53:06.289301] [DEBUG] [LOCAL ] KYN: Saving primary data. [2025-10-15T19:53:06.290323] [DEBUG] [LOCAL ] KYN: Trimmed 44546 records to 30275 (keeping 200 days of data) [2025-10-15T19:53:06.476132] [DEBUG] [LOCAL ] KYN: Primary data saved (30275 records). [2025-10-15T19:53:06.476269] [INFO ] [MAIN ] KYN: Full history saved. [2025-10-15T19:53:06.476364] [INFO ] [MAIN ] Update Progress: 1231/2369 symbols completed. KYN took 31.2s. Estimated remaining: 2h 39m 58s. Rate: 7.1 symbols/min [2025-10-15T19:53:06.522521] [INFO ] [REMOTE ] L: Fetching primary data for 2025-07. [2025-10-15T19:53:06.648498] [INFO ] [MAIN ] LADR: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:53:06.683957] [DEBUG] [LOCAL ] LADR: Loaded 39388 existing records from primary storage. [2025-10-15T19:53:06.684236] [INFO ] [MAIN ] LADR: Loaded 39388 existing records. [2025-10-15T19:53:06.857336] [WARN ] [MAIN ] LADR: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:53:06.857550] [INFO ] [MAIN ] LADR: Wiping existing primary data before full refresh. [2025-10-15T19:53:06.857597] [INFO ] [LOCAL ] LADR: Starting deletion of primary data. [2025-10-15T19:53:06.858429] [DEBUG] [LOCAL ] LADR: Deleted primary data file. [2025-10-15T19:53:06.858487] [INFO ] [MAIN ] LADR: Starting full primary refresh. [2025-10-15T19:53:07.207134] [INFO ] [REMOTE ] LADR: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:53:07.314007] [INFO ] [REMOTE ] LADR: Fetching primary data for 2024-12. [2025-10-15T19:53:07.574953] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-15T19:53:07.932389] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-15T19:53:08.113996] [INFO ] [REMOTE ] L: Fetching primary data for 2025-08. [2025-10-15T19:53:08.335719] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-15T19:53:08.913985] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-08. [2025-10-15T19:53:09.376717] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-15T19:53:09.635349] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-15T19:53:09.714018] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-01. [2025-10-15T19:53:10.514010] [INFO ] [REMOTE ] L: Fetching primary data for 2025-09. [2025-10-15T19:53:11.185555] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-15T19:53:11.314021] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-09. [2025-10-15T19:53:12.098015] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-15T19:53:12.113962] [INFO ] [REMOTE ] L: Fetching primary data for 2025-10. [2025-10-15T19:53:12.381573] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-15T19:53:12.914015] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-02. [2025-10-15T19:53:13.561524] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-15T19:53:13.566478] [INFO ] [REMOTE ] L: Full fetch complete (59390 records). [2025-10-15T19:53:13.566562] [DEBUG] [VALIDATOR ] L: Validating primary data. [2025-10-15T19:53:13.719024] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-07. [2025-10-15T19:53:13.954073] [DEBUG] [VALIDATOR ] L: All expected trading days are present. [2025-10-15T19:53:13.954157] [DEBUG] [VALIDATOR ] L: Primary data validation passed. [2025-10-15T19:53:13.955244] [INFO ] [MAIN ] L: Fetched primary data is valid. [2025-10-15T19:53:13.955345] [DEBUG] [LOCAL ] L: Saving primary data. [2025-10-15T19:53:13.956832] [DEBUG] [LOCAL ] L: Trimmed 59390 records to 41169 (keeping 200 days of data) [2025-10-15T19:53:14.206975] [DEBUG] [LOCAL ] L: Primary data saved (41169 records). [2025-10-15T19:53:14.207153] [INFO ] [MAIN ] L: Full history saved. [2025-10-15T19:53:14.207366] [INFO ] [MAIN ] Update Progress: 1232/2369 symbols completed. L took 34.6s. Estimated remaining: 2h 39m 49s. Rate: 7.1 symbols/min [2025-10-15T19:53:14.367938] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-15T19:53:14.408282] [INFO ] [MAIN ] LANV: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:53:14.414207] [DEBUG] [LOCAL ] LANV: Loaded 2789 existing records from primary storage. [2025-10-15T19:53:14.414378] [INFO ] [MAIN ] LANV: Loaded 2789 existing records. [2025-10-15T19:53:14.519305] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-03. [2025-10-15T19:53:14.610419] [WARN ] [MAIN ] LANV: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:53:14.610828] [INFO ] [MAIN ] LANV: Wiping existing primary data before full refresh. [2025-10-15T19:53:14.610884] [INFO ] [LOCAL ] LANV: Starting deletion of primary data. [2025-10-15T19:53:14.611184] [DEBUG] [LOCAL ] LANV: Deleted primary data file. [2025-10-15T19:53:14.611257] [INFO ] [MAIN ] LANV: Starting full primary refresh. [2025-10-15T19:53:14.973370] [INFO ] [REMOTE ] LANV: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:53:15.313993] [INFO ] [REMOTE ] LANV: Fetching primary data for 2024-12. [2025-10-15T19:53:15.658392] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-15T19:53:15.941694] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-10-15T19:53:15.984339] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-15T19:53:16.114002] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-08. [2025-10-15T19:53:16.914044] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-01. [2025-10-15T19:53:17.470050] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-15T19:53:17.714037] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-10. [2025-10-15T19:53:18.158620] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-10-15T19:53:18.514038] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-04. [2025-10-15T19:53:18.840668] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-15T19:53:18.843918] [INFO ] [REMOTE ] LAD: Full fetch complete (35388 records). [2025-10-15T19:53:18.844013] [DEBUG] [VALIDATOR ] LAD: Validating primary data. [2025-10-15T19:53:19.218805] [DEBUG] [VALIDATOR ] LAD: All expected trading days are present. [2025-10-15T19:53:19.218889] [DEBUG] [VALIDATOR ] LAD: Primary data validation passed. [2025-10-15T19:53:19.219693] [INFO ] [MAIN ] LAD: Fetched primary data is valid. [2025-10-15T19:53:19.219757] [DEBUG] [LOCAL ] LAD: Saving primary data. [2025-10-15T19:53:19.220533] [DEBUG] [LOCAL ] LAD: Trimmed 35388 records to 23378 (keeping 200 days of data) [2025-10-15T19:53:19.315687] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-09. [2025-10-15T19:53:19.367322] [DEBUG] [LOCAL ] LAD: Primary data saved (23378 records). [2025-10-15T19:53:19.367440] [INFO ] [MAIN ] LAD: Full history saved. [2025-10-15T19:53:19.367524] [INFO ] [MAIN ] Update Progress: 1233/2369 symbols completed. LAD took 37.4s. Estimated remaining: 2h 39m 37s. Rate: 7.1 symbols/min [2025-10-15T19:53:19.542456] [INFO ] [MAIN ] LAR: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:53:19.542673] [DEBUG] [LOCAL ] LAR: No existing data file found in primary storage. [2025-10-15T19:53:19.542760] [WARN ] [MAIN ] LAR: No existing data found, performing full refresh instead. [2025-10-15T19:53:19.542878] [INFO ] [MAIN ] LAR: Wiping existing primary data before full refresh. [2025-10-15T19:53:19.542957] [INFO ] [LOCAL ] LAR: Starting deletion of primary data. [2025-10-15T19:53:19.543029] [DEBUG] [LOCAL ] LAR: No primary data file found to delete. [2025-10-15T19:53:19.543092] [INFO ] [MAIN ] LAR: Starting full primary refresh. [2025-10-15T19:53:19.900674] [INFO ] [REMOTE ] LAR: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:53:20.114054] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-02. [2025-10-15T19:53:20.389640] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-15T19:53:20.562675] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-15T19:53:20.914043] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-03. [2025-10-15T19:53:21.380325] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-10-15T19:53:21.409981] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-09 (2.09 seconds). [2025-10-15T19:53:21.714007] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-04. [2025-10-15T19:53:22.035040] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-04 (0.32 seconds). [2025-10-15T19:53:22.514010] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-05. [2025-10-15T19:53:23.314017] [INFO ] [REMOTE ] LAR: Fetching primary data for 2024-12. [2025-10-15T19:53:23.519801] [DEBUG] [REMOTE ] LAR: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-15T19:53:23.520112] [WARN ] [REMOTE ] LAR: No data returned for month 2024-12 [2025-10-15T19:53:23.520201] [FATAL] [REMOTE ] LAR: API call failed - aborting fetch to avoid wasting further API calls [2025-10-15T19:53:23.520279] [FATAL] [MAIN ] LAR: Failed to fetch primary data. [2025-10-15T19:53:23.520345] [WARN ] [MAIN ] LAR: Deleting existing primary and derivative data due to fetch failure. [2025-10-15T19:53:23.520416] [INFO ] [LOCAL ] LAR: Starting deletion of primary data. [2025-10-15T19:53:23.520481] [DEBUG] [LOCAL ] LAR: No primary data file found to delete. [2025-10-15T19:53:23.520518] [INFO ] [LOCAL ] LAR: Starting deletion of derivative data. [2025-10-15T19:53:23.520557] [DEBUG] [LOCAL ] LAR: No derivative data file found to delete. [2025-10-15T19:53:23.520603] [INFO ] [MAIN ] Update Progress: 1234/2369 symbols completed. LAR took 4.2s. Estimated remaining: 2h 39m 25s. Rate: 7.1 symbols/min [2025-10-15T19:53:23.690576] [INFO ] [MAIN ] LAW: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:53:23.704795] [DEBUG] [LOCAL ] LAW: Loaded 14591 existing records from primary storage. [2025-10-15T19:53:23.705074] [INFO ] [MAIN ] LAW: Loaded 14591 existing records. [2025-10-15T19:53:23.892412] [WARN ] [MAIN ] LAW: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:53:23.892804] [INFO ] [MAIN ] LAW: Wiping existing primary data before full refresh. [2025-10-15T19:53:23.892877] [INFO ] [LOCAL ] LAW: Starting deletion of primary data. [2025-10-15T19:53:23.893319] [DEBUG] [LOCAL ] LAW: Deleted primary data file. [2025-10-15T19:53:23.893379] [INFO ] [MAIN ] LAW: Starting full primary refresh. [2025-10-15T19:53:24.088160] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-15T19:53:24.126463] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-05. [2025-10-15T19:53:24.322440] [INFO ] [REMOTE ] LAW: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:53:24.623382] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-10-15T19:53:24.914039] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-06. [2025-10-15T19:53:25.234540] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-06 (0.32 seconds). [2025-10-15T19:53:25.714003] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-07. [2025-10-15T19:53:26.272778] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-15T19:53:26.514003] [INFO ] [REMOTE ] LAW: Fetching primary data for 2024-12. [2025-10-15T19:53:27.274342] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-10-15T19:53:27.314024] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-08. [2025-10-15T19:53:27.842330] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-10-15T19:53:28.113994] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-10. [2025-10-15T19:53:28.913991] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-06. [2025-10-15T19:53:29.714006] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-01. [2025-10-15T19:53:30.275975] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-15T19:53:30.455858] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-10 (2.34 seconds). [2025-10-15T19:53:30.462363] [INFO ] [REMOTE ] LAC: Full fetch complete (76123 records). [2025-10-15T19:53:30.462501] [DEBUG] [VALIDATOR ] LAC: Validating primary data. [2025-10-15T19:53:30.523354] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-09. [2025-10-15T19:53:30.648126] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-15T19:53:30.864441] [DEBUG] [VALIDATOR ] LAC: All expected trading days are present. [2025-10-15T19:53:30.864519] [DEBUG] [VALIDATOR ] LAC: Primary data validation passed. [2025-10-15T19:53:30.865550] [INFO ] [MAIN ] LAC: Fetched primary data is valid. [2025-10-15T19:53:30.865614] [DEBUG] [LOCAL ] LAC: Saving primary data. [2025-10-15T19:53:30.867030] [DEBUG] [LOCAL ] LAC: Trimmed 76123 records to 52510 (keeping 200 days of data) [2025-10-15T19:53:31.155409] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-15T19:53:31.177451] [DEBUG] [LOCAL ] LAC: Primary data saved (52510 records). [2025-10-15T19:53:31.177586] [INFO ] [MAIN ] LAC: Full history saved. [2025-10-15T19:53:31.178546] [INFO ] [MAIN ] Update Progress: 1235/2369 symbols completed. LAC took 49.5s. Estimated remaining: 2h 39m 16s. Rate: 7.1 symbols/min [2025-10-15T19:53:31.323388] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-10. [2025-10-15T19:53:31.348448] [INFO ] [MAIN ] LAZ: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:53:31.391460] [DEBUG] [LOCAL ] LAZ: Loaded 44781 existing records from primary storage. [2025-10-15T19:53:31.391784] [INFO ] [MAIN ] LAZ: Loaded 44781 existing records. [2025-10-15T19:53:31.568067] [WARN ] [MAIN ] LAZ: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:53:31.568304] [INFO ] [MAIN ] LAZ: Wiping existing primary data before full refresh. [2025-10-15T19:53:31.568355] [INFO ] [LOCAL ] LAZ: Starting deletion of primary data. [2025-10-15T19:53:31.569402] [DEBUG] [LOCAL ] LAZ: Deleted primary data file. [2025-10-15T19:53:31.569461] [INFO ] [MAIN ] LAZ: Starting full primary refresh. [2025-10-15T19:53:31.899039] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-15T19:53:31.924300] [INFO ] [REMOTE ] LANV: Full fetch complete (4306 records). [2025-10-15T19:53:31.928572] [INFO ] [REMOTE ] LAZ: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:53:31.928673] [DEBUG] [VALIDATOR ] LANV: Validating primary data. [2025-10-15T19:53:32.124165] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-02. [2025-10-15T19:53:32.282349] [DEBUG] [VALIDATOR ] LANV: All expected trading days are present. [2025-10-15T19:53:32.282422] [DEBUG] [VALIDATOR ] LANV: Primary data validation passed. [2025-10-15T19:53:32.282566] [INFO ] [MAIN ] LANV: Fetched primary data is valid. [2025-10-15T19:53:32.282604] [DEBUG] [LOCAL ] LANV: Saving primary data. [2025-10-15T19:53:32.282976] [DEBUG] [LOCAL ] LANV: Trimmed 4306 records to 2784 (keeping 200 days of data) [2025-10-15T19:53:32.298393] [DEBUG] [LOCAL ] LANV: Primary data saved (2784 records). [2025-10-15T19:53:32.298459] [INFO ] [MAIN ] LANV: Full history saved. [2025-10-15T19:53:32.298530] [INFO ] [MAIN ] Update Progress: 1236/2369 symbols completed. LANV took 18.1s. Estimated remaining: 2h 39m 0s. Rate: 7.1 symbols/min [2025-10-15T19:53:32.462079] [INFO ] [MAIN ] LB: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:53:32.498521] [DEBUG] [LOCAL ] LB: Loaded 37450 existing records from primary storage. [2025-10-15T19:53:32.498835] [INFO ] [MAIN ] LB: Loaded 37450 existing records. [2025-10-15T19:53:32.671114] [WARN ] [MAIN ] LB: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:53:32.671358] [INFO ] [MAIN ] LB: Wiping existing primary data before full refresh. [2025-10-15T19:53:32.671406] [INFO ] [LOCAL ] LB: Starting deletion of primary data. [2025-10-15T19:53:32.671798] [DEBUG] [LOCAL ] LB: Deleted primary data file. [2025-10-15T19:53:32.671854] [INFO ] [MAIN ] LB: Starting full primary refresh. [2025-10-15T19:53:32.919260] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-07. [2025-10-15T19:53:33.024828] [INFO ] [REMOTE ] LB: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:53:33.148712] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-15T19:53:33.714038] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-03. [2025-10-15T19:53:34.433086] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-15T19:53:34.463113] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-15T19:53:34.514040] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-04. [2025-10-15T19:53:35.298687] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-15T19:53:35.313945] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-05. [2025-10-15T19:53:36.114022] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2024-12. [2025-10-15T19:53:36.184688] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-15T19:53:36.913984] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-06. [2025-10-15T19:53:37.707202] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-15T19:53:37.716766] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-01. [2025-10-15T19:53:37.821933] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-15T19:53:38.513991] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-08. [2025-10-15T19:53:39.141927] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-15T19:53:39.314024] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-02. [2025-10-15T19:53:39.898986] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-15T19:53:40.114073] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-07. [2025-10-15T19:53:40.812633] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-15T19:53:40.913995] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-03. [2025-10-15T19:53:40.944522] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-15T19:53:41.714015] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-09. [2025-10-15T19:53:42.513984] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-08. [2025-10-15T19:53:43.131414] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-15T19:53:43.268378] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-15T19:53:43.313959] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-10. [2025-10-15T19:53:44.114022] [INFO ] [REMOTE ] LB: Fetching primary data for 2024-12. [2025-10-15T19:53:44.734561] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-15T19:53:44.739674] [INFO ] [REMOTE ] LADR: Full fetch complete (55671 records). [2025-10-15T19:53:44.739801] [DEBUG] [VALIDATOR ] LADR: Validating primary data. [2025-10-15T19:53:44.915550] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-09. [2025-10-15T19:53:45.140877] [DEBUG] [VALIDATOR ] LADR: All expected trading days are present. [2025-10-15T19:53:45.140960] [DEBUG] [VALIDATOR ] LADR: Primary data validation passed. [2025-10-15T19:53:45.141854] [INFO ] [MAIN ] LADR: Fetched primary data is valid. [2025-10-15T19:53:45.141915] [DEBUG] [LOCAL ] LADR: Saving primary data. [2025-10-15T19:53:45.145906] [DEBUG] [LOCAL ] LADR: Trimmed 55671 records to 39396 (keeping 200 days of data) [2025-10-15T19:53:45.384691] [DEBUG] [LOCAL ] LADR: Primary data saved (39396 records). [2025-10-15T19:53:45.384836] [INFO ] [MAIN ] LADR: Full history saved. [2025-10-15T19:53:45.384953] [INFO ] [MAIN ] Update Progress: 1237/2369 symbols completed. LADR took 38.9s. Estimated remaining: 2h 38m 56s. Rate: 7.1 symbols/min [2025-10-15T19:53:45.674557] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-15T19:53:45.713946] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-01. [2025-10-15T19:53:45.888779] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-15T19:53:46.055429] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-03 (5.14 seconds). [2025-10-15T19:53:46.514018] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-04. [2025-10-15T19:53:47.213968] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-15T19:53:47.313953] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-02. [2025-10-15T19:53:48.105823] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-15T19:53:48.115519] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-10. [2025-10-15T19:53:48.827684] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-15T19:53:48.913965] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-05. [2025-10-15T19:53:49.091890] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-15T19:53:49.094369] [INFO ] [REMOTE ] LAW: Full fetch complete (20860 records). [2025-10-15T19:53:49.094440] [DEBUG] [VALIDATOR ] LAW: Validating primary data. [2025-10-15T19:53:49.452779] [DEBUG] [VALIDATOR ] LAW: All expected trading days are present. [2025-10-15T19:53:49.452852] [DEBUG] [VALIDATOR ] LAW: Primary data validation passed. [2025-10-15T19:53:49.453265] [INFO ] [MAIN ] LAW: Fetched primary data is valid. [2025-10-15T19:53:49.453304] [DEBUG] [LOCAL ] LAW: Saving primary data. [2025-10-15T19:53:49.453875] [DEBUG] [LOCAL ] LAW: Trimmed 20860 records to 14653 (keeping 200 days of data) [2025-10-15T19:53:49.530971] [DEBUG] [LOCAL ] LAW: Primary data saved (14653 records). [2025-10-15T19:53:49.531094] [INFO ] [MAIN ] LAW: Full history saved. [2025-10-15T19:53:49.531172] [INFO ] [MAIN ] Update Progress: 1238/2369 symbols completed. LAW took 26.0s. Estimated remaining: 2h 38m 44s. Rate: 7.1 symbols/min [2025-10-15T19:53:49.714053] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-03. [2025-10-15T19:53:50.383950] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-15T19:53:50.513986] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-06. [2025-10-15T19:53:51.327209] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-15T19:53:51.335971] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-04. [2025-10-15T19:53:51.991008] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-15T19:53:52.113963] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-07. [2025-10-15T19:53:52.901592] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-15T19:53:52.913947] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-05. [2025-10-15T19:53:53.703971] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-15T19:53:53.714114] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-08. [2025-10-15T19:53:54.396209] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-15T19:53:54.513987] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-06. [2025-10-15T19:53:55.195457] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-15T19:53:55.314006] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-09. [2025-10-15T19:53:55.834843] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-15T19:53:56.114045] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-07. [2025-10-15T19:53:56.896960] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-15T19:53:56.913954] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-10. [2025-10-15T19:53:57.747157] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-15T19:53:57.756612] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-08. [2025-10-15T19:53:58.408373] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-15T19:53:58.413291] [INFO ] [REMOTE ] LAZ: Full fetch complete (65697 records). [2025-10-15T19:53:58.413389] [DEBUG] [VALIDATOR ] LAZ: Validating primary data. [2025-10-15T19:53:58.796306] [DEBUG] [VALIDATOR ] LAZ: All expected trading days are present. [2025-10-15T19:53:58.796405] [DEBUG] [VALIDATOR ] LAZ: Primary data validation passed. [2025-10-15T19:53:58.797499] [INFO ] [MAIN ] LAZ: Fetched primary data is valid. [2025-10-15T19:53:58.797580] [DEBUG] [LOCAL ] LAZ: Saving primary data. [2025-10-15T19:53:58.798926] [DEBUG] [LOCAL ] LAZ: Trimmed 65697 records to 44741 (keeping 200 days of data) [2025-10-15T19:53:59.037963] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-15T19:53:59.048783] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-09. [2025-10-15T19:53:59.096845] [DEBUG] [LOCAL ] LAZ: Primary data saved (44741 records). [2025-10-15T19:53:59.096963] [INFO ] [MAIN ] LAZ: Full history saved. [2025-10-15T19:53:59.097864] [INFO ] [MAIN ] Update Progress: 1239/2369 symbols completed. LAZ took 27.9s. Estimated remaining: 2h 38m 37s. Rate: 7.1 symbols/min [2025-10-15T19:54:00.656402] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-15T19:54:00.664067] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-10. [2025-10-15T19:54:02.299544] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-15T19:54:02.305054] [INFO ] [REMOTE ] LB: Full fetch complete (56014 records). [2025-10-15T19:54:02.305214] [DEBUG] [VALIDATOR ] LB: Validating primary data. [2025-10-15T19:54:02.714986] [DEBUG] [VALIDATOR ] LB: All expected trading days are present. [2025-10-15T19:54:02.715063] [DEBUG] [VALIDATOR ] LB: Primary data validation passed. [2025-10-15T19:54:02.715960] [INFO ] [MAIN ] LB: Fetched primary data is valid. [2025-10-15T19:54:02.716036] [DEBUG] [LOCAL ] LB: Saving primary data. [2025-10-15T19:54:02.717093] [DEBUG] [LOCAL ] LB: Trimmed 56014 records to 37383 (keeping 200 days of data) [2025-10-15T19:54:02.938903] [DEBUG] [LOCAL ] LB: Primary data saved (37383 records). [2025-10-15T19:54:02.939039] [INFO ] [MAIN ] LB: Full history saved. [2025-10-15T19:54:02.939118] [INFO ] [MAIN ] Update Progress: 1240/2369 symbols completed. LB took 30.6s. Estimated remaining: 2h 38m 24s. Rate: 7.1 symbols/min [2025-10-15T19:54:03.649685] [INFO ] [MAIN ] LC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:54:03.630358] [INFO ] [MAIN ] LBRT: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:54:03.653218] [INFO ] [MAIN ] LDI: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:54:03.648817] [INFO ] [MAIN ] LCII: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:54:03.707882] [DEBUG] [LOCAL ] LCII: Loaded 27499 existing records from primary storage. [2025-10-15T19:54:03.708259] [INFO ] [MAIN ] LCII: Loaded 27499 existing records. [2025-10-15T19:54:03.853481] [DEBUG] [LOCAL ] LDI: Loaded 44773 existing records from primary storage. [2025-10-15T19:54:03.852846] [DEBUG] [LOCAL ] LC: Loaded 48108 existing records from primary storage. [2025-10-15T19:54:03.908761] [INFO ] [MAIN ] LDI: Loaded 44773 existing records. [2025-10-15T19:54:03.957015] [INFO ] [MAIN ] LC: Loaded 48108 existing records. [2025-10-15T19:54:03.985369] [WARN ] [MAIN ] LCII: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:54:04.036265] [INFO ] [MAIN ] LCII: Wiping existing primary data before full refresh. [2025-10-15T19:54:03.991929] [DEBUG] [LOCAL ] LBRT: Loaded 52954 existing records from primary storage. [2025-10-15T19:54:04.046306] [INFO ] [LOCAL ] LCII: Starting deletion of primary data. [2025-10-15T19:54:04.078060] [DEBUG] [LOCAL ] LCII: Deleted primary data file. [2025-10-15T19:54:04.114926] [INFO ] [MAIN ] LCII: Starting full primary refresh. [2025-10-15T19:54:04.077990] [INFO ] [MAIN ] LBRT: Loaded 52954 existing records. [2025-10-15T19:54:04.433290] [WARN ] [MAIN ] LDI: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:54:04.499370] [INFO ] [MAIN ] LDI: Wiping existing primary data before full refresh. [2025-10-15T19:54:04.510443] [INFO ] [LOCAL ] LDI: Starting deletion of primary data. [2025-10-15T19:54:04.530666] [DEBUG] [LOCAL ] LDI: Deleted primary data file. [2025-10-15T19:54:04.596233] [INFO ] [MAIN ] LDI: Starting full primary refresh. [2025-10-15T19:54:04.723912] [WARN ] [MAIN ] LC: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:54:04.720937] [WARN ] [MAIN ] LBRT: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:54:04.774464] [INFO ] [MAIN ] LC: Wiping existing primary data before full refresh. [2025-10-15T19:54:04.814050] [INFO ] [MAIN ] LBRT: Wiping existing primary data before full refresh. [2025-10-15T19:54:04.784978] [INFO ] [LOCAL ] LC: Starting deletion of primary data. [2025-10-15T19:54:04.830505] [INFO ] [LOCAL ] LBRT: Starting deletion of primary data. [2025-10-15T19:54:04.898369] [DEBUG] [LOCAL ] LBRT: Deleted primary data file. [2025-10-15T19:54:04.904863] [INFO ] [MAIN ] LBRT: Starting full primary refresh. [2025-10-15T19:54:04.904919] [DEBUG] [LOCAL ] LC: Deleted primary data file. [2025-10-15T19:54:04.914040] [INFO ] [MAIN ] LC: Starting full primary refresh. [2025-10-15T19:54:05.326168] [INFO ] [REMOTE ] LCII: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:54:05.363252] [INFO ] [REMOTE ] LCII: Fetching primary data for 2024-12. [2025-10-15T19:54:05.876382] [INFO ] [REMOTE ] LDI: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:54:05.880230] [INFO ] [REMOTE ] LDI: Fetching primary data for 2024-12. [2025-10-15T19:54:06.047189] [INFO ] [REMOTE ] LBRT: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:54:06.051299] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2024-12. [2025-10-15T19:54:06.071229] [INFO ] [REMOTE ] LC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:54:06.071773] [INFO ] [REMOTE ] LC: Fetching primary data for 2024-12. [2025-10-15T19:54:06.703348] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-15T19:54:06.707894] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-01. [2025-10-15T19:54:07.524423] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-15T19:54:07.533302] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-01. [2025-10-15T19:54:07.612316] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-15T19:54:07.625739] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-01. [2025-10-15T19:54:07.762813] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-15T19:54:07.773146] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-01. [2025-10-15T19:54:07.819767] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-15T19:54:07.824745] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-02. [2025-10-15T19:54:08.579178] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-15T19:54:08.585859] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-02. [2025-10-15T19:54:08.706405] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-15T19:54:08.711484] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-03. [2025-10-15T19:54:09.037441] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-15T19:54:09.048186] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-02. [2025-10-15T19:54:09.552407] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-15T19:54:09.714026] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-02. [2025-10-15T19:54:09.839734] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-15T19:54:10.001597] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-15T19:54:10.307602] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-15T19:54:10.513996] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-03. [2025-10-15T19:54:11.314069] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-03. [2025-10-15T19:54:11.455122] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-15T19:54:11.751013] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-15T19:54:12.114042] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-04. [2025-10-15T19:54:12.663433] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-15T19:54:12.913999] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-04. [2025-10-15T19:54:13.558473] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-15T19:54:13.714001] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-05. [2025-10-15T19:54:14.503884] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-15T19:54:14.513956] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-05. [2025-10-15T19:54:15.251448] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-15T19:54:15.313959] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-06. [2025-10-15T19:54:15.962178] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-15T19:54:16.114008] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-06. [2025-10-15T19:54:16.860429] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-15T19:54:16.913947] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-07. [2025-10-15T19:54:17.517862] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-15T19:54:17.713999] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-04. [2025-10-15T19:54:18.514006] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-03. [2025-10-15T19:54:18.650854] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-15T19:54:19.280879] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-15T19:54:19.313966] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-05. [2025-10-15T19:54:19.906249] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-15T19:54:20.113965] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-07. [2025-10-15T19:54:20.379634] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-15T19:54:20.913980] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-06. [2025-10-15T19:54:21.722577] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-04. [2025-10-15T19:54:21.728396] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-15T19:54:21.980025] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-15T19:54:22.514047] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-08. [2025-10-15T19:54:23.313968] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-08. [2025-10-15T19:54:23.528787] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-15T19:54:24.113984] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-05. [2025-10-15T19:54:24.248573] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-15T19:54:24.913991] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-07. [2025-10-15T19:54:25.142554] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-15T19:54:25.713963] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-09. [2025-10-15T19:54:25.930273] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-15T19:54:26.191154] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-15T19:54:26.514025] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-08. [2025-10-15T19:54:27.313962] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-06. [2025-10-15T19:54:27.659091] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-15T19:54:27.948044] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-09 (2.23 seconds). [2025-10-15T19:54:28.114007] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-10. [2025-10-15T19:54:28.912304] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-15T19:54:28.922193] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-09. [2025-10-15T19:54:29.714040] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-07. [2025-10-15T19:54:30.066252] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-15T19:54:30.302686] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-10 (2.19 seconds). [2025-10-15T19:54:30.309017] [INFO ] [REMOTE ] LDI: Full fetch complete (61752 records). [2025-10-15T19:54:30.309173] [DEBUG] [VALIDATOR ] LDI: Validating primary data. [2025-10-15T19:54:30.523571] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-10. [2025-10-15T19:54:30.696535] [DEBUG] [VALIDATOR ] LDI: All expected trading days are present. [2025-10-15T19:54:30.696664] [DEBUG] [VALIDATOR ] LDI: Primary data validation passed. [2025-10-15T19:54:30.697595] [INFO ] [MAIN ] LDI: Fetched primary data is valid. [2025-10-15T19:54:30.697699] [DEBUG] [LOCAL ] LDI: Saving primary data. [2025-10-15T19:54:30.698976] [DEBUG] [LOCAL ] LDI: Trimmed 61752 records to 44806 (keeping 200 days of data) [2025-10-15T19:54:30.952061] [DEBUG] [LOCAL ] LDI: Primary data saved (44806 records). [2025-10-15T19:54:30.952195] [INFO ] [MAIN ] LDI: Full history saved. [2025-10-15T19:54:30.952292] [INFO ] [MAIN ] Update Progress: 1241/2369 symbols completed. LDI took 28.0s. Estimated remaining: 2h 38m 33s. Rate: 7.1 symbols/min [2025-10-15T19:54:31.119452] [INFO ] [MAIN ] LDOS: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:54:31.164756] [DEBUG] [LOCAL ] LDOS: Loaded 45119 existing records from primary storage. [2025-10-15T19:54:31.165046] [INFO ] [MAIN ] LDOS: Loaded 45119 existing records. [2025-10-15T19:54:31.319464] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-09. [2025-10-15T19:54:31.350439] [WARN ] [MAIN ] LDOS: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:54:31.351759] [INFO ] [MAIN ] LDOS: Wiping existing primary data before full refresh. [2025-10-15T19:54:31.351852] [INFO ] [LOCAL ] LDOS: Starting deletion of primary data. [2025-10-15T19:54:31.352955] [DEBUG] [LOCAL ] LDOS: Deleted primary data file. [2025-10-15T19:54:31.353018] [INFO ] [MAIN ] LDOS: Starting full primary refresh. [2025-10-15T19:54:31.747559] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-15T19:54:31.763738] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-10-15T19:54:31.761516] [INFO ] [REMOTE ] LDOS: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:54:31.777736] [INFO ] [REMOTE ] LCII: Full fetch complete (39140 records). [2025-10-15T19:54:31.778828] [DEBUG] [VALIDATOR ] LCII: Validating primary data. [2025-10-15T19:54:32.119214] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2024-12. [2025-10-15T19:54:32.165815] [DEBUG] [VALIDATOR ] LCII: All expected trading days are present. [2025-10-15T19:54:32.165901] [DEBUG] [VALIDATOR ] LCII: Primary data validation passed. [2025-10-15T19:54:32.166699] [INFO ] [MAIN ] LCII: Fetched primary data is valid. [2025-10-15T19:54:32.166761] [DEBUG] [LOCAL ] LCII: Saving primary data. [2025-10-15T19:54:32.167972] [DEBUG] [LOCAL ] LCII: Trimmed 39140 records to 27437 (keeping 200 days of data) [2025-10-15T19:54:32.337933] [DEBUG] [LOCAL ] LCII: Primary data saved (27437 records). [2025-10-15T19:54:32.338073] [INFO ] [MAIN ] LCII: Full history saved. [2025-10-15T19:54:32.338156] [INFO ] [MAIN ] Update Progress: 1242/2369 symbols completed. LCII took 29.4s. Estimated remaining: 2h 38m 19s. Rate: 7.1 symbols/min [2025-10-15T19:54:32.512517] [INFO ] [MAIN ] LDP: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:54:32.526438] [DEBUG] [LOCAL ] LDP: Loaded 12849 existing records from primary storage. [2025-10-15T19:54:32.526719] [INFO ] [MAIN ] LDP: Loaded 12849 existing records. [2025-10-15T19:54:32.709023] [WARN ] [MAIN ] LDP: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:54:32.709231] [INFO ] [MAIN ] LDP: Wiping existing primary data before full refresh. [2025-10-15T19:54:32.709278] [INFO ] [LOCAL ] LDP: Starting deletion of primary data. [2025-10-15T19:54:32.709597] [DEBUG] [LOCAL ] LDP: Deleted primary data file. [2025-10-15T19:54:32.709692] [INFO ] [MAIN ] LDP: Starting full primary refresh. [2025-10-15T19:54:32.921747] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-08. [2025-10-15T19:54:33.057392] [INFO ] [REMOTE ] LDP: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:54:33.083372] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-15T19:54:33.713964] [INFO ] [REMOTE ] LDP: Fetching primary data for 2024-12. [2025-10-15T19:54:33.899210] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-15T19:54:34.340609] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-15T19:54:34.514019] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-01. [2025-10-15T19:54:34.824969] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-15T19:54:35.314052] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-01. [2025-10-15T19:54:35.901367] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-15T19:54:36.114027] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-10. [2025-10-15T19:54:36.141054] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-15T19:54:36.914041] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-02. [2025-10-15T19:54:37.528738] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-15T19:54:37.713998] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-09. [2025-10-15T19:54:37.836259] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-15T19:54:37.843850] [INFO ] [REMOTE ] LC: Full fetch complete (70662 records). [2025-10-15T19:54:37.844018] [DEBUG] [VALIDATOR ] LC: Validating primary data. [2025-10-15T19:54:38.236203] [DEBUG] [VALIDATOR ] LC: All expected trading days are present. [2025-10-15T19:54:38.236310] [DEBUG] [VALIDATOR ] LC: Primary data validation passed. [2025-10-15T19:54:38.237382] [INFO ] [MAIN ] LC: Fetched primary data is valid. [2025-10-15T19:54:38.237475] [DEBUG] [LOCAL ] LC: Saving primary data. [2025-10-15T19:54:38.239026] [DEBUG] [LOCAL ] LC: Trimmed 70662 records to 48164 (keeping 200 days of data) [2025-10-15T19:54:38.516716] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-02. [2025-10-15T19:54:38.516607] [DEBUG] [LOCAL ] LC: Primary data saved (48164 records). [2025-10-15T19:54:38.517914] [INFO ] [MAIN ] LC: Full history saved. [2025-10-15T19:54:38.518013] [INFO ] [MAIN ] Update Progress: 1243/2369 symbols completed. LC took 35.6s. Estimated remaining: 2h 38m 8s. Rate: 7.1 symbols/min [2025-10-15T19:54:38.705631] [INFO ] [MAIN ] LEA: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:54:38.742720] [DEBUG] [LOCAL ] LEA: Loaded 41400 existing records from primary storage. [2025-10-15T19:54:38.743036] [INFO ] [MAIN ] LEA: Loaded 41400 existing records. [2025-10-15T19:54:38.924230] [WARN ] [MAIN ] LEA: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:54:38.924455] [INFO ] [MAIN ] LEA: Wiping existing primary data before full refresh. [2025-10-15T19:54:38.924509] [INFO ] [LOCAL ] LEA: Starting deletion of primary data. [2025-10-15T19:54:38.925230] [DEBUG] [LOCAL ] LEA: Deleted primary data file. [2025-10-15T19:54:38.925289] [INFO ] [MAIN ] LEA: Starting full primary refresh. [2025-10-15T19:54:39.306299] [INFO ] [REMOTE ] LEA: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:54:39.313979] [INFO ] [REMOTE ] LEA: Fetching primary data for 2024-12. [2025-10-15T19:54:39.447231] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-15T19:54:40.082563] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-15T19:54:40.113952] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-03. [2025-10-15T19:54:40.797815] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-15T19:54:40.913978] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-01. [2025-10-15T19:54:41.714212] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-03. [2025-10-15T19:54:42.274830] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-03 (2.16 seconds). [2025-10-15T19:54:42.495692] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-15T19:54:42.514023] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-02. [2025-10-15T19:54:42.533165] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-15T19:54:43.314064] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-10. [2025-10-15T19:54:44.026622] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-15T19:54:44.114007] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-03. [2025-10-15T19:54:44.914032] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-04. [2025-10-15T19:54:44.988124] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-15T19:54:44.994382] [INFO ] [REMOTE ] LBRT: Full fetch complete (76877 records). [2025-10-15T19:54:44.994486] [DEBUG] [VALIDATOR ] LBRT: Validating primary data. [2025-10-15T19:54:45.379523] [DEBUG] [VALIDATOR ] LBRT: All expected trading days are present. [2025-10-15T19:54:45.379597] [DEBUG] [VALIDATOR ] LBRT: Primary data validation passed. [2025-10-15T19:54:45.380613] [INFO ] [MAIN ] LBRT: Fetched primary data is valid. [2025-10-15T19:54:45.380698] [DEBUG] [LOCAL ] LBRT: Saving primary data. [2025-10-15T19:54:45.382082] [DEBUG] [LOCAL ] LBRT: Trimmed 76877 records to 52959 (keeping 200 days of data) [2025-10-15T19:54:45.707788] [DEBUG] [LOCAL ] LBRT: Primary data saved (52959 records). [2025-10-15T19:54:45.707963] [INFO ] [MAIN ] LBRT: Full history saved. [2025-10-15T19:54:45.708070] [INFO ] [MAIN ] Update Progress: 1244/2369 symbols completed. LBRT took 42.8s. Estimated remaining: 2h 37m 59s. Rate: 7.1 symbols/min [2025-10-15T19:54:45.719800] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-04. [2025-10-15T19:54:45.910202] [INFO ] [MAIN ] LEG: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:54:45.912760] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-15T19:54:45.961154] [DEBUG] [LOCAL ] LEG: Loaded 50183 existing records from primary storage. [2025-10-15T19:54:45.961452] [INFO ] [MAIN ] LEG: Loaded 50183 existing records. [2025-10-15T19:54:46.136455] [WARN ] [MAIN ] LEG: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:54:46.136709] [INFO ] [MAIN ] LEG: Wiping existing primary data before full refresh. [2025-10-15T19:54:46.136782] [INFO ] [LOCAL ] LEG: Starting deletion of primary data. [2025-10-15T19:54:46.137721] [DEBUG] [LOCAL ] LEG: Deleted primary data file. [2025-10-15T19:54:46.137914] [INFO ] [MAIN ] LEG: Starting full primary refresh. [2025-10-15T19:54:46.466390] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-15T19:54:46.529869] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-04. [2025-10-15T19:54:46.535507] [INFO ] [REMOTE ] LEG: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:54:46.569301] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-15T19:54:47.314064] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-05. [2025-10-15T19:54:48.026133] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-15T19:54:48.071383] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-15T19:54:48.113955] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-06. [2025-10-15T19:54:48.856396] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-15T19:54:48.913963] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-07. [2025-10-15T19:54:49.713976] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-05. [2025-10-15T19:54:49.850345] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-15T19:54:50.514076] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-05. [2025-10-15T19:54:51.314049] [INFO ] [REMOTE ] LEG: Fetching primary data for 2024-12. [2025-10-15T19:54:51.418129] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-15T19:54:52.083417] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-15T19:54:52.113948] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-06. [2025-10-15T19:54:52.728724] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-15T19:54:52.914026] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-06. [2025-10-15T19:54:53.645375] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-15T19:54:53.713981] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-07. [2025-10-15T19:54:54.514009] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-08. [2025-10-15T19:54:54.547084] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-15T19:54:55.276771] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-15T19:54:55.314028] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-08. [2025-10-15T19:54:55.386464] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-15T19:54:56.114021] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-07. [2025-10-15T19:54:56.775190] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-15T19:54:56.913964] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-09. [2025-10-15T19:54:57.714056] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-01. [2025-10-15T19:54:57.754601] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-15T19:54:58.190350] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-15T19:54:58.514028] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-10. [2025-10-15T19:54:59.321090] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-08. [2025-10-15T19:54:59.326449] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-15T19:54:59.968042] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-15T19:54:59.973054] [INFO ] [REMOTE ] LEA: Full fetch complete (60658 records). [2025-10-15T19:54:59.973159] [DEBUG] [VALIDATOR ] LEA: Validating primary data. [2025-10-15T19:55:00.120533] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-02. [2025-10-15T19:55:00.354897] [DEBUG] [VALIDATOR ] LEA: All expected trading days are present. [2025-10-15T19:55:00.354980] [DEBUG] [VALIDATOR ] LEA: Primary data validation passed. [2025-10-15T19:55:00.355897] [INFO ] [MAIN ] LEA: Fetched primary data is valid. [2025-10-15T19:55:00.355962] [DEBUG] [LOCAL ] LEA: Saving primary data. [2025-10-15T19:55:00.357170] [DEBUG] [LOCAL ] LEA: Trimmed 60658 records to 41359 (keeping 200 days of data) [2025-10-15T19:55:00.612357] [DEBUG] [LOCAL ] LEA: Primary data saved (41359 records). [2025-10-15T19:55:00.612484] [INFO ] [MAIN ] LEA: Full history saved. [2025-10-15T19:55:00.612849] [INFO ] [MAIN ] Update Progress: 1245/2369 symbols completed. LEA took 22.1s. Estimated remaining: 2h 37m 56s. Rate: 7.1 symbols/min [2025-10-15T19:55:00.783599] [INFO ] [MAIN ] LEN: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:55:00.836044] [DEBUG] [LOCAL ] LEN: Loaded 53192 existing records from primary storage. [2025-10-15T19:55:00.836375] [INFO ] [MAIN ] LEN: Loaded 53192 existing records. [2025-10-15T19:55:00.915126] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-09. [2025-10-15T19:55:01.018825] [WARN ] [MAIN ] LEN: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:55:01.019188] [INFO ] [MAIN ] LEN: Wiping existing primary data before full refresh. [2025-10-15T19:55:01.019267] [INFO ] [LOCAL ] LEN: Starting deletion of primary data. [2025-10-15T19:55:01.020478] [DEBUG] [LOCAL ] LEN: Deleted primary data file. [2025-10-15T19:55:01.020536] [INFO ] [MAIN ] LEN: Starting full primary refresh. [2025-10-15T19:55:01.204555] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-15T19:55:01.407343] [INFO ] [REMOTE ] LEN: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:55:01.714022] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-09. [2025-10-15T19:55:01.881057] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-15T19:55:02.131132] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-02 (2.01 seconds). [2025-10-15T19:55:02.514000] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-10. [2025-10-15T19:55:03.294108] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-15T19:55:03.296354] [INFO ] [REMOTE ] LDP: Full fetch complete (18986 records). [2025-10-15T19:55:03.296564] [DEBUG] [VALIDATOR ] LDP: Validating primary data. [2025-10-15T19:55:03.319120] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-03. [2025-10-15T19:55:03.627408] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-15T19:55:03.711126] [DEBUG] [VALIDATOR ] LDP: All expected trading days are present. [2025-10-15T19:55:03.711202] [DEBUG] [VALIDATOR ] LDP: Primary data validation passed. [2025-10-15T19:55:03.711585] [INFO ] [MAIN ] LDP: Fetched primary data is valid. [2025-10-15T19:55:03.711624] [DEBUG] [LOCAL ] LDP: Saving primary data. [2025-10-15T19:55:03.712187] [DEBUG] [LOCAL ] LDP: Trimmed 18986 records to 12815 (keeping 200 days of data) [2025-10-15T19:55:03.789916] [DEBUG] [LOCAL ] LDP: Primary data saved (12815 records). [2025-10-15T19:55:03.790053] [INFO ] [MAIN ] LDP: Full history saved. [2025-10-15T19:55:03.790137] [INFO ] [MAIN ] Update Progress: 1246/2369 symbols completed. LDP took 31.5s. Estimated remaining: 2h 37m 43s. Rate: 7.1 symbols/min [2025-10-15T19:55:03.959834] [INFO ] [MAIN ] LEO: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:55:03.975804] [DEBUG] [LOCAL ] LEO: Loaded 16716 existing records from primary storage. [2025-10-15T19:55:03.976015] [INFO ] [MAIN ] LEO: Loaded 16716 existing records. [2025-10-15T19:55:04.122356] [INFO ] [REMOTE ] LEN: Fetching primary data for 2024-12. [2025-10-15T19:55:04.165805] [WARN ] [MAIN ] LEO: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:55:04.166221] [INFO ] [MAIN ] LEO: Wiping existing primary data before full refresh. [2025-10-15T19:55:04.166278] [INFO ] [LOCAL ] LEO: Starting deletion of primary data. [2025-10-15T19:55:04.166741] [DEBUG] [LOCAL ] LEO: Deleted primary data file. [2025-10-15T19:55:04.166813] [INFO ] [MAIN ] LEO: Starting full primary refresh. [2025-10-15T19:55:04.530985] [INFO ] [REMOTE ] LEO: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:55:04.914001] [INFO ] [REMOTE ] LEO: Fetching primary data for 2024-12. [2025-10-15T19:55:05.135123] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-15T19:55:05.713997] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-10. [2025-10-15T19:55:05.745116] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-15T19:55:05.789961] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-15T19:55:06.514006] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-04. [2025-10-15T19:55:07.093792] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-15T19:55:07.102454] [INFO ] [REMOTE ] LDOS: Full fetch complete (67113 records). [2025-10-15T19:55:07.102598] [DEBUG] [VALIDATOR ] LDOS: Validating primary data. [2025-10-15T19:55:07.317201] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-01. [2025-10-15T19:55:07.541189] [DEBUG] [VALIDATOR ] LDOS: All expected trading days are present. [2025-10-15T19:55:07.541261] [DEBUG] [VALIDATOR ] LDOS: Primary data validation passed. [2025-10-15T19:55:07.542226] [INFO ] [MAIN ] LDOS: Fetched primary data is valid. [2025-10-15T19:55:07.542287] [DEBUG] [LOCAL ] LDOS: Saving primary data. [2025-10-15T19:55:07.543460] [DEBUG] [LOCAL ] LDOS: Trimmed 67113 records to 44998 (keeping 200 days of data) [2025-10-15T19:55:07.845523] [DEBUG] [LOCAL ] LDOS: Primary data saved (44998 records). [2025-10-15T19:55:07.845734] [INFO ] [MAIN ] LDOS: Full history saved. [2025-10-15T19:55:07.846877] [INFO ] [MAIN ] Update Progress: 1247/2369 symbols completed. LDOS took 36.9s. Estimated remaining: 2h 37m 30s. Rate: 7.1 symbols/min [2025-10-15T19:55:08.026576] [INFO ] [MAIN ] LEVI: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:55:08.059241] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-15T19:55:08.114161] [DEBUG] [LOCAL ] LEVI: Loaded 51765 existing records from primary storage. [2025-10-15T19:55:08.114266] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-01. [2025-10-15T19:55:08.115600] [INFO ] [MAIN ] LEVI: Loaded 51765 existing records. [2025-10-15T19:55:08.296698] [WARN ] [MAIN ] LEVI: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:55:08.296937] [INFO ] [MAIN ] LEVI: Wiping existing primary data before full refresh. [2025-10-15T19:55:08.297006] [INFO ] [LOCAL ] LEVI: Starting deletion of primary data. [2025-10-15T19:55:08.297975] [DEBUG] [LOCAL ] LEVI: Deleted primary data file. [2025-10-15T19:55:08.298037] [INFO ] [MAIN ] LEVI: Starting full primary refresh. [2025-10-15T19:55:08.474559] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-15T19:55:08.721510] [INFO ] [REMOTE ] LEVI: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:55:08.914053] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2024-12. [2025-10-15T19:55:09.714069] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-02. [2025-10-15T19:55:10.142741] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-01 (2.03 seconds). [2025-10-15T19:55:10.514011] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-05. [2025-10-15T19:55:10.781099] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-10-15T19:55:10.804898] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-15T19:55:11.314028] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-03. [2025-10-15T19:55:12.114030] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-01. [2025-10-15T19:55:12.192546] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-15T19:55:12.244016] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-15T19:55:12.914013] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-04. [2025-10-15T19:55:13.713979] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-02. [2025-10-15T19:55:13.787911] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-15T19:55:14.010367] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-15T19:55:14.514033] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-02. [2025-10-15T19:55:15.289351] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-15T19:55:15.313964] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-03. [2025-10-15T19:55:15.717158] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-15T19:55:16.114042] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-03. [2025-10-15T19:55:16.913973] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-05. [2025-10-15T19:55:17.304236] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-15T19:55:17.714083] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-04. [2025-10-15T19:55:17.811183] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-15T19:55:17.967036] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-15T19:55:18.514053] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-04. [2025-10-15T19:55:19.313987] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-06. [2025-10-15T19:55:19.383431] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-15T19:55:20.113973] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-05. [2025-10-15T19:55:20.283214] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-15T19:55:20.324694] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-15T19:55:20.913996] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-07. [2025-10-15T19:55:21.713976] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-06. [2025-10-15T19:55:21.910812] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-15T19:55:21.915612] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-15T19:55:22.514037] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-05. [2025-10-15T19:55:23.085423] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-15T19:55:23.314021] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-06. [2025-10-15T19:55:23.964515] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-15T19:55:24.113989] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-06. [2025-10-15T19:55:24.847833] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-15T19:55:24.913989] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-07. [2025-10-15T19:55:25.694427] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-15T19:55:25.713950] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-07. [2025-10-15T19:55:26.513978] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-07. [2025-10-15T19:55:26.593273] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-15T19:55:27.235063] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-15T19:55:27.314024] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-08. [2025-10-15T19:55:28.114027] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-08. [2025-10-15T19:55:28.261314] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-15T19:55:28.913999] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-08. [2025-10-15T19:55:28.958526] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-15T19:55:29.121244] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-15T19:55:29.714063] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-08. [2025-10-15T19:55:30.513982] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-09. [2025-10-15T19:55:30.693901] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-15T19:55:31.302881] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-15T19:55:31.313952] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-09. [2025-10-15T19:55:32.114004] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-09. [2025-10-15T19:55:32.225528] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-15T19:55:32.913995] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-10. [2025-10-15T19:55:32.951988] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-15T19:55:33.005084] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-15T19:55:33.714007] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-10. [2025-10-15T19:55:34.513990] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-10. [2025-10-15T19:55:34.866364] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-10 (1.95 seconds). [2025-10-15T19:55:34.877471] [INFO ] [REMOTE ] LEVI: Full fetch complete (74865 records). [2025-10-15T19:55:34.877954] [DEBUG] [VALIDATOR ] LEVI: Validating primary data. [2025-10-15T19:55:35.315528] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-09. [2025-10-15T19:55:35.435631] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-15T19:55:35.435943] [DEBUG] [VALIDATOR ] LEVI: All expected trading days are present. [2025-10-15T19:55:35.436359] [DEBUG] [VALIDATOR ] LEVI: Primary data validation passed. [2025-10-15T19:55:35.456148] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-15T19:55:35.455464] [INFO ] [MAIN ] LEVI: Fetched primary data is valid. [2025-10-15T19:55:35.460288] [INFO ] [REMOTE ] LEO: Full fetch complete (26591 records). [2025-10-15T19:55:35.460546] [DEBUG] [LOCAL ] LEVI: Saving primary data. [2025-10-15T19:55:35.460707] [DEBUG] [VALIDATOR ] LEO: Validating primary data. [2025-10-15T19:55:35.460113] [INFO ] [REMOTE ] LEG: Full fetch complete (73037 records). [2025-10-15T19:55:35.461150] [DEBUG] [VALIDATOR ] LEG: Validating primary data. [2025-10-15T19:55:35.638483] [DEBUG] [LOCAL ] LEVI: Trimmed 74865 records to 51780 (keeping 200 days of data) [2025-10-15T19:55:36.550615] [DEBUG] [VALIDATOR ] LEG: All expected trading days are present. [2025-10-15T19:55:36.559210] [DEBUG] [VALIDATOR ] LEG: Primary data validation passed. [2025-10-15T19:55:36.562008] [INFO ] [MAIN ] LEG: Fetched primary data is valid. [2025-10-15T19:55:36.562567] [DEBUG] [VALIDATOR ] LEO: All expected trading days are present. [2025-10-15T19:55:36.563557] [DEBUG] [LOCAL ] LEG: Saving primary data. [2025-10-15T19:55:36.563691] [DEBUG] [VALIDATOR ] LEO: Primary data validation passed. [2025-10-15T19:55:36.564559] [INFO ] [MAIN ] LEO: Fetched primary data is valid. [2025-10-15T19:55:36.565501] [DEBUG] [LOCAL ] LEO: Saving primary data. [2025-10-15T19:55:36.581097] [DEBUG] [LOCAL ] LEG: Trimmed 73037 records to 50170 (keeping 200 days of data) [2025-10-15T19:55:36.581548] [DEBUG] [LOCAL ] LEO: Trimmed 26591 records to 16652 (keeping 200 days of data) [2025-10-15T19:55:36.846810] [DEBUG] [LOCAL ] LEVI: Primary data saved (51780 records). [2025-10-15T19:55:36.847887] [INFO ] [MAIN ] LEVI: Full history saved. [2025-10-15T19:55:36.848941] [INFO ] [MAIN ] Update Progress: 1248/2369 symbols completed. LEVI took 29.0s. Estimated remaining: 2h 37m 41s. Rate: 7.1 symbols/min [2025-10-15T19:55:36.959153] [DEBUG] [LOCAL ] LEO: Primary data saved (16652 records). [2025-10-15T19:55:36.982589] [INFO ] [MAIN ] LEO: Full history saved. [2025-10-15T19:55:36.988270] [INFO ] [MAIN ] Update Progress: 1249/2369 symbols completed. LEO took 33.2s. Estimated remaining: 2h 37m 25s. Rate: 7.1 symbols/min [2025-10-15T19:55:37.224068] [INFO ] [MAIN ] LFT: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:55:37.371231] [DEBUG] [LOCAL ] LFT: Loaded 18370 existing records from primary storage. [2025-10-15T19:55:37.370572] [INFO ] [MAIN ] LGI: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:55:37.380509] [INFO ] [MAIN ] LFT: Loaded 18370 existing records. [2025-10-15T19:55:37.506166] [DEBUG] [LOCAL ] LGI: Loaded 10092 existing records from primary storage. [2025-10-15T19:55:37.524840] [INFO ] [MAIN ] LGI: Loaded 10092 existing records. [2025-10-15T19:55:37.637474] [WARN ] [MAIN ] LFT: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:55:37.764420] [INFO ] [MAIN ] LFT: Wiping existing primary data before full refresh. [2025-10-15T19:55:37.781373] [INFO ] [LOCAL ] LFT: Starting deletion of primary data. [2025-10-15T19:55:37.832197] [DEBUG] [LOCAL ] LFT: Deleted primary data file. [2025-10-15T19:55:37.857700] [INFO ] [MAIN ] LFT: Starting full primary refresh. [2025-10-15T19:55:37.865119] [WARN ] [MAIN ] LGI: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:55:37.874057] [INFO ] [MAIN ] LGI: Wiping existing primary data before full refresh. [2025-10-15T19:55:37.925612] [INFO ] [LOCAL ] LGI: Starting deletion of primary data. [2025-10-15T19:55:37.988804] [DEBUG] [LOCAL ] LGI: Deleted primary data file. [2025-10-15T19:55:37.989056] [INFO ] [MAIN ] LGI: Starting full primary refresh. [2025-10-15T19:55:37.983480] [DEBUG] [LOCAL ] LEG: Primary data saved (50170 records). [2025-10-15T19:55:38.016177] [INFO ] [MAIN ] LEG: Full history saved. [2025-10-15T19:55:38.162718] [INFO ] [MAIN ] Update Progress: 1250/2369 symbols completed. LEG took 52.5s. Estimated remaining: 2h 37m 10s. Rate: 7.1 symbols/min [2025-10-15T19:55:38.568384] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-09 (3.25 seconds). [2025-10-15T19:55:38.752949] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-10. [2025-10-15T19:55:38.824716] [INFO ] [REMOTE ] LFT: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:55:38.864232] [INFO ] [MAIN ] LH: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:55:38.898861] [INFO ] [REMOTE ] LFT: Fetching primary data for 2024-12. [2025-10-15T19:55:38.928335] [INFO ] [REMOTE ] LGI: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:55:38.930014] [INFO ] [REMOTE ] LGI: Fetching primary data for 2024-12. [2025-10-15T19:55:38.965634] [DEBUG] [LOCAL ] LH: Loaded 37606 existing records from primary storage. [2025-10-15T19:55:38.965950] [INFO ] [MAIN ] LH: Loaded 37606 existing records. [2025-10-15T19:55:39.142891] [WARN ] [MAIN ] LH: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:55:39.143150] [INFO ] [MAIN ] LH: Wiping existing primary data before full refresh. [2025-10-15T19:55:39.143214] [INFO ] [LOCAL ] LH: Starting deletion of primary data. [2025-10-15T19:55:39.143991] [DEBUG] [LOCAL ] LH: Deleted primary data file. [2025-10-15T19:55:39.144050] [INFO ] [MAIN ] LH: Starting full primary refresh. [2025-10-15T19:55:39.506331] [INFO ] [REMOTE ] LH: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:55:39.506682] [INFO ] [REMOTE ] LH: Fetching primary data for 2024-12. [2025-10-15T19:55:39.706340] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-10-15T19:55:39.709137] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-01. [2025-10-15T19:55:40.014885] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-15T19:55:40.114016] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-01. [2025-10-15T19:55:40.154242] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-10-15T19:55:40.663206] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-15T19:55:40.913978] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-02. [2025-10-15T19:55:41.044696] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-15T19:55:41.186821] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-10 (2.43 seconds). [2025-10-15T19:55:41.196532] [INFO ] [REMOTE ] LEN: Full fetch complete (77197 records). [2025-10-15T19:55:41.196733] [DEBUG] [VALIDATOR ] LEN: Validating primary data. [2025-10-15T19:55:41.521460] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-15T19:55:41.604876] [DEBUG] [VALIDATOR ] LEN: All expected trading days are present. [2025-10-15T19:55:41.604951] [DEBUG] [VALIDATOR ] LEN: Primary data validation passed. [2025-10-15T19:55:41.605974] [INFO ] [MAIN ] LEN: Fetched primary data is valid. [2025-10-15T19:55:41.606041] [DEBUG] [LOCAL ] LEN: Saving primary data. [2025-10-15T19:55:41.607393] [DEBUG] [LOCAL ] LEN: Trimmed 77197 records to 53195 (keeping 200 days of data) [2025-10-15T19:55:41.715146] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-01. [2025-10-15T19:55:41.946232] [DEBUG] [LOCAL ] LEN: Primary data saved (53195 records). [2025-10-15T19:55:41.946375] [INFO ] [MAIN ] LEN: Full history saved. [2025-10-15T19:55:41.947017] [INFO ] [MAIN ] Update Progress: 1251/2369 symbols completed. LEN took 41.3s. Estimated remaining: 2h 36m 57s. Rate: 7.1 symbols/min [2025-10-15T19:55:42.118546] [INFO ] [MAIN ] LHX: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:55:42.166942] [DEBUG] [LOCAL ] LHX: Loaded 48594 existing records from primary storage. [2025-10-15T19:55:42.167259] [INFO ] [MAIN ] LHX: Loaded 48594 existing records. [2025-10-15T19:55:42.343131] [WARN ] [MAIN ] LHX: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:55:42.343383] [INFO ] [MAIN ] LHX: Wiping existing primary data before full refresh. [2025-10-15T19:55:42.343432] [INFO ] [LOCAL ] LHX: Starting deletion of primary data. [2025-10-15T19:55:42.343997] [DEBUG] [LOCAL ] LHX: Deleted primary data file. [2025-10-15T19:55:42.344052] [INFO ] [MAIN ] LHX: Starting full primary refresh. [2025-10-15T19:55:42.519199] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-02. [2025-10-15T19:55:42.780471] [INFO ] [REMOTE ] LHX: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:55:42.979962] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-15T19:55:43.313973] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-03. [2025-10-15T19:55:43.465529] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-15T19:55:44.087276] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-15T19:55:44.113968] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-04. [2025-10-15T19:55:44.913977] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-02. [2025-10-15T19:55:45.134609] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-15T19:55:45.714037] [INFO ] [REMOTE ] LHX: Fetching primary data for 2024-12. [2025-10-15T19:55:46.409550] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-15T19:55:46.513955] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-03. [2025-10-15T19:55:46.976094] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-15T19:55:47.314011] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-05. [2025-10-15T19:55:48.036115] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-15T19:55:48.095984] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-15T19:55:48.113946] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-06. [2025-10-15T19:55:48.850374] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-15T19:55:48.913999] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-07. [2025-10-15T19:55:49.690667] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-15T19:55:49.713950] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-08. [2025-10-15T19:55:50.513966] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-04. [2025-10-15T19:55:50.607489] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-15T19:55:51.313997] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-01. [2025-10-15T19:55:51.982564] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-15T19:55:52.113993] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-05. [2025-10-15T19:55:52.913990] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-03. [2025-10-15T19:55:53.033177] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-15T19:55:53.714164] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-02. [2025-10-15T19:55:53.763379] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-15T19:55:53.772753] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-15T19:55:54.514019] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-09. [2025-10-15T19:55:55.104248] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-15T19:55:55.314022] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-10. [2025-10-15T19:55:55.482998] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-15T19:55:56.021476] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-15T19:55:56.023724] [INFO ] [REMOTE ] LGI: Full fetch complete (14525 records). [2025-10-15T19:55:56.023807] [DEBUG] [VALIDATOR ] LGI: Validating primary data. [2025-10-15T19:55:56.119154] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-04. [2025-10-15T19:55:56.409972] [DEBUG] [VALIDATOR ] LGI: All expected trading days are present. [2025-10-15T19:55:56.410072] [DEBUG] [VALIDATOR ] LGI: Primary data validation passed. [2025-10-15T19:55:56.410500] [INFO ] [MAIN ] LGI: Fetched primary data is valid. [2025-10-15T19:55:56.410543] [DEBUG] [LOCAL ] LGI: Saving primary data. [2025-10-15T19:55:56.411153] [DEBUG] [LOCAL ] LGI: Trimmed 14525 records to 10092 (keeping 200 days of data) [2025-10-15T19:55:56.475766] [DEBUG] [LOCAL ] LGI: Primary data saved (10092 records). [2025-10-15T19:55:56.475957] [INFO ] [MAIN ] LGI: Full history saved. [2025-10-15T19:55:56.476059] [INFO ] [MAIN ] Update Progress: 1252/2369 symbols completed. LGI took 19.5s. Estimated remaining: 2h 36m 54s. Rate: 7.1 symbols/min [2025-10-15T19:55:56.658766] [INFO ] [MAIN ] LII: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:55:56.686340] [DEBUG] [LOCAL ] LII: Loaded 27855 existing records from primary storage. [2025-10-15T19:55:56.686599] [INFO ] [MAIN ] LII: Loaded 27855 existing records. [2025-10-15T19:55:56.859322] [WARN ] [MAIN ] LII: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:55:56.859692] [INFO ] [MAIN ] LII: Wiping existing primary data before full refresh. [2025-10-15T19:55:56.859751] [INFO ] [LOCAL ] LII: Starting deletion of primary data. [2025-10-15T19:55:56.860076] [DEBUG] [LOCAL ] LII: Deleted primary data file. [2025-10-15T19:55:56.860134] [INFO ] [MAIN ] LII: Starting full primary refresh. [2025-10-15T19:55:56.921336] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-03. [2025-10-15T19:55:57.190277] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-15T19:55:57.258720] [INFO ] [REMOTE ] LII: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:55:57.714047] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-06. [2025-10-15T19:55:58.514027] [INFO ] [REMOTE ] LII: Fetching primary data for 2024-12. [2025-10-15T19:55:58.743362] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-15T19:55:59.199992] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-15T19:55:59.314063] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-05. [2025-10-15T19:55:59.674688] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-15T19:55:59.910928] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-15T19:56:00.114021] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-06. [2025-10-15T19:56:00.914020] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-07. [2025-10-15T19:56:01.252415] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-15T19:56:01.714038] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-01. [2025-10-15T19:56:02.523835] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-04. [2025-10-15T19:56:02.528003] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-15T19:56:02.863077] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-15T19:56:03.314025] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-02. [2025-10-15T19:56:04.113971] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-07. [2025-10-15T19:56:04.218324] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-15T19:56:04.326378] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-15T19:56:04.913993] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-05. [2025-10-15T19:56:05.225567] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-15T19:56:05.714004] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-03. [2025-10-15T19:56:06.514044] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-08. [2025-10-15T19:56:06.763284] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-15T19:56:07.078812] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-15T19:56:07.314033] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-04. [2025-10-15T19:56:07.584711] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-15T19:56:08.114018] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-08. [2025-10-15T19:56:08.716920] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-15T19:56:08.914002] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-09. [2025-10-15T19:56:09.183780] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-15T19:56:09.714000] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-05. [2025-10-15T19:56:10.339817] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-15T19:56:10.513972] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-06. [2025-10-15T19:56:11.010237] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-15T19:56:11.314095] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-10. [2025-10-15T19:56:12.113982] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-06. [2025-10-15T19:56:12.202159] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-15T19:56:12.685454] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-15T19:56:12.689897] [INFO ] [REMOTE ] LH: Full fetch complete (54961 records). [2025-10-15T19:56:12.690013] [DEBUG] [VALIDATOR ] LH: Validating primary data. [2025-10-15T19:56:12.919250] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-09. [2025-10-15T19:56:13.073477] [DEBUG] [VALIDATOR ] LH: All expected trading days are present. [2025-10-15T19:56:13.073571] [DEBUG] [VALIDATOR ] LH: Primary data validation passed. [2025-10-15T19:56:13.074462] [INFO ] [MAIN ] LH: Fetched primary data is valid. [2025-10-15T19:56:13.074564] [DEBUG] [LOCAL ] LH: Saving primary data. [2025-10-15T19:56:13.075807] [DEBUG] [LOCAL ] LH: Trimmed 54961 records to 37607 (keeping 200 days of data) [2025-10-15T19:56:13.293976] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-15T19:56:13.329065] [DEBUG] [LOCAL ] LH: Primary data saved (37607 records). [2025-10-15T19:56:13.329180] [INFO ] [MAIN ] LH: Full history saved. [2025-10-15T19:56:13.329250] [INFO ] [MAIN ] Update Progress: 1253/2369 symbols completed. LH took 35.1s. Estimated remaining: 2h 36m 53s. Rate: 7.1 symbols/min [2025-10-15T19:56:13.509211] [INFO ] [MAIN ] LION: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:56:13.552773] [DEBUG] [LOCAL ] LION: Loaded 46175 existing records from primary storage. [2025-10-15T19:56:13.553061] [INFO ] [MAIN ] LION: Loaded 46175 existing records. [2025-10-15T19:56:13.719835] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-07. [2025-10-15T19:56:13.733436] [WARN ] [MAIN ] LION: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:56:13.734444] [INFO ] [MAIN ] LION: Wiping existing primary data before full refresh. [2025-10-15T19:56:13.734520] [INFO ] [LOCAL ] LION: Starting deletion of primary data. [2025-10-15T19:56:13.735004] [DEBUG] [LOCAL ] LION: Deleted primary data file. [2025-10-15T19:56:13.735076] [INFO ] [MAIN ] LION: Starting full primary refresh. [2025-10-15T19:56:14.048818] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-15T19:56:14.112158] [INFO ] [REMOTE ] LION: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:56:14.514013] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-10. [2025-10-15T19:56:15.314007] [INFO ] [REMOTE ] LION: Fetching primary data for 2024-12. [2025-10-15T19:56:15.455347] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-15T19:56:15.457563] [INFO ] [REMOTE ] LFT: Full fetch complete (24071 records). [2025-10-15T19:56:15.457637] [DEBUG] [VALIDATOR ] LFT: Validating primary data. [2025-10-15T19:56:15.840743] [DEBUG] [VALIDATOR ] LFT: All expected trading days are present. [2025-10-15T19:56:15.840853] [DEBUG] [VALIDATOR ] LFT: Primary data validation passed. [2025-10-15T19:56:15.841434] [INFO ] [MAIN ] LFT: Fetched primary data is valid. [2025-10-15T19:56:15.841512] [DEBUG] [LOCAL ] LFT: Saving primary data. [2025-10-15T19:56:15.842490] [DEBUG] [LOCAL ] LFT: Trimmed 24071 records to 18357 (keeping 200 days of data) [2025-10-15T19:56:15.953025] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-07 (2.23 seconds). [2025-10-15T19:56:15.993590] [DEBUG] [LOCAL ] LFT: Primary data saved (18357 records). [2025-10-15T19:56:15.993779] [INFO ] [MAIN ] LFT: Full history saved. [2025-10-15T19:56:15.993893] [INFO ] [MAIN ] Update Progress: 1254/2369 symbols completed. LFT took 39.1s. Estimated remaining: 2h 36m 40s. Rate: 7.1 symbols/min [2025-10-15T19:56:16.119124] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-07. [2025-10-15T19:56:16.171917] [INFO ] [MAIN ] LITB: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:56:16.178344] [DEBUG] [LOCAL ] LITB: Loaded 4160 existing records from primary storage. [2025-10-15T19:56:16.178567] [INFO ] [MAIN ] LITB: Loaded 4160 existing records. [2025-10-15T19:56:16.369122] [WARN ] [MAIN ] LITB: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:56:16.369367] [INFO ] [MAIN ] LITB: Wiping existing primary data before full refresh. [2025-10-15T19:56:16.369419] [INFO ] [LOCAL ] LITB: Starting deletion of primary data. [2025-10-15T19:56:16.369567] [DEBUG] [LOCAL ] LITB: Deleted primary data file. [2025-10-15T19:56:16.369621] [INFO ] [MAIN ] LITB: Starting full primary refresh. [2025-10-15T19:56:16.537136] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-15T19:56:16.782231] [INFO ] [REMOTE ] LITB: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:56:16.914020] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-08. [2025-10-15T19:56:17.528897] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-15T19:56:17.714010] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-08. [2025-10-15T19:56:18.513972] [INFO ] [REMOTE ] LITB: Fetching primary data for 2024-12. [2025-10-15T19:56:18.640911] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-15T19:56:18.946487] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-15T19:56:18.974823] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2024-12 (0.46 seconds). [2025-10-15T19:56:19.313990] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-01. [2025-10-15T19:56:19.835902] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-10-15T19:56:20.114038] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-09. [2025-10-15T19:56:20.914061] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-09. [2025-10-15T19:56:21.401179] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-15T19:56:21.713993] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-02. [2025-10-15T19:56:22.072028] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-02 (0.36 seconds). [2025-10-15T19:56:22.308532] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-15T19:56:22.513989] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-10. [2025-10-15T19:56:23.313998] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-03. [2025-10-15T19:56:23.932565] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-15T19:56:24.096348] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-15T19:56:24.102236] [INFO ] [REMOTE ] LHX: Full fetch complete (70762 records). [2025-10-15T19:56:24.102381] [DEBUG] [VALIDATOR ] LHX: Validating primary data. [2025-10-15T19:56:24.123271] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-04. [2025-10-15T19:56:24.492338] [DEBUG] [VALIDATOR ] LHX: All expected trading days are present. [2025-10-15T19:56:24.492413] [DEBUG] [VALIDATOR ] LHX: Primary data validation passed. [2025-10-15T19:56:24.493404] [INFO ] [MAIN ] LHX: Fetched primary data is valid. [2025-10-15T19:56:24.493466] [DEBUG] [LOCAL ] LHX: Saving primary data. [2025-10-15T19:56:24.494853] [DEBUG] [LOCAL ] LHX: Trimmed 70762 records to 48604 (keeping 200 days of data) [2025-10-15T19:56:24.798770] [DEBUG] [LOCAL ] LHX: Primary data saved (48604 records). [2025-10-15T19:56:24.798915] [INFO ] [MAIN ] LHX: Full history saved. [2025-10-15T19:56:24.799238] [INFO ] [MAIN ] Update Progress: 1255/2369 symbols completed. LHX took 42.9s. Estimated remaining: 2h 36m 32s. Rate: 7.1 symbols/min [2025-10-15T19:56:24.919102] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-10. [2025-10-15T19:56:24.977546] [INFO ] [MAIN ] LLY: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:56:25.017868] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-15T19:56:25.040702] [DEBUG] [LOCAL ] LLY: Loaded 53265 existing records from primary storage. [2025-10-15T19:56:25.041080] [INFO ] [MAIN ] LLY: Loaded 53265 existing records. [2025-10-15T19:56:25.218402] [WARN ] [MAIN ] LLY: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:56:25.218611] [INFO ] [MAIN ] LLY: Wiping existing primary data before full refresh. [2025-10-15T19:56:25.218685] [INFO ] [LOCAL ] LLY: Starting deletion of primary data. [2025-10-15T19:56:25.219582] [DEBUG] [LOCAL ] LLY: Deleted primary data file. [2025-10-15T19:56:25.219669] [INFO ] [MAIN ] LLY: Starting full primary refresh. [2025-10-15T19:56:25.572737] [INFO ] [REMOTE ] LLY: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:56:25.713993] [INFO ] [REMOTE ] LLY: Fetching primary data for 2024-12. [2025-10-15T19:56:26.314505] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-15T19:56:26.318193] [INFO ] [REMOTE ] LII: Full fetch complete (41343 records). [2025-10-15T19:56:26.318331] [DEBUG] [VALIDATOR ] LII: Validating primary data. [2025-10-15T19:56:26.523996] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-05. [2025-10-15T19:56:26.784083] [DEBUG] [VALIDATOR ] LII: All expected trading days are present. [2025-10-15T19:56:26.784212] [DEBUG] [VALIDATOR ] LII: Primary data validation passed. [2025-10-15T19:56:26.785936] [INFO ] [MAIN ] LII: Fetched primary data is valid. [2025-10-15T19:56:26.786029] [DEBUG] [LOCAL ] LII: Saving primary data. [2025-10-15T19:56:26.787498] [DEBUG] [LOCAL ] LII: Trimmed 41343 records to 27767 (keeping 200 days of data) [2025-10-15T19:56:27.035412] [DEBUG] [LOCAL ] LII: Primary data saved (27767 records). [2025-10-15T19:56:27.035599] [INFO ] [MAIN ] LII: Full history saved. [2025-10-15T19:56:27.035746] [INFO ] [MAIN ] Update Progress: 1256/2369 symbols completed. LII took 30.6s. Estimated remaining: 2h 36m 18s. Rate: 7.1 symbols/min [2025-10-15T19:56:27.168084] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-15T19:56:27.296516] [INFO ] [MAIN ] LMND: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:56:27.328015] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-01. [2025-10-15T19:56:27.354318] [DEBUG] [LOCAL ] LMND: Loaded 52049 existing records from primary storage. [2025-10-15T19:56:27.354754] [INFO ] [MAIN ] LMND: Loaded 52049 existing records. [2025-10-15T19:56:27.573566] [WARN ] [MAIN ] LMND: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:56:27.573841] [INFO ] [MAIN ] LMND: Wiping existing primary data before full refresh. [2025-10-15T19:56:27.573894] [INFO ] [LOCAL ] LMND: Starting deletion of primary data. [2025-10-15T19:56:27.574998] [DEBUG] [LOCAL ] LMND: Deleted primary data file. [2025-10-15T19:56:27.575065] [INFO ] [MAIN ] LMND: Starting full primary refresh. [2025-10-15T19:56:27.971134] [INFO ] [REMOTE ] LMND: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:56:28.119120] [INFO ] [REMOTE ] LMND: Fetching primary data for 2024-12. [2025-10-15T19:56:28.139674] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2024-12 (2.43 seconds). [2025-10-15T19:56:28.410063] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-15T19:56:28.914021] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-02. [2025-10-15T19:56:29.713991] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-01. [2025-10-15T19:56:29.820500] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-15T19:56:29.933871] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-15T19:56:30.514023] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-06. [2025-10-15T19:56:30.951053] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-10-15T19:56:31.314013] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-07. [2025-10-15T19:56:31.698291] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-07 (0.38 seconds). [2025-10-15T19:56:32.108106] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-01 (2.39 seconds). [2025-10-15T19:56:32.118349] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-03. [2025-10-15T19:56:32.914013] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-08. [2025-10-15T19:56:33.039455] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-15T19:56:33.347266] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-10-15T19:56:33.714002] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-04. [2025-10-15T19:56:34.514023] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-02. [2025-10-15T19:56:34.960999] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-15T19:56:35.314007] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-09. [2025-10-15T19:56:35.892382] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-15T19:56:36.114040] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-10. [2025-10-15T19:56:36.629388] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-02 (2.12 seconds). [2025-10-15T19:56:36.697911] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-15T19:56:36.698907] [INFO ] [REMOTE ] LITB: Full fetch complete (5677 records). [2025-10-15T19:56:36.698975] [DEBUG] [VALIDATOR ] LITB: Validating primary data. [2025-10-15T19:56:36.919179] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-03. [2025-10-15T19:56:37.058897] [DEBUG] [VALIDATOR ] LITB: All expected trading days are present. [2025-10-15T19:56:37.059004] [DEBUG] [VALIDATOR ] LITB: Primary data validation passed. [2025-10-15T19:56:37.059172] [INFO ] [MAIN ] LITB: Fetched primary data is valid. [2025-10-15T19:56:37.059211] [DEBUG] [LOCAL ] LITB: Saving primary data. [2025-10-15T19:56:37.059570] [DEBUG] [LOCAL ] LITB: Trimmed 5677 records to 4146 (keeping 200 days of data) [2025-10-15T19:56:37.082661] [DEBUG] [LOCAL ] LITB: Primary data saved (4146 records). [2025-10-15T19:56:37.082768] [INFO ] [MAIN ] LITB: Full history saved. [2025-10-15T19:56:37.082844] [INFO ] [MAIN ] Update Progress: 1257/2369 symbols completed. LITB took 21.1s. Estimated remaining: 2h 36m 11s. Rate: 7.1 symbols/min [2025-10-15T19:56:37.246309] [INFO ] [MAIN ] LMT: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:56:37.246490] [DEBUG] [LOCAL ] LMT: No existing data file found in primary storage. [2025-10-15T19:56:37.246526] [WARN ] [MAIN ] LMT: No existing data found, performing full refresh instead. [2025-10-15T19:56:37.246633] [INFO ] [MAIN ] LMT: Wiping existing primary data before full refresh. [2025-10-15T19:56:37.246710] [INFO ] [LOCAL ] LMT: Starting deletion of primary data. [2025-10-15T19:56:37.246768] [DEBUG] [LOCAL ] LMT: No primary data file found to delete. [2025-10-15T19:56:37.246801] [INFO ] [MAIN ] LMT: Starting full primary refresh. [2025-10-15T19:56:37.594384] [INFO ] [REMOTE ] LMT: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:56:37.713981] [INFO ] [REMOTE ] LMT: Fetching primary data for 2024-12. [2025-10-15T19:56:38.514027] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-01. [2025-10-15T19:56:39.314103] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-05. [2025-10-15T19:56:39.354224] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-03 (2.44 seconds). [2025-10-15T19:56:39.679202] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-10-15T19:56:40.113960] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-01. [2025-10-15T19:56:40.310414] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-15T19:56:40.763844] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-15T19:56:40.913998] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-06. [2025-10-15T19:56:41.714033] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-02. [2025-10-15T19:56:42.215275] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-01 (2.10 seconds). [2025-10-15T19:56:42.346951] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-15T19:56:42.513988] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-04. [2025-10-15T19:56:43.314065] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-07. [2025-10-15T19:56:43.555390] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-15T19:56:44.113990] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-02. [2025-10-15T19:56:44.769131] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-15T19:56:44.913963] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-03. [2025-10-15T19:56:45.091004] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-04 (2.58 seconds). [2025-10-15T19:56:45.713994] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-05. [2025-10-15T19:56:46.161150] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-02 (2.05 seconds). [2025-10-15T19:56:46.514021] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-03. [2025-10-15T19:56:46.772746] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-15T19:56:47.314062] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-08. [2025-10-15T19:56:48.114028] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-04. [2025-10-15T19:56:48.313749] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-05 (2.60 seconds). [2025-10-15T19:56:48.606728] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-10-15T19:56:48.913975] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-06. [2025-10-15T19:56:49.063381] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-15T19:56:49.714010] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-04. [2025-10-15T19:56:49.969552] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-15T19:56:50.513988] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-05. [2025-10-15T19:56:51.303474] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-06 (2.39 seconds). [2025-10-15T19:56:51.314052] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-07. [2025-10-15T19:56:51.607246] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-15T19:56:52.114448] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-09. [2025-10-15T19:56:52.114356] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-15T19:56:52.914031] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-06. [2025-10-15T19:56:53.716160] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-05. [2025-10-15T19:56:53.716078] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-15T19:56:53.741094] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-07 (2.43 seconds). [2025-10-15T19:56:54.513959] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-10. [2025-10-15T19:56:54.595538] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-15T19:56:55.314030] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-07. [2025-10-15T19:56:55.676427] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-15T19:56:56.114042] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-08. [2025-10-15T19:56:56.143244] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-15T19:56:56.149403] [INFO ] [REMOTE ] LION: Full fetch complete (57108 records). [2025-10-15T19:56:56.149524] [DEBUG] [VALIDATOR ] LION: Validating primary data. [2025-10-15T19:56:56.528354] [DEBUG] [VALIDATOR ] LION: All expected trading days are present. [2025-10-15T19:56:56.528442] [DEBUG] [VALIDATOR ] LION: Primary data validation passed. [2025-10-15T19:56:56.529361] [INFO ] [MAIN ] LION: Fetched primary data is valid. [2025-10-15T19:56:56.529423] [DEBUG] [LOCAL ] LION: Saving primary data. [2025-10-15T19:56:56.530614] [DEBUG] [LOCAL ] LION: Trimmed 57108 records to 46349 (keeping 200 days of data) [2025-10-15T19:56:56.786803] [DEBUG] [LOCAL ] LION: Primary data saved (46349 records). [2025-10-15T19:56:56.786976] [INFO ] [MAIN ] LION: Full history saved. [2025-10-15T19:56:56.787086] [INFO ] [MAIN ] Update Progress: 1258/2369 symbols completed. LION took 43.5s. Estimated remaining: 2h 36m 12s. Rate: 7.1 symbols/min [2025-10-15T19:56:56.919130] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-06. [2025-10-15T19:56:56.965199] [INFO ] [MAIN ] LNC: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:56:57.015509] [DEBUG] [LOCAL ] LNC: Loaded 51593 existing records from primary storage. [2025-10-15T19:56:57.015967] [INFO ] [MAIN ] LNC: Loaded 51593 existing records. [2025-10-15T19:56:57.231729] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-15T19:56:57.235911] [WARN ] [MAIN ] LNC: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:56:57.247068] [INFO ] [MAIN ] LNC: Wiping existing primary data before full refresh. [2025-10-15T19:56:57.247441] [INFO ] [LOCAL ] LNC: Starting deletion of primary data. [2025-10-15T19:56:57.248785] [DEBUG] [LOCAL ] LNC: Deleted primary data file. [2025-10-15T19:56:57.248849] [INFO ] [MAIN ] LNC: Starting full primary refresh. [2025-10-15T19:56:57.597358] [INFO ] [REMOTE ] LNC: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:56:57.713978] [INFO ] [REMOTE ] LNC: Fetching primary data for 2024-12. [2025-10-15T19:56:58.514031] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-08. [2025-10-15T19:56:58.701477] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-08 (2.59 seconds). [2025-10-15T19:56:59.113622] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-06 (2.19 seconds). [2025-10-15T19:56:59.313968] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-09. [2025-10-15T19:56:59.360456] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-15T19:57:00.113992] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-01. [2025-10-15T19:57:00.473964] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-10-15T19:57:00.913993] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-07. [2025-10-15T19:57:01.596615] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-15T19:57:01.713962] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-02. [2025-10-15T19:57:01.985200] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-09 (2.67 seconds). [2025-10-15T19:57:02.514044] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-09. [2025-10-15T19:57:03.028071] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-10-15T19:57:03.319080] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-08. [2025-10-15T19:57:03.325334] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-15T19:57:04.113987] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-03. [2025-10-15T19:57:04.676700] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-09 (2.16 seconds). [2025-10-15T19:57:04.913988] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-10. [2025-10-15T19:57:05.545039] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-08 (2.23 seconds). [2025-10-15T19:57:05.714045] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-10. [2025-10-15T19:57:05.839735] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-15T19:57:05.868810] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-15T19:57:05.875298] [INFO ] [REMOTE ] LLY: Full fetch complete (77258 records). [2025-10-15T19:57:05.875452] [DEBUG] [VALIDATOR ] LLY: Validating primary data. [2025-10-15T19:57:06.257974] [DEBUG] [VALIDATOR ] LLY: All expected trading days are present. [2025-10-15T19:57:06.258057] [DEBUG] [VALIDATOR ] LLY: Primary data validation passed. [2025-10-15T19:57:06.259104] [INFO ] [MAIN ] LLY: Fetched primary data is valid. [2025-10-15T19:57:06.259168] [DEBUG] [LOCAL ] LLY: Saving primary data. [2025-10-15T19:57:06.260574] [DEBUG] [LOCAL ] LLY: Trimmed 77258 records to 53261 (keeping 200 days of data) [2025-10-15T19:57:06.539766] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-04. [2025-10-15T19:57:06.588411] [DEBUG] [LOCAL ] LLY: Primary data saved (53261 records). [2025-10-15T19:57:06.588511] [INFO ] [MAIN ] LLY: Full history saved. [2025-10-15T19:57:06.588993] [INFO ] [MAIN ] Update Progress: 1259/2369 symbols completed. LLY took 41.8s. Estimated remaining: 2h 36m 5s. Rate: 7.1 symbols/min [2025-10-15T19:57:06.754270] [INFO ] [MAIN ] LND: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:57:06.761955] [DEBUG] [LOCAL ] LND: Loaded 4953 existing records from primary storage. [2025-10-15T19:57:06.762164] [INFO ] [MAIN ] LND: Loaded 4953 existing records. [2025-10-15T19:57:06.939084] [WARN ] [MAIN ] LND: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:57:06.939306] [INFO ] [MAIN ] LND: Wiping existing primary data before full refresh. [2025-10-15T19:57:06.939389] [INFO ] [LOCAL ] LND: Starting deletion of primary data. [2025-10-15T19:57:06.939686] [DEBUG] [LOCAL ] LND: Deleted primary data file. [2025-10-15T19:57:06.939754] [INFO ] [MAIN ] LND: Starting full primary refresh. [2025-10-15T19:57:07.286565] [INFO ] [REMOTE ] LND: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:57:07.313951] [INFO ] [REMOTE ] LND: Fetching primary data for 2024-12. [2025-10-15T19:57:07.892618] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-10 (2.18 seconds). [2025-10-15T19:57:07.898893] [INFO ] [REMOTE ] LMND: Full fetch complete (75460 records). [2025-10-15T19:57:07.899000] [DEBUG] [VALIDATOR ] LMND: Validating primary data. [2025-10-15T19:57:08.121166] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-09. [2025-10-15T19:57:08.197668] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-15T19:57:08.308164] [DEBUG] [VALIDATOR ] LMND: All expected trading days are present. [2025-10-15T19:57:08.308267] [DEBUG] [VALIDATOR ] LMND: Primary data validation passed. [2025-10-15T19:57:08.309384] [INFO ] [MAIN ] LMND: Fetched primary data is valid. [2025-10-15T19:57:08.309484] [DEBUG] [LOCAL ] LMND: Saving primary data. [2025-10-15T19:57:08.311078] [DEBUG] [LOCAL ] LMND: Trimmed 75460 records to 52062 (keeping 200 days of data) [2025-10-15T19:57:08.426787] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-15T19:57:08.652312] [DEBUG] [LOCAL ] LMND: Primary data saved (52062 records). [2025-10-15T19:57:08.652468] [INFO ] [MAIN ] LMND: Full history saved. [2025-10-15T19:57:08.653393] [INFO ] [MAIN ] Update Progress: 1260/2369 symbols completed. LMND took 41.6s. Estimated remaining: 2h 35m 51s. Rate: 7.1 symbols/min [2025-10-15T19:57:08.817575] [INFO ] [MAIN ] LNG: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:57:08.868706] [DEBUG] [LOCAL ] LNG: Loaded 51269 existing records from primary storage. [2025-10-15T19:57:08.869015] [INFO ] [MAIN ] LNG: Loaded 51269 existing records. [2025-10-15T19:57:08.922017] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-05. [2025-10-15T19:57:09.049191] [WARN ] [MAIN ] LNG: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:57:09.049425] [INFO ] [MAIN ] LNG: Wiping existing primary data before full refresh. [2025-10-15T19:57:09.049471] [INFO ] [LOCAL ] LNG: Starting deletion of primary data. [2025-10-15T19:57:09.050370] [DEBUG] [LOCAL ] LNG: Deleted primary data file. [2025-10-15T19:57:09.050426] [INFO ] [MAIN ] LNG: Starting full primary refresh. [2025-10-15T19:57:09.394558] [INFO ] [REMOTE ] LNG: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:57:09.714017] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-01. [2025-10-15T19:57:10.064089] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-10-15T19:57:10.333598] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-15T19:57:10.513985] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-10. [2025-10-15T19:57:10.694256] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-15T19:57:11.314039] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-06. [2025-10-15T19:57:12.114019] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-02. [2025-10-15T19:57:12.618753] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-10-15T19:57:12.618491] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-15T19:57:12.647234] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-10 (2.13 seconds). [2025-10-15T19:57:12.653125] [INFO ] [REMOTE ] LMT: Full fetch complete (72446 records). [2025-10-15T19:57:12.653258] [DEBUG] [VALIDATOR ] LMT: Validating primary data. [2025-10-15T19:57:12.919161] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-07. [2025-10-15T19:57:13.041543] [DEBUG] [VALIDATOR ] LMT: All expected trading days are present. [2025-10-15T19:57:13.041618] [DEBUG] [VALIDATOR ] LMT: Primary data validation passed. [2025-10-15T19:57:13.042635] [INFO ] [MAIN ] LMT: Fetched primary data is valid. [2025-10-15T19:57:13.042719] [DEBUG] [LOCAL ] LMT: Saving primary data. [2025-10-15T19:57:13.044059] [DEBUG] [LOCAL ] LMT: Trimmed 72446 records to 49623 (keeping 200 days of data) [2025-10-15T19:57:13.351224] [DEBUG] [LOCAL ] LMT: Primary data saved (49623 records). [2025-10-15T19:57:13.351353] [INFO ] [MAIN ] LMT: Full history saved. [2025-10-15T19:57:13.351427] [INFO ] [MAIN ] Update Progress: 1261/2369 symbols completed. LMT took 36.3s. Estimated remaining: 2h 35m 39s. Rate: 7.1 symbols/min [2025-10-15T19:57:13.521983] [INFO ] [MAIN ] LNN: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:57:13.533873] [DEBUG] [LOCAL ] LNN: Loaded 11373 existing records from primary storage. [2025-10-15T19:57:13.534100] [INFO ] [MAIN ] LNN: Loaded 11373 existing records. [2025-10-15T19:57:13.717853] [WARN ] [MAIN ] LNN: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:57:13.714669] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-03. [2025-10-15T19:57:13.718846] [INFO ] [MAIN ] LNN: Wiping existing primary data before full refresh. [2025-10-15T19:57:13.718929] [INFO ] [LOCAL ] LNN: Starting deletion of primary data. [2025-10-15T19:57:13.719246] [DEBUG] [LOCAL ] LNN: Deleted primary data file. [2025-10-15T19:57:13.719301] [INFO ] [MAIN ] LNN: Starting full primary refresh. [2025-10-15T19:57:14.077986] [INFO ] [REMOTE ] LNN: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:57:14.421062] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-15T19:57:14.514018] [INFO ] [REMOTE ] LNG: Fetching primary data for 2024-12. [2025-10-15T19:57:14.736281] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-15T19:57:15.313988] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-08. [2025-10-15T19:57:16.114021] [INFO ] [REMOTE ] LNN: Fetching primary data for 2024-12. [2025-10-15T19:57:16.272527] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-15T19:57:16.605064] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2024-12 (0.49 seconds). [2025-10-15T19:57:16.913973] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-01. [2025-10-15T19:57:17.083117] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-15T19:57:17.714010] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-09. [2025-10-15T19:57:18.514052] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-04. [2025-10-15T19:57:19.035866] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-15T19:57:19.120049] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-01 (2.21 seconds). [2025-10-15T19:57:19.165493] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-10-15T19:57:19.314039] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-10. [2025-10-15T19:57:20.114076] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-01. [2025-10-15T19:57:20.914002] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-02. [2025-10-15T19:57:20.980033] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-15T19:57:21.175447] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-10 (1.86 seconds). [2025-10-15T19:57:21.184344] [INFO ] [REMOTE ] LNC: Full fetch complete (74510 records). [2025-10-15T19:57:21.184513] [DEBUG] [VALIDATOR ] LNC: Validating primary data. [2025-10-15T19:57:21.578152] [DEBUG] [VALIDATOR ] LNC: All expected trading days are present. [2025-10-15T19:57:21.578233] [DEBUG] [VALIDATOR ] LNC: Primary data validation passed. [2025-10-15T19:57:21.579274] [INFO ] [MAIN ] LNC: Fetched primary data is valid. [2025-10-15T19:57:21.579339] [DEBUG] [LOCAL ] LNC: Saving primary data. [2025-10-15T19:57:21.580785] [DEBUG] [LOCAL ] LNC: Trimmed 74510 records to 51556 (keeping 200 days of data) [2025-10-15T19:57:21.761763] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-05. [2025-10-15T19:57:21.906933] [DEBUG] [LOCAL ] LNC: Primary data saved (51556 records). [2025-10-15T19:57:21.907100] [INFO ] [MAIN ] LNC: Full history saved. [2025-10-15T19:57:21.907188] [INFO ] [MAIN ] Update Progress: 1262/2369 symbols completed. LNC took 25.1s. Estimated remaining: 2h 35m 31s. Rate: 7.1 symbols/min [2025-10-15T19:57:22.073374] [INFO ] [MAIN ] LOAR: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:57:22.110164] [DEBUG] [LOCAL ] LOAR: Loaded 42212 existing records from primary storage. [2025-10-15T19:57:22.110435] [INFO ] [MAIN ] LOAR: Loaded 42212 existing records. [2025-10-15T19:57:22.290143] [WARN ] [MAIN ] LOAR: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:57:22.290410] [INFO ] [MAIN ] LOAR: Wiping existing primary data before full refresh. [2025-10-15T19:57:22.290459] [INFO ] [LOCAL ] LOAR: Starting deletion of primary data. [2025-10-15T19:57:22.291139] [DEBUG] [LOCAL ] LOAR: Deleted primary data file. [2025-10-15T19:57:22.291196] [INFO ] [MAIN ] LOAR: Starting full primary refresh. [2025-10-15T19:57:22.398805] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-15T19:57:22.519076] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-02. [2025-10-15T19:57:22.668510] [INFO ] [REMOTE ] LOAR: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:57:22.706244] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-15T19:57:23.313975] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2024-12. [2025-10-15T19:57:23.387733] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-15T19:57:24.114009] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-03. [2025-10-15T19:57:24.617476] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-15T19:57:24.753341] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-15T19:57:24.913994] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-01. [2025-10-15T19:57:25.713973] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-06. [2025-10-15T19:57:25.954787] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-15T19:57:26.302865] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-15T19:57:26.514005] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-07. [2025-10-15T19:57:27.015901] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-10-15T19:57:27.314048] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-02. [2025-10-15T19:57:28.114094] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-08. [2025-10-15T19:57:28.584716] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-10-15T19:57:28.608562] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-15T19:57:28.914014] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-03. [2025-10-15T19:57:29.714060] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-03. [2025-10-15T19:57:30.307029] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-15T19:57:30.514025] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-04. [2025-10-15T19:57:31.313978] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-04. [2025-10-15T19:57:31.456232] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-15T19:57:31.546012] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-15T19:57:32.114018] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-04. [2025-10-15T19:57:32.871873] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-15T19:57:32.914037] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-05. [2025-10-15T19:57:33.714032] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-05. [2025-10-15T19:57:33.927252] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-15T19:57:34.513998] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-05. [2025-10-15T19:57:34.615742] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-15T19:57:34.663602] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-15T19:57:35.314000] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-06. [2025-10-15T19:57:36.113961] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-09. [2025-10-15T19:57:36.187675] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-15T19:57:36.383343] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-15T19:57:36.459565] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-09 (0.35 seconds). [2025-10-15T19:57:36.914063] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-06. [2025-10-15T19:57:37.714039] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-10. [2025-10-15T19:57:38.269544] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-15T19:57:38.296536] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-15T19:57:38.297852] [INFO ] [REMOTE ] LND: Full fetch complete (7980 records). [2025-10-15T19:57:38.297948] [DEBUG] [VALIDATOR ] LND: Validating primary data. [2025-10-15T19:57:38.519091] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-06. [2025-10-15T19:57:38.654293] [DEBUG] [VALIDATOR ] LND: All expected trading days are present. [2025-10-15T19:57:38.654364] [DEBUG] [VALIDATOR ] LND: Primary data validation passed. [2025-10-15T19:57:38.654550] [INFO ] [MAIN ] LND: Fetched primary data is valid. [2025-10-15T19:57:38.654587] [DEBUG] [LOCAL ] LND: Saving primary data. [2025-10-15T19:57:38.654988] [DEBUG] [LOCAL ] LND: Trimmed 7980 records to 4972 (keeping 200 days of data) [2025-10-15T19:57:38.681554] [DEBUG] [LOCAL ] LND: Primary data saved (4972 records). [2025-10-15T19:57:38.681625] [INFO ] [MAIN ] LND: Full history saved. [2025-10-15T19:57:38.681729] [INFO ] [MAIN ] Update Progress: 1263/2369 symbols completed. LND took 32.1s. Estimated remaining: 2h 35m 30s. Rate: 7.1 symbols/min [2025-10-15T19:57:38.845105] [INFO ] [MAIN ] LOB: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:57:38.871703] [DEBUG] [LOCAL ] LOB: Loaded 26746 existing records from primary storage. [2025-10-15T19:57:38.871949] [INFO ] [MAIN ] LOB: Loaded 26746 existing records. [2025-10-15T19:57:39.051168] [WARN ] [MAIN ] LOB: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:57:39.051361] [INFO ] [MAIN ] LOB: Wiping existing primary data before full refresh. [2025-10-15T19:57:39.051409] [INFO ] [LOCAL ] LOB: Starting deletion of primary data. [2025-10-15T19:57:39.051963] [DEBUG] [LOCAL ] LOB: Deleted primary data file. [2025-10-15T19:57:39.052021] [INFO ] [MAIN ] LOB: Starting full primary refresh. [2025-10-15T19:57:39.319149] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-07. [2025-10-15T19:57:39.458194] [INFO ] [REMOTE ] LOB: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:57:40.114003] [INFO ] [REMOTE ] LOB: Fetching primary data for 2024-12. [2025-10-15T19:57:40.531939] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-10-15T19:57:40.886451] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-15T19:57:40.913975] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-08. [2025-10-15T19:57:41.098050] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-10-15T19:57:41.714011] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-07. [2025-10-15T19:57:42.263857] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-15T19:57:42.514010] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-09. [2025-10-15T19:57:43.313981] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-01. [2025-10-15T19:57:43.730561] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-15T19:57:43.768332] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-15T19:57:44.052919] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-15T19:57:44.113966] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-07. [2025-10-15T19:57:44.914036] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-02. [2025-10-15T19:57:45.030349] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-15T19:57:45.619111] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-15T19:57:45.714059] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-10. [2025-10-15T19:57:46.513998] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-03. [2025-10-15T19:57:47.067287] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-15T19:57:47.072313] [INFO ] [REMOTE ] LOAR: Full fetch complete (56057 records). [2025-10-15T19:57:47.072427] [DEBUG] [VALIDATOR ] LOAR: Validating primary data. [2025-10-15T19:57:47.322451] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-08. [2025-10-15T19:57:47.509883] [DEBUG] [VALIDATOR ] LOAR: All expected trading days are present. [2025-10-15T19:57:47.510059] [DEBUG] [VALIDATOR ] LOAR: Primary data validation passed. [2025-10-15T19:57:47.510981] [INFO ] [MAIN ] LOAR: Fetched primary data is valid. [2025-10-15T19:57:47.511090] [DEBUG] [LOCAL ] LOAR: Saving primary data. [2025-10-15T19:57:47.530605] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-15T19:57:47.538507] [DEBUG] [LOCAL ] LOAR: Trimmed 56057 records to 42140 (keeping 200 days of data) [2025-10-15T19:57:47.787668] [DEBUG] [LOCAL ] LOAR: Primary data saved (42140 records). [2025-10-15T19:57:47.787820] [INFO ] [MAIN ] LOAR: Full history saved. [2025-10-15T19:57:47.787907] [INFO ] [MAIN ] Update Progress: 1264/2369 symbols completed. LOAR took 25.9s. Estimated remaining: 2h 35m 22s. Rate: 7.1 symbols/min [2025-10-15T19:57:47.960365] [INFO ] [MAIN ] LOCL: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:57:47.965329] [DEBUG] [LOCAL ] LOCL: Loaded 3701 existing records from primary storage. [2025-10-15T19:57:47.965482] [INFO ] [MAIN ] LOCL: Loaded 3701 existing records. [2025-10-15T19:57:48.120750] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-04. [2025-10-15T19:57:48.150219] [WARN ] [MAIN ] LOCL: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:57:48.150431] [INFO ] [MAIN ] LOCL: Wiping existing primary data before full refresh. [2025-10-15T19:57:48.150478] [INFO ] [LOCAL ] LOCL: Starting deletion of primary data. [2025-10-15T19:57:48.150711] [DEBUG] [LOCAL ] LOCL: Deleted primary data file. [2025-10-15T19:57:48.150768] [INFO ] [MAIN ] LOCL: Starting full primary refresh. [2025-10-15T19:57:48.501707] [INFO ] [REMOTE ] LOCL: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:57:48.919113] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2024-12. [2025-10-15T19:57:48.941538] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-15T19:57:49.562038] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-10-15T19:57:49.673604] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-15T19:57:49.713965] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-05. [2025-10-15T19:57:50.514017] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-01. [2025-10-15T19:57:50.796717] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-15T19:57:50.881519] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-01 (0.37 seconds). [2025-10-15T19:57:51.314037] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-02. [2025-10-15T19:57:51.655062] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-10-15T19:57:52.114023] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-08. [2025-10-15T19:57:52.911049] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-15T19:57:52.914046] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-06. [2025-10-15T19:57:53.713980] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-09. [2025-10-15T19:57:54.020217] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-15T19:57:54.496959] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-15T19:57:54.513957] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-10. [2025-10-15T19:57:55.313998] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-03. [2025-10-15T19:57:55.377855] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-15T19:57:55.379586] [INFO ] [REMOTE ] LNN: Full fetch complete (15697 records). [2025-10-15T19:57:55.379692] [DEBUG] [VALIDATOR ] LNN: Validating primary data. [2025-10-15T19:57:55.745407] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-10-15T19:57:55.745716] [DEBUG] [VALIDATOR ] LNN: All expected trading days are present. [2025-10-15T19:57:55.747051] [DEBUG] [VALIDATOR ] LNN: Primary data validation passed. [2025-10-15T19:57:55.747626] [INFO ] [MAIN ] LNN: Fetched primary data is valid. [2025-10-15T19:57:55.747718] [DEBUG] [LOCAL ] LNN: Saving primary data. [2025-10-15T19:57:55.748290] [DEBUG] [LOCAL ] LNN: Trimmed 15697 records to 11430 (keeping 200 days of data) [2025-10-15T19:57:55.821303] [DEBUG] [LOCAL ] LNN: Primary data saved (11430 records). [2025-10-15T19:57:55.821459] [INFO ] [MAIN ] LNN: Full history saved. [2025-10-15T19:57:55.821544] [INFO ] [MAIN ] Update Progress: 1265/2369 symbols completed. LNN took 42.5s. Estimated remaining: 2h 35m 13s. Rate: 7.1 symbols/min [2025-10-15T19:57:55.987950] [INFO ] [MAIN ] LOMA: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:57:56.017282] [DEBUG] [LOCAL ] LOMA: Loaded 32605 existing records from primary storage. [2025-10-15T19:57:56.017540] [INFO ] [MAIN ] LOMA: Loaded 32605 existing records. [2025-10-15T19:57:56.115225] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-09. [2025-10-15T19:57:56.201967] [WARN ] [MAIN ] LOMA: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:57:56.202144] [INFO ] [MAIN ] LOMA: Wiping existing primary data before full refresh. [2025-10-15T19:57:56.202196] [INFO ] [LOCAL ] LOMA: Starting deletion of primary data. [2025-10-15T19:57:56.202794] [DEBUG] [LOCAL ] LOMA: Deleted primary data file. [2025-10-15T19:57:56.202850] [INFO ] [MAIN ] LOMA: Starting full primary refresh. [2025-10-15T19:57:56.547751] [INFO ] [REMOTE ] LOMA: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:57:56.914000] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-07. [2025-10-15T19:57:57.713975] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-04. [2025-10-15T19:57:57.826807] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-15T19:57:57.854836] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-15T19:57:58.477961] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-15T19:57:58.513985] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-08. [2025-10-15T19:57:59.313993] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2024-12. [2025-10-15T19:57:59.586768] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-15T19:58:00.113998] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-09. [2025-10-15T19:58:00.488543] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-15T19:58:00.914002] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-01. [2025-10-15T19:58:01.407566] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-15T19:58:01.714001] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-05. [2025-10-15T19:58:02.332699] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-15T19:58:02.364795] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-15T19:58:02.514005] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-06. [2025-10-15T19:58:02.954676] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-10-15T19:58:03.313977] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-10. [2025-10-15T19:58:04.114000] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-07. [2025-10-15T19:58:04.154632] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-15T19:58:04.160683] [INFO ] [REMOTE ] LNG: Full fetch complete (74748 records). [2025-10-15T19:58:04.160869] [DEBUG] [VALIDATOR ] LNG: Validating primary data. [2025-10-15T19:58:04.553384] [DEBUG] [VALIDATOR ] LNG: All expected trading days are present. [2025-10-15T19:58:04.553475] [DEBUG] [VALIDATOR ] LNG: Primary data validation passed. [2025-10-15T19:58:04.554578] [INFO ] [MAIN ] LNG: Fetched primary data is valid. [2025-10-15T19:58:04.554677] [DEBUG] [LOCAL ] LNG: Saving primary data. [2025-10-15T19:58:04.556152] [DEBUG] [LOCAL ] LNG: Trimmed 74748 records to 51216 (keeping 200 days of data) [2025-10-15T19:58:04.688353] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-15T19:58:04.889219] [DEBUG] [LOCAL ] LNG: Primary data saved (51216 records). [2025-10-15T19:58:04.889371] [INFO ] [MAIN ] LNG: Full history saved. [2025-10-15T19:58:04.890369] [INFO ] [MAIN ] Update Progress: 1266/2369 symbols completed. LNG took 56.2s. Estimated remaining: 2h 35m 5s. Rate: 7.1 symbols/min [2025-10-15T19:58:04.922426] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-02. [2025-10-15T19:58:05.083476] [INFO ] [MAIN ] LOW: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:58:05.142807] [DEBUG] [LOCAL ] LOW: Loaded 52994 existing records from primary storage. [2025-10-15T19:58:05.143154] [INFO ] [MAIN ] LOW: Loaded 52994 existing records. [2025-10-15T19:58:05.320662] [WARN ] [MAIN ] LOW: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:58:05.320863] [INFO ] [MAIN ] LOW: Wiping existing primary data before full refresh. [2025-10-15T19:58:05.320912] [INFO ] [LOCAL ] LOW: Starting deletion of primary data. [2025-10-15T19:58:05.321827] [DEBUG] [LOCAL ] LOW: Deleted primary data file. [2025-10-15T19:58:05.321886] [INFO ] [MAIN ] LOW: Starting full primary refresh. [2025-10-15T19:58:05.683413] [INFO ] [REMOTE ] LOW: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:58:05.713969] [INFO ] [REMOTE ] LOW: Fetching primary data for 2024-12. [2025-10-15T19:58:06.218587] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-15T19:58:06.514014] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-08. [2025-10-15T19:58:06.965662] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-15T19:58:07.313992] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-10. [2025-10-15T19:58:07.390394] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-15T19:58:08.114067] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-03. [2025-10-15T19:58:08.575696] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-15T19:58:08.578961] [INFO ] [REMOTE ] LOB: Full fetch complete (38203 records). [2025-10-15T19:58:08.579060] [DEBUG] [VALIDATOR ] LOB: Validating primary data. [2025-10-15T19:58:08.919089] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-09. [2025-10-15T19:58:08.968695] [DEBUG] [VALIDATOR ] LOB: All expected trading days are present. [2025-10-15T19:58:08.968823] [DEBUG] [VALIDATOR ] LOB: Primary data validation passed. [2025-10-15T19:58:08.969695] [INFO ] [MAIN ] LOB: Fetched primary data is valid. [2025-10-15T19:58:08.969826] [DEBUG] [LOCAL ] LOB: Saving primary data. [2025-10-15T19:58:08.970861] [DEBUG] [LOCAL ] LOB: Trimmed 38203 records to 26728 (keeping 200 days of data) [2025-10-15T19:58:09.139480] [DEBUG] [LOCAL ] LOB: Primary data saved (26728 records). [2025-10-15T19:58:09.139687] [INFO ] [MAIN ] LOB: Full history saved. [2025-10-15T19:58:09.139818] [INFO ] [MAIN ] Update Progress: 1267/2369 symbols completed. LOB took 30.5s. Estimated remaining: 2h 34m 53s. Rate: 7.1 symbols/min [2025-10-15T19:58:09.276110] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-15T19:58:09.339627] [INFO ] [MAIN ] LPG: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:58:09.376492] [DEBUG] [LOCAL ] LPG: Loaded 39624 existing records from primary storage. [2025-10-15T19:58:09.376827] [INFO ] [MAIN ] LPG: Loaded 39624 existing records. [2025-10-15T19:58:09.552817] [WARN ] [MAIN ] LPG: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:58:09.556109] [INFO ] [MAIN ] LPG: Wiping existing primary data before full refresh. [2025-10-15T19:58:09.559414] [INFO ] [LOCAL ] LPG: Starting deletion of primary data. [2025-10-15T19:58:09.559724] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-15T19:58:09.561251] [DEBUG] [LOCAL ] LPG: Deleted primary data file. [2025-10-15T19:58:09.562062] [INFO ] [MAIN ] LPG: Starting full primary refresh. [2025-10-15T19:58:09.719133] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-04. [2025-10-15T19:58:09.948567] [INFO ] [REMOTE ] LPG: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:58:10.514037] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-10. [2025-10-15T19:58:10.967954] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-15T19:58:11.042689] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-15T19:58:11.043739] [INFO ] [REMOTE ] LOCL: Full fetch complete (4553 records). [2025-10-15T19:58:11.043809] [DEBUG] [VALIDATOR ] LOCL: Validating primary data. [2025-10-15T19:58:11.319064] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-05. [2025-10-15T19:58:11.407349] [DEBUG] [VALIDATOR ] LOCL: All expected trading days are present. [2025-10-15T19:58:11.407421] [DEBUG] [VALIDATOR ] LOCL: Primary data validation passed. [2025-10-15T19:58:11.407561] [INFO ] [MAIN ] LOCL: Fetched primary data is valid. [2025-10-15T19:58:11.407597] [DEBUG] [LOCAL ] LOCL: Saving primary data. [2025-10-15T19:58:11.407986] [DEBUG] [LOCAL ] LOCL: Trimmed 4553 records to 3781 (keeping 200 days of data) [2025-10-15T19:58:11.428527] [DEBUG] [LOCAL ] LOCL: Primary data saved (3781 records). [2025-10-15T19:58:11.428598] [INFO ] [MAIN ] LOCL: Full history saved. [2025-10-15T19:58:11.428693] [INFO ] [MAIN ] Update Progress: 1268/2369 symbols completed. LOCL took 23.6s. Estimated remaining: 2h 34m 39s. Rate: 7.1 symbols/min [2025-10-15T19:58:11.594825] [INFO ] [MAIN ] LPL: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:58:11.624722] [DEBUG] [LOCAL ] LPL: Loaded 28131 existing records from primary storage. [2025-10-15T19:58:11.625015] [INFO ] [MAIN ] LPL: Loaded 28131 existing records. [2025-10-15T19:58:11.824029] [WARN ] [MAIN ] LPL: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:58:11.824443] [INFO ] [MAIN ] LPL: Wiping existing primary data before full refresh. [2025-10-15T19:58:11.824498] [INFO ] [LOCAL ] LPL: Starting deletion of primary data. [2025-10-15T19:58:11.824903] [DEBUG] [LOCAL ] LPL: Deleted primary data file. [2025-10-15T19:58:11.824960] [INFO ] [MAIN ] LPL: Starting full primary refresh. [2025-10-15T19:58:12.119165] [INFO ] [REMOTE ] LPG: Fetching primary data for 2024-12. [2025-10-15T19:58:12.169632] [INFO ] [REMOTE ] LPL: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:58:12.358351] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-15T19:58:12.914017] [INFO ] [REMOTE ] LPL: Fetching primary data for 2024-12. [2025-10-15T19:58:13.713979] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-01. [2025-10-15T19:58:13.827303] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-15T19:58:14.034877] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-15T19:58:14.514062] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-01. [2025-10-15T19:58:15.313982] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-01. [2025-10-15T19:58:15.420695] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-15T19:58:15.582094] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-15T19:58:16.114027] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-06. [2025-10-15T19:58:16.919105] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-02. [2025-10-15T19:58:16.934394] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-15T19:58:16.997073] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-15T19:58:17.714007] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-07. [2025-10-15T19:58:17.925554] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-15T19:58:18.514020] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-02. [2025-10-15T19:58:18.848342] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-15T19:58:19.314068] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-02. [2025-10-15T19:58:20.114006] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-03. [2025-10-15T19:58:20.358298] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-15T19:58:20.826753] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-15T19:58:20.903437] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-15T19:58:20.913952] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-04. [2025-10-15T19:58:21.656437] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-15T19:58:21.713991] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-05. [2025-10-15T19:58:22.513957] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-08. [2025-10-15T19:58:22.823960] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-15T19:58:23.313976] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-03. [2025-10-15T19:58:23.589178] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-15T19:58:24.114013] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-06. [2025-10-15T19:58:24.920807] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-09. [2025-10-15T19:58:24.923200] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-15T19:58:25.173559] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-15T19:58:25.713990] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-07. [2025-10-15T19:58:26.155376] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-15T19:58:26.513964] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-04. [2025-10-15T19:58:26.851898] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-15T19:58:27.314078] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-03. [2025-10-15T19:58:28.049538] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-15T19:58:28.113965] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-10. [2025-10-15T19:58:28.913971] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-08. [2025-10-15T19:58:29.277567] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-15T19:58:29.613282] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-15T19:58:29.621122] [INFO ] [REMOTE ] LOMA: Full fetch complete (47991 records). [2025-10-15T19:58:29.621372] [DEBUG] [VALIDATOR ] LOMA: Validating primary data. [2025-10-15T19:58:29.719307] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-05. [2025-10-15T19:58:30.159398] [DEBUG] [VALIDATOR ] LOMA: All expected trading days are present. [2025-10-15T19:58:30.159542] [DEBUG] [VALIDATOR ] LOMA: Primary data validation passed. [2025-10-15T19:58:30.160500] [INFO ] [MAIN ] LOMA: Fetched primary data is valid. [2025-10-15T19:58:30.160955] [DEBUG] [LOCAL ] LOMA: Saving primary data. [2025-10-15T19:58:30.189510] [DEBUG] [LOCAL ] LOMA: Trimmed 47991 records to 32694 (keeping 200 days of data) [2025-10-15T19:58:30.190843] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-15T19:58:30.385830] [DEBUG] [LOCAL ] LOMA: Primary data saved (32694 records). [2025-10-15T19:58:30.385978] [INFO ] [MAIN ] LOMA: Full history saved. [2025-10-15T19:58:30.386074] [INFO ] [MAIN ] Update Progress: 1269/2369 symbols completed. LOMA took 34.6s. Estimated remaining: 2h 34m 40s. Rate: 7.1 symbols/min [2025-10-15T19:58:30.522778] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-09. [2025-10-15T19:58:30.554767] [INFO ] [MAIN ] LPX: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:58:30.590463] [DEBUG] [LOCAL ] LPX: Loaded 40227 existing records from primary storage. [2025-10-15T19:58:30.590765] [INFO ] [MAIN ] LPX: Loaded 40227 existing records. [2025-10-15T19:58:30.766840] [WARN ] [MAIN ] LPX: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:58:30.767065] [INFO ] [MAIN ] LPX: Wiping existing primary data before full refresh. [2025-10-15T19:58:30.767113] [INFO ] [LOCAL ] LPX: Starting deletion of primary data. [2025-10-15T19:58:30.768135] [DEBUG] [LOCAL ] LPX: Deleted primary data file. [2025-10-15T19:58:30.768195] [INFO ] [MAIN ] LPX: Starting full primary refresh. [2025-10-15T19:58:31.122748] [INFO ] [REMOTE ] LPX: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:58:31.292012] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-15T19:58:31.314017] [INFO ] [REMOTE ] LPX: Fetching primary data for 2024-12. [2025-10-15T19:58:31.580079] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-15T19:58:32.114022] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-06. [2025-10-15T19:58:32.737246] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-15T19:58:32.914029] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-01. [2025-10-15T19:58:33.612043] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-15T19:58:33.713993] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-07. [2025-10-15T19:58:34.213108] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-15T19:58:34.514043] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-10. [2025-10-15T19:58:34.836121] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-15T19:58:35.314115] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-02. [2025-10-15T19:58:36.047786] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-15T19:58:36.055446] [INFO ] [REMOTE ] LPL: Full fetch complete (36846 records). [2025-10-15T19:58:36.055710] [DEBUG] [VALIDATOR ] LPL: Validating primary data. [2025-10-15T19:58:36.125748] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-04. [2025-10-15T19:58:36.469577] [DEBUG] [VALIDATOR ] LPL: All expected trading days are present. [2025-10-15T19:58:36.469867] [DEBUG] [VALIDATOR ] LPL: Primary data validation passed. [2025-10-15T19:58:36.470761] [INFO ] [MAIN ] LPL: Fetched primary data is valid. [2025-10-15T19:58:36.470854] [DEBUG] [LOCAL ] LPL: Saving primary data. [2025-10-15T19:58:36.471835] [DEBUG] [LOCAL ] LPL: Trimmed 36846 records to 28287 (keeping 200 days of data) [2025-10-15T19:58:36.656769] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-15T19:58:36.679085] [DEBUG] [LOCAL ] LPL: Primary data saved (28287 records). [2025-10-15T19:58:36.679208] [INFO ] [MAIN ] LPL: Full history saved. [2025-10-15T19:58:36.679351] [INFO ] [MAIN ] Update Progress: 1270/2369 symbols completed. LPL took 25.3s. Estimated remaining: 2h 34m 30s. Rate: 7.1 symbols/min [2025-10-15T19:58:36.855790] [INFO ] [MAIN ] LRN: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:58:36.898975] [DEBUG] [LOCAL ] LRN: Loaded 39539 existing records from primary storage. [2025-10-15T19:58:36.899303] [INFO ] [MAIN ] LRN: Loaded 39539 existing records. [2025-10-15T19:58:36.921580] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-03. [2025-10-15T19:58:37.083126] [WARN ] [MAIN ] LRN: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:58:37.083323] [INFO ] [MAIN ] LRN: Wiping existing primary data before full refresh. [2025-10-15T19:58:37.083379] [INFO ] [LOCAL ] LRN: Starting deletion of primary data. [2025-10-15T19:58:37.084082] [DEBUG] [LOCAL ] LRN: Deleted primary data file. [2025-10-15T19:58:37.084138] [INFO ] [MAIN ] LRN: Starting full primary refresh. [2025-10-15T19:58:37.431680] [INFO ] [REMOTE ] LRN: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:58:37.714010] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-08. [2025-10-15T19:58:37.928520] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-15T19:58:38.289045] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-15T19:58:38.513968] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-05. [2025-10-15T19:58:39.290526] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-15T19:58:39.314033] [INFO ] [REMOTE ] LRN: Fetching primary data for 2024-12. [2025-10-15T19:58:40.114042] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-04. [2025-10-15T19:58:40.281201] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-15T19:58:40.698211] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-15T19:58:40.914032] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-01. [2025-10-15T19:58:41.599291] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-15T19:58:41.714002] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-06. [2025-10-15T19:58:42.497429] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-15T19:58:42.513962] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-02. [2025-10-15T19:58:43.313985] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-09. [2025-10-15T19:58:43.476077] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-15T19:58:43.643908] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-15T19:58:44.114010] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-03. [2025-10-15T19:58:44.281344] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-15T19:58:44.914066] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-10. [2025-10-15T19:58:45.713984] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-07. [2025-10-15T19:58:45.761756] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-15T19:58:46.385087] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-15T19:58:46.389621] [INFO ] [REMOTE ] LPG: Full fetch complete (59202 records). [2025-10-15T19:58:46.389781] [DEBUG] [VALIDATOR ] LPG: Validating primary data. [2025-10-15T19:58:46.519215] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-05. [2025-10-15T19:58:46.778211] [DEBUG] [VALIDATOR ] LPG: All expected trading days are present. [2025-10-15T19:58:46.778286] [DEBUG] [VALIDATOR ] LPG: Primary data validation passed. [2025-10-15T19:58:46.779201] [INFO ] [MAIN ] LPG: Fetched primary data is valid. [2025-10-15T19:58:46.779262] [DEBUG] [LOCAL ] LPG: Saving primary data. [2025-10-15T19:58:46.780349] [DEBUG] [LOCAL ] LPG: Trimmed 59202 records to 39643 (keeping 200 days of data) [2025-10-15T19:58:47.015417] [DEBUG] [LOCAL ] LPG: Primary data saved (39643 records). [2025-10-15T19:58:47.015554] [INFO ] [MAIN ] LPG: Full history saved. [2025-10-15T19:58:47.015984] [INFO ] [MAIN ] Update Progress: 1271/2369 symbols completed. LPG took 37.9s. Estimated remaining: 2h 34m 23s. Rate: 7.1 symbols/min [2025-10-15T19:58:47.185840] [INFO ] [MAIN ] LSPD: Starting incremental primary update from 2025-10-07 to 2025-10-15. [2025-10-15T19:58:47.226411] [DEBUG] [LOCAL ] LSPD: Loaded 42628 existing records from primary storage. [2025-10-15T19:58:47.226718] [INFO ] [MAIN ] LSPD: Loaded 42628 existing records. [2025-10-15T19:58:47.320546] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-04. [2025-10-15T19:58:47.412092] [WARN ] [MAIN ] LSPD: Insufficient historical data. Have data from 2025-03-28, but need from 2024-12-27 for 200 day retention. Performing full refresh. [2025-10-15T19:58:47.412358] [INFO ] [MAIN ] LSPD: Wiping existing primary data before full refresh. [2025-10-15T19:58:47.412407] [INFO ] [LOCAL ] LSPD: Starting deletion of primary data. [2025-10-15T19:58:47.412987] [DEBUG] [LOCAL ] LSPD: Deleted primary data file. [2025-10-15T19:58:47.413044] [INFO ] [MAIN ] LSPD: Starting full primary refresh. [2025-10-15T19:58:47.780089] [INFO ] [REMOTE ] LSPD: Fetching primary data covering 200 trading days from 2024-12-27 to 2025-10-15 (requires 11 months of data pull). [2025-10-15T19:58:47.814992] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-10-15T19:58:47.865794] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-15T19:58:48.114001] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2024-12. [2025-10-15T19:58:48.913976] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-08. [2025-10-15T19:58:48.971235] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-15T19:58:49.289033] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-15T19:58:49.714029] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-05. [2025-10-15T19:58:50.514000] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-06. [2025-10-15T19:58:50.634379] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-15T19:58:51.305889] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-15T19:58:51.314559] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-09. [2025-10-15T19:58:52.042237] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-06 (1.53 second